2023-10-06T10:59:44.655 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T10:59:44.655 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/orig.config.yaml 2023-10-06T10:59:44.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T10:59:44.783 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} email: yweinste@redhat.com first_in_suite: false job_id: '7412387' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - client session with non-allowable root sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfA70rXdcP7VtZS4hWwOWKeSR3CWfg6XNN7t2mMWNTM6Al0tFQNb8UEn6A1a/Hgg3aoUoXiT6wdgqdUIOJzh+I= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd/W4zYwgaIpJR2tJL8Rjp1wbqFJOksMBCcJJPNtAaqHKAf7+VnrnlSq9Jc/Ap2UAqWfFpLspkzcb+LpQzfxd0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T10:59:44.784 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T10:59:44.784 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T10:59:44.784 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T10:59:44.786 INFO:teuthology.task.internal:Checking packages... 2023-10-06T10:59:44.809 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T10:59:44.809 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T10:59:44.809 INFO:teuthology.packaging:ref: None 2023-10-06T10:59:44.809 INFO:teuthology.packaging:tag: None 2023-10-06T10:59:44.810 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T10:59:44.810 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:59:44.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T10:59:45.034 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T10:59:45.034 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T10:59:45.040 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T10:59:45.040 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T10:59:45.085 INFO:teuthology.task.internal:Saving configuration 2023-10-06T10:59:45.101 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T10:59:45.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T10:59:45.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:54:44.100216', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfA70rXdcP7VtZS4hWwOWKeSR3CWfg6XNN7t2mMWNTM6Al0tFQNb8UEn6A1a/Hgg3aoUoXiT6wdgqdUIOJzh+I='} 2023-10-06T10:59:45.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:54:44.102079', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd/W4zYwgaIpJR2tJL8Rjp1wbqFJOksMBCcJJPNtAaqHKAf7+VnrnlSq9Jc/Ap2UAqWfFpLspkzcb+LpQzfxd0='} 2023-10-06T10:59:45.167 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T10:59:45.173 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T10:59:45.173 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T10:59:45.173 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T10:59:45.265 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f76114bab80>, signals=[15]) 2023-10-06T10:59:45.265 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T10:59:45.272 INFO:teuthology.task.internal:Opening connections... 2023-10-06T10:59:45.272 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T10:59:45.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:59:45.344 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T10:59:45.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:59:45.412 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T10:59:45.418 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-10-06T10:59:45.436 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-10-06T10:59:45.436 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-10-06T10:59:45.493 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.4" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T10:59:45.494 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T10:59:45.495 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T10:59:45.495 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T10:59:45.495 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T10:59:45.495 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T10:59:45.495 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T10:59:45.495 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T10:59:45.495 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-10-06T10:59:45.517 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-10-06T10:59:45.534 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-10-06T10:59:45.534 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-10-06T10:59:45.590 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T10:59:45.590 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T10:59:45.590 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-10-06T10:59:45.590 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-10-06T10:59:45.590 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.4" 2023-10-06T10:59:45.590 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T10:59:45.591 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T10:59:45.592 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-10-06T10:59:45.615 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T10:59:45.625 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T10:59:45.653 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T10:59:45.653 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2023-10-06T10:59:45.655 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-10-06T10:59:45.670 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T10:59:45.686 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T10:59:45.686 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2023-10-06T10:59:45.712 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-10-06T10:59:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T10:59:45.728 INFO:teuthology.orchestra.run.smithi142.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T10:59:45.728 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T10:59:45.787 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T10:59:45.801 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T10:59:45.802 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T10:59:45.802 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T10:59:45.802 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T10:59:45.802 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T10:59:45.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:59:45.817 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-10-06T10:59:45.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:59:45.819 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-10-06T10:59:45.872 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:59:45.872 INFO:teuthology.task.kernel:Running kernel on smithi142: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:59:45.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2023-10-06T10:59:45.875 INFO:teuthology.orchestra.run.smithi055.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:59:45.876 INFO:teuthology.task.kernel:Running kernel on smithi055: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:59:45.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2023-10-06T10:59:47.232 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-10-06T10:59:47.233 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2023-10-06T10:59:47.349 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2023-10-06T10:59:47.350 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2023-10-06T10:59:48.580 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-06T10:59:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-06T10:59:49.078 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 34 MB/s | 16 MB 00:00 2023-10-06T10:59:49.829 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T10:59:52.374 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T10:59:53.093 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T10:59:53.093 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T10:59:53.093 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T10:59:53.261 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-10-06T10:59:53.262 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2023-10-06T10:59:53.263 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-10-06T10:59:53.350 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T10:59:53.368 DEBUG:teuthology.orchestra.run.smithi142:> echo no | sudo yum reinstall kernel || true 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-10-06T10:59:53.752 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2023-10-06T10:59:54.047 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 10:59:52 AM UTC. 2023-10-06T10:59:54.103 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T10:59:54.103 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T10:59:54.103 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T10:59:54.166 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:59:54.166 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:54.166 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:54.197 INFO:teuthology.orchestra.run.smithi142.stderr:Error: No packages marked for reinstall. 2023-10-06T10:59:54.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum reinstall -y kernel || true 2023-10-06T10:59:54.252 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2023-10-06T10:59:54.253 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2023-10-06T10:59:54.254 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2023-10-06T10:59:54.351 DEBUG:teuthology.orchestra.run.smithi055:> echo no | sudo yum reinstall kernel || true 2023-10-06T10:59:54.588 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-10-06T10:59:54.589 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2023-10-06T10:59:54.715 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2023-10-06T10:59:54.715 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2023-10-06T10:59:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 10:59:52 AM UTC. 2023-10-06T10:59:55.025 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:59:55.025 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:55.025 INFO:teuthology.orchestra.run.smithi142.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:55.033 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 10:59:53 AM UTC. 2023-10-06T10:59:55.039 INFO:teuthology.orchestra.run.smithi142.stderr:Error: No packages marked for reinstall. 2023-10-06T10:59:55.095 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:59:55.169 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:59:55.169 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:55.169 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:55.192 INFO:teuthology.orchestra.run.smithi055.stderr:Error: No packages marked for reinstall. 2023-10-06T10:59:55.219 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:55.220 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:55.220 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:55.220 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T10:59:55.220 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T10:59:55.220 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T10:59:55.220 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T10:59:55.220 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:59:55.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum reinstall -y kernel || true 2023-10-06T10:59:55.347 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:55.347 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:55.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2023-10-06T10:59:55.374 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2023-10-06T10:59:55.374 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2023-10-06T10:59:55.374 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.02 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 99.el8_4.1 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Group : System Environment/Base 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 9264631 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Relocations : (not relocatable) 2023-10-06T10:59:55.375 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : Red Hat, Inc. 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : Red Hat, Inc. 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T10:59:55.376 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T10:59:55.377 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T10:59:55.377 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:55.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T10:59:55.609 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2023-10-06T10:59:55.609 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2023-10-06T10:59:55.912 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 10:59:53 AM UTC. 2023-10-06T10:59:56.052 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:59:56.052 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:56.052 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:59:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:Error: No packages marked for reinstall. 2023-10-06T10:59:56.113 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:59:56.245 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:56.246 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:56.247 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:56.247 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T10:59:56.247 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T10:59:56.247 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T10:59:56.247 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi055.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T10:59:56.247 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:59:56.387 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:56.387 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:56.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -qi grub2-tools 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Name : grub2-tools 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Epoch : 1 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Version : 2.02 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Release : 99.el8_4.1 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: x86_64 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Group : System Environment/Base 2023-10-06T10:59:56.418 INFO:teuthology.orchestra.run.smithi055.stdout:Size : 9264631 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:License : GPLv3+ 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Relocations : (not relocatable) 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Packager : Red Hat, Inc. 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Vendor : Red Hat, Inc. 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Summary : Support tools for GRUB. 2023-10-06T10:59:56.419 INFO:teuthology.orchestra.run.smithi055.stdout:Description : 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout:hardware devices. 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T10:59:56.420 INFO:teuthology.orchestra.run.smithi055.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T10:59:56.421 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T10:59:56.421 INFO:teuthology.task.kernel:Updating grub on smithi055 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:56.421 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T10:59:56.431 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-10-06T10:59:57.675 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2023-10-06T10:59:58.266 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-10-06T10:59:58.267 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-10-06T10:59:58.288 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.gHH0l1GXN7 2023-10-06T10:59:58.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gHH0l1GXN7 2023-10-06T10:59:58.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.gHH0l1GXN7 2023-10-06T10:59:58.513 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.gHH0l1GXN7 is 6KB 2023-10-06T10:59:58.561 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.gHH0l1GXN7 2023-10-06T10:59:58.574 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T10:59:58.646 INFO:teuthology.orchestra.run.smithi142.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T10:59:58.646 INFO:teuthology.orchestra.run.smithi142.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T10:59:58.646 INFO:teuthology.orchestra.run.smithi142.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T10:59:58.646 INFO:teuthology.orchestra.run.smithi142.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T10:59:58.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:59:58.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2023-10-06T10:59:59.732 INFO:teuthology.orchestra.run.smithi055.stderr:done 2023-10-06T10:59:59.734 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-10-06T10:59:59.755 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.Ijsoqb43aB 2023-10-06T10:59:59.755 DEBUG:teuthology.orchestra.run.smithi055:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ijsoqb43aB 2023-10-06T10:59:59.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.Ijsoqb43aB 2023-10-06T10:59:59.979 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.Ijsoqb43aB is 6KB 2023-10-06T11:00:00.027 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.Ijsoqb43aB 2023-10-06T11:00:00.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T11:00:00.110 INFO:teuthology.orchestra.run.smithi055.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T11:00:00.110 INFO:teuthology.orchestra.run.smithi055.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T11:00:00.110 INFO:teuthology.orchestra.run.smithi055.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T11:00:00.110 INFO:teuthology.orchestra.run.smithi055.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T11:00:00.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T11:00:00.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo shutdown -r now 2023-10-06T11:00:28.834 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T11:00:28.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-06T11:00:28.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:00:30.261 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T11:00:30.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:00:30.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:00:47.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-10-06T11:00:48.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-10-06T11:00:56.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-06T11:00:56.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:00:57.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:00:57.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:00:59.418 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-10-06T11:01:11.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-06T11:01:11.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:01:16.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-10-06T11:01:28.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:01:28.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:01:31.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-10-06T11:01:43.535 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-10-06T11:01:44.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-06T11:01:44.187 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T11:01:44.188 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-10-06T11:01:44.504 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T11:01:44.505 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T11:01:44.505 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T11:01:44.505 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T11:01:45.506 DEBUG:teuthology.parallel:result is None 2023-10-06T11:01:46.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:01:46.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:01:46.339 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-10-06T11:01:46.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:01:46.567 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T11:01:46.567 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-10-06T11:01:46.623 INFO:teuthology.orchestra.run.smithi055.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T11:01:46.623 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T11:01:46.623 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T11:01:46.623 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T11:01:47.624 DEBUG:teuthology.parallel:result is None 2023-10-06T11:01:47.625 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T11:01:47.632 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T11:01:47.633 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T11:01:47.635 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T11:01:47.651 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T11:01:47.669 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T11:01:47.720 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T11:01:47.720 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T11:01:47.722 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T11:01:47.751 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T11:01:47.770 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T11:01:47.770 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T11:01:47.786 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T11:01:47.877 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T11:01:47.878 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T11:01:47.893 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T11:01:47.894 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T11:01:47.895 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T11:01:47.902 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T11:01:47.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T11:01:47.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T11:01:47.931 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T11:01:47.940 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T11:01:47.940 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T11:01:47.973 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T11:01:47.988 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T11:01:48.070 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T11:01:48.138 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T11:01:48.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T11:01:48.223 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:01:48.223 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T11:01:48.289 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T11:01:48.329 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T11:01:48.402 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T11:01:48.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T11:01:48.483 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:01:48.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T11:01:48.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2023-10-06T11:01:48.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-10-06T11:01:48.598 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:01:48.643 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:01:49.025 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T11:01:49.033 INFO:teuthology.task.internal:Starting timer... 2023-10-06T11:01:49.033 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T11:01:49.056 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T11:01:49.106 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T11:01:49.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2023-10-06T11:01:49.187 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: [ OK ] 2023-10-06T11:01:49.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2023-10-06T11:01:49.244 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: [ OK ] 2023-10-06T11:01:49.246 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T11:01:49.246 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2023-10-06T11:01:49.270 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2023-10-06T11:01:49.270 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2023-10-06T11:01:49.301 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2023-10-06T11:01:49.301 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2023-10-06T11:01:49.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:01:49.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:01:49.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:01:49.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:01:49.366 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T11:01:49.366 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2023-10-06T11:01:49.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2023-10-06T11:01:49.431 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T11:01:49.440 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T11:01:49.445 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T11:01:49.588 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T11:01:49.604 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T11:01:49.605 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T11:10:00.105 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2023-10-06T11:10:00.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:10:00.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:10:00.180 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-10-06T11:10:00.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-10-06T11:10:00.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-06T11:10:00.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:10:00.317 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-10-06T11:10:00.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-10-06T11:10:00.382 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T11:10:00.394 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T11:10:00.394 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T11:10:00.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:10:00.397 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T11:10:00.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:10:00.424 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T11:10:00.439 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T11:10:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T11:10:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T11:10:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2023-10-06T11:10:00.488 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2023-10-06T11:10:00.498 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2023-10-06T11:10:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T11:10:00.509 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2023-10-06T11:10:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T11:10:00.522 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T11:10:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T11:10:00.584 INFO:teuthology.orchestra.run.smithi055.stderr:bash: ntpq: command not found 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:210 Number of sources = 4 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.588 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.600 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:210 Number of sources = 4 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:10:00.604 INFO:teuthology.run_tasks:Running task install... 2023-10-06T11:10:00.612 DEBUG:teuthology.task.install:project ceph 2023-10-06T11:10:00.612 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T11:10:00.612 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T11:10:00.612 INFO:teuthology.task.install:Using flavor: default 2023-10-06T11:10:00.618 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T11:10:00.618 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T11:10:00.619 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T11:10:00.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:10:00.621 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T11:10:00.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:10:00.767 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T11:10:00.768 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T11:10:00.784 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T11:10:00.784 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T11:10:00.896 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T11:10:00.896 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:10:00.896 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T11:10:00.922 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T11:10:00.922 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T11:10:00.933 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T11:10:00.934 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:10:00.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T11:10:00.961 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T11:10:00.962 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T11:10:00.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T11:10:01.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T11:10:01.061 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T11:10:01.105 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T11:10:01.125 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2023-10-06T11:10:01.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2023-10-06T11:10:01.170 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2023-10-06T11:10:01.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2023-10-06T11:10:01.516 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-10-06T11:10:01.582 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2023-10-06T11:10:01.794 INFO:teuthology.orchestra.run.smithi142.stdout:44 files removed 2023-10-06T11:10:01.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi055.stdout:44 files removed 2023-10-06T11:10:01.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T11:10:02.193 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-10-06T11:10:02.291 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2023-10-06T11:10:02.961 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 226 kB/s | 78 kB 00:00 2023-10-06T11:10:03.032 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 281 kB/s | 78 kB 00:00 2023-10-06T11:10:03.244 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-06T11:10:03.316 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-06T11:10:03.520 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T11:10:03.597 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 5.8 kB/s | 1.4 kB 00:00 2023-10-06T11:10:03.630 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T11:10:03.708 INFO:teuthology.orchestra.run.smithi055.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T11:10:04.346 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-06T11:10:05.799 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2023-10-06T11:10:07.729 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T11:10:08.093 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 117 MB/s | 33 MB 00:00 2023-10-06T11:10:09.301 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-06T11:10:09.725 INFO:teuthology.orchestra.run.smithi055.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 114 MB/s | 38 MB 00:00 2023-10-06T11:10:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 120 MB/s | 38 MB 00:00 2023-10-06T11:10:15.576 INFO:teuthology.orchestra.run.smithi055.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 MB/s | 33 MB 00:00 2023-10-06T11:10:22.036 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:10:22.036 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:10:22.047 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T11:10:22.047 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T11:10:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T11:10:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T11:10:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T11:10:22.053 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T11:10:22.054 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T11:10:22.548 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-10-06T11:10:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================================================== 2023-10-06T11:10:22.559 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-10-06T11:10:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================================================== 2023-10-06T11:10:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T11:10:22.560 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T11:10:22.561 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T11:10:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T11:10:22.563 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T11:10:22.564 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T11:10:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T11:10:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T11:10:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T11:10:22.568 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T11:10:22.569 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================================================== 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:Install 118 Packages 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2023-10-06T11:10:22.570 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:10:22.571 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 201 M 2023-10-06T11:10:22.571 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-10-06T11:10:22.754 INFO:teuthology.orchestra.run.smithi142.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-10-06T11:10:23.030 INFO:teuthology.orchestra.run.smithi142.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 3.1 MB/s | 877 kB 00:00 2023-10-06T11:10:23.107 INFO:teuthology.orchestra.run.smithi142.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 2.0 MB/s | 162 kB 00:00 2023-10-06T11:10:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:(4/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 5.9 MB/s | 2.3 MB 00:00 2023-10-06T11:10:23.550 INFO:teuthology.orchestra.run.smithi142.stdout:(5/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 5.5 MB/s | 5.2 MB 00:00 2023-10-06T11:10:23.762 INFO:teuthology.orchestra.run.smithi142.stdout:(6/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 5.9 MB/s | 1.6 MB 00:00 2023-10-06T11:10:24.013 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:10:24.014 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:10:24.025 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T11:10:24.026 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T11:10:24.027 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T11:10:24.028 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T11:10:24.030 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T11:10:24.032 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T11:10:24.033 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T11:10:24.133 INFO:teuthology.orchestra.run.smithi142.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 6.8 MB/s | 3.9 MB 00:00 2023-10-06T11:10:24.405 INFO:teuthology.orchestra.run.smithi142.stdout:(8/120): ceph-common-17.2.6-1274.g68e53a4a.el8. 13 MB/s | 23 MB 00:01 2023-10-06T11:10:24.455 INFO:teuthology.orchestra.run.smithi142.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 490 kB/s | 24 kB 00:00 2023-10-06T11:10:24.542 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2023-10-06T11:10:24.554 INFO:teuthology.orchestra.run.smithi055.stdout:====================================================================================================================== 2023-10-06T11:10:24.554 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2023-10-06T11:10:24.554 INFO:teuthology.orchestra.run.smithi055.stdout:====================================================================================================================== 2023-10-06T11:10:24.554 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2023-10-06T11:10:24.554 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:10:24.555 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T11:10:24.556 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T11:10:24.557 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T11:10:24.558 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T11:10:24.560 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:10:24.560 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T11:10:24.560 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T11:10:24.561 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T11:10:24.562 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T11:10:24.563 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T11:10:24.564 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T11:10:24.565 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T11:10:24.566 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T11:10:24.567 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T11:10:24.568 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:10:24.568 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2023-10-06T11:10:24.568 INFO:teuthology.orchestra.run.smithi055.stdout:====================================================================================================================== 2023-10-06T11:10:24.568 INFO:teuthology.orchestra.run.smithi055.stdout:Install 118 Packages 2023-10-06T11:10:24.568 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 2 Packages 2023-10-06T11:10:24.568 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:10:24.569 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 201 M 2023-10-06T11:10:24.569 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2023-10-06T11:10:24.982 INFO:teuthology.orchestra.run.smithi055.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-06T11:10:25.385 INFO:teuthology.orchestra.run.smithi142.stdout:(10/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 10 MB/s | 17 MB 00:01 2023-10-06T11:10:25.444 INFO:teuthology.orchestra.run.smithi142.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 4.2 MB/s | 255 kB 00:00 2023-10-06T11:10:25.500 INFO:teuthology.orchestra.run.smithi142.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 442 kB/s | 25 kB 00:00 2023-10-06T11:10:25.615 INFO:teuthology.orchestra.run.smithi142.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 6.8 MB/s | 797 kB 00:00 2023-10-06T11:10:25.671 INFO:teuthology.orchestra.run.smithi142.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 3.0 MB/s | 175 kB 00:00 2023-10-06T11:10:25.726 INFO:teuthology.orchestra.run.smithi142.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 2.3 MB/s | 130 kB 00:00 2023-10-06T11:10:25.795 INFO:teuthology.orchestra.run.smithi142.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 7.2 MB/s | 506 kB 00:00 2023-10-06T11:10:26.388 INFO:teuthology.orchestra.run.smithi055.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 624 kB/s | 877 kB 00:01 2023-10-06T11:10:26.421 INFO:teuthology.orchestra.run.smithi142.stdout:(17/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 8.9 MB/s | 5.6 MB 00:00 2023-10-06T11:10:26.485 INFO:teuthology.orchestra.run.smithi142.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 700 kB/s | 45 kB 00:00 2023-10-06T11:10:26.544 INFO:teuthology.orchestra.run.smithi142.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 1.9 MB/s | 115 kB 00:00 2023-10-06T11:10:26.588 INFO:teuthology.orchestra.run.smithi055.stdout:(3/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 2.6 MB/s | 5.2 MB 00:01 2023-10-06T11:10:26.603 INFO:teuthology.orchestra.run.smithi142.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 3.1 MB/s | 190 kB 00:00 2023-10-06T11:10:26.635 INFO:teuthology.orchestra.run.smithi055.stdout:(4/120): ceph-immutable-object-cache-17.2.6-127 657 kB/s | 162 kB 00:00 2023-10-06T11:10:26.731 INFO:teuthology.orchestra.run.smithi142.stdout:(21/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 6.5 MB/s | 17 MB 00:02 2023-10-06T11:10:26.734 INFO:teuthology.orchestra.run.smithi142.stdout:(22/120): python3-rados-17.2.6-1274.g68e53a4a.e 2.8 MB/s | 371 kB 00:00 2023-10-06T11:10:26.796 INFO:teuthology.orchestra.run.smithi142.stdout:(23/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 5.4 MB/s | 358 kB 00:00 2023-10-06T11:10:26.803 INFO:teuthology.orchestra.run.smithi142.stdout:(24/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.5 MB/s | 107 kB 00:00 2023-10-06T11:10:26.835 INFO:teuthology.orchestra.run.smithi055.stdout:(5/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 9.3 MB/s | 2.3 MB 00:00 2023-10-06T11:10:26.850 INFO:teuthology.orchestra.run.smithi142.stdout:(25/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.6 MB/s | 91 kB 00:00 2023-10-06T11:10:26.932 INFO:teuthology.orchestra.run.smithi142.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 2.1 MB/s | 173 kB 00:00 2023-10-06T11:10:27.011 INFO:teuthology.orchestra.run.smithi142.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 295 kB/s | 23 kB 00:00 2023-10-06T11:10:27.104 INFO:teuthology.orchestra.run.smithi142.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.3 MB/s | 121 kB 00:00 2023-10-06T11:10:27.253 INFO:teuthology.orchestra.run.smithi142.stdout:(29/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 7.7 MB/s | 3.5 MB 00:00 2023-10-06T11:10:27.370 INFO:teuthology.orchestra.run.smithi055.stdout:(6/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 7.4 MB/s | 3.9 MB 00:00 2023-10-06T11:10:27.548 INFO:teuthology.orchestra.run.smithi142.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 3.8 MB/s | 1.7 MB 00:00 2023-10-06T11:10:27.650 INFO:teuthology.orchestra.run.smithi142.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 2.3 MB/s | 238 kB 00:00 2023-10-06T11:10:27.746 INFO:teuthology.orchestra.run.smithi142.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 493 kB/s | 47 kB 00:00 2023-10-06T11:10:27.823 INFO:teuthology.orchestra.run.smithi142.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 188 kB/s | 14 kB 00:00 2023-10-06T11:10:27.907 INFO:teuthology.orchestra.run.smithi142.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 3.1 MB/s | 267 kB 00:00 2023-10-06T11:10:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 1.0 MB/s | 80 kB 00:00 2023-10-06T11:10:28.064 INFO:teuthology.orchestra.run.smithi142.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 230 kB/s | 18 kB 00:00 2023-10-06T11:10:28.137 INFO:teuthology.orchestra.run.smithi142.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 4.2 MB/s | 306 kB 00:00 2023-10-06T11:10:28.146 INFO:teuthology.orchestra.run.smithi142.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 6.6 MB/s | 59 kB 00:00 2023-10-06T11:10:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 8.1 MB/s | 75 kB 00:00 2023-10-06T11:10:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 27 MB/s | 476 kB 00:00 2023-10-06T11:10:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 5.1 MB/s | 44 kB 00:00 2023-10-06T11:10:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:(42/120): ceph-mgr-diskprediction-local-17.2.6- 7.7 MB/s | 7.4 MB 00:00 2023-10-06T11:10:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 6.2 MB/s | 185 kB 00:00 2023-10-06T11:10:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 1.9 MB/s | 16 kB 00:00 2023-10-06T11:10:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 17 MB/s | 173 kB 00:00 2023-10-06T11:10:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:(46/120): python3-cachetools-3.1.1-4.el8.noarch 1.2 MB/s | 33 kB 00:00 2023-10-06T11:10:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 33 MB/s | 384 kB 00:00 2023-10-06T11:10:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2023-10-06T11:10:28.257 INFO:teuthology.orchestra.run.smithi142.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 3.8 MB/s | 81 kB 00:00 2023-10-06T11:10:28.257 INFO:teuthology.orchestra.run.smithi142.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 2.0 MB/s | 18 kB 00:00 2023-10-06T11:10:28.266 INFO:teuthology.orchestra.run.smithi142.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 5.8 MB/s | 49 kB 00:00 2023-10-06T11:10:28.275 INFO:teuthology.orchestra.run.smithi142.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 6.6 MB/s | 59 kB 00:00 2023-10-06T11:10:28.284 INFO:teuthology.orchestra.run.smithi142.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 6.8 MB/s | 60 kB 00:00 2023-10-06T11:10:28.294 INFO:teuthology.orchestra.run.smithi142.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 27 MB/s | 283 kB 00:00 2023-10-06T11:10:28.298 INFO:teuthology.orchestra.run.smithi142.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 29 MB/s | 1.2 MB 00:00 2023-10-06T11:10:28.302 INFO:teuthology.orchestra.run.smithi142.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2023-10-06T11:10:28.306 INFO:teuthology.orchestra.run.smithi142.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 3.9 MB/s | 34 kB 00:00 2023-10-06T11:10:28.312 INFO:teuthology.orchestra.run.smithi142.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 20 MB/s | 196 kB 00:00 2023-10-06T11:10:28.315 INFO:teuthology.orchestra.run.smithi142.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 7.6 MB/s | 64 kB 00:00 2023-10-06T11:10:28.321 INFO:teuthology.orchestra.run.smithi142.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2023-10-06T11:10:28.323 INFO:teuthology.orchestra.run.smithi142.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 2.9 MB/s | 24 kB 00:00 2023-10-06T11:10:28.329 INFO:teuthology.orchestra.run.smithi142.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 3.4 MB/s | 29 kB 00:00 2023-10-06T11:10:28.331 INFO:teuthology.orchestra.run.smithi142.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 3.3 MB/s | 27 kB 00:00 2023-10-06T11:10:28.339 INFO:teuthology.orchestra.run.smithi142.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 25 MB/s | 255 kB 00:00 2023-10-06T11:10:28.341 INFO:teuthology.orchestra.run.smithi142.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 25 MB/s | 251 kB 00:00 2023-10-06T11:10:28.348 INFO:teuthology.orchestra.run.smithi142.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 7.1 MB/s | 61 kB 00:00 2023-10-06T11:10:28.351 INFO:teuthology.orchestra.run.smithi142.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 9.7 MB/s | 85 kB 00:00 2023-10-06T11:10:28.357 INFO:teuthology.orchestra.run.smithi142.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 2.7 MB/s | 23 kB 00:00 2023-10-06T11:10:28.362 INFO:teuthology.orchestra.run.smithi142.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 MB/s | 70 kB 00:00 2023-10-06T11:10:28.371 INFO:teuthology.orchestra.run.smithi142.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 85 MB/s | 1.7 MB 00:00 2023-10-06T11:10:28.422 INFO:teuthology.orchestra.run.smithi142.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 974 kB/s | 44 kB 00:00 2023-10-06T11:10:28.448 INFO:teuthology.orchestra.run.smithi142.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-10-06T11:10:28.474 INFO:teuthology.orchestra.run.smithi142.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 6.0 MB/s | 161 kB 00:00 2023-10-06T11:10:28.503 INFO:teuthology.orchestra.run.smithi142.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2023-10-06T11:10:28.534 INFO:teuthology.orchestra.run.smithi142.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 15 MB/s | 457 kB 00:00 2023-10-06T11:10:28.652 INFO:teuthology.orchestra.run.smithi142.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 50 MB/s | 15 MB 00:00 2023-10-06T11:10:28.676 INFO:teuthology.orchestra.run.smithi142.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 1.6 MB/s | 39 kB 00:00 2023-10-06T11:10:28.695 INFO:teuthology.orchestra.run.smithi055.stdout:(7/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 780 kB/s | 1.6 MB 00:02 2023-10-06T11:10:28.711 INFO:teuthology.orchestra.run.smithi142.stdout:(78/120): python3-babel-2.5.1-5.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-10-06T11:10:28.718 INFO:teuthology.orchestra.run.smithi142.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-10-06T11:10:28.737 INFO:teuthology.orchestra.run.smithi142.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.5 MB/s | 259 kB 00:00 2023-10-06T11:10:28.746 INFO:teuthology.orchestra.run.smithi142.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 7.7 MB/s | 225 kB 00:00 2023-10-06T11:10:28.762 INFO:teuthology.orchestra.run.smithi142.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.9 MB/s | 126 kB 00:00 2023-10-06T11:10:28.790 INFO:teuthology.orchestra.run.smithi142.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 6.8 MB/s | 187 kB 00:00 2023-10-06T11:10:28.814 INFO:teuthology.orchestra.run.smithi142.stdout:(84/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 56 MB/s | 3.7 MB 00:00 2023-10-06T11:10:28.821 INFO:teuthology.orchestra.run.smithi142.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 17 MB/s | 538 kB 00:00 2023-10-06T11:10:28.843 INFO:teuthology.orchestra.run.smithi142.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 10 MB/s | 302 kB 00:00 2023-10-06T11:10:28.848 INFO:teuthology.orchestra.run.smithi142.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.8 MB/s | 157 kB 00:00 2023-10-06T11:10:28.875 INFO:teuthology.orchestra.run.smithi142.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2023-10-06T11:10:28.876 INFO:teuthology.orchestra.run.smithi142.stdout:(89/120): python3-pyasn1-modules-0.3.7-6.el8.no 3.3 MB/s | 110 kB 00:00 2023-10-06T11:10:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 846 kB/s | 20 kB 00:00 2023-10-06T11:10:28.914 INFO:teuthology.orchestra.run.smithi142.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 18 MB/s | 709 kB 00:00 2023-10-06T11:10:28.926 INFO:teuthology.orchestra.run.smithi142.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2023-10-06T11:10:28.954 INFO:teuthology.orchestra.run.smithi055.stdout:(8/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x86 11 MB/s | 17 MB 00:01 2023-10-06T11:10:28.977 INFO:teuthology.orchestra.run.smithi055.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 1.1 MB/s | 24 kB 00:00 2023-10-06T11:10:29.003 INFO:teuthology.orchestra.run.smithi142.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 53 MB/s | 4.7 MB 00:00 2023-10-06T11:10:29.026 INFO:teuthology.orchestra.run.smithi142.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 46 MB/s | 4.6 MB 00:00 2023-10-06T11:10:29.035 INFO:teuthology.orchestra.run.smithi142.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 22 MB/s | 713 kB 00:00 2023-10-06T11:10:29.050 INFO:teuthology.orchestra.run.smithi142.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 790 kB/s | 19 kB 00:00 2023-10-06T11:10:29.061 INFO:teuthology.orchestra.run.smithi142.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2023-10-06T11:10:29.076 INFO:teuthology.orchestra.run.smithi142.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.9 MB/s | 155 kB 00:00 2023-10-06T11:10:29.088 INFO:teuthology.orchestra.run.smithi142.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.9 MB/s | 220 kB 00:00 2023-10-06T11:10:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.3 MB/s | 48 kB 00:00 2023-10-06T11:10:29.121 INFO:teuthology.orchestra.run.smithi142.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.9 MB/s | 229 kB 00:00 2023-10-06T11:10:29.136 INFO:teuthology.orchestra.run.smithi142.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.7 MB/s | 43 kB 00:00 2023-10-06T11:10:29.160 INFO:teuthology.orchestra.run.smithi142.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 754 kB/s | 18 kB 00:00 2023-10-06T11:10:29.172 INFO:teuthology.orchestra.run.smithi142.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 46 MB/s | 2.3 MB 00:00 2023-10-06T11:10:29.199 INFO:teuthology.orchestra.run.smithi142.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 15 MB/s | 605 kB 00:00 2023-10-06T11:10:29.202 INFO:teuthology.orchestra.run.smithi142.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 83 kB 00:00 2023-10-06T11:10:29.224 INFO:teuthology.orchestra.run.smithi142.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 2.4 MB/s | 59 kB 00:00 2023-10-06T11:10:29.227 INFO:teuthology.orchestra.run.smithi142.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 6.7 MB/s | 169 kB 00:00 2023-10-06T11:10:29.249 INFO:teuthology.orchestra.run.smithi142.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.5 MB/s | 38 kB 00:00 2023-10-06T11:10:29.256 INFO:teuthology.orchestra.run.smithi142.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.9 MB/s | 86 kB 00:00 2023-10-06T11:10:29.626 INFO:teuthology.orchestra.run.smithi142.stdout:(111/120): ceph-test-17.2.6-1274.g68e53a4a.el8. 10 MB/s | 52 MB 00:05 2023-10-06T11:10:29.628 INFO:teuthology.orchestra.run.smithi142.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 126 kB/s | 47 kB 00:00 2023-10-06T11:10:29.629 INFO:teuthology.orchestra.run.smithi142.stdout:(113/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 152 kB/s | 58 kB 00:00 2023-10-06T11:10:29.657 INFO:teuthology.orchestra.run.smithi142.stdout:(114/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 2.4 MB/s | 70 kB 00:00 2023-10-06T11:10:29.663 INFO:teuthology.orchestra.run.smithi142.stdout:(115/120): libgfortran-8.4.1-1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2023-10-06T11:10:29.686 INFO:teuthology.orchestra.run.smithi142.stdout:(116/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 9.1 MB/s | 559 kB 00:00 2023-10-06T11:10:29.690 INFO:teuthology.orchestra.run.smithi142.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 3.5 MB/s | 97 kB 00:00 2023-10-06T11:10:29.694 INFO:teuthology.orchestra.run.smithi142.stdout:(118/120): libselinux-devel-2.9-5.el8.x86_64.rp 5.5 MB/s | 200 kB 00:00 2023-10-06T11:10:30.268 INFO:teuthology.orchestra.run.smithi142.stdout:(119/120): librados2-17.2.6-1274.g68e53a4a.el8. 5.9 MB/s | 3.4 MB 00:00 2023-10-06T11:10:30.411 INFO:teuthology.orchestra.run.smithi142.stdout:(120/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 4.9 MB/s | 3.5 MB 00:00 2023-10-06T11:10:30.414 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-10-06T11:10:30.415 INFO:teuthology.orchestra.run.smithi142.stdout:Total 26 MB/s | 201 MB 00:07 2023-10-06T11:10:30.463 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-10-06T11:10:30.575 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-10-06T11:10:30.576 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-10-06T11:10:31.952 INFO:teuthology.orchestra.run.smithi055.stdout:(10/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 17 MB/s | 52 MB 00:02 2023-10-06T11:10:31.996 INFO:teuthology.orchestra.run.smithi055.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 5.7 MB/s | 255 kB 00:00 2023-10-06T11:10:32.018 INFO:teuthology.orchestra.run.smithi055.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 1.1 MB/s | 25 kB 00:00 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi055.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 16 MB/s | 797 kB 00:00 2023-10-06T11:10:32.089 INFO:teuthology.orchestra.run.smithi055.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 7.7 MB/s | 175 kB 00:00 2023-10-06T11:10:32.112 INFO:teuthology.orchestra.run.smithi055.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 5.7 MB/s | 130 kB 00:00 2023-10-06T11:10:32.141 INFO:teuthology.orchestra.run.smithi055.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 17 MB/s | 506 kB 00:00 2023-10-06T11:10:32.343 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-10-06T11:10:32.348 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi055.stdout:(17/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 22 MB/s | 5.6 MB 00:00 2023-10-06T11:10:32.418 INFO:teuthology.orchestra.run.smithi055.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 2.0 MB/s | 45 kB 00:00 2023-10-06T11:10:32.441 INFO:teuthology.orchestra.run.smithi055.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 5.2 MB/s | 115 kB 00:00 2023-10-06T11:10:32.463 INFO:teuthology.orchestra.run.smithi055.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 8.3 MB/s | 190 kB 00:00 2023-10-06T11:10:32.488 INFO:teuthology.orchestra.run.smithi055.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 15 MB/s | 371 kB 00:00 2023-10-06T11:10:32.513 INFO:teuthology.orchestra.run.smithi055.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 14 MB/s | 358 kB 00:00 2023-10-06T11:10:32.535 INFO:teuthology.orchestra.run.smithi055.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 4.7 MB/s | 107 kB 00:00 2023-10-06T11:10:32.557 INFO:teuthology.orchestra.run.smithi055.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 4.0 MB/s | 91 kB 00:00 2023-10-06T11:10:32.717 INFO:teuthology.orchestra.run.smithi055.stdout:(25/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 22 MB/s | 3.5 MB 00:00 2023-10-06T11:10:32.739 INFO:teuthology.orchestra.run.smithi055.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 7.6 MB/s | 173 kB 00:00 2023-10-06T11:10:32.761 INFO:teuthology.orchestra.run.smithi055.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 1.1 MB/s | 23 kB 00:00 2023-10-06T11:10:32.783 INFO:teuthology.orchestra.run.smithi055.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 5.4 MB/s | 121 kB 00:00 2023-10-06T11:10:32.867 INFO:teuthology.orchestra.run.smithi055.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 20 MB/s | 1.7 MB 00:00 2023-10-06T11:10:33.219 INFO:teuthology.orchestra.run.smithi055.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 21 MB/s | 7.4 MB 00:00 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi055.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 8.8 MB/s | 238 kB 00:00 2023-10-06T11:10:33.267 INFO:teuthology.orchestra.run.smithi055.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 2.1 MB/s | 47 kB 00:00 2023-10-06T11:10:33.289 INFO:teuthology.orchestra.run.smithi055.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 683 kB/s | 14 kB 00:00 2023-10-06T11:10:33.313 INFO:teuthology.orchestra.run.smithi055.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 11 MB/s | 267 kB 00:00 2023-10-06T11:10:33.335 INFO:teuthology.orchestra.run.smithi055.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 3.6 MB/s | 80 kB 00:00 2023-10-06T11:10:33.356 INFO:teuthology.orchestra.run.smithi055.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 837 kB/s | 18 kB 00:00 2023-10-06T11:10:34.082 INFO:teuthology.orchestra.run.smithi055.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 422 kB/s | 306 kB 00:00 2023-10-06T11:10:34.191 INFO:teuthology.orchestra.run.smithi055.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 539 kB/s | 59 kB 00:00 2023-10-06T11:10:34.304 INFO:teuthology.orchestra.run.smithi055.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 666 kB/s | 75 kB 00:00 2023-10-06T11:10:34.507 INFO:teuthology.orchestra.run.smithi055.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-10-06T11:10:34.607 INFO:teuthology.orchestra.run.smithi055.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 439 kB/s | 44 kB 00:00 2023-10-06T11:10:34.760 INFO:teuthology.orchestra.run.smithi055.stdout:(42/120): ceph-common-17.2.6-1274.g68e53a4a.el8 2.3 MB/s | 23 MB 00:10 2023-10-06T11:10:34.821 INFO:teuthology.orchestra.run.smithi055.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 865 kB/s | 185 kB 00:00 2023-10-06T11:10:34.932 INFO:teuthology.orchestra.run.smithi055.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 148 kB/s | 16 kB 00:00 2023-10-06T11:10:35.041 INFO:teuthology.orchestra.run.smithi055.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-10-06T11:10:35.168 INFO:teuthology.orchestra.run.smithi055.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-06T11:10:35.195 INFO:teuthology.orchestra.run.smithi055.stdout:(47/120): python3-cachetools-3.1.1-4.el8.noarch 76 kB/s | 33 kB 00:00 2023-10-06T11:10:35.270 INFO:teuthology.orchestra.run.smithi055.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 795 kB/s | 81 kB 00:00 2023-10-06T11:10:35.417 INFO:teuthology.orchestra.run.smithi055.stdout:(49/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 2.5 MB/s | 17 MB 00:06 2023-10-06T11:10:35.417 INFO:teuthology.orchestra.run.smithi055.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 50 kB/s | 11 kB 00:00 2023-10-06T11:10:35.418 INFO:teuthology.orchestra.run.smithi055.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 119 kB/s | 18 kB 00:00 2023-10-06T11:10:35.521 INFO:teuthology.orchestra.run.smithi055.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 471 kB/s | 49 kB 00:00 2023-10-06T11:10:35.622 INFO:teuthology.orchestra.run.smithi055.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 602 kB/s | 60 kB 00:00 2023-10-06T11:10:35.740 INFO:teuthology.orchestra.run.smithi055.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.3 MB/s | 283 kB 00:00 2023-10-06T11:10:35.837 INFO:teuthology.orchestra.run.smithi055.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 161 kB/s | 16 kB 00:00 2023-10-06T11:10:35.913 INFO:teuthology.orchestra.run.smithi055.stdout:(56/120): python3-more-itertools-7.2.0-3.el8.no 119 kB/s | 59 kB 00:00 2023-10-06T11:10:35.935 INFO:teuthology.orchestra.run.smithi055.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 343 kB/s | 34 kB 00:00 2023-10-06T11:10:36.006 INFO:teuthology.orchestra.run.smithi055.stdout:(58/120): python3-kubernetes-11.0.0-6.el8.noarc 2.0 MB/s | 1.2 MB 00:00 2023-10-06T11:10:36.036 INFO:teuthology.orchestra.run.smithi055.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 638 kB/s | 64 kB 00:00 2023-10-06T11:10:36.105 INFO:teuthology.orchestra.run.smithi055.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 191 kB/s | 19 kB 00:00 2023-10-06T11:10:36.133 INFO:teuthology.orchestra.run.smithi055.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 246 kB/s | 24 kB 00:00 2023-10-06T11:10:36.201 INFO:teuthology.orchestra.run.smithi055.stdout:(62/120): python3-routes-2.4.1-12.el8.noarch.rp 684 kB/s | 196 kB 00:00 2023-10-06T11:10:36.203 INFO:teuthology.orchestra.run.smithi055.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 297 kB/s | 29 kB 00:00 2023-10-06T11:10:36.232 INFO:teuthology.orchestra.run.smithi055.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 279 kB/s | 27 kB 00:00 2023-10-06T11:10:36.315 INFO:teuthology.orchestra.run.smithi055.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.2 MB/s | 251 kB 00:00 2023-10-06T11:10:36.333 INFO:teuthology.orchestra.run.smithi055.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 611 kB/s | 61 kB 00:00 2023-10-06T11:10:36.400 INFO:teuthology.orchestra.run.smithi055.stdout:(67/120): python3-waitress-1.4.3-1.el8.noarch.r 1.3 MB/s | 255 kB 00:00 2023-10-06T11:10:36.418 INFO:teuthology.orchestra.run.smithi055.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 833 kB/s | 85 kB 00:00 2023-10-06T11:10:36.422 INFO:teuthology.orchestra.run.smithi055.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-06T11:10:36.430 INFO:teuthology.orchestra.run.smithi055.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 237 kB/s | 23 kB 00:00 2023-10-06T11:10:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 543 kB/s | 19 kB 00:00 2023-10-06T11:10:36.466 INFO:teuthology.orchestra.run.smithi055.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-10-06T11:10:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.1 MB/s | 155 kB 00:00 2023-10-06T11:10:36.486 INFO:teuthology.orchestra.run.smithi055.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2023-10-06T11:10:36.492 INFO:teuthology.orchestra.run.smithi055.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-10-06T11:10:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-06T11:10:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.8 MB/s | 43 kB 00:00 2023-10-06T11:10:36.521 INFO:teuthology.orchestra.run.smithi055.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-10-06T11:10:36.547 INFO:teuthology.orchestra.run.smithi055.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2023-10-06T11:10:36.561 INFO:teuthology.orchestra.run.smithi055.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 41 MB/s | 2.3 MB 00:00 2023-10-06T11:10:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.1 MB/s | 83 kB 00:00 2023-10-06T11:10:36.575 INFO:teuthology.orchestra.run.smithi055.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.1 MB/s | 59 kB 00:00 2023-10-06T11:10:36.578 INFO:teuthology.orchestra.run.smithi055.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-06T11:10:36.589 INFO:teuthology.orchestra.run.smithi055.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.8 MB/s | 38 kB 00:00 2023-10-06T11:10:36.592 INFO:teuthology.orchestra.run.smithi055.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.0 MB/s | 86 kB 00:00 2023-10-06T11:10:36.603 INFO:teuthology.orchestra.run.smithi055.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.1 MB/s | 58 kB 00:00 2023-10-06T11:10:36.606 INFO:teuthology.orchestra.run.smithi055.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.5 MB/s | 47 kB 00:00 2023-10-06T11:10:36.626 INFO:teuthology.orchestra.run.smithi055.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 23 MB/s | 559 kB 00:00 2023-10-06T11:10:36.631 INFO:teuthology.orchestra.run.smithi055.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 25 MB/s | 639 kB 00:00 2023-10-06T11:10:36.642 INFO:teuthology.orchestra.run.smithi055.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.5 MB/s | 70 kB 00:00 2023-10-06T11:10:36.654 INFO:teuthology.orchestra.run.smithi055.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 8.8 MB/s | 200 kB 00:00 2023-10-06T11:10:36.660 INFO:teuthology.orchestra.run.smithi055.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.2 MB/s | 97 kB 00:00 2023-10-06T11:10:36.674 INFO:teuthology.orchestra.run.smithi055.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-06T11:10:36.686 INFO:teuthology.orchestra.run.smithi055.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-10-06T11:10:36.701 INFO:teuthology.orchestra.run.smithi055.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-06T11:10:36.719 INFO:teuthology.orchestra.run.smithi055.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-06T11:10:36.740 INFO:teuthology.orchestra.run.smithi055.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 22 MB/s | 457 kB 00:00 2023-10-06T11:10:36.799 INFO:teuthology.orchestra.run.smithi055.stdout:(98/120): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-10-06T11:10:36.829 INFO:teuthology.orchestra.run.smithi055.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.3 MB/s | 39 kB 00:00 2023-10-06T11:10:36.848 INFO:teuthology.orchestra.run.smithi055.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 44 MB/s | 4.8 MB 00:00 2023-10-06T11:10:36.872 INFO:teuthology.orchestra.run.smithi055.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-10-06T11:10:36.924 INFO:teuthology.orchestra.run.smithi055.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-10-06T11:10:37.022 INFO:teuthology.orchestra.run.smithi055.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-10-06T11:10:37.024 INFO:teuthology.orchestra.run.smithi055.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.2 MB/s | 126 kB 00:00 2023-10-06T11:10:37.040 INFO:teuthology.orchestra.run.smithi055.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T11:10:37.161 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-10-06T11:10:37.165 INFO:teuthology.orchestra.run.smithi055.stdout:(106/120): python3-scipy-1.0.0-20.module+el8.1. 28 MB/s | 15 MB 00:00 2023-10-06T11:10:37.174 INFO:teuthology.orchestra.run.smithi055.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 3.9 MB/s | 538 kB 00:00 2023-10-06T11:10:37.182 INFO:teuthology.orchestra.run.smithi055.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-10-06T11:10:37.190 INFO:teuthology.orchestra.run.smithi055.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.4 MB/s | 157 kB 00:00 2023-10-06T11:10:37.197 INFO:teuthology.orchestra.run.smithi055.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.5 MB/s | 110 kB 00:00 2023-10-06T11:10:37.211 INFO:teuthology.orchestra.run.smithi055.stdout:(111/120): python3-numpy-1.14.3-9.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-10-06T11:10:37.212 INFO:teuthology.orchestra.run.smithi055.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.3 MB/s | 20 kB 00:00 2023-10-06T11:10:37.216 INFO:teuthology.orchestra.run.smithi055.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2023-10-06T11:10:37.229 INFO:teuthology.orchestra.run.smithi055.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.3 MB/s | 54 kB 00:00 2023-10-06T11:10:37.233 INFO:teuthology.orchestra.run.smithi055.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 32 MB/s | 709 kB 00:00 2023-10-06T11:10:37.260 INFO:teuthology.orchestra.run.smithi055.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-06T11:10:37.314 INFO:teuthology.orchestra.run.smithi055.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 49 MB/s | 4.7 MB 00:00 2023-10-06T11:10:37.333 INFO:teuthology.orchestra.run.smithi055.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 44 MB/s | 4.6 MB 00:00 2023-10-06T11:10:37.394 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T11:10:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:(119/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 14 MB/s | 3.5 MB 00:00 2023-10-06T11:10:37.606 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T11:10:37.825 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T11:10:37.971 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T11:10:37.976 INFO:teuthology.orchestra.run.smithi055.stdout:(120/120): librados2-17.2.6-1274.g68e53a4a.el8. 4.8 MB/s | 3.4 MB 00:00 2023-10-06T11:10:37.981 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2023-10-06T11:10:37.981 INFO:teuthology.orchestra.run.smithi055.stdout:Total 15 MB/s | 201 MB 00:13 2023-10-06T11:10:38.034 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2023-10-06T11:10:38.158 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2023-10-06T11:10:38.158 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2023-10-06T11:10:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T11:10:38.609 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T11:10:38.867 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:10:39.285 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:10:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:10:39.623 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:10:39.833 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:10:39.875 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2023-10-06T11:10:39.879 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2023-10-06T11:10:39.951 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:10:40.345 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T11:10:41.090 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T11:10:41.300 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:10:41.409 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:10:41.679 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T11:10:41.881 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T11:10:42.133 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:10:42.267 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:10:42.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:10:42.527 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:10:42.727 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T11:10:42.924 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T11:10:43.065 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T11:10:43.266 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T11:10:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T11:10:44.032 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T11:10:44.565 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T11:10:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T11:10:45.012 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T11:10:45.470 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T11:10:45.499 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T11:10:45.707 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T11:10:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T11:10:45.929 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T11:10:45.998 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T11:10:46.178 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T11:10:46.326 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T11:10:46.438 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T11:10:46.595 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:10:46.742 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T11:10:46.990 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:10:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T11:10:47.247 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T11:10:47.337 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:10:47.470 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:10:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T11:10:47.686 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:10:47.787 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:10:47.978 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T11:10:47.996 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:10:48.795 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T11:10:49.052 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T11:10:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T11:10:49.504 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T11:10:49.736 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:10:49.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T11:10:49.855 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:10:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T11:10:50.083 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T11:10:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T11:10:50.286 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T11:10:50.478 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:10:50.531 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T11:10:50.571 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:10:50.728 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:10:50.789 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:10:51.008 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T11:10:51.273 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T11:10:51.505 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T11:10:51.703 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T11:10:51.844 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T11:10:51.987 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T11:10:52.144 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T11:10:52.602 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T11:10:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T11:10:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T11:10:52.935 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T11:10:53.390 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T11:10:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T11:10:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T11:10:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T11:10:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T11:10:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T11:10:54.188 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T11:10:54.376 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T11:10:54.570 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T11:10:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T11:10:54.777 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T11:10:54.932 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T11:10:54.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T11:10:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T11:10:55.226 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T11:10:55.335 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T11:10:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T11:10:55.594 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T11:10:55.818 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T11:10:55.872 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T11:10:55.956 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T11:10:56.177 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T11:10:56.220 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T11:10:56.444 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T11:10:56.459 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T11:10:56.735 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T11:10:56.799 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T11:10:56.952 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T11:10:57.046 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T11:10:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T11:10:57.469 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T11:10:57.736 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T11:10:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T11:10:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T11:10:58.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T11:10:58.357 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T11:10:58.547 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T11:10:58.752 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T11:10:59.025 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T11:10:59.116 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T11:10:59.255 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T11:10:59.504 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T11:10:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T11:10:59.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T11:10:59.900 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T11:11:00.122 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T11:11:00.376 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T11:11:00.625 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T11:11:00.827 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T11:11:00.858 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T11:11:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T11:11:01.179 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T11:11:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T11:11:01.457 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T11:11:01.559 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T11:11:01.693 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T11:11:01.778 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T11:11:01.922 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T11:11:02.068 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T11:11:02.145 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T11:11:02.334 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T11:11:02.355 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T11:11:02.573 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T11:11:02.605 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T11:11:02.844 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T11:11:02.845 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T11:11:03.034 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T11:11:03.242 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T11:11:03.439 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T11:11:03.626 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T11:11:03.705 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T11:11:03.885 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T11:11:04.012 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T11:11:04.061 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T11:11:04.262 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T11:11:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T11:11:04.439 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T11:11:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T11:11:04.746 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T11:11:04.929 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T11:11:04.938 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T11:11:05.083 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T11:11:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T11:11:05.286 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T11:11:05.457 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T11:11:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T11:11:05.803 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T11:11:05.864 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T11:11:06.079 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T11:11:06.080 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T11:11:06.321 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T11:11:06.455 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T11:11:06.735 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T11:11:06.902 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T11:11:07.108 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T11:11:07.371 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T11:11:07.594 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T11:11:07.842 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T11:11:07.996 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T11:11:08.157 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T11:11:08.367 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T11:11:08.619 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T11:11:08.834 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T11:11:09.030 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T11:11:09.238 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T11:11:09.468 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T11:11:09.708 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T11:11:09.958 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T11:11:10.289 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T11:11:10.584 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T11:11:10.803 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T11:11:11.084 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T11:11:11.599 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:11:11.837 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:11:12.339 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T11:11:12.430 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:11:12.609 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T11:11:12.722 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:11:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:11:12.870 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T11:11:12.978 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:11:13.210 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T11:11:13.504 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T11:11:13.850 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T11:11:14.125 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T11:11:14.319 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T11:11:14.517 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T11:11:19.839 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:11:20.074 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:11:20.798 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:11:21.246 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:11:21.335 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:11:21.474 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2023-10-06T11:11:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2023-10-06T11:11:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2023-10-06T11:11:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2023-10-06T11:11:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2023-10-06T11:11:30.667 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:11:31.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:11:32.548 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:11:32.752 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:11:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:11:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:11:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:11:33.708 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:11:33.726 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:11:36.588 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:11:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:11:37.014 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T11:11:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T11:11:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:11:37.657 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:11:37.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:11:38.803 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:11:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:11:39.062 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:11:39.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T11:11:39.635 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:11:39.671 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /dev 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /run 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2023-10-06T11:11:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2023-10-06T11:11:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2023-10-06T11:11:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2023-10-06T11:11:39.818 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /dev 2023-10-06T11:11:39.818 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:11:39.857 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:11:39.868 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:11:40.214 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:11:41.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T11:11:41.734 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:11:41.787 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:11:41.848 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:11:41.968 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:11:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:11:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:11:42.202 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:11:42.257 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:11:42.355 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:11:42.605 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:11:42.776 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:11:42.790 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:11:42.930 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:11:42.948 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:11:45.948 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:11:46.103 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:11:46.320 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T11:11:46.501 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T11:11:46.679 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:11:46.908 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:11:47.158 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:11:47.767 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:11:48.090 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T11:11:48.188 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:11:48.289 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T11:11:48.377 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:11:48.480 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:11:48.848 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T11:11:48.990 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T11:11:49.017 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:11:49.055 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:11:49.220 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:11:49.232 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:11:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T11:11:49.603 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T11:11:49.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T11:11:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T11:11:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T11:11:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T11:11:50.538 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T11:11:50.665 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T11:11:50.922 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T11:11:50.924 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T11:11:51.142 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:11:51.159 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T11:11:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T11:11:51.254 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:11:51.405 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T11:11:51.412 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:11:51.414 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T11:11:51.414 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:11:51.463 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:11:51.614 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:11:51.641 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:11:51.641 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:11:51.982 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:11:52.137 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:11:52.519 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:11:52.519 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T11:11:52.519 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T11:11:52.519 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T11:11:52.519 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:11:52.520 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T11:11:52.521 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T11:11:52.522 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T11:11:52.522 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T11:11:52.522 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T11:11:52.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T11:11:52.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T11:11:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T11:11:52.536 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T11:11:52.537 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T11:11:52.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T11:11:52.539 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T11:11:52.540 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T11:11:52.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T11:11:52.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T11:11:52.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T11:11:52.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T11:11:52.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T11:11:52.541 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T11:11:54.903 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:11:54.903 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:41 ago on Fri 06 Oct 2023 11:10:13 AM UTC. 2023-10-06T11:11:56.856 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.991 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T11:11:56.992 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.5-12.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T11:11:56.993 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T11:11:56.994 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T11:11:56.995 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T11:11:56.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T11:11:56.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:56.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T11:11:56.999 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T11:11:57.000 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T11:11:57.001 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:11:57.001 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-10-06T11:11:57.368 DEBUG:teuthology.parallel:result is None 2023-10-06T11:11:57.376 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T11:11:58.738 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T11:11:58.964 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 110/122 2023-10-06T11:11:59.213 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T11:11:59.377 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T11:11:59.389 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T11:11:59.549 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T11:11:59.733 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T11:11:59.895 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T11:12:00.087 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T11:12:00.347 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T11:12:00.544 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T11:12:00.607 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T11:12:00.777 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T11:12:00.787 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T11:12:00.896 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T11:12:00.897 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:12:01.123 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:12:01.123 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:12:02.032 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:12:02.032 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T11:12:02.033 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T11:12:02.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T11:12:02.035 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T11:12:02.036 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T11:12:02.037 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T11:12:02.038 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T11:12:02.039 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T11:12:02.040 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T11:12:02.041 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T11:12:02.042 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T11:12:02.043 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T11:12:02.043 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T11:12:02.043 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T11:12:04.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:12:04.182 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:49 ago on Fri 06 Oct 2023 11:10:15 AM UTC. 2023-10-06T11:12:06.156 INFO:teuthology.orchestra.run.smithi055.stdout:Installed products updated. 2023-10-06T11:12:06.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:06.312 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2023-10-06T11:12:06.312 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.313 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.313 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2023-10-06T11:12:06.313 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T11:12:06.313 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T11:12:06.313 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.313 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.314 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.314 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.314 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.314 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.314 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.314 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.315 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.316 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.316 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.316 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.316 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.316 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.316 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.317 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.317 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:12:06.317 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T11:12:06.317 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T11:12:06.317 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T11:12:06.317 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: jq-1.5-12.el8.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.318 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T11:12:06.319 INFO:teuthology.orchestra.run.smithi055.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T11:12:06.320 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T11:12:06.321 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T11:12:06.322 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T11:12:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T11:12:06.324 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T11:12:06.325 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:12:06.326 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T11:12:06.327 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T11:12:06.327 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T11:12:06.327 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T11:12:06.327 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T11:12:06.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:06.327 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2023-10-06T11:12:06.583 DEBUG:teuthology.parallel:result is None 2023-10-06T11:12:06.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:12:06.811 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T11:12:06.833 INFO:teuthology.orchestra.run.smithi055.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T11:12:06.833 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T11:12:06.833 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T11:12:06.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:12:06.968 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T11:12:06.991 INFO:teuthology.orchestra.run.smithi142.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T11:12:06.991 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T11:12:06.991 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T11:12:06.991 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T11:12:06.991 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:06.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T11:12:07.032 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:07.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T11:12:07.072 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T11:12:07.072 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:07.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T11:12:07.098 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T11:12:07.165 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:07.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T11:12:07.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T11:12:07.254 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T11:12:07.255 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:07.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T11:12:07.280 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T11:12:07.346 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:07.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T11:12:07.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T11:12:07.433 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T11:12:07.434 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:07.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T11:12:07.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T11:12:07.524 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:07.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T11:12:07.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T11:12:07.612 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T11:12:07.673 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T11:12:07.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2023-10-06T11:12:07.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2023-10-06T11:12:07.699 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T11:12:07.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T11:12:07.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T11:12:07.765 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T11:12:07.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T11:12:07.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T11:12:07.839 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T11:12:07.839 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T11:12:07.839 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T11:12:07.839 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:07.839 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T11:12:07.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:07.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:08.023 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:08.024 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T11:12:08.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:08.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:08.179 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T11:12:08.179 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T11:12:08.179 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412387', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfA70rXdcP7VtZS4hWwOWKeSR3CWfg6XNN7t2mMWNTM6Al0tFQNb8UEn6A1a/Hgg3aoUoXiT6wdgqdUIOJzh+I=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd/W4zYwgaIpJR2tJL8Rjp1wbqFJOksMBCcJJPNtAaqHKAf7+VnrnlSq9Jc/Ap2UAqWfFpLspkzcb+LpQzfxd0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T11:12:08.180 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T11:12:08.183 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T11:12:08.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T11:12:08.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T11:12:08.291 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:08.292 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T11:12:08.315 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T11:12:08.315 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 222246 Links: 1 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-10-06 11:12:01.575386190 +0000 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-10-06 11:09:31.786383303 +0000 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-10-06 11:09:31.786383303 +0000 2023-10-06T11:12:08.371 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-10-06T11:12:08.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T11:12:08.435 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-10-06T11:12:08.435 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-10-06T11:12:08.436 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000313317 s, 1.6 MB/s 2023-10-06T11:12:08.436 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T11:12:08.492 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2023-10-06T11:12:08.547 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T11:12:08.547 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 222372 Links: 1 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-10-06 11:12:01.575386190 +0000 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-10-06 11:09:32.312373249 +0000 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-10-06 11:09:32.312373249 +0000 2023-10-06T11:12:08.548 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-10-06T11:12:08.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T11:12:08.611 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-10-06T11:12:08.611 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-10-06T11:12:08.611 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000295344 s, 1.7 MB/s 2023-10-06T11:12:08.612 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T11:12:08.669 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2023-10-06T11:12:08.724 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 221231 Links: 1 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-10-06 11:12:01.575386190 +0000 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-10-06 11:09:32.813363674 +0000 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-10-06 11:09:32.813363674 +0000 2023-10-06T11:12:08.725 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-10-06T11:12:08.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T11:12:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-10-06T11:12:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-10-06T11:12:08.788 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000308993 s, 1.7 MB/s 2023-10-06T11:12:08.789 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T11:12:08.846 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 219924 Links: 1 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-10-06 11:12:01.575386190 +0000 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-10-06 11:09:33.313354118 +0000 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-10-06 11:09:33.313354118 +0000 2023-10-06T11:12:08.902 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-10-06T11:12:08.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T11:12:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-10-06T11:12:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-10-06T11:12:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000453342 s, 1.1 MB/s 2023-10-06T11:12:08.967 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T11:12:09.023 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:09.023 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:09.024 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T11:12:09.039 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T11:12:09.039 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-10-06T11:12:09.095 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T11:12:09.095 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:09.095 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 221282 Links: 1 2023-10-06T11:12:09.095 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:09.096 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:09.096 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-10-06 11:11:52.085828903 +0000 2023-10-06T11:12:09.096 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-10-06 11:09:20.665689172 +0000 2023-10-06T11:12:09.096 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-10-06 11:09:20.665689172 +0000 2023-10-06T11:12:09.096 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-10-06T11:12:09.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T11:12:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-10-06T11:12:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-10-06T11:12:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000258095 s, 2.0 MB/s 2023-10-06T11:12:09.160 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T11:12:09.217 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 221358 Links: 1 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-10-06 11:11:52.085828903 +0000 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-10-06 11:09:21.165680074 +0000 2023-10-06T11:12:09.272 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-10-06 11:09:21.165680074 +0000 2023-10-06T11:12:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-10-06T11:12:09.273 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T11:12:09.334 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-10-06T11:12:09.334 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-10-06T11:12:09.335 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000227915 s, 2.2 MB/s 2023-10-06T11:12:09.335 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T11:12:09.391 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-10-06T11:12:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T11:12:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 223389 Links: 1 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-10-06 11:11:52.085828903 +0000 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-10-06 11:09:21.658671103 +0000 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-10-06 11:09:21.658671103 +0000 2023-10-06T11:12:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-10-06T11:12:09.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T11:12:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-10-06T11:12:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-10-06T11:12:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000268169 s, 1.9 MB/s 2023-10-06T11:12:09.511 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T11:12:09.567 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 221505 Links: 1 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-10-06 11:11:52.085828903 +0000 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-10-06 11:09:22.166661859 +0000 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-10-06 11:09:22.166661859 +0000 2023-10-06T11:12:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-10-06T11:12:09.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T11:12:09.685 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-10-06T11:12:09.685 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-10-06T11:12:09.685 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000193718 s, 2.6 MB/s 2023-10-06T11:12:09.686 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T11:12:09.742 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:09.742 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T11:12:09.742 INFO:tasks.ceph:Generating config... 2023-10-06T11:12:09.743 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T11:12:09.743 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T11:12:09.743 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T11:12:09.743 INFO:tasks.ceph:[client] pid file = 2023-10-06T11:12:09.744 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T11:12:09.744 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T11:12:09.744 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T11:12:09.744 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T11:12:09.745 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T11:12:09.745 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T11:12:09.745 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T11:12:09.745 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T11:12:09.745 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T11:12:09.745 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T11:12:09.745 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T11:12:09.746 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T11:12:09.746 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T11:12:09.746 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T11:12:09.746 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T11:12:09.746 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T11:12:09.746 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T11:12:09.746 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T11:12:09.746 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T11:12:09.801 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T11:12:09.803 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T11:12:09.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T11:12:09.914 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2023-10-06T11:12:09.914 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T11:12:09.915 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:09.915 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T11:12:09.970 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:10.055 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:10.055 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:12:10.055 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = octopus 2023-10-06T11:12:10.055 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2023-10-06T11:12:10.055 INFO:teuthology.orchestra.run.smithi055.stdout:fsid 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2023-10-06T11:12:10.054644+0000 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:created 2023-10-06T11:12:10.054644+0000 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 15 (octopus) 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2023-10-06T11:12:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T11:12:10.057 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T11:12:10.072 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2bd5b0c1-a996-4dae-ab19-fd6663182240... 2023-10-06T11:12:10.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:12:10.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:12:10.157 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-10-06T11:12:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-10-06T11:12:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:12:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-10-06T11:12:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-10-06T11:12:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-10-06T11:12:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-10-06T11:12:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-10-06T11:12:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-10-06T11:12:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-10-06T11:12:10.168 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-10-06T11:12:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2023-10-06T11:12:10.171 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:12:10.172 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2023-10-06T11:12:10.173 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:12:10.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2023-10-06T11:12:10.175 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:12:10.176 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:12:10.177 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2023-10-06T11:12:10.178 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.179 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2023-10-06T11:12:10.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-10-06T11:12:10.181 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2023-10-06T11:12:10.182 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2023-10-06T11:12:10.183 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2023-10-06T11:12:10.183 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-10-06T11:12:10.183 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-10-06T11:12:10.183 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-10-06T11:12:10.183 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T11:12:10.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T11:12:10.264 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T11:12:10.264 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:10.264 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T11:12:10.278 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:10.279 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T11:12:10.333 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:12:10.333 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:10.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T11:12:10.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T11:12:10.408 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:10.409 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:10.463 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:12:10.463 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:10.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T11:12:10.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T11:12:10.498 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:10.499 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:10.553 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T11:12:10.554 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T11:12:10.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T11:12:10.603 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T11:12:10.606 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T11:12:10.659 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T11:12:10.662 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T11:12:10.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T11:12:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T11:12:10.714 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T11:12:10.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T11:12:10.829 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T11:12:10.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T11:12:10.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T11:12:10.904 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T11:12:10.907 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T11:12:10.931 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T11:12:11.019 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T11:12:11.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T11:12:11.046 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T11:12:11.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T11:12:11.085 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T11:12:11.098 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T11:12:11.177 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T11:12:11.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T11:12:11.229 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T11:12:11.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T11:12:11.318 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T11:12:11.331 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T11:12:11.332 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T11:12:11.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T11:12:11.357 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:11.358 INFO:tasks.ceph:role: osd.0 2023-10-06T11:12:11.358 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:12:11.358 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T11:12:11.451 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:11.451 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:11.451 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:11.451 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 2023-10-06T11:12:11.452 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:11.452 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:11.452 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:11.452 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:11.452 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:11.452 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:12.747 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-10-06T11:12:12.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-10-06T11:12:12.749 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T11:12:12.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T11:12:12.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T11:12:12.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:12.896 INFO:tasks.ceph:role: osd.1 2023-10-06T11:12:12.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:12:12.896 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T11:12:12.990 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:12.990 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:12.990 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:12.990 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 2023-10-06T11:12:12.991 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:12.991 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:12.991 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:12.991 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:12.991 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:12.991 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:14.288 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-10-06T11:12:14.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-10-06T11:12:14.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T11:12:14.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T11:12:14.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T11:12:14.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:14.435 INFO:tasks.ceph:role: osd.2 2023-10-06T11:12:14.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:12:14.436 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T11:12:14.530 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:14.530 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:14.530 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:14.530 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 2023-10-06T11:12:14.530 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:14.531 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:14.531 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:14.531 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:14.531 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:14.531 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:15.825 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-10-06T11:12:15.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-10-06T11:12:15.828 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T11:12:15.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T11:12:15.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T11:12:15.972 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:15.972 INFO:tasks.ceph:role: osd.3 2023-10-06T11:12:15.973 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:12:15.973 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T11:12:16.066 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:16.066 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:16.066 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:16.066 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 2023-10-06T11:12:16.066 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:16.066 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:16.067 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:16.067 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:16.067 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:16.067 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:17.364 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-10-06T11:12:17.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-10-06T11:12:17.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T11:12:17.413 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T11:12:17.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:17.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:17.551+0000 7faee1350540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T11:12:17.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:17.551+0000 7faee1350540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T11:12:17.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:17.551+0000 7faee1350540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T11:12:17.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:17.551+0000 7faee1350540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T11:12:17.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:17.551+0000 7faee1350540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T11:12:17.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:17.552+0000 7faee1350540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T11:12:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:18.080+0000 7faee1350540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:18.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:18.858+0000 7faee1350540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:19.626+0000 7faee1350540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:20.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T11:12:20.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:20.552+0000 7f60fee01540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T11:12:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:20.552+0000 7f60fee01540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T11:12:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:20.552+0000 7f60fee01540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T11:12:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:20.552+0000 7f60fee01540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T11:12:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:20.552+0000 7f60fee01540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T11:12:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:20.553+0000 7f60fee01540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T11:12:21.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:21.078+0000 7f60fee01540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:21.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:21.844+0000 7f60fee01540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:22.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:22.605+0000 7f60fee01540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:23.408 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T11:12:23.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:23.523+0000 7fe02982d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T11:12:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:23.523+0000 7fe02982d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T11:12:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:23.523+0000 7fe02982d540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T11:12:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:23.523+0000 7fe02982d540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T11:12:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:23.523+0000 7fe02982d540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T11:12:23.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:23.524+0000 7fe02982d540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T11:12:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:24.052+0000 7fe02982d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:24.822+0000 7fe02982d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:25.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:25.584+0000 7fe02982d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:26.398 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T11:12:26.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:26.512+0000 7f93c57b1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T11:12:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:26.513+0000 7f93c57b1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T11:12:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:26.513+0000 7f93c57b1540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T11:12:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:26.513+0000 7f93c57b1540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T11:12:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:26.513+0000 7f93c57b1540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T11:12:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:26.513+0000 7f93c57b1540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T11:12:27.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:27.041+0000 7f93c57b1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:27.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:27.817+0000 7f93c57b1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:28.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:28.580+0000 7f93c57b1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:29.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T11:12:29.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T11:12:29.448 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:29.448 INFO:tasks.ceph:role: osd.4 2023-10-06T11:12:29.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:12:29.448 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T11:12:29.523 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:29.524 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:29.952 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-10-06T11:12:29.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-10-06T11:12:29.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T11:12:30.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T11:12:30.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T11:12:30.237 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:30.238 INFO:tasks.ceph:role: osd.5 2023-10-06T11:12:30.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:12:30.238 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T11:12:30.311 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:30.312 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:30.313 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:30.313 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:30.740 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-10-06T11:12:30.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-10-06T11:12:30.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T11:12:30.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T11:12:30.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T11:12:30.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:30.943 INFO:tasks.ceph:role: osd.6 2023-10-06T11:12:30.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:12:30.943 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T11:12:31.014 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:31.016 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:31.457 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-10-06T11:12:31.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-10-06T11:12:31.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T11:12:31.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T11:12:31.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T11:12:31.714 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:12:31.714 INFO:tasks.ceph:role: osd.7 2023-10-06T11:12:31.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:12:31.714 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T11:12:31.786 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:12:31.786 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:12:31.786 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:12:31.786 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-10-06T11:12:31.787 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:12:31.787 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:12:31.787 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:12:31.787 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:12:31.787 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:12:31.787 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:12:32.226 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-10-06T11:12:32.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-10-06T11:12:32.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T11:12:32.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T11:12:32.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:32.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:32.522+0000 7f0ec82d8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T11:12:32.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:32.522+0000 7f0ec82d8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T11:12:32.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:32.522+0000 7f0ec82d8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T11:12:32.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:32.522+0000 7f0ec82d8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T11:12:32.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:32.522+0000 7f0ec82d8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T11:12:32.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:32.522+0000 7f0ec82d8540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T11:12:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:33.046+0000 7f0ec82d8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:33.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:33.814+0000 7f0ec82d8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:34.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:34.576+0000 7f0ec82d8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:35.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T11:12:35.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:35.477+0000 7fa9025bf540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T11:12:35.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:35.477+0000 7fa9025bf540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T11:12:35.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:35.477+0000 7fa9025bf540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T11:12:35.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:35.477+0000 7fa9025bf540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T11:12:35.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:35.477+0000 7fa9025bf540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T11:12:35.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:35.478+0000 7fa9025bf540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T11:12:36.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:36.004+0000 7fa9025bf540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:36.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:36.767+0000 7fa9025bf540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:37.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:37.536+0000 7fa9025bf540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:38.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:38.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:38.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T11:12:38.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.437+0000 7f56fd527540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T11:12:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.438+0000 7f56fd527540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T11:12:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.438+0000 7f56fd527540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T11:12:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.438+0000 7f56fd527540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T11:12:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.438+0000 7f56fd527540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T11:12:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.438+0000 7f56fd527540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T11:12:38.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:38.964+0000 7f56fd527540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:39.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:39.727+0000 7f56fd527540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:40.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:40.496+0000 7f56fd527540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:41.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T11:12:41.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.446+0000 7f68b810b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T11:12:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.446+0000 7f68b810b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T11:12:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.446+0000 7f68b810b540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T11:12:41.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.446+0000 7f68b810b540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T11:12:41.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.446+0000 7f68b810b540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T11:12:41.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.447+0000 7f68b810b540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T11:12:41.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:41.968+0000 7f68b810b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:42.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:42.730+0000 7f68b810b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:43.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:43.493+0000 7f68b810b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:12:44.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T11:12:44.310 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T11:12:44.310 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.311 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T11:12:44.341 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T11:12:44.410 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T11:12:44.477 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.477 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T11:12:44.544 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T11:12:44.610 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T11:12:44.676 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:44.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T11:12:44.742 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:44.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T11:12:44.770 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:44.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T11:12:44.834 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:44.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T11:12:44.899 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:44.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T11:12:44.963 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:44.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T11:12:45.027 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:45.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T11:12:45.091 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:45.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T11:12:45.158 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:45.159 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T11:12:45.175 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:45.175 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T11:12:45.233 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:45.252 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T11:12:45.268 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:45.268 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T11:12:45.322 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T11:12:45.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T11:12:45.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T11:12:45.368 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g== 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ== 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q== 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw== 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2023-10-06T11:12:45.369 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw== 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA== 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA== 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA== 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-10-06T11:12:45.370 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg== 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag== 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ== 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug== 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw== 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2023-10-06T11:12:45.371 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg== 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w== 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ== 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg== 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2023-10-06T11:12:45.372 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA== 2023-10-06T11:12:45.387 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2023-10-06T11:12:45.387 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g== 2023-10-06T11:12:45.387 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-10-06T11:12:45.387 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ== 2023-10-06T11:12:45.387 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-10-06T11:12:45.387 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q== 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw== 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw== 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA== 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA== 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA== 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-10-06T11:12:45.388 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg== 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag== 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ== 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug== 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw== 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg== 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-10-06T11:12:45.389 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w== 2023-10-06T11:12:45.390 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2023-10-06T11:12:45.390 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ== 2023-10-06T11:12:45.390 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-10-06T11:12:45.390 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg== 2023-10-06T11:12:45.390 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2023-10-06T11:12:45.390 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA== 2023-10-06T11:12:45.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:12:45.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:12:45.484 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:12:45.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:12:45.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:12:45.949 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.951 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:45.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:46.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:46.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:46.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:46.098 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:46.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:12:46.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.260 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:12:46.366 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T11:12:46.366 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T11:12:46.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T11:12:46.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T11:12:46.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T11:12:46.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T11:12:46.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T11:12:46.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T11:12:46.721 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T11:12:46.812 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T11:12:46.836 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:46.838 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:12:46.890 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T11:12:46.890 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T11:12:46.891 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T11:12:46.893 INFO:tasks.ceph.mon.a:Started 2023-10-06T11:12:46.894 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T11:12:46.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T11:12:46.932 INFO:tasks.ceph.mon.b:Started 2023-10-06T11:12:46.932 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T11:12:46.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T11:12:46.934 INFO:tasks.ceph.mon.c:Started 2023-10-06T11:12:46.934 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T11:12:46.935 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T11:12:46.935 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T11:12:46.938 INFO:tasks.ceph.mgr.y:Started 2023-10-06T11:12:46.938 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T11:12:46.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T11:12:46.940 INFO:tasks.ceph.mgr.x:Started 2023-10-06T11:12:46.940 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T11:12:46.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T11:12:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.058+0000 7f137c7c4700 1 Processor -- start 2023-10-06T11:12:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.058+0000 7f137c7c4700 1 -- start start 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137c7c4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137c7c4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137c7c4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137c7c4700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137415ac30 con 0x7f137415a160 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137c7c4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13740cb6a0 con 0x7f1374150940 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137c7c4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740cb090 con 0x7f13740c5250 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42788/0 (socket says 172.21.15.55:42788) 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 -- 172.21.15.55:0/769732911 learned_addr learned my addr 172.21.15.55:0/769732911 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 -- 172.21.15.55:0/769732911 >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 msgr2=0x7f13740ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T11:12:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 -- 172.21.15.55:0/769732911 >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 msgr2=0x7f13740ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f1379d5f700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137a560700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137ad61700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137a560700 1 -- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 msgr2=0x7f1374159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137a560700 1 -- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 msgr2=0x7f1374159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137a560700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137a560700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137ad61700 1 -- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 msgr2=0x7f13740cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137ad61700 1 -- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 msgr2=0x7f13740cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137ad61700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T11:12:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.059+0000 7f137ad61700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.55:3300/0 conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f137a560700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f137ad61700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 -- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 msgr2=0x7f13740cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 -- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 msgr2=0x7f1374159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 -- 172.21.15.55:0/769732911 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137415a670 con 0x7f137415a160 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f1379d5f700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137415a160 0x7f13740ccdc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f137408ab60 tx=0x7f1364008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de235543cadbe601 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f137955e700 1 -- 172.21.15.55:0/769732911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364013410 con 0x7f137415a160 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f137955e700 1 -- 172.21.15.55:0/769732911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364013570 con 0x7f137415a160 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.260+0000 7f137955e700 1 -- 172.21.15.55:0/769732911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364013970 con 0x7f137415a160 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 -- 172.21.15.55:0/769732911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137415a160 msgr2=0x7f13740ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137415a160 0x7f13740ccdc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f137408ab60 tx=0x7f1364008040 comp rx=0 tx=0).stop 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 -- 172.21.15.55:0/769732911 shutdown_connections 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f13740cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 --2- 172.21.15.55:0/769732911 >> v2:172.21.15.142:3300/0 conn(0x7f1374150940 0x7f1374159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 --2- 172.21.15.55:0/769732911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137415a160 0x7f13740ccdc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 -- 172.21.15.55:0/769732911 >> 172.21.15.55:0/769732911 conn(0x7f1374099700 msgr2=0x7f137406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 -- 172.21.15.55:0/769732911 shutdown_connections 2023-10-06T11:12:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.261+0000 7f137c7c4700 1 -- 172.21.15.55:0/769732911 wait complete. 2023-10-06T11:12:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.262+0000 7f137c7c4700 1 Processor -- start 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.262+0000 7f137c7c4700 1 -- start start 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137c7c4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f137415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137c7c4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f137415a160 0x7f137415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137c7c4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 0x7f13740b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137c7c4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137415dc20 con 0x7f13740b3250 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137c7c4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137415ea50 con 0x7f137415a160 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137c7c4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137414f5f0 con 0x7f13740c5250 2023-10-06T11:12:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 0x7f13740b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137a560700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f137415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 0x7f13740b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42854/0 (socket says 172.21.15.55:42854) 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 -- 172.21.15.55:0/1999390132 learned_addr learned my addr 172.21.15.55:0/1999390132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f1379d5f700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f137415a160 0x7f137415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 -- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 msgr2=0x7f137415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f137415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 -- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f137415a160 msgr2=0x7f137415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f137415a160 0x7f137415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 -- 172.21.15.55:0/1999390132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364009570 con 0x7f13740b3250 2023-10-06T11:12:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.263+0000 7f137ad61700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 0x7f13740b36f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f136c002330 tx=0x7f136c0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c014410 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c014570 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137414f0a0 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c014930 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137415e120 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f136c003040 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.264+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f136c01dc30 con 0x7f13740b3250 2023-10-06T11:12:47.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.265+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1374064a90 con 0x7f13740b3250 2023-10-06T11:12:47.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.267+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f136c014db0 con 0x7f13740b3250 2023-10-06T11:12:47.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.343+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f137404bb40 con 0x7f13740b3250 2023-10-06T11:12:47.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.353+0000 7f136a7fc700 1 -- 172.21.15.55:0/1999390132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f136c027440 con 0x7f13740b3250 2023-10-06T11:12:47.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 msgr2=0x7f13740b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 0x7f13740b36f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f136c002330 tx=0x7f136c0097c0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 shutdown_connections 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13740b3250 0x7f13740b36f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13740c5250 0x7f137415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 --2- 172.21.15.55:0/1999390132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f137415a160 0x7f137415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.354+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 >> 172.21.15.55:0/1999390132 conn(0x7f1374099700 msgr2=0x7f1374156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.355+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 shutdown_connections 2023-10-06T11:12:47.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:47.355+0000 7f137c7c4700 1 -- 172.21.15.55:0/1999390132 wait complete. 2023-10-06T11:12:47.358 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2023-10-06T11:12:47.368 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T11:12:47.368 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:47.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T11:12:47.393 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:47.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T11:12:47.459 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:47.459 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T11:12:47.524 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-10-06T11:12:47.525 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T11:12:47.589 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:47.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T11:12:47.614 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:47.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T11:12:47.678 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:47.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T11:12:47.743 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-10-06T11:12:47.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T11:12:47.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new e5cbdc97-a9f4-4743-8b21-390106fa48d3 0 2023-10-06T11:12:47.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.962+0000 7f7905549700 1 Processor -- start 2023-10-06T11:12:47.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.962+0000 7f7905549700 1 -- start start 2023-10-06T11:12:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f7905549700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 0x7f7900159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f7905549700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f790015a160 0x7f79000ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f7905549700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790015ac30 con 0x7f79000c5250 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f7905549700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79000cb6a0 con 0x7f790015a160 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f7905549700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000cb090 con 0x7f7900150940 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 0x7f7900159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 0x7f7900159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:37702/0 (socket says 172.21.15.142:37702) 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 -- 172.21.15.142:0/1391075131 learned_addr learned my addr 172.21.15.142:0/1391075131 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78fe7fc700 1 --2- 172.21.15.142:0/1391075131 >> v2:172.21.15.55:3300/0 conn(0x7f790015a160 0x7f79000ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 -- 172.21.15.142:0/1391075131 >> v2:172.21.15.55:3300/0 conn(0x7f790015a160 msgr2=0x7f79000ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 --2- 172.21.15.142:0/1391075131 >> v2:172.21.15.55:3300/0 conn(0x7f790015a160 0x7f79000ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 -- 172.21.15.142:0/1391075131 >> v1:172.21.15.55:6789/0 conn(0x7f79000c5250 legacy=0x7f79000b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 -- 172.21.15.142:0/1391075131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790015a670 con 0x7f7900150940 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78feffd700 1 --2- 172.21.15.142:0/1391075131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 0x7f7900159c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009990 tx=0x7f78f0009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af29eefd176d4cff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78fdffb700 1 -- 172.21.15.142:0/1391075131 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0009e80 con 0x7f7900150940 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78fdffb700 1 -- 172.21.15.142:0/1391075131 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0005c10 con 0x7f7900150940 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.963+0000 7f78fdffb700 1 -- 172.21.15.142:0/1391075131 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f000b650 con 0x7f7900150940 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 -- 172.21.15.142:0/1391075131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 msgr2=0x7f7900159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 --2- 172.21.15.142:0/1391075131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 0x7f7900159c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009990 tx=0x7f78f0009220 comp rx=0 tx=0).stop 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 -- 172.21.15.142:0/1391075131 shutdown_connections 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 --2- 172.21.15.142:0/1391075131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7900150940 0x7f7900159c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 --2- 172.21.15.142:0/1391075131 >> v2:172.21.15.55:3300/0 conn(0x7f790015a160 0x7f79000ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 -- 172.21.15.142:0/1391075131 >> 172.21.15.142:0/1391075131 conn(0x7f7900099700 msgr2=0x7f790006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 -- 172.21.15.142:0/1391075131 shutdown_connections 2023-10-06T11:12:47.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.964+0000 7f7905549700 1 -- 172.21.15.142:0/1391075131 wait complete. 2023-10-06T11:12:47.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.965+0000 7f7905549700 1 Processor -- start 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.965+0000 7f7905549700 1 -- start start 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f7905549700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 0x7f790014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f7905549700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a160 0x7f790016d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f7905549700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79000b5910 0x7f79000c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f7905549700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000c83a0 con 0x7f79000b5910 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f7905549700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000b6160 con 0x7f790015a160 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f7905549700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000b3580 con 0x7f79000c5250 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 0x7f790014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 0x7f790014d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:37710/0 (socket says 172.21.15.142:37710) 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 -- 172.21.15.142:0/2100837185 learned_addr learned my addr 172.21.15.142:0/2100837185 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:47.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78fe7fc700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a160 0x7f790016d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78ff7fe700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79000b5910 0x7f79000c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 -- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a160 msgr2=0x7f790016d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a160 0x7f790016d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 -- 172.21.15.142:0/2100837185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79000b5910 msgr2=0x7f79000c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.966+0000 7f78feffd700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79000b5910 0x7f79000c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78feffd700 1 -- 172.21.15.142:0/2100837185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0009480 con 0x7f79000c5250 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78feffd700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 0x7f790014d230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f78f0011750 tx=0x7f78f0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011970 con 0x7f79000c5250 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0020070 con 0x7f79000c5250 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79000c9460 con 0x7f79000c5250 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011d20 con 0x7f79000c5250 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79000b5e80 con 0x7f79000c5250 2023-10-06T11:12:47.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f78f0022030 con 0x7f79000c5250 2023-10-06T11:12:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.967+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f78f002e440 con 0x7f79000c5250 2023-10-06T11:12:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.968+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7900064a90 con 0x7f79000c5250 2023-10-06T11:12:47.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:47.970+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f78f0025aa0 con 0x7f79000c5250 2023-10-06T11:12:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.088+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5cbdc97-a9f4-4743-8b21-390106fa48d3", "id": 0} v 0) v1 -- 0x7f790004bb40 con 0x7f79000c5250 2023-10-06T11:12:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.101+0000 7f78e6ffd700 1 -- 172.21.15.142:0/2100837185 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5cbdc97-a9f4-4743-8b21-390106fa48d3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f78f0025c40 con 0x7f79000c5250 2023-10-06T11:12:48.103 INFO:teuthology.orchestra.run.smithi142.stdout:0 2023-10-06T11:12:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 msgr2=0x7f790014d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 0x7f790014d230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f78f0011750 tx=0x7f78f0016000 comp rx=0 tx=0).stop 2023-10-06T11:12:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 shutdown_connections 2023-10-06T11:12:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79000b5910 0x7f79000c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79000c5250 0x7f790014d230 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 --2- 172.21.15.142:0/2100837185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f790015a160 0x7f790016d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 >> 172.21.15.142:0/2100837185 conn(0x7f7900099700 msgr2=0x7f790014fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 shutdown_connections 2023-10-06T11:12:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.102+0000 7f7905549700 1 -- 172.21.15.142:0/2100837185 wait complete. 2023-10-06T11:12:48.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 2d5e909b-302b-4782-bcb2-a4ce4e9a9e85 1 2023-10-06T11:12:48.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.230+0000 7f65e2fe7700 1 Processor -- start 2023-10-06T11:12:48.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.230+0000 7f65e2fe7700 1 -- start start 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e2fe7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65dc0cd3c0 0x7f65dc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e2fe7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65dc0b29f0 0x7f65dc0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e2fe7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc0cc970 con 0x7f65dc0b2620 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e2fe7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc0cf520 con 0x7f65dc0cd3c0 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e2fe7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc0cbd60 con 0x7f65dc0b29f0 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e27e6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65dc0b29f0 0x7f65dc0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e27e6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65dc0b29f0 0x7f65dc0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50964/0 (socket says 172.21.15.142:50964) 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e27e6700 1 -- 172.21.15.142:0/3539009968 learned_addr learned my addr 172.21.15.142:0/3539009968 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.231+0000 7f65e17e4700 1 --2- 172.21.15.142:0/3539009968 >> v2:172.21.15.55:3300/0 conn(0x7f65dc0cd3c0 0x7f65dc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e27e6700 1 -- 172.21.15.142:0/3539009968 >> v2:172.21.15.55:3300/0 conn(0x7f65dc0cd3c0 msgr2=0x7f65dc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e27e6700 1 --2- 172.21.15.142:0/3539009968 >> v2:172.21.15.55:3300/0 conn(0x7f65dc0cd3c0 0x7f65dc0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e27e6700 1 -- 172.21.15.142:0/3539009968 >> v1:172.21.15.55:6789/0 conn(0x7f65dc0b2620 legacy=0x7f65dc0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e27e6700 1 -- 172.21.15.142:0/3539009968 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0cc040 con 0x7f65dc0b29f0 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e27e6700 1 --2- 172.21.15.142:0/3539009968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc0cefe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f65dc099b90 tx=0x7f65d4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a185e6c3b5cd71e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e0fe3700 1 -- 172.21.15.142:0/3539009968 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d400e070 con 0x7f65dc0b29f0 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e0fe3700 1 -- 172.21.15.142:0/3539009968 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d400ba20 con 0x7f65dc0b29f0 2023-10-06T11:12:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e0fe3700 1 -- 172.21.15.142:0/3539009968 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d40092e0 con 0x7f65dc0b29f0 2023-10-06T11:12:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3539009968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 msgr2=0x7f65dc0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.232+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3539009968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc0cefe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f65dc099b90 tx=0x7f65d4009840 comp rx=0 tx=0).stop 2023-10-06T11:12:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.233+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3539009968 shutdown_connections 2023-10-06T11:12:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.233+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3539009968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc0cefe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.233+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3539009968 >> v2:172.21.15.55:3300/0 conn(0x7f65dc0cd3c0 0x7f65dc0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.233+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3539009968 >> 172.21.15.142:0/3539009968 conn(0x7f65dc099520 msgr2=0x7f65dc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.233+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3539009968 shutdown_connections 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.233+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3539009968 wait complete. 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.234+0000 7f65e2fe7700 1 Processor -- start 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.234+0000 7f65e2fe7700 1 -- start start 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65dc0b2620 0x7f65dc150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65dc0cd3c0 0x7f65dc15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0b34d0 con 0x7f65dc0b2620 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc15c440 con 0x7f65dc0b29f0 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc156600 con 0x7f65dc0cd3c0 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50978/0 (socket says 172.21.15.142:50978) 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e27e6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65dc0cd3c0 0x7f65dc15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 -- 172.21.15.142:0/3411153866 learned_addr learned my addr 172.21.15.142:0/3411153866 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e1fe5700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65dc0b2620 0x7f65dc150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 -- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65dc0cd3c0 msgr2=0x7f65dc15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65dc0cd3c0 0x7f65dc15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 -- 172.21.15.142:0/3411153866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65dc0b2620 msgr2=0x7f65dc150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65dc0b2620 0x7f65dc150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 -- 172.21.15.142:0/3411153866 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4009ae0 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e17e4700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc15b9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65d800ec50 tx=0x7f65d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800c850 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d800c9b0 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc0b36e0 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.235+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800cd70 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.236+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc0b3ca0 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.236+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f65d8005c80 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.236+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f65d8006020 con 0x7f65dc0b29f0 2023-10-06T11:12:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.236+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc0b4010 con 0x7f65dc0b29f0 2023-10-06T11:12:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.239+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f65d8021060 con 0x7f65dc0b29f0 2023-10-06T11:12:48.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.322+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d5e909b-302b-4782-bcb2-a4ce4e9a9e85", "id": 1} v 0) v1 -- 0x7f65dc05f230 con 0x7f65dc0b29f0 2023-10-06T11:12:48.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.327+0000 7f65d1ffb700 1 -- 172.21.15.142:0/3411153866 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d5e909b-302b-4782-bcb2-a4ce4e9a9e85", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f65d8017070 con 0x7f65dc0b29f0 2023-10-06T11:12:48.329 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 msgr2=0x7f65dc15b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc15b9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65d800ec50 tx=0x7f65d80091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 shutdown_connections 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65dc0b2620 0x7f65dc150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65dc0cd3c0 0x7f65dc15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 --2- 172.21.15.142:0/3411153866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65dc0b29f0 0x7f65dc15b9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 >> 172.21.15.142:0/3411153866 conn(0x7f65dc099520 msgr2=0x7f65dc157940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 shutdown_connections 2023-10-06T11:12:48.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.328+0000 7f65e2fe7700 1 -- 172.21.15.142:0/3411153866 wait complete. 2023-10-06T11:12:48.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7c514074-b72a-4b8e-83c3-8e7259e95180 2 2023-10-06T11:12:48.452 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:48.450+0000 7f62656fa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T11:12:48.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.456+0000 7f0f5a680700 1 Processor -- start 2023-10-06T11:12:48.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.456+0000 7f0f5a680700 1 -- start start 2023-10-06T11:12:48.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f5a680700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f54150940 0x7f0f54159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f5a680700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f540cd4d0 0x7f0f540b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f5a680700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5415ac30 con 0x7f0f5415a160 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f5a680700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540cb6a0 con 0x7f0f54150940 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f5a680700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540cb090 con 0x7f0f540cd4d0 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f58c1d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f540cd4d0 0x7f0f540b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f58c1d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f540cd4d0 0x7f0f540b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50982/0 (socket says 172.21.15.142:50982) 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f58c1d700 1 -- 172.21.15.142:0/2487357717 learned_addr learned my addr 172.21.15.142:0/2487357717 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.457+0000 7f0f53fff700 1 --2- 172.21.15.142:0/2487357717 >> v2:172.21.15.55:3300/0 conn(0x7f0f54150940 0x7f0f54159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f58c1d700 1 -- 172.21.15.142:0/2487357717 >> v2:172.21.15.55:3300/0 conn(0x7f0f54150940 msgr2=0x7f0f54159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f58c1d700 1 --2- 172.21.15.142:0/2487357717 >> v2:172.21.15.55:3300/0 conn(0x7f0f54150940 0x7f0f54159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f58c1d700 1 -- 172.21.15.142:0/2487357717 >> v1:172.21.15.55:6789/0 conn(0x7f0f5415a160 legacy=0x7f0f540ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f58c1d700 1 -- 172.21.15.142:0/2487357717 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5415a670 con 0x7f0f540cd4d0 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f58c1d700 1 --2- 172.21.15.142:0/2487357717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540b2050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f540d0460 tx=0x7f0f4c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c472b54f7e819f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f52ffd700 1 -- 172.21.15.142:0/2487357717 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00e070 con 0x7f0f540cd4d0 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f52ffd700 1 -- 172.21.15.142:0/2487357717 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00ba20 con 0x7f0f540cd4d0 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f52ffd700 1 -- 172.21.15.142:0/2487357717 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0092e0 con 0x7f0f540cd4d0 2023-10-06T11:12:48.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f5a680700 1 -- 172.21.15.142:0/2487357717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 msgr2=0x7f0f540b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.458+0000 7f0f5a680700 1 --2- 172.21.15.142:0/2487357717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540b2050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f540d0460 tx=0x7f0f4c009840 comp rx=0 tx=0).stop 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.459+0000 7f0f5a680700 1 -- 172.21.15.142:0/2487357717 shutdown_connections 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.459+0000 7f0f5a680700 1 --2- 172.21.15.142:0/2487357717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540b2050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.459+0000 7f0f5a680700 1 --2- 172.21.15.142:0/2487357717 >> v2:172.21.15.55:3300/0 conn(0x7f0f54150940 0x7f0f54159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.459+0000 7f0f5a680700 1 -- 172.21.15.142:0/2487357717 >> 172.21.15.142:0/2487357717 conn(0x7f0f54099700 msgr2=0x7f0f5406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.459+0000 7f0f5a680700 1 -- 172.21.15.142:0/2487357717 shutdown_connections 2023-10-06T11:12:48.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.459+0000 7f0f5a680700 1 -- 172.21.15.142:0/2487357717 wait complete. 2023-10-06T11:12:48.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 Processor -- start 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 -- start start 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5415a160 0x7f0f54154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f54169cd0 0x7f0f540c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5416d2d0 con 0x7f0f5415a160 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.460+0000 7f0f5a680700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5416a1b0 con 0x7f0f540cd4d0 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f5a680700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5416a490 con 0x7f0f54169cd0 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f53fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f54169cd0 0x7f0f540c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f53fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50998/0 (socket says 172.21.15.142:50998) 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f53fff700 1 -- 172.21.15.142:0/1935465402 learned_addr learned my addr 172.21.15.142:0/1935465402 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f537fe700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5415a160 0x7f0f54154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 -- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 msgr2=0x7f0f540c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 -- 172.21.15.142:0/1935465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5415a160 msgr2=0x7f0f54154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5415a160 0x7f0f54154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 -- 172.21.15.142:0/1935465402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009ae0 con 0x7f0f54169cd0 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f53fff700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f537fe700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5415a160 0x7f0f54154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f58c1d700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f54169cd0 0x7f0f540c5250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c015000 tx=0x7f0f4c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c008a80 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c008c20 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c026460 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5416a770 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540c9c80 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0f4c003040 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.461+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0f4c026810 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.462+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5416ac10 con 0x7f0f54169cd0 2023-10-06T11:12:48.468 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:48.463+0000 7fe5e17b4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T11:12:48.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.464+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0f4c02b020 con 0x7f0f54169cd0 2023-10-06T11:12:48.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.546+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7c514074-b72a-4b8e-83c3-8e7259e95180", "id": 2} v 0) v1 -- 0x7f0f5416a5d0 con 0x7f0f54169cd0 2023-10-06T11:12:48.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.551+0000 7f0f3bfff700 1 -- 172.21.15.142:0/1935465402 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c514074-b72a-4b8e-83c3-8e7259e95180", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0f5416a5d0 con 0x7f0f54169cd0 2023-10-06T11:12:48.553 INFO:teuthology.orchestra.run.smithi142.stdout:2 2023-10-06T11:12:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f54169cd0 msgr2=0x7f0f540c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f54169cd0 0x7f0f540c5250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c015000 tx=0x7f0f4c018000 comp rx=0 tx=0).stop 2023-10-06T11:12:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 shutdown_connections 2023-10-06T11:12:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f54169cd0 0x7f0f540c5250 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f540cd4d0 0x7f0f540c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 --2- 172.21.15.142:0/1935465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5415a160 0x7f0f54154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 >> 172.21.15.142:0/1935465402 conn(0x7f0f54099700 msgr2=0x7f0f540cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 shutdown_connections 2023-10-06T11:12:48.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.552+0000 7f0f5a680700 1 -- 172.21.15.142:0/1935465402 wait complete. 2023-10-06T11:12:48.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 97f9cb9a-2dec-48d3-8d46-2ec0e86661f7 3 2023-10-06T11:12:48.590 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:48.589+0000 7f62656fa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T11:12:48.605 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:48.603+0000 7fe5e17b4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T11:12:48.669 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:48.668+0000 7f62656fa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T11:12:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.680+0000 7f3a49cf3700 1 Processor -- start 2023-10-06T11:12:48.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.680+0000 7f3a49cf3700 1 -- start start 2023-10-06T11:12:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a49cf3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a4406d670 0x7f3a4415dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a49cf3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 0x7f3a440b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a49cf3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4415ab50 con 0x7f3a4406ce10 2023-10-06T11:12:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a49cf3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4415d650 con 0x7f3a4406d670 2023-10-06T11:12:48.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a49cf3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4415a590 con 0x7f3a4406da40 2023-10-06T11:12:48.684 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:48.681+0000 7fe5e17b4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T11:12:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 0x7f3a440b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a437fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a4406d670 0x7f3a4415dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 0x7f3a440b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:37738/0 (socket says 172.21.15.142:37738) 2023-10-06T11:12:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a437fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a4406d670 0x7f3a4415dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51014/0 (socket says 172.21.15.142:51014) 2023-10-06T11:12:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.681+0000 7f3a43fff700 1 -- 172.21.15.142:0/559292402 learned_addr learned my addr 172.21.15.142:0/559292402 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a43fff700 1 -- 172.21.15.142:0/559292402 >> v2:172.21.15.142:3300/0 conn(0x7f3a4406d670 msgr2=0x7f3a4415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a43fff700 1 --2- 172.21.15.142:0/559292402 >> v2:172.21.15.142:3300/0 conn(0x7f3a4406d670 0x7f3a4415dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a43fff700 1 -- 172.21.15.142:0/559292402 >> v1:172.21.15.142:6789/0 conn(0x7f3a4406ce10 legacy=0x7f3a44159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a43fff700 1 -- 172.21.15.142:0/559292402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4415a870 con 0x7f3a4406da40 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a43fff700 1 --2- 172.21.15.142:0/559292402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 0x7f3a440b1080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009f50 tx=0x7f3a3c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd8aad1ec0b34eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a42ffd700 1 -- 172.21.15.142:0/559292402 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00e070 con 0x7f3a4406da40 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a42ffd700 1 -- 172.21.15.142:0/559292402 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00b9c0 con 0x7f3a4406da40 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.682+0000 7f3a42ffd700 1 -- 172.21.15.142:0/559292402 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0092e0 con 0x7f3a4406da40 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 -- 172.21.15.142:0/559292402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 msgr2=0x7f3a440b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/559292402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 0x7f3a440b1080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009f50 tx=0x7f3a3c009840 comp rx=0 tx=0).stop 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 -- 172.21.15.142:0/559292402 shutdown_connections 2023-10-06T11:12:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/559292402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406da40 0x7f3a440b1080 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/559292402 >> v2:172.21.15.142:3300/0 conn(0x7f3a4406d670 0x7f3a4415dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 -- 172.21.15.142:0/559292402 >> 172.21.15.142:0/559292402 conn(0x7f3a4406b600 msgr2=0x7f3a4406ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 -- 172.21.15.142:0/559292402 shutdown_connections 2023-10-06T11:12:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.683+0000 7f3a49cf3700 1 -- 172.21.15.142:0/559292402 wait complete. 2023-10-06T11:12:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.684+0000 7f3a49cf3700 1 Processor -- start 2023-10-06T11:12:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.684+0000 7f3a49cf3700 1 -- start start 2023-10-06T11:12:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.684+0000 7f3a49cf3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 0x7f3a4416d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.684+0000 7f3a49cf3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4406da40 0x7f3a44148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a49cf3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a44148cc0 0x7f3a4414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a49cf3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440aded0 con 0x7f3a4406da40 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a49cf3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4416ded0 con 0x7f3a44148cc0 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a49cf3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4414b420 con 0x7f3a4406d670 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a437fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 0x7f3a4416d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a44148cc0 0x7f3a4414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a437fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 0x7f3a4416d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:37750/0 (socket says 172.21.15.142:37750) 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a437fe700 1 -- 172.21.15.142:0/2105321137 learned_addr learned my addr 172.21.15.142:0/2105321137 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3bfff700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4406da40 0x7f3a44148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 -- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 msgr2=0x7f3a4416d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 0x7f3a4416d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 -- 172.21.15.142:0/2105321137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4406da40 msgr2=0x7f3a44148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4406da40 0x7f3a44148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 -- 172.21.15.142:0/2105321137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009ae0 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a437fe700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 0x7f3a4416d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3bfff700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4406da40 0x7f3a44148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a43fff700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a44148cc0 0x7f3a4414b8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c015000 tx=0x7f3a3c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c008c50 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c008db0 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a44148a90 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0256b0 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4414aaf0 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3a3c003040 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.685+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f3a3c01c8b0 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.686+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a44064a90 con 0x7f3a44148cc0 2023-10-06T11:12:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.688+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3a3c020070 con 0x7f3a44148cc0 2023-10-06T11:12:48.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.772+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97f9cb9a-2dec-48d3-8d46-2ec0e86661f7", "id": 3} v 0) v1 -- 0x7f3a4414b560 con 0x7f3a44148cc0 2023-10-06T11:12:48.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.778+0000 7f3a3b7fe700 1 -- 172.21.15.142:0/2105321137 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97f9cb9a-2dec-48d3-8d46-2ec0e86661f7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a3c025a60 con 0x7f3a44148cc0 2023-10-06T11:12:48.780 INFO:teuthology.orchestra.run.smithi142.stdout:3 2023-10-06T11:12:48.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a44148cc0 msgr2=0x7f3a4414b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a44148cc0 0x7f3a4414b8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c015000 tx=0x7f3a3c018000 comp rx=0 tx=0).stop 2023-10-06T11:12:48.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 shutdown_connections 2023-10-06T11:12:48.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a44148cc0 0x7f3a4414b8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4406d670 0x7f3a4416d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 --2- 172.21.15.142:0/2105321137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4406da40 0x7f3a44148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 >> 172.21.15.142:0/2105321137 conn(0x7f3a4406b600 msgr2=0x7f3a44157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 shutdown_connections 2023-10-06T11:12:48.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.779+0000 7f3a49cf3700 1 -- 172.21.15.142:0/2105321137 wait complete. 2023-10-06T11:12:48.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7a3da0b5-7c0e-4a44-bee4-6164f3010296 4 2023-10-06T11:12:48.861 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:48.859+0000 7f62656fa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:12:48.876 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:48.874+0000 7fe5e17b4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:12:48.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.946+0000 7fa0bacc9700 1 Processor -- start 2023-10-06T11:12:48.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.946+0000 7fa0bacc9700 1 -- start start 2023-10-06T11:12:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0bacc9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 0x7fa0b406b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0bacc9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 0x7fa0b406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0bacc9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b415d130 con 0x7fa0b4159ea0 2023-10-06T11:12:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0bacc9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b415d380 con 0x7fa0b406a050 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0bacc9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b415d660 con 0x7fa0b406a420 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0b8a65700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 0x7fa0b406b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0b3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 0x7fa0b406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0b8a65700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 0x7fa0b406b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51028/0 (socket says 172.21.15.142:51028) 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0b3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 0x7fa0b406bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:37754/0 (socket says 172.21.15.142:37754) 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.947+0000 7fa0b8a65700 1 -- 172.21.15.142:0/3174583926 learned_addr learned my addr 172.21.15.142:0/3174583926 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b3fff700 1 -- 172.21.15.142:0/3174583926 >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 msgr2=0x7fa0b406b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b3fff700 1 --2- 172.21.15.142:0/3174583926 >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 0x7fa0b406b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b3fff700 1 -- 172.21.15.142:0/3174583926 >> v1:172.21.15.55:6789/0 conn(0x7fa0b4159ea0 legacy=0x7fa0b415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b3fff700 1 -- 172.21.15.142:0/3174583926 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b415d940 con 0x7fa0b406a420 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b8a65700 1 --2- 172.21.15.142:0/3174583926 >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 0x7fa0b406b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b3fff700 1 --2- 172.21.15.142:0/3174583926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 0x7fa0b406bde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00098e0 tx=0x7fa0a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7f9d3d4a5bb43a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b37fe700 1 -- 172.21.15.142:0/3174583926 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000b640 con 0x7fa0b406a420 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b37fe700 1 -- 172.21.15.142:0/3174583926 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a000b7a0 con 0x7fa0b406a420 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.948+0000 7fa0b37fe700 1 -- 172.21.15.142:0/3174583926 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000bb40 con 0x7fa0b406a420 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 -- 172.21.15.142:0/3174583926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 msgr2=0x7fa0b406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/3174583926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 0x7fa0b406bde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00098e0 tx=0x7fa0a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 -- 172.21.15.142:0/3174583926 shutdown_connections 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/3174583926 >> v2:172.21.15.142:3300/0 conn(0x7fa0b406a050 0x7fa0b406b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/3174583926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b406a420 0x7fa0b406bde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 -- 172.21.15.142:0/3174583926 >> 172.21.15.142:0/3174583926 conn(0x7fa0b40ce2f0 msgr2=0x7fa0b40ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 -- 172.21.15.142:0/3174583926 shutdown_connections 2023-10-06T11:12:48.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.949+0000 7fa0bacc9700 1 -- 172.21.15.142:0/3174583926 wait complete. 2023-10-06T11:12:48.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.950+0000 7fa0bacc9700 1 Processor -- start 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.950+0000 7fa0bacc9700 1 -- start start 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b406a050 0x7fa0b414a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 0x7fa0b406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b4159ea0 0x7fa0b406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40c5dd0 con 0x7fa0b406a050 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40b2070 con 0x7fa0b406a420 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40b2350 con 0x7fa0b4159ea0 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 0x7fa0b406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 0x7fa0b406ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51034/0 (socket says 172.21.15.142:51034) 2023-10-06T11:12:48.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b9266700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b4159ea0 0x7fa0b406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 -- 172.21.15.142:0/4190097658 learned_addr learned my addr 172.21.15.142:0/4190097658 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b8a65700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b406a050 0x7fa0b414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 -- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b4159ea0 msgr2=0x7fa0b406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b4159ea0 0x7fa0b406d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 -- 172.21.15.142:0/4190097658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b406a050 msgr2=0x7fa0b414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b406a050 0x7fa0b414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 -- 172.21.15.142:0/4190097658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a80094f0 con 0x7fa0b406a420 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b9266700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b4159ea0 0x7fa0b406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b3fff700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 0x7fa0b406ce70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00093f0 tx=0x7fa0a0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a001f070 con 0x7fa0b406a420 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a001a910 con 0x7fa0b406a420 2023-10-06T11:12:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a0009420 con 0x7fa0b406a420 2023-10-06T11:12:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a001ad10 con 0x7fa0b406a420 2023-10-06T11:12:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.951+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b40b2910 con 0x7fa0b406a420 2023-10-06T11:12:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.952+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa0a0023070 con 0x7fa0b406a420 2023-10-06T11:12:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.952+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa0a0011930 con 0x7fa0b406a420 2023-10-06T11:12:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.953+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b4064a90 con 0x7fa0b406a420 2023-10-06T11:12:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:48.955+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa0a002a070 con 0x7fa0b406a420 2023-10-06T11:12:49.042 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:49.039+0000 7f62656fa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T11:12:49.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.038+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a3da0b5-7c0e-4a44-bee4-6164f3010296", "id": 4} v 0) v1 -- 0x7fa0b415dc20 con 0x7fa0b406a420 2023-10-06T11:12:49.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.044+0000 7fa0b0ff9700 1 -- 172.21.15.142:0/4190097658 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a3da0b5-7c0e-4a44-bee4-6164f3010296", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0a0015020 con 0x7fa0b406a420 2023-10-06T11:12:49.046 INFO:teuthology.orchestra.run.smithi142.stdout:4 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 msgr2=0x7fa0b406ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 0x7fa0b406ce70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00093f0 tx=0x7fa0a0017000 comp rx=0 tx=0).stop 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 shutdown_connections 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0b406a050 0x7fa0b414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0b4159ea0 0x7fa0b406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 --2- 172.21.15.142:0/4190097658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0b406a420 0x7fa0b406ce70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 >> 172.21.15.142:0/4190097658 conn(0x7fa0b40ce2f0 msgr2=0x7fa0b4156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 shutdown_connections 2023-10-06T11:12:49.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.046+0000 7fa0bacc9700 1 -- 172.21.15.142:0/4190097658 wait complete. 2023-10-06T11:12:49.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 829cdebd-73f9-4b35-970f-9db061d86f9f 5 2023-10-06T11:12:49.064 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:49.061+0000 7fe5e17b4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T11:12:49.121 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:49.120+0000 7f62656fa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T11:12:49.143 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:49.142+0000 7fe5e17b4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T11:12:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.229+0000 7fe020ced700 1 Processor -- start 2023-10-06T11:12:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.229+0000 7fe020ced700 1 -- start start 2023-10-06T11:12:49.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe020ced700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 0x7fe01c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe020ced700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe01c15a160 0x7fe01c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe020ced700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c15ac30 con 0x7fe01c0c5250 2023-10-06T11:12:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe020ced700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0cb6a0 con 0x7fe01c15a160 2023-10-06T11:12:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe020ced700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0cb090 con 0x7fe01c150940 2023-10-06T11:12:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe01a59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 0x7fe01c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe01c15a160 0x7fe01c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe01c15a160 0x7fe01c0ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46322/0 (socket says 172.21.15.142:46322) 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe01a59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 0x7fe01c159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:48600/0 (socket says 172.21.15.142:48600) 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 -- 172.21.15.142:0/713067265 learned_addr learned my addr 172.21.15.142:0/713067265 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 -- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 msgr2=0x7fe01c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 --2- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 0x7fe01c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 -- 172.21.15.142:0/713067265 >> v1:172.21.15.55:6789/0 conn(0x7fe01c0c5250 legacy=0x7fe01c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 -- 172.21.15.142:0/713067265 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c15a670 con 0x7fe01c15a160 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe01a59c700 1 --2- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 0x7fe01c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.230+0000 7fe019d9b700 1 --2- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c0ccdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe010009f20 tx=0x7fe010009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=184ee65566acafcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe01959a700 1 -- 172.21.15.142:0/713067265 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01000e070 con 0x7fe01c15a160 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe01959a700 1 -- 172.21.15.142:0/713067265 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01000b9d0 con 0x7fe01c15a160 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe01959a700 1 -- 172.21.15.142:0/713067265 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100092e0 con 0x7fe01c15a160 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 -- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 msgr2=0x7fe01c0ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 --2- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c0ccdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe010009f20 tx=0x7fe010009840 comp rx=0 tx=0).stop 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 -- 172.21.15.142:0/713067265 shutdown_connections 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 --2- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c150940 0x7fe01c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 --2- 172.21.15.142:0/713067265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c0ccdc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 -- 172.21.15.142:0/713067265 >> 172.21.15.142:0/713067265 conn(0x7fe01c099700 msgr2=0x7fe01c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 -- 172.21.15.142:0/713067265 shutdown_connections 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.231+0000 7fe020ced700 1 -- 172.21.15.142:0/713067265 wait complete. 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.232+0000 7fe020ced700 1 Processor -- start 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.232+0000 7fe020ced700 1 -- start start 2023-10-06T11:12:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe020ced700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe01c0c5250 0x7fe01c14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe020ced700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe020ced700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c1523e0 0x7fe01c1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe020ced700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c153490 con 0x7fe01c0c5250 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe020ced700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c152880 con 0x7fe01c15a160 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe020ced700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c152b60 con 0x7fe01c1523e0 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46332/0 (socket says 172.21.15.142:46332) 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 -- 172.21.15.142:0/4159948767 learned_addr learned my addr 172.21.15.142:0/4159948767 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe01ad9d700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c1523e0 0x7fe01c1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe01a59c700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe01c0c5250 0x7fe01c14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 -- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c1523e0 msgr2=0x7fe01c1542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c1523e0 0x7fe01c1542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 -- 172.21.15.142:0/4159948767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe01c0c5250 msgr2=0x7fe01c14e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe01c0c5250 0x7fe01c14e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.233+0000 7fe019d9b700 1 -- 172.21.15.142:0/4159948767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140093c0 con 0x7fe01c15a160 2023-10-06T11:12:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe019d9b700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c151ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0d14c0 tx=0x7fe010018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100078e0 con 0x7fe01c15a160 2023-10-06T11:12:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010007a80 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010009ae0 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010007e40 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c153120 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe010003040 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.234+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fe010028460 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.235+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c153600 con 0x7fe01c15a160 2023-10-06T11:12:49.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.237+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe01001d630 con 0x7fe01c15a160 2023-10-06T11:12:49.261 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:49.260+0000 7f62656fa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T11:12:49.290 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:49.288+0000 7fe5e17b4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T11:12:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.321+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "829cdebd-73f9-4b35-970f-9db061d86f9f", "id": 5} v 0) v1 -- 0x7fe01c064a90 con 0x7fe01c15a160 2023-10-06T11:12:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.324+0000 7fe00a7fc700 1 -- 172.21.15.142:0/4159948767 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "829cdebd-73f9-4b35-970f-9db061d86f9f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe01001da40 con 0x7fe01c15a160 2023-10-06T11:12:49.326 INFO:teuthology.orchestra.run.smithi142.stdout:5 2023-10-06T11:12:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 msgr2=0x7fe01c151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c151ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0d14c0 tx=0x7fe010018000 comp rx=0 tx=0).stop 2023-10-06T11:12:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 shutdown_connections 2023-10-06T11:12:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe01c0c5250 0x7fe01c14e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe01c1523e0 0x7fe01c1542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 --2- 172.21.15.142:0/4159948767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01c15a160 0x7fe01c151ea0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 >> 172.21.15.142:0/4159948767 conn(0x7fe01c099700 msgr2=0x7fe01c159850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.325+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 shutdown_connections 2023-10-06T11:12:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.326+0000 7fe020ced700 1 -- 172.21.15.142:0/4159948767 wait complete. 2023-10-06T11:12:49.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new d1735cdc-48e1-46a8-b607-092577a501bd 6 2023-10-06T11:12:49.361 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:49.360+0000 7f62656fa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T11:12:49.388 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:49.386+0000 7fe5e17b4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T11:12:49.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.493+0000 7f911c281700 1 Processor -- start 2023-10-06T11:12:49.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.493+0000 7f911c281700 1 -- start start 2023-10-06T11:12:49.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911c281700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9114150940 0x7f9114159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911c281700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91140cd4d0 0x7f91140b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911c281700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911415ac30 con 0x7f911415a160 2023-10-06T11:12:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911c281700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140cb6a0 con 0x7f9114150940 2023-10-06T11:12:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911c281700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140cb090 con 0x7f91140cd4d0 2023-10-06T11:12:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91140cd4d0 0x7f91140b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91140cd4d0 0x7f91140b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46346/0 (socket says 172.21.15.142:46346) 2023-10-06T11:12:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 -- 172.21.15.142:0/3072017561 learned_addr learned my addr 172.21.15.142:0/3072017561 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 -- 172.21.15.142:0/3072017561 >> v2:172.21.15.55:3300/0 conn(0x7f9114150940 msgr2=0x7f9114159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 --2- 172.21.15.142:0/3072017561 >> v2:172.21.15.55:3300/0 conn(0x7f9114150940 0x7f9114159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 -- 172.21.15.142:0/3072017561 >> v1:172.21.15.55:6789/0 conn(0x7f911415a160 legacy=0x7f91140ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 -- 172.21.15.142:0/3072017561 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911415a670 con 0x7f91140cd4d0 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911a81e700 1 --2- 172.21.15.142:0/3072017561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140b2050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f91140d0460 tx=0x7f910c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8f342d4b187bf99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.495+0000 7f911901b700 1 -- 172.21.15.142:0/3072017561 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00e070 con 0x7f91140cd4d0 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911901b700 1 -- 172.21.15.142:0/3072017561 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c00ba10 con 0x7f91140cd4d0 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911901b700 1 -- 172.21.15.142:0/3072017561 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0092e0 con 0x7f91140cd4d0 2023-10-06T11:12:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 -- 172.21.15.142:0/3072017561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 msgr2=0x7f91140b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 --2- 172.21.15.142:0/3072017561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140b2050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f91140d0460 tx=0x7f910c009840 comp rx=0 tx=0).stop 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 -- 172.21.15.142:0/3072017561 shutdown_connections 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 --2- 172.21.15.142:0/3072017561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140b2050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 --2- 172.21.15.142:0/3072017561 >> v2:172.21.15.55:3300/0 conn(0x7f9114150940 0x7f9114159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 -- 172.21.15.142:0/3072017561 >> 172.21.15.142:0/3072017561 conn(0x7f9114099700 msgr2=0x7f911406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 -- 172.21.15.142:0/3072017561 shutdown_connections 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.496+0000 7f911c281700 1 -- 172.21.15.142:0/3072017561 wait complete. 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.498+0000 7f911c281700 1 Processor -- start 2023-10-06T11:12:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.498+0000 7f911c281700 1 -- start start 2023-10-06T11:12:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.499+0000 7f911c281700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.499+0000 7f911c281700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f911415a160 0x7f9114152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.499+0000 7f911c281700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91141530a0 0x7f9114158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.499+0000 7f911c281700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911416de40 con 0x7f91141530a0 2023-10-06T11:12:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.499+0000 7f911c281700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114150370 con 0x7f91140cd4d0 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.499+0000 7f911c281700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911416d230 con 0x7f911415a160 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911a01d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f911415a160 0x7f9114152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911a01d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46358/0 (socket says 172.21.15.142:46358) 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911a01d700 1 -- 172.21.15.142:0/2274263825 learned_addr learned my addr 172.21.15.142:0/2274263825 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911a81e700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91141530a0 0x7f9114158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 -- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 msgr2=0x7f91140ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 -- 172.21.15.142:0/2274263825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91141530a0 msgr2=0x7f9114158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91141530a0 0x7f9114158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 -- 172.21.15.142:0/2274263825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c009ae0 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911a01d700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911981c700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f911415a160 0x7f9114152b60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f911000b490 tx=0x7f9110009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000be40 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000f510 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911416d510 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000f8d0 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911416dad0 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f911000fc80 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.500+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f911001aa40 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.501+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911416dfb0 con 0x7f911415a160 2023-10-06T11:12:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.504+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f911001a450 con 0x7f911415a160 2023-10-06T11:12:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.585+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1735cdc-48e1-46a8-b607-092577a501bd", "id": 6} v 0) v1 -- 0x7f9114064a90 con 0x7f911415a160 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.593+0000 7f910a7fc700 1 -- 172.21.15.142:0/2274263825 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1735cdc-48e1-46a8-b607-092577a501bd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f91100290b0 con 0x7f911415a160 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi142.stdout:6 2023-10-06T11:12:49.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f911415a160 msgr2=0x7f9114152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f911415a160 0x7f9114152b60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f911000b490 tx=0x7f9110009060 comp rx=0 tx=0).stop 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 shutdown_connections 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91141530a0 0x7f9114158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91140cd4d0 0x7f91140ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 --2- 172.21.15.142:0/2274263825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f911415a160 0x7f9114152b60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 >> 172.21.15.142:0/2274263825 conn(0x7f9114099700 msgr2=0x7f91140cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 shutdown_connections 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.594+0000 7f911c281700 1 -- 172.21.15.142:0/2274263825 wait complete. 2023-10-06T11:12:49.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae 7 2023-10-06T11:12:49.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.765+0000 7f383d909700 1 Processor -- start 2023-10-06T11:12:49.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.765+0000 7f383d909700 1 -- start start 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383d909700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38380cd3c0 0x7f38380ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383d909700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38380b29f0 0x7f38380cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383d909700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380cc970 con 0x7f38380b2620 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383d909700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380cf520 con 0x7f38380b29f0 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383d909700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380cbd60 con 0x7f38380cd3c0 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38380cd3c0 0x7f38380ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38380cd3c0 0x7f38380ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46372/0 (socket says 172.21.15.142:46372) 2023-10-06T11:12:49.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 -- 172.21.15.142:0/1139416739 learned_addr learned my addr 172.21.15.142:0/1139416739 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:49.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383c907700 1 --1- 172.21.15.142:0/1139416739 >> v1:172.21.15.142:6789/0 conn(0x7f38380b2620 0x7f38380cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:57548/0 (socket says 172.21.15.142:57548) 2023-10-06T11:12:49.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f383d108700 1 --2- 172.21.15.142:0/1139416739 >> v2:172.21.15.55:3300/0 conn(0x7f38380b29f0 0x7f38380cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 -- 172.21.15.142:0/1139416739 >> v2:172.21.15.55:3300/0 conn(0x7f38380b29f0 msgr2=0x7f38380cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 --2- 172.21.15.142:0/1139416739 >> v2:172.21.15.55:3300/0 conn(0x7f38380b29f0 0x7f38380cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 -- 172.21.15.142:0/1139416739 >> v1:172.21.15.142:6789/0 conn(0x7f38380b2620 legacy=0x7f38380cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.766+0000 7f3837fff700 1 -- 172.21.15.142:0/1139416739 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380cc040 con 0x7f38380cd3c0 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f3837fff700 1 --2- 172.21.15.142:0/1139416739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380cd3c0 0x7f38380ceaa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f38380b62d0 tx=0x7f3824009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b2a70f7f215e9fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f38377fe700 1 -- 172.21.15.142:0/1139416739 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824009e70 con 0x7f38380cd3c0 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f38377fe700 1 -- 172.21.15.142:0/1139416739 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382400b860 con 0x7f38380cd3c0 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f38377fe700 1 -- 172.21.15.142:0/1139416739 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400bc00 con 0x7f38380cd3c0 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 -- 172.21.15.142:0/1139416739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380cd3c0 msgr2=0x7f38380ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 --2- 172.21.15.142:0/1139416739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380cd3c0 0x7f38380ceaa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f38380b62d0 tx=0x7f3824009250 comp rx=0 tx=0).stop 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 -- 172.21.15.142:0/1139416739 shutdown_connections 2023-10-06T11:12:49.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 --2- 172.21.15.142:0/1139416739 >> v2:172.21.15.55:3300/0 conn(0x7f38380b29f0 0x7f38380cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 --2- 172.21.15.142:0/1139416739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380cd3c0 0x7f38380ceaa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 -- 172.21.15.142:0/1139416739 >> 172.21.15.142:0/1139416739 conn(0x7f3838099520 msgr2=0x7f383806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 -- 172.21.15.142:0/1139416739 shutdown_connections 2023-10-06T11:12:49.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.767+0000 7f383d909700 1 -- 172.21.15.142:0/1139416739 wait complete. 2023-10-06T11:12:49.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.768+0000 7f383d909700 1 Processor -- start 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 -- start start 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38380b2620 0x7f3838169800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 0x7f383815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 0x7f383815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38380c8cd0 con 0x7f38380b2620 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383815c010 con 0x7f38380b29f0 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d909700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380c8680 con 0x7f38380cd3c0 2023-10-06T11:12:49.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d108700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 0x7f383815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f3837fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 0x7f383815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f3837fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 0x7f383815b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46384/0 (socket says 172.21.15.142:46384) 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f383d108700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 0x7f383815b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:48624/0 (socket says 172.21.15.142:48624) 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.769+0000 7f3837fff700 1 -- 172.21.15.142:0/3978061534 learned_addr learned my addr 172.21.15.142:0/3978061534 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f383c907700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38380b2620 0x7f3838169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3837fff700 1 -- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 msgr2=0x7f383815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3837fff700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 0x7f383815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3837fff700 1 -- 172.21.15.142:0/3978061534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38380b2620 msgr2=0x7f3838169800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3837fff700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38380b2620 0x7f3838169800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3837fff700 1 -- 172.21.15.142:0/3978061534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240094f0 con 0x7f38380b29f0 2023-10-06T11:12:49.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f383d108700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 0x7f383815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3837fff700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 0x7f383815b430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f38380cbea0 tx=0x7f3824017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400bbe0 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824027450 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38380c8960 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824027810 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38380c9160 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f382401a430 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.770+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f3824027e40 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.771+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38380b5bd0 con 0x7f38380b29f0 2023-10-06T11:12:49.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.773+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f38240476d0 con 0x7f38380b29f0 2023-10-06T11:12:49.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.874+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae", "id": 7} v 0) v1 -- 0x7f38380c84e0 con 0x7f38380b29f0 2023-10-06T11:12:49.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.882+0000 7f3834ff9700 1 -- 172.21.15.142:0/3978061534 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f38380c84e0 con 0x7f38380b29f0 2023-10-06T11:12:49.885 INFO:teuthology.orchestra.run.smithi142.stdout:7 2023-10-06T11:12:49.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 msgr2=0x7f383815b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 0x7f383815b430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f38380cbea0 tx=0x7f3824017000 comp rx=0 tx=0).stop 2023-10-06T11:12:49.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 shutdown_connections 2023-10-06T11:12:49.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38380b2620 0x7f3838169800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38380cd3c0 0x7f383815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 --2- 172.21.15.142:0/3978061534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38380b29f0 0x7f383815b430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 >> 172.21.15.142:0/3978061534 conn(0x7f3838099520 msgr2=0x7f3838152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 shutdown_connections 2023-10-06T11:12:49.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-10-06T11:12:49.883+0000 7f383d909700 1 -- 172.21.15.142:0/3978061534 wait complete. 2023-10-06T11:12:49.897 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T11:12:49.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T11:12:49.900 INFO:tasks.ceph.osd.0:Started 2023-10-06T11:12:49.900 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T11:12:49.900 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T11:12:49.902 INFO:tasks.ceph.osd.1:Started 2023-10-06T11:12:49.902 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T11:12:49.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T11:12:49.904 INFO:tasks.ceph.osd.2:Started 2023-10-06T11:12:49.904 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T11:12:49.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T11:12:49.906 INFO:tasks.ceph.osd.3:Started 2023-10-06T11:12:49.906 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T11:12:49.907 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T11:12:49.908 INFO:tasks.ceph.osd.4:Started 2023-10-06T11:12:49.909 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T11:12:49.909 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T11:12:49.910 INFO:tasks.ceph.osd.5:Started 2023-10-06T11:12:49.910 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T11:12:49.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T11:12:49.912 INFO:tasks.ceph.osd.6:Started 2023-10-06T11:12:49.913 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T11:12:49.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T11:12:49.914 INFO:tasks.ceph.osd.7:Started 2023-10-06T11:12:49.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:49.938 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:49.936+0000 7fe5e17b4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T11:12:49.965 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:49.964+0000 7f62656fa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T11:12:50.025 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:50.023+0000 7fe5e17b4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T11:12:50.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.051+0000 7f207582f700 1 Processor -- start 2023-10-06T11:12:50.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.051+0000 7f207582f700 1 -- start start 2023-10-06T11:12:50.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.052+0000 7f207582f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2070159650 0x7f20700ac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.052+0000 7f207582f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20700ab430 0x7f2070068a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.052+0000 7f207582f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2070068f70 con 0x7f20700685c0 2023-10-06T11:12:50.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.052+0000 7f207582f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20700a9f90 con 0x7f2070159650 2023-10-06T11:12:50.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.052+0000 7f207582f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700ac980 con 0x7f20700ab430 2023-10-06T11:12:50.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20700ab430 0x7f2070068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2070159650 0x7f20700ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2070159650 0x7f20700ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:40434/0 (socket says 172.21.15.55:40434) 2023-10-06T11:12:50.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20700ab430 0x7f2070068a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:57514/0 (socket says 172.21.15.55:57514) 2023-10-06T11:12:50.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 -- 172.21.15.55:0/3309066748 learned_addr learned my addr 172.21.15.55:0/3309066748 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:50.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206e7fc700 1 --1- 172.21.15.55:0/3309066748 >> v1:172.21.15.142:6789/0 conn(0x7f20700685c0 0x7f207015d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:35392/0 (socket says 172.21.15.55:35392) 2023-10-06T11:12:50.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 -- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20700ab430 msgr2=0x7f2070068a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:50.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 --2- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20700ab430 0x7f2070068a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 -- 172.21.15.55:0/3309066748 >> v1:172.21.15.142:6789/0 conn(0x7f20700685c0 legacy=0x7f207015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 -- 172.21.15.55:0/3309066748 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700abfa0 con 0x7f2070159650 2023-10-06T11:12:50.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206effd700 1 --2- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2070159650 0x7f20700ac440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2064009990 tx=0x7f2064009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b0a36ad2b21894 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206dffb700 1 -- 172.21.15.55:0/3309066748 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064009e80 con 0x7f2070159650 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206dffb700 1 -- 172.21.15.55:0/3309066748 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064005c10 con 0x7f2070159650 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.053+0000 7f206dffb700 1 -- 172.21.15.55:0/3309066748 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400b650 con 0x7f2070159650 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 -- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2070159650 msgr2=0x7f20700ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 --2- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2070159650 0x7f20700ac440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2064009990 tx=0x7f2064009220 comp rx=0 tx=0).stop 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 -- 172.21.15.55:0/3309066748 shutdown_connections 2023-10-06T11:12:50.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 --2- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20700ab430 0x7f2070068a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 --2- 172.21.15.55:0/3309066748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2070159650 0x7f20700ac440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 -- 172.21.15.55:0/3309066748 >> 172.21.15.55:0/3309066748 conn(0x7f207006de40 msgr2=0x7f207006e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 -- 172.21.15.55:0/3309066748 shutdown_connections 2023-10-06T11:12:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.054+0000 7f207582f700 1 -- 172.21.15.55:0/3309066748 wait complete. 2023-10-06T11:12:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.055+0000 7f207582f700 1 Processor -- start 2023-10-06T11:12:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.055+0000 7f207582f700 1 -- start start 2023-10-06T11:12:50.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f207582f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 0x7f207014c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f207582f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20700ab430 0x7f207015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f207582f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2070159650 0x7f20700b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f207582f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207015ba20 con 0x7f20700ab430 2023-10-06T11:12:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f207582f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207015ae10 con 0x7f20700685c0 2023-10-06T11:12:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f207582f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207015b0f0 con 0x7f2070159650 2023-10-06T11:12:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 0x7f207014c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20700ab430 0x7f207015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2070159650 0x7f20700b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 0x7f207014c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:40448/0 (socket says 172.21.15.55:40448) 2023-10-06T11:12:50.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 -- 172.21.15.55:0/2143561424 learned_addr learned my addr 172.21.15.55:0/2143561424 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:50.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 -- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2070159650 msgr2=0x7f20700b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2070159650 0x7f20700b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 -- 172.21.15.55:0/2143561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20700ab430 msgr2=0x7f207015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20700ab430 0x7f207015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.056+0000 7f206effd700 1 -- 172.21.15.55:0/2143561424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064009480 con 0x7f20700685c0 2023-10-06T11:12:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f206effd700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 0x7f207014c710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f206400b3c0 tx=0x7f2064016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064011980 con 0x7f20700685c0 2023-10-06T11:12:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064020070 con 0x7f20700685c0 2023-10-06T11:12:50.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207015b3d0 con 0x7f20700685c0 2023-10-06T11:12:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064011d30 con 0x7f20700685c0 2023-10-06T11:12:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207014cc50 con 0x7f20700685c0 2023-10-06T11:12:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2064022030 con 0x7f20700685c0 2023-10-06T11:12:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.057+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f206402eb20 con 0x7f20700685c0 2023-10-06T11:12:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.058+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2070064a90 con 0x7f20700685c0 2023-10-06T11:12:50.072 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:50.059+0000 7f62656fa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T11:12:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.061+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f206402ee00 con 0x7f20700685c0 2023-10-06T11:12:50.105 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:50.103+0000 7fe5e17b4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T11:12:50.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.132+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f207004bb40 con 0x7f20700685c0 2023-10-06T11:12:50.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.133+0000 7f2056ffd700 1 -- 172.21.15.55:0/2143561424 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f2064025aa0 con 0x7f20700685c0 2023-10-06T11:12:50.135 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:12:50.135 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:12:49.876402+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 msgr2=0x7f207014c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 0x7f207014c710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f206400b3c0 tx=0x7f2064016000 comp rx=0 tx=0).stop 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 shutdown_connections 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2070159650 0x7f20700b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20700685c0 0x7f207014c710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 --2- 172.21.15.55:0/2143561424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20700ab430 0x7f207015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 >> 172.21.15.55:0/2143561424 conn(0x7f207006de40 msgr2=0x7f20700afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 shutdown_connections 2023-10-06T11:12:50.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:12:50.134+0000 7f207582f700 1 -- 172.21.15.55:0/2143561424 wait complete. 2023-10-06T11:12:50.142 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:50.141+0000 7f62656fa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T11:12:50.148 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T11:12:50.148 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T11:12:50.507 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-10-06T11:12:50.505+0000 7f4f388b2540 -1 Falling back to public interface 2023-10-06T11:12:50.508 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-10-06T11:12:50.506+0000 7f3889243540 -1 Falling back to public interface 2023-10-06T11:12:50.524 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-10-06T11:12:50.522+0000 7fcd4473c540 -1 Falling back to public interface 2023-10-06T11:12:50.528 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-10-06T11:12:50.526+0000 7fcaebded540 -1 Falling back to public interface 2023-10-06T11:12:50.529 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-10-06T11:12:50.528+0000 7f656d26a540 -1 Falling back to public interface 2023-10-06T11:12:50.530 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-10-06T11:12:50.528+0000 7f11e9844540 -1 Falling back to public interface 2023-10-06T11:12:50.530 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-10-06T11:12:50.528+0000 7f6567693700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-10-06T11:12:50.533 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-10-06T11:12:50.531+0000 7f7ad5524540 -1 Falling back to public interface 2023-10-06T11:12:50.533 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-10-06T11:12:50.531+0000 7ff573650540 -1 Falling back to public interface 2023-10-06T11:12:50.683 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:50.681+0000 7fe5e17b4180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T11:12:50.822 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:50.820+0000 7fe5e17b4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:12:50.839 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:50.838+0000 7f62656fa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T11:12:50.919 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:50.917+0000 7fe5e17b4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T11:12:50.953 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:50.983 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:50.981+0000 7f62656fa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:12:51.063 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.061+0000 7f3be0ad0700 1 Processor -- start 2023-10-06T11:12:51.063 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.061+0000 7f3be0ad0700 1 -- start start 2023-10-06T11:12:51.064 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3be0ad0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bdc069e60 0x7f3bdc0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.064 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3be0ad0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc15d620 con 0x7f3bdc0aee60 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3be0ad0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc06a820 con 0x7f3bdc06a300 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3be0ad0700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc06ab00 con 0x7f3bdc069e60 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3bd9d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bdc069e60 0x7f3bdc0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3bda59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bdc0aee60 0x7f3bdc15dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58020/0 (socket says 172.21.15.55:58020) 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.062+0000 7f3bda59c700 1 -- 172.21.15.55:0/2790712821 learned_addr learned my addr 172.21.15.55:0/2790712821 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/2790712821 >> v1:172.21.15.142:6789/0 conn(0x7f3bdc06a300 legacy=0x7f3bdc0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/2790712821 >> v1:172.21.15.55:6789/0 conn(0x7f3bdc0aee60 legacy=0x7f3bdc15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/2790712821 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc15d2b0 con 0x7f3bdc069e60 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd9d9b700 1 --2- 172.21.15.55:0/2790712821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc069e60 0x7f3bdc0c6f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098e0 tx=0x7f3bcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831404fb2258338d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.065 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd959a700 1 -- 172.21.15.55:0/2790712821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc009e80 con 0x7f3bdc069e60 2023-10-06T11:12:51.066 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd959a700 1 -- 172.21.15.55:0/2790712821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00b860 con 0x7f3bdc069e60 2023-10-06T11:12:51.066 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3bd959a700 1 -- 172.21.15.55:0/2790712821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00bbe0 con 0x7f3bdc069e60 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3be0ad0700 1 -- 172.21.15.55:0/2790712821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc069e60 msgr2=0x7f3bdc0c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.063+0000 7f3be0ad0700 1 --2- 172.21.15.55:0/2790712821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc069e60 0x7f3bdc0c6f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098e0 tx=0x7f3bcc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.064+0000 7f3be0ad0700 1 -- 172.21.15.55:0/2790712821 shutdown_connections 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.064+0000 7f3be0ad0700 1 --2- 172.21.15.55:0/2790712821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc069e60 0x7f3bdc0c6f40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.064+0000 7f3be0ad0700 1 -- 172.21.15.55:0/2790712821 >> 172.21.15.55:0/2790712821 conn(0x7f3bdc06e680 msgr2=0x7f3bdc06ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.064+0000 7f3be0ad0700 1 -- 172.21.15.55:0/2790712821 shutdown_connections 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.064+0000 7f3be0ad0700 1 -- 172.21.15.55:0/2790712821 wait complete. 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.065+0000 7f3be0ad0700 1 Processor -- start 2023-10-06T11:12:51.067 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.065+0000 7f3be0ad0700 1 -- start start 2023-10-06T11:12:51.069 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3be0ad0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc069e60 0x7f3bdc156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.069 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3be0ad0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 0x7f3bdc0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3be0ad0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0aee60 0x7f3bdc0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3be0ad0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c2ff0 con 0x7f3bdc06a300 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3be0ad0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc156580 con 0x7f3bdc0aee60 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3be0ad0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c4070 con 0x7f3bdc069e60 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 0x7f3bdc0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 0x7f3bdc0c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42876/0 (socket says 172.21.15.55:42876) 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/4195874991 learned_addr learned my addr 172.21.15.55:0/4195874991 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bdad9d700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0aee60 0x7f3bdc0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bda59c700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc069e60 0x7f3bdc156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc069e60 msgr2=0x7f3bdc156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.070 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc069e60 0x7f3bdc156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0aee60 msgr2=0x7f3bdc0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0aee60 0x7f3bdc0b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 -- 172.21.15.55:0/4195874991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009420 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.066+0000 7f3bd9d9b700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 0x7f3bdc0c72b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0cc710 tx=0x7f3bcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00bbe0 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc011420 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc0c6800 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0117e0 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc0c3d90 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3bcc02e3f0 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3bcc011e10 con 0x7f3bdc06a300 2023-10-06T11:12:51.071 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.067+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc064a90 con 0x7f3bdc06a300 2023-10-06T11:12:51.072 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.070+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3bcc033060 con 0x7f3bdc06a300 2023-10-06T11:12:51.075 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:51.074+0000 7f62656fa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T11:12:51.142 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.140+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bdc04bb40 con 0x7f3bdc06a300 2023-10-06T11:12:51.142 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.141+0000 7f3bca7fc700 1 -- 172.21.15.55:0/4195874991 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f3bcc015020 con 0x7f3bdc06a300 2023-10-06T11:12:51.143 INFO:teuthology.misc.health.smithi055.stdout: 2023-10-06T11:12:51.143 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:12:49.876402+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 msgr2=0x7f3bdc0c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 0x7f3bdc0c72b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0cc710 tx=0x7f3bcc017000 comp rx=0 tx=0).stop 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 shutdown_connections 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0aee60 0x7f3bdc0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc069e60 0x7f3bdc156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 --2- 172.21.15.55:0/4195874991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bdc06a300 0x7f3bdc0c72b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 >> 172.21.15.55:0/4195874991 conn(0x7f3bdc06e680 msgr2=0x7f3bdc0afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 shutdown_connections 2023-10-06T11:12:51.144 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:51.142+0000 7f3be0ad0700 1 -- 172.21.15.55:0/4195874991 wait complete. 2023-10-06T11:12:51.155 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T11:12:51.168 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:51.166+0000 7fe5e17b4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T11:12:51.245 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:51.243+0000 7fe5e17b4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T11:12:51.334 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:51.333+0000 7f62656fa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T11:12:51.415 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:51.413+0000 7f62656fa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T11:12:52.073 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.071+0000 7fe5e17b4180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T11:12:52.146 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.144+0000 7fe5e17b4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T11:12:52.221 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.219+0000 7fe5e17b4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T11:12:52.276 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.274+0000 7f62656fa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T11:12:52.352 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.351+0000 7f62656fa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T11:12:52.353 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.352+0000 7fe5e17b4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T11:12:52.429 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.428+0000 7f62656fa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T11:12:52.437 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.435+0000 7fe5e17b4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T11:12:52.568 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.566+0000 7f62656fa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T11:12:52.590 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.588+0000 7fe5e17b4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T11:12:52.655 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.654+0000 7f62656fa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T11:12:52.665 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.663+0000 7fe5e17b4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T11:12:52.740 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.738+0000 7fe5e17b4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T11:12:52.812 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.811+0000 7f62656fa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T11:12:52.815 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:52.813+0000 7fe5e17b4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T11:12:52.892 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.891+0000 7f62656fa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T11:12:52.972 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:52.971+0000 7f62656fa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T11:12:53.053 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-10-06T11:12:53.052+0000 7f62656fa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T11:12:53.840 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:53.839+0000 7fe59abb4700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T11:12:53.841 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-10-06T11:12:53.839+0000 7fe59abb4700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T11:12:54.031 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-10-06T11:12:54.029+0000 7f7ad5524540 -1 osd.3 0 log_to_monitors true 2023-10-06T11:12:54.036 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-10-06T11:12:54.035+0000 7fcd4473c540 -1 osd.1 0 log_to_monitors true 2023-10-06T11:12:54.048 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-10-06T11:12:54.046+0000 7ff573650540 -1 osd.2 0 log_to_monitors true 2023-10-06T11:12:54.056 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-10-06T11:12:54.055+0000 7fcaebded540 -1 osd.0 0 log_to_monitors true 2023-10-06T11:12:54.063 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-10-06T11:12:54.061+0000 7f4f388b2540 -1 osd.7 0 log_to_monitors true 2023-10-06T11:12:54.100 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-10-06T11:12:54.098+0000 7f3889243540 -1 osd.4 0 log_to_monitors true 2023-10-06T11:12:54.101 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-10-06T11:12:54.100+0000 7f656d26a540 -1 osd.5 0 log_to_monitors true 2023-10-06T11:12:54.113 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-10-06T11:12:54.111+0000 7f11e9844540 -1 osd.6 0 log_to_monitors true 2023-10-06T11:12:57.938 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-10-06T11:12:57.936+0000 7f6563e8c700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T11:12:57.943 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-10-06T11:12:57.939+0000 7f655cc83700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:57.961 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:57.985 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-10-06T11:12:57.983+0000 7f387fe65700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T11:12:57.990 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-10-06T11:12:57.988+0000 7f3878c5c700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.002 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-10-06T11:12:58.000+0000 7f4f2f4d4700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T11:12:58.007 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-10-06T11:12:58.005+0000 7f4f282cb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.132 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-10-06T11:12:58.128+0000 7fcd3b35e700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T11:12:58.140 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-10-06T11:12:58.133+0000 7fcd34155700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.146 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.145+0000 7fd8c86cf700 1 Processor -- start 2023-10-06T11:12:58.149 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.145+0000 7fd8c86cf700 1 -- start start 2023-10-06T11:12:58.149 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.146+0000 7fd8c86cf700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8c00c91c0 0x7fd8c00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:58.150 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.146+0000 7fd8c86cf700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c006c3e0 con 0x7fd8c00c7150 2023-10-06T11:12:58.150 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.146+0000 7fd8c86cf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c0156050 con 0x7fd8c01554f0 2023-10-06T11:12:58.150 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.146+0000 7fd8c86cf700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c006a6b0 con 0x7fd8c00c91c0 2023-10-06T11:12:58.150 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8c00c91c0 0x7fd8c00c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:58.150 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8c00c91c0 0x7fd8c00c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39854/0 (socket says 172.21.15.55:39854) 2023-10-06T11:12:58.150 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 -- 172.21.15.55:0/2055594364 learned_addr learned my addr 172.21.15.55:0/2055594364 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:58.151 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 -- 172.21.15.55:0/2055594364 >> v1:172.21.15.142:6789/0 conn(0x7fd8c01554f0 legacy=0x7fd8c0155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.151 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 -- 172.21.15.55:0/2055594364 >> v1:172.21.15.55:6789/0 conn(0x7fd8c00c7150 legacy=0x7fd8c0069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.151 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 -- 172.21.15.55:0/2055594364 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c006a990 con 0x7fd8c00c91c0 2023-10-06T11:12:58.151 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.147+0000 7fd8c646b700 1 --2- 172.21.15.55:0/2055594364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c9590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00bc40 tx=0x7fd8bc00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4871e8473acaca6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:58.151 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.148+0000 7fd8c5469700 1 -- 172.21.15.55:0/2055594364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00db40 con 0x7fd8c00c91c0 2023-10-06T11:12:58.152 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.148+0000 7fd8c5469700 1 -- 172.21.15.55:0/2055594364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00dca0 con 0x7fd8c00c91c0 2023-10-06T11:12:58.152 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.148+0000 7fd8c5469700 1 -- 172.21.15.55:0/2055594364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc017650 con 0x7fd8c00c91c0 2023-10-06T11:12:58.153 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.149+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2055594364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00c91c0 msgr2=0x7fd8c00c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.153 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.149+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2055594364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c9590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00bc40 tx=0x7fd8bc00b4e0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.153 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.149+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2055594364 shutdown_connections 2023-10-06T11:12:58.153 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.149+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2055594364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c9590 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.154 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.149+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2055594364 >> 172.21.15.55:0/2055594364 conn(0x7fd8c006e680 msgr2=0x7fd8c006ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:58.154 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.149+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2055594364 shutdown_connections 2023-10-06T11:12:58.154 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.150+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2055594364 wait complete. 2023-10-06T11:12:58.157 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.152+0000 7fd8c86cf700 1 Processor -- start 2023-10-06T11:12:58.157 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.152+0000 7fd8c86cf700 1 -- start start 2023-10-06T11:12:58.157 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.153+0000 7fd8c86cf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 0x7fd8c014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:58.157 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.153+0000 7fd8c86cf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:58.158 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.153+0000 7fd8c86cf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c01554f0 0x7fd8c00c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:58.158 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.153+0000 7fd8c86cf700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c014f5c0 con 0x7fd8c01554f0 2023-10-06T11:12:58.158 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.153+0000 7fd8c86cf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00c4ff0 con 0x7fd8c00c91c0 2023-10-06T11:12:58.158 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.153+0000 7fd8c86cf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00c2cd0 con 0x7fd8c00c7150 2023-10-06T11:12:58.159 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 0x7fd8c014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:58.159 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 0x7fd8c014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:40124/0 (socket says 172.21.15.55:40124) 2023-10-06T11:12:58.159 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 -- 172.21.15.55:0/2435332155 learned_addr learned my addr 172.21.15.55:0/2435332155 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:12:58.159 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c5c6a700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:58.159 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 -- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00c91c0 msgr2=0x7fd8c00c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.159 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.160 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 -- 172.21.15.55:0/2435332155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c01554f0 msgr2=0x7fd8c00c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.160 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c01554f0 0x7fd8c00c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.160 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 -- 172.21.15.55:0/2435332155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc00b780 con 0x7fd8c00c7150 2023-10-06T11:12:58.160 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.154+0000 7fd8c646b700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 0x7fd8c014f080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b520 tx=0x7fd8bc01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:58.160 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.155+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc009040 con 0x7fd8c00c7150 2023-10-06T11:12:58.161 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.155+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc016690 con 0x7fd8c00c7150 2023-10-06T11:12:58.161 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.155+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc016a30 con 0x7fd8c00c7150 2023-10-06T11:12:58.161 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.155+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00c2430 con 0x7fd8c00c7150 2023-10-06T11:12:58.161 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.155+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c00c29f0 con 0x7fd8c00c7150 2023-10-06T11:12:58.162 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.157+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a80052b0 con 0x7fd8c00c7150 2023-10-06T11:12:58.163 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.158+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd8bc015070 con 0x7fd8c00c7150 2023-10-06T11:12:58.163 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.159+0000 7fd8b67fc700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8a4066ff0 0x7fd8a40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:58.163 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.159+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fd8bc084a80 con 0x7fd8c00c7150 2023-10-06T11:12:58.163 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.159+0000 7fd8c5c6a700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8a4066ff0 0x7fd8a40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:58.164 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.160+0000 7fd8c5c6a700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8a4066ff0 0x7fd8a40694a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00c18c0 tx=0x7fd8b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:58.164 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.162+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8bc052bf0 con 0x7fd8c00c7150 2023-10-06T11:12:58.233 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-10-06T11:12:58.231+0000 7fcae2a0f700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T11:12:58.238 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-10-06T11:12:58.237+0000 7fcadb806700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.255 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-10-06T11:12:58.252+0000 7f7acc146700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T11:12:58.259 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-10-06T11:12:58.258+0000 7f7ac4f3d700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.282 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-10-06T11:12:58.280+0000 7f11e1c69700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T11:12:58.285 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-10-06T11:12:58.283+0000 7f11d925d700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.324 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-10-06T11:12:58.323+0000 7ff56ba75700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T11:12:58.329 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-10-06T11:12:58.327+0000 7ff563069700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:12:58.406 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.404+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8a8005560 con 0x7fd8c00c7150 2023-10-06T11:12:58.406 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.405+0000 7fd8b67fc700 1 -- 172.21.15.55:0/2435332155 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd8bc027090 con 0x7fd8c00c7150 2023-10-06T11:12:58.406 INFO:teuthology.misc.health.smithi055.stdout: 2023-10-06T11:12:58.407 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":12,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:12:55.996369+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:58.409 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8a4066ff0 msgr2=0x7fd8a40694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.409 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8a4066ff0 0x7fd8a40694a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00c18c0 tx=0x7fd8b0009040 comp rx=0 tx=0).stop 2023-10-06T11:12:58.409 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 msgr2=0x7fd8c014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:58.409 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 0x7fd8c014f080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b520 tx=0x7fd8bc01a000 comp rx=0 tx=0).stop 2023-10-06T11:12:58.409 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 shutdown_connections 2023-10-06T11:12:58.409 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8a4066ff0 0x7fd8a40694a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.410 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c01554f0 0x7fd8c00c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.410 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c00c7150 0x7fd8c014f080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.410 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 --2- 172.21.15.55:0/2435332155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c00c91c0 0x7fd8c00c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:58.410 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 >> 172.21.15.55:0/2435332155 conn(0x7fd8c006e680 msgr2=0x7fd8c00cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:58.410 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 shutdown_connections 2023-10-06T11:12:58.410 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:12:58.407+0000 7fd8c86cf700 1 -- 172.21.15.55:0/2435332155 wait complete. 2023-10-06T11:12:58.419 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T11:13:05.226 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:05.346 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.344+0000 7f20f5986700 1 Processor -- start 2023-10-06T11:13:05.346 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.344+0000 7f20f5986700 1 -- start start 2023-10-06T11:13:05.348 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5986700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20f00cd060 0x7f20f0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.348 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5986700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20f015d130 0x7f20f015a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.348 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5986700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f015d5d0 con 0x7f20f01537d0 2023-10-06T11:13:05.348 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5986700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f00cbd80 con 0x7f20f00cd060 2023-10-06T11:13:05.348 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5986700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f015aa90 con 0x7f20f015d130 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20effff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20f00cd060 0x7f20f0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f4984700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f20f01537d0 0x7f20f00cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50594/0 (socket says 172.21.15.55:50594) 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f4984700 1 -- 172.21.15.55:0/1651188757 learned_addr learned my addr 172.21.15.55:0/1651188757 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5185700 1 --2- 172.21.15.55:0/1651188757 >> v2:172.21.15.142:3300/0 conn(0x7f20f015d130 0x7f20f015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20effff700 1 -- 172.21.15.55:0/1651188757 >> v2:172.21.15.142:3300/0 conn(0x7f20f015d130 msgr2=0x7f20f015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20effff700 1 --2- 172.21.15.55:0/1651188757 >> v2:172.21.15.142:3300/0 conn(0x7f20f015d130 0x7f20f015a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20effff700 1 -- 172.21.15.55:0/1651188757 >> v1:172.21.15.55:6789/0 conn(0x7f20f01537d0 legacy=0x7f20f00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20effff700 1 -- 172.21.15.55:0/1651188757 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f00ce8b0 con 0x7f20f00cd060 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20f5185700 1 --2- 172.21.15.55:0/1651188757 >> v2:172.21.15.142:3300/0 conn(0x7f20f015d130 0x7f20f015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.345+0000 7f20ef7fe700 1 -- 172.21.15.55:0/1651188757 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794069000 0 0) 0x7f20f015d5d0 con 0x7f20f01537d0 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20effff700 1 --2- 172.21.15.55:0/1651188757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00cd060 0x7f20f0153ba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f20f0159b30 tx=0x7f20e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50670360f482f61c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:05.349 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20ef7fe700 1 -- 172.21.15.55:0/1651188757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400b6b0 con 0x7f20f00cd060 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20ef7fe700 1 -- 172.21.15.55:0/1651188757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e400b810 con 0x7f20f00cd060 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20ef7fe700 1 -- 172.21.15.55:0/1651188757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400bbb0 con 0x7f20f00cd060 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 -- 172.21.15.55:0/1651188757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00cd060 msgr2=0x7f20f0153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 --2- 172.21.15.55:0/1651188757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00cd060 0x7f20f0153ba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f20f0159b30 tx=0x7f20e40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 -- 172.21.15.55:0/1651188757 shutdown_connections 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 --2- 172.21.15.55:0/1651188757 >> v2:172.21.15.142:3300/0 conn(0x7f20f015d130 0x7f20f015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 --2- 172.21.15.55:0/1651188757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f00cd060 0x7f20f0153ba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 -- 172.21.15.55:0/1651188757 >> 172.21.15.55:0/1651188757 conn(0x7f20f006ed40 msgr2=0x7f20f006f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 -- 172.21.15.55:0/1651188757 shutdown_connections 2023-10-06T11:13:05.350 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.346+0000 7f20f5986700 1 -- 172.21.15.55:0/1651188757 wait complete. 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.347+0000 7f20f5986700 1 Processor -- start 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 -- start start 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f00cd060 0x7f20f01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 0x7f20f00c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f015d130 0x7f20f016d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0155040 con 0x7f20f01537d0 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0155a10 con 0x7f20f015d130 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.348+0000 7f20f5986700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0169f70 con 0x7f20f00cd060 2023-10-06T11:13:05.353 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 0x7f20f00c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 0x7f20f00c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57340/0 (socket says 172.21.15.55:57340) 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 -- 172.21.15.55:0/963284227 learned_addr learned my addr 172.21.15.55:0/963284227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20f5185700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f015d130 0x7f20f016d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20f4984700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f00cd060 0x7f20f01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 -- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f00cd060 msgr2=0x7f20f01554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f00cd060 0x7f20f01554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 -- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f015d130 msgr2=0x7f20f016d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f015d130 0x7f20f016d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 -- 172.21.15.55:0/963284227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4009420 con 0x7f20f01537d0 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20effff700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 0x7f20f00c99f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f20f0089400 tx=0x7f20e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:05.354 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4011420 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4011580 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f016ddd0 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4011920 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.349+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f0154cd0 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.350+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f0071700 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.351+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20e4011d10 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.351+0000 7f20ecff9700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.351+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f20e4085da0 con 0x7f20f01537d0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.351+0000 7f20f4984700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.355 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.352+0000 7f20f4984700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f20dc066f30 0x7f20dc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20e00011e0 tx=0x7f20e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:05.357 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.356+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20e40533e0 con 0x7f20f01537d0 2023-10-06T11:13:05.553 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.551+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20f0064a90 con 0x7f20f01537d0 2023-10-06T11:13:05.553 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.552+0000 7f20ecff9700 1 -- 172.21.15.55:0/963284227 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f20e4015090 con 0x7f20f01537d0 2023-10-06T11:13:05.554 INFO:teuthology.misc.health.smithi055.stdout: 2023-10-06T11:13:05.554 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":17,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:03.032731+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:05.556 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f20dc066f30 msgr2=0x7f20dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.556 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f20dc066f30 0x7f20dc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20e00011e0 tx=0x7f20e0009040 comp rx=0 tx=0).stop 2023-10-06T11:13:05.556 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 msgr2=0x7f20f00c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.556 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 0x7f20f00c99f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f20f0089400 tx=0x7f20e4017000 comp rx=0 tx=0).stop 2023-10-06T11:13:05.556 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 shutdown_connections 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20f015d130 0x7f20f016d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20f00cd060 0x7f20f01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 --2- 172.21.15.55:0/963284227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20f01537d0 0x7f20f00c99f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 >> 172.21.15.55:0/963284227 conn(0x7f20f006ed40 msgr2=0x7f20f006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 shutdown_connections 2023-10-06T11:13:05.557 INFO:teuthology.misc.health.smithi055.stderr:2023-10-06T11:13:05.554+0000 7f20f5986700 1 -- 172.21.15.55:0/963284227 wait complete. 2023-10-06T11:13:05.567 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T11:13:05.567 INFO:tasks.ceph:Creating RBD pool 2023-10-06T11:13:05.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T11:13:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.683+0000 7f004a7f5700 1 Processor -- start 2023-10-06T11:13:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.683+0000 7f004a7f5700 1 -- start start 2023-10-06T11:13:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.684+0000 7f004a7f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0044155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.684+0000 7f004a7f5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440c92e0 con 0x7f004415a0d0 2023-10-06T11:13:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.684+0000 7f004a7f5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440c95c0 con 0x7f00441561f0 2023-10-06T11:13:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.684+0000 7f004a7f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440685c0 con 0x7f004415a4a0 2023-10-06T11:13:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.684+0000 7f0043fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f004415a0d0 0x7f00440aee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50606/0 (socket says 172.21.15.55:50606) 2023-10-06T11:13:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.684+0000 7f0043fff700 1 -- 172.21.15.55:0/1858033218 learned_addr learned my addr 172.21.15.55:0/1858033218 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:05.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f00437fe700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0044155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776025354 0 0) 0x7f00440c92e0 con 0x7f004415a0d0 2023-10-06T11:13:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0030003570 con 0x7f004415a0d0 2023-10-06T11:13:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581819591 0 0) 0x7f00440c95c0 con 0x7f00441561f0 2023-10-06T11:13:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00440c92e0 con 0x7f00441561f0 2023-10-06T11:13:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3177192575 0 0) 0x7f0030003570 con 0x7f004415a0d0 2023-10-06T11:13:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 msgr2=0x7f0044155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:05.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0044155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 >> v1:172.21.15.142:6789/0 conn(0x7f00441561f0 legacy=0x7f00440c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044068810 con 0x7f004415a0d0 2023-10-06T11:13:05.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f0034001470 con 0x7f004415a0d0 2023-10-06T11:13:05.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f00437fe700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0044155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:05.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 >> v1:172.21.15.55:6789/0 conn(0x7f004415a0d0 legacy=0x7f00440aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0030003c20 0x7f0030004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0030004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030004d50 0x7f00300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440685c0 con 0x7f0030003c20 2023-10-06T11:13:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003000bb10 con 0x7f0030004d50 2023-10-06T11:13:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003000bcd0 con 0x7f004415a4a0 2023-10-06T11:13:05.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0043fff700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0030003c20 0x7f0030004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f00437fe700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0030004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0048d92700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030004d50 0x7f00300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0043fff700 1 -- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 msgr2=0x7f0030004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0043fff700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f004415a4a0 0x7f0030004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0043fff700 1 -- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030004d50 msgr2=0x7f00300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0043fff700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030004d50 0x7f00300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.685+0000 7f0043fff700 1 -- 172.21.15.55:0/1858033218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009420 con 0x7f0030003c20 2023-10-06T11:13:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f0043fff700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0030003c20 0x7f0030004010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f003400c2d0 tx=0x7f0034001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8811c6356d930315 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400cba0 con 0x7f0030003c20 2023-10-06T11:13:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003400cd00 con 0x7f0030003c20 2023-10-06T11:13:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f0042ffd700 1 -- 172.21.15.55:0/1858033218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034005b70 con 0x7f0030003c20 2023-10-06T11:13:05.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f004a7f5700 1 -- 172.21.15.55:0/1858033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0030003c20 msgr2=0x7f0030004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f004a7f5700 1 --2- 172.21.15.55:0/1858033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0030003c20 0x7f0030004010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f003400c2d0 tx=0x7f0034001e10 comp rx=0 tx=0).stop 2023-10-06T11:13:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f0048d92700 1 -- 172.21.15.55:0/1858033218 reap_dead start 2023-10-06T11:13:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f004a7f5700 1 -- 172.21.15.55:0/1858033218 shutdown_connections 2023-10-06T11:13:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f004a7f5700 1 -- 172.21.15.55:0/1858033218 >> 172.21.15.55:0/1858033218 conn(0x7f00440cd3d0 msgr2=0x7f00440b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f004a7f5700 1 -- 172.21.15.55:0/1858033218 shutdown_connections 2023-10-06T11:13:05.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.686+0000 7f004a7f5700 1 -- 172.21.15.55:0/1858033218 wait complete. 2023-10-06T11:13:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.687+0000 7f004a7f5700 1 Processor -- start 2023-10-06T11:13:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 -- start start 2023-10-06T11:13:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003c20 0x7f0044156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044166ac0 0x7f0044166f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 0x7f0044152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044159160 con 0x7f0044167470 2023-10-06T11:13:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044167910 con 0x7f0030003c20 2023-10-06T11:13:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f004a7f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0044159af0 con 0x7f0044166ac0 2023-10-06T11:13:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f0048d92700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 0x7f0044152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f0048d92700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 0x7f0044152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57366/0 (socket says 172.21.15.55:57366) 2023-10-06T11:13:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f0048d92700 1 -- 172.21.15.55:0/3822330182 learned_addr learned my addr 172.21.15.55:0/3822330182 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:05.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f0043fff700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003c20 0x7f0044156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.688+0000 7f00437fe700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044166ac0 0x7f0044166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f0048d92700 1 -- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044166ac0 msgr2=0x7f0044166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f0048d92700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044166ac0 0x7f0044166f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f0048d92700 1 -- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003c20 msgr2=0x7f0044156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f0048d92700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003c20 0x7f0044156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:05.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f0048d92700 1 -- 172.21.15.55:0/3822330182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044158550 con 0x7f0044167470 2023-10-06T11:13:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f0048d92700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 0x7f0044152bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f003c001460 tx=0x7f003c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c006db0 con 0x7f0044167470 2023-10-06T11:13:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c003030 con 0x7f0044167470 2023-10-06T11:13:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0044158830 con 0x7f0044167470 2023-10-06T11:13:05.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0033d0 con 0x7f0044167470 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.689+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044158df0 con 0x7f0044167470 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.690+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00441528e0 con 0x7f0044167470 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.690+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f003c0018f0 con 0x7f0044167470 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.691+0000 7f003bfff700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0024066f30 0x7f00240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.691+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f003c083bf0 con 0x7f0044167470 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.691+0000 7f0043fff700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0024066f30 0x7f00240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:05.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.692+0000 7f0043fff700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0024066f30 0x7f00240693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0034001e50 tx=0x7f0034015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:05.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.695+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00441528e0 con 0x7f0044167470 2023-10-06T11:13:05.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:05.886+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f00441528e0 con 0x7f0044167470 2023-10-06T11:13:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.042+0000 7f003bfff700 1 -- 172.21.15.55:0/3822330182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f00441528e0 con 0x7f0044167470 2023-10-06T11:13:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0024066f30 msgr2=0x7f00240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0024066f30 0x7f00240693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0034001e50 tx=0x7f0034015000 comp rx=0 tx=0).stop 2023-10-06T11:13:06.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 msgr2=0x7f0044152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 0x7f0044152bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f003c001460 tx=0x7f003c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 shutdown_connections 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0024066f30 0x7f00240693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0044167470 0x7f0044152bc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003c20 0x7f0044156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 --2- 172.21.15.55:0/3822330182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044166ac0 0x7f0044166f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 >> 172.21.15.55:0/3822330182 conn(0x7f00440cd3d0 msgr2=0x7f004414f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.045+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 shutdown_connections 2023-10-06T11:13:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.046+0000 7f004a7f5700 1 -- 172.21.15.55:0/3822330182 wait complete. 2023-10-06T11:13:06.049 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'rbd' created 2023-10-06T11:13:06.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T11:13:06.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.179+0000 7f6a65d67700 1 Processor -- start 2023-10-06T11:13:06.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.179+0000 7f6a65d67700 1 -- start start 2023-10-06T11:13:06.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a65d67700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a600cca70 0x7f6a600d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a65d67700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 0x7f6a600ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a65d67700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600d0c50 con 0x7f6a60153990 2023-10-06T11:13:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a65d67700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a600cdbf0 con 0x7f6a600cca70 2023-10-06T11:13:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a65d67700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600cb4c0 con 0x7f6a600d07f0 2023-10-06T11:13:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a64d65700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6a60153990 0x7f6a6015a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50614/0 (socket says 172.21.15.55:50614) 2023-10-06T11:13:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a64d65700 1 -- 172.21.15.55:0/1517601400 learned_addr learned my addr 172.21.15.55:0/1517601400 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:06.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a5ffff700 1 --2- 172.21.15.55:0/1517601400 >> v2:172.21.15.142:3300/0 conn(0x7f6a600cca70 0x7f6a600d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a65566700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 0x7f6a600ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848410716 0 0) 0x7f6a58001490 con 0x7f6a60153990 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.180+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003570 con 0x7f6a60153990 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449287631 0 0) 0x7f6a48003570 con 0x7f6a60153990 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 msgr2=0x7f6a600ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 0x7f6a600ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 >> v2:172.21.15.142:3300/0 conn(0x7f6a600cca70 msgr2=0x7f6a600d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 --2- 172.21.15.55:0/1517601400 >> v2:172.21.15.142:3300/0 conn(0x7f6a600cca70 0x7f6a600d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600ccfe0 con 0x7f6a60153990 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f6a58001980 con 0x7f6a60153990 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 >> v1:172.21.15.55:6789/0 conn(0x7f6a60153990 legacy=0x7f6a6015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a48003a60 0x7f6a48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 0x7f6a48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a48004d50 0x7f6a480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600cdbf0 con 0x7f6a48004d50 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600cb4c0 con 0x7f6a48003a60 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4800ba60 con 0x7f6a600d07f0 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a48004d50 0x7f6a480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5ffff700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 0x7f6a48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a64d65700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a48003a60 0x7f6a48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 -- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 msgr2=0x7f6a48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600d07f0 0x7f6a48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 -- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a48003a60 msgr2=0x7f6a48003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a48003a60 0x7f6a48003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 -- 172.21.15.55:0/1517601400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48003570 con 0x7f6a48004d50 2023-10-06T11:13:06.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a65566700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a48004d50 0x7f6a480051c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009c00 tx=0x7f6a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5fe17cc41b8a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000e6b0 con 0x7f6a48004d50 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5000e810 con 0x7f6a48004d50 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.181+0000 7f6a5f7fe700 1 -- 172.21.15.55:0/1517601400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000ebd0 con 0x7f6a48004d50 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65d67700 1 -- 172.21.15.55:0/1517601400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a48004d50 msgr2=0x7f6a480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65d67700 1 --2- 172.21.15.55:0/1517601400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a48004d50 0x7f6a480051c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009c00 tx=0x7f6a500091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65566700 1 -- 172.21.15.55:0/1517601400 reap_dead start 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65d67700 1 -- 172.21.15.55:0/1517601400 shutdown_connections 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65d67700 1 -- 172.21.15.55:0/1517601400 >> 172.21.15.55:0/1517601400 conn(0x7f6a600680c0 msgr2=0x7f6a60068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65d67700 1 -- 172.21.15.55:0/1517601400 shutdown_connections 2023-10-06T11:13:06.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.182+0000 7f6a65d67700 1 -- 172.21.15.55:0/1517601400 wait complete. 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.183+0000 7f6a65d67700 1 Processor -- start 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.183+0000 7f6a65d67700 1 -- start start 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65d67700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a60151580 0x7f6a60156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65d67700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 0x7f6a600b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65d67700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600c7de0 0x7f6a600b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65d67700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60169ec0 con 0x7f6a60151950 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65d67700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60169590 con 0x7f6a60151580 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65d67700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60169870 con 0x7f6a600c7de0 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 0x7f6a600b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 0x7f6a600b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57392/0 (socket says 172.21.15.55:57392) 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 -- 172.21.15.55:0/3243560980 learned_addr learned my addr 172.21.15.55:0/3243560980 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a64d65700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a60151580 0x7f6a60156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a65566700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600c7de0 0x7f6a600b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 -- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600c7de0 msgr2=0x7f6a600b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600c7de0 0x7f6a600b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 -- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a60151580 msgr2=0x7f6a60156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a60151580 0x7f6a60156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:06.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 -- 172.21.15.55:0/3243560980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60169b50 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.184+0000 7f6a5ffff700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 0x7f6a600b0f90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a54006ac0 tx=0x7f6a540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.185+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54011ec0 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.185+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5400f940 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.185+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400fcc0 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.185+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a600c7650 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.185+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600c82e0 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.186+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6016a030 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.186+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a54014650 con 0x7f6a60151950 2023-10-06T11:13:06.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.186+0000 7f6a5cff9700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a4c066f30 0x7f6a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:06.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.187+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f6a54018030 con 0x7f6a60151950 2023-10-06T11:13:06.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.187+0000 7f6a64d65700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a4c066f30 0x7f6a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:06.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.187+0000 7f6a64d65700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a4c066f30 0x7f6a4c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a58001710 tx=0x7f6a58006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:06.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.191+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a54052080 con 0x7f6a60151950 2023-10-06T11:13:06.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:06.383+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a6005f230 con 0x7f6a60151950 2023-10-06T11:13:07.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.042+0000 7f6a5cff9700 1 -- 172.21.15.55:0/3243560980 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6a540220c0 con 0x7f6a60151950 2023-10-06T11:13:07.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a4c066f30 msgr2=0x7f6a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a4c066f30 0x7f6a4c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a58001710 tx=0x7f6a58006040 comp rx=0 tx=0).stop 2023-10-06T11:13:07.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 msgr2=0x7f6a600b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 0x7f6a600b0f90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a54006ac0 tx=0x7f6a540091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 shutdown_connections 2023-10-06T11:13:07.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a4c066f30 0x7f6a4c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a600c7de0 0x7f6a600b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a60151580 0x7f6a60156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 --2- 172.21.15.55:0/3243560980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a60151950 0x7f6a600b0f90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 >> 172.21.15.55:0/3243560980 conn(0x7f6a600680c0 msgr2=0x7f6a6015c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 shutdown_connections 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.045+0000 7f6a65d67700 1 -- 172.21.15.55:0/3243560980 wait complete. 2023-10-06T11:13:07.048 INFO:teuthology.orchestra.run.smithi055.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T11:13:07.065 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T11:13:07.065 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:13:07.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:13:07.068 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:13:07.068 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:13:07.068 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:13:07.070 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:13:07.070 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:13:07.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:13:07.072 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:13:07.072 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:13:07.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:13:07.074 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:13:07.075 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T11:13:07.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:07.149 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:13:07.149 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:13:07.152 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:13:07.153 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:13:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.203+0000 7f3f90c74700 1 Processor -- start 2023-10-06T11:13:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.203+0000 7f3f90c74700 1 -- start start 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.204+0000 7f3f90c74700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f8c159650 0x7f3f8c0ac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.204+0000 7f3f90c74700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.204+0000 7f3f90c74700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c068f70 con 0x7f3f8c0685c0 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.204+0000 7f3f90c74700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c0a9f90 con 0x7f3f8c159650 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.204+0000 7f3f90c74700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0ac980 con 0x7f3f8c0ab430 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f8c159650 0x7f3f8c0ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8ad9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f89d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3f8c0685c0 0x7f3f8c15d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:35676/0 (socket says 172.21.15.55:35676) 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f89d9b700 1 -- 172.21.15.55:0/2615159891 learned_addr learned my addr 172.21.15.55:0/2615159891 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8959a700 1 -- 172.21.15.55:0/2615159891 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207445665 0 0) 0x7f3f8c068f70 con 0x7f3f8c0685c0 2023-10-06T11:13:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8959a700 1 -- 172.21.15.55:0/2615159891 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f74003570 con 0x7f3f8c0685c0 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8a59c700 1 -- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 msgr2=0x7f3f8c068a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8a59c700 1 --2- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c068a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8a59c700 1 -- 172.21.15.55:0/2615159891 >> v1:172.21.15.142:6789/0 conn(0x7f3f8c0685c0 legacy=0x7f3f8c15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8a59c700 1 -- 172.21.15.55:0/2615159891 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c0abfa0 con 0x7f3f8c159650 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8ad9d700 1 --2- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c068a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8a59c700 1 --2- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0ac440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0098d0 tx=0x7f3f7c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4af303240514129 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8959a700 1 -- 172.21.15.55:0/2615159891 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c005c10 con 0x7f3f8c159650 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8959a700 1 -- 172.21.15.55:0/2615159891 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c005d70 con 0x7f3f8c159650 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.205+0000 7f3f8959a700 1 -- 172.21.15.55:0/2615159891 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c006260 con 0x7f3f8c159650 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 -- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 msgr2=0x7f3f8c0ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 --2- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0ac440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0098d0 tx=0x7f3f7c009120 comp rx=0 tx=0).stop 2023-10-06T11:13:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 -- 172.21.15.55:0/2615159891 shutdown_connections 2023-10-06T11:13:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 --2- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c068a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 --2- 172.21.15.55:0/2615159891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0ac440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 -- 172.21.15.55:0/2615159891 >> 172.21.15.55:0/2615159891 conn(0x7f3f8c06de40 msgr2=0x7f3f8c06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 -- 172.21.15.55:0/2615159891 shutdown_connections 2023-10-06T11:13:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.206+0000 7f3f90c74700 1 -- 172.21.15.55:0/2615159891 wait complete. 2023-10-06T11:13:07.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.207+0000 7f3f90c74700 1 Processor -- start 2023-10-06T11:13:07.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.207+0000 7f3f90c74700 1 -- start start 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f90c74700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 0x7f3f8c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f90c74700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f90c74700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f90c74700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0cc310 con 0x7f3f8c0685c0 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f90c74700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c141b30 con 0x7f3f8c159650 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f90c74700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0cb700 con 0x7f3f8c0ab430 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 0x7f3f8c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 0x7f3f8c150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57430/0 (socket says 172.21.15.55:57430) 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 -- 172.21.15.55:0/970895535 learned_addr learned my addr 172.21.15.55:0/970895535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f89d9b700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8ad9d700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 -- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 msgr2=0x7f3f8c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 -- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 msgr2=0x7f3f8c0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 -- 172.21.15.55:0/970895535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009a20 con 0x7f3f8c0685c0 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f89d9b700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8ad9d700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f8a59c700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 0x7f3f8c150af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009ec0 tx=0x7f3f7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c01d9c0 con 0x7f3f8c0685c0 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c01db40 con 0x7f3f8c0685c0 2023-10-06T11:13:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.208+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c01b480 con 0x7f3f8c0685c0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.209+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c0093c0 con 0x7f3f8c0685c0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.209+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0cbcc0 con 0x7f3f8c0685c0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.209+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c0cc5f0 con 0x7f3f8c0685c0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.210+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f7c01b870 con 0x7f3f8c0685c0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.210+0000 7f3f7a7fc700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f6c066f30 0x7f3f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.210+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3f7c086050 con 0x7f3f8c0685c0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.210+0000 7f3f89d9b700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f6c066f30 0x7f3f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.211+0000 7f3f89d9b700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f6c066f30 0x7f3f6c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0c93a0 tx=0x7f3f80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.215+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f7c0534b0 con 0x7f3f8c0685c0 2023-10-06T11:13:07.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.408+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f8c064a90 con 0x7f3f8c0685c0 2023-10-06T11:13:07.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.409+0000 7f3f7a7fc700 1 -- 172.21.15.55:0/970895535 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f3f7c02a020 con 0x7f3f8c0685c0 2023-10-06T11:13:07.411 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:07.411 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:07.039245+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f6c066f30 msgr2=0x7f3f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f6c066f30 0x7f3f6c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0c93a0 tx=0x7f3f80009040 comp rx=0 tx=0).stop 2023-10-06T11:13:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 msgr2=0x7f3f8c150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 0x7f3f8c150af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009ec0 tx=0x7f3f7c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 shutdown_connections 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f6c066f30 0x7f3f6c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8c0685c0 0x7f3f8c150af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f8c159650 0x7f3f8c0c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 --2- 172.21.15.55:0/970895535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f8c0ab430 0x7f3f8c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 >> 172.21.15.55:0/970895535 conn(0x7f3f8c06de40 msgr2=0x7f3f8c0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 shutdown_connections 2023-10-06T11:13:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.411+0000 7f3f90c74700 1 -- 172.21.15.55:0/970895535 wait complete. 2023-10-06T11:13:07.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:13:07.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:07.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.546+0000 7fa11df61700 1 Processor -- start 2023-10-06T11:13:07.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.546+0000 7fa11df61700 1 -- start start 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa11df61700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1181594d0 0x7fa1180cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa11df61700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1181598a0 0x7fa1180cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa11df61700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180cf310 con 0x7fa1180ce7e0 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa11df61700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180cf5d0 con 0x7fa1181594d0 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa11df61700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180cf8b0 con 0x7fa1181598a0 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa1177fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1181594d0 0x7fa1180cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa1177fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1181594d0 0x7fa1180cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57442/0 (socket says 172.21.15.55:57442) 2023-10-06T11:13:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa117fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa1180ce7e0 0x7fa1180cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50620/0 (socket says 172.21.15.55:50620) 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa1177fe700 1 -- 172.21.15.55:0/1848544499 learned_addr learned my addr 172.21.15.55:0/1848544499 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa116ffd700 1 --2- 172.21.15.55:0/1848544499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1181598a0 0x7fa1180cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa1177fe700 1 -- 172.21.15.55:0/1848544499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1181598a0 msgr2=0x7fa1180cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.547+0000 7fa1177fe700 1 --2- 172.21.15.55:0/1848544499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1181598a0 0x7fa1180cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1177fe700 1 -- 172.21.15.55:0/1848544499 >> v1:172.21.15.55:6789/0 conn(0x7fa1180ce7e0 legacy=0x7fa1180cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1177fe700 1 -- 172.21.15.55:0/1848544499 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180cfb90 con 0x7fa1181594d0 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1167fc700 1 -- 172.21.15.55:0/1848544499 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528665690 0 0) 0x7fa1180cf310 con 0x7fa1180ce7e0 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1177fe700 1 --2- 172.21.15.55:0/1848544499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180cb560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1080099b0 tx=0x7fa108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b6434d93216f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1167fc700 1 -- 172.21.15.55:0/1848544499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108009ea0 con 0x7fa1181594d0 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1167fc700 1 -- 172.21.15.55:0/1848544499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10800b860 con 0x7fa1181594d0 2023-10-06T11:13:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa1167fc700 1 -- 172.21.15.55:0/1848544499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10800bc00 con 0x7fa1181594d0 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 -- 172.21.15.55:0/1848544499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 msgr2=0x7fa1180cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 --2- 172.21.15.55:0/1848544499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180cb560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1080099b0 tx=0x7fa108009250 comp rx=0 tx=0).stop 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 -- 172.21.15.55:0/1848544499 shutdown_connections 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 --2- 172.21.15.55:0/1848544499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180cb560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 --2- 172.21.15.55:0/1848544499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1181598a0 0x7fa1180cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 -- 172.21.15.55:0/1848544499 >> 172.21.15.55:0/1848544499 conn(0x7fa118089e50 msgr2=0x7fa118099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 -- 172.21.15.55:0/1848544499 shutdown_connections 2023-10-06T11:13:07.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.548+0000 7fa11df61700 1 -- 172.21.15.55:0/1848544499 wait complete. 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 Processor -- start 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 -- start start 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1180ce7e0 0x7fa1180c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1181598a0 0x7fa1180c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180ca6e0 con 0x7fa1181594d0 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180b5090 con 0x7fa1181598a0 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa11df61700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180b5370 con 0x7fa1180ce7e0 2023-10-06T11:13:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.550+0000 7fa116ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57456/0 (socket says 172.21.15.55:57456) 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 -- 172.21.15.55:0/2534625061 learned_addr learned my addr 172.21.15.55:0/2534625061 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa117fff700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1181598a0 0x7fa1180c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa1177fe700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1180ce7e0 0x7fa1180c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 -- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1180ce7e0 msgr2=0x7fa1180c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1180ce7e0 0x7fa1180c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 -- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1181598a0 msgr2=0x7fa1180c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1181598a0 0x7fa1180c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 -- 172.21.15.55:0/2534625061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080094f0 con 0x7fa1181594d0 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa117fff700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1181598a0 0x7fa1180c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa116ffd700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180c9280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00e900 tx=0x7fa10c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00eea0 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00c850 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1180b5650 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00cc10 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.551+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1180b5c10 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.552+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1181561d0 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.552+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa10c013470 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.553+0000 7fa0ff7fe700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa104066f30 0x7fa1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.553+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa10c0844b0 con 0x7fa1181594d0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.553+0000 7fa1177fe700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa104066f30 0x7fa1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.553+0000 7fa1177fe700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa104066f30 0x7fa1040693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1080099b0 tx=0x7fa108017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.557+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa10c051910 con 0x7fa1181594d0 2023-10-06T11:13:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.750+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa118064a90 con 0x7fa1181594d0 2023-10-06T11:13:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.750+0000 7fa0ff7fe700 1 -- 172.21.15.55:0/2534625061 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa10c054f30 con 0x7fa1181594d0 2023-10-06T11:13:07.752 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa104066f30 msgr2=0x7fa1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa104066f30 0x7fa1040693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1080099b0 tx=0x7fa108017000 comp rx=0 tx=0).stop 2023-10-06T11:13:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 msgr2=0x7fa1180c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180c9280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00e900 tx=0x7fa10c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 shutdown_connections 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa104066f30 0x7fa1040693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1181598a0 0x7fa1180c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1180ce7e0 0x7fa1180c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 --2- 172.21.15.55:0/2534625061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1181594d0 0x7fa1180c9280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 >> 172.21.15.55:0/2534625061 conn(0x7fa118089e50 msgr2=0x7fa11815bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 shutdown_connections 2023-10-06T11:13:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.752+0000 7fa11df61700 1 -- 172.21.15.55:0/2534625061 wait complete. 2023-10-06T11:13:07.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:07.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.885+0000 7f48148b1700 1 Processor -- start 2023-10-06T11:13:07.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.885+0000 7f48148b1700 1 -- start start 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.886+0000 7f48148b1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48101598a0 0x7f48100ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.886+0000 7f48148b1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100cf5d0 con 0x7f48101594d0 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.886+0000 7f48148b1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100cf8b0 con 0x7f48100cbc70 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.886+0000 7f48148b1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48100cfb90 con 0x7f48101598a0 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480e59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f48101594d0 0x7f48100cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50628/0 (socket says 172.21.15.55:50628) 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480e59c700 1 -- 172.21.15.55:0/4061960184 learned_addr learned my addr 172.21.15.55:0/4061960184 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480dd9b700 1 --2- 172.21.15.55:0/4061960184 >> v2:172.21.15.142:3300/0 conn(0x7f48101598a0 0x7f48100ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176794148 0 0) 0x7f48100cf5d0 con 0x7f48101594d0 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f8003570 con 0x7f48101594d0 2023-10-06T11:13:07.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629987996 0 0) 0x7f47f8003570 con 0x7f48101594d0 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 >> v2:172.21.15.142:3300/0 conn(0x7f48101598a0 msgr2=0x7f48100ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 --2- 172.21.15.55:0/4061960184 >> v2:172.21.15.142:3300/0 conn(0x7f48101598a0 0x7f48100ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 >> v1:172.21.15.142:6789/0 conn(0x7f48100cbc70 legacy=0x7f48100ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100cfe70 con 0x7f48101594d0 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f4800001470 con 0x7f48101594d0 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 >> v1:172.21.15.55:6789/0 conn(0x7f48101594d0 legacy=0x7f48100cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f8003a60 0x7f47f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f8004810 0x7f47f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f80051c0 0x7f47f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48100cfb90 con 0x7f47f8004810 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f800c0d0 con 0x7f47f8003a60 2023-10-06T11:13:07.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f800c290 con 0x7f47f80051c0 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480dd9b700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f8004810 0x7f47f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480e59c700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f8003a60 0x7f47f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.887+0000 7f480ed9d700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f80051c0 0x7f47f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480dd9b700 1 -- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f80051c0 msgr2=0x7f47f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480dd9b700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f80051c0 0x7f47f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480dd9b700 1 -- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f8003a60 msgr2=0x7f47f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480dd9b700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f8003a60 0x7f47f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480dd9b700 1 -- 172.21.15.55:0/4061960184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8003570 con 0x7f47f8004810 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480ed9d700 1 -- 172.21.15.55:0/4061960184 reap_dead start 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480dd9b700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f8004810 0x7f47f8004c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f48100cad00 tx=0x7f48040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b630396fd757b272 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400e6e0 con 0x7f47f8004810 2023-10-06T11:13:07.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400e840 con 0x7f47f8004810 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f480d59a700 1 -- 172.21.15.55:0/4061960184 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400ec00 con 0x7f47f8004810 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f48148b1700 1 -- 172.21.15.55:0/4061960184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f8004810 msgr2=0x7f47f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.888+0000 7f48148b1700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f8004810 0x7f47f8004c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f48100cad00 tx=0x7f48040091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.889+0000 7f48148b1700 1 -- 172.21.15.55:0/4061960184 shutdown_connections 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.889+0000 7f48148b1700 1 --2- 172.21.15.55:0/4061960184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f8004810 0x7f47f8004c80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.889+0000 7f48148b1700 1 -- 172.21.15.55:0/4061960184 >> 172.21.15.55:0/4061960184 conn(0x7f4810089e50 msgr2=0x7f4810099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.889+0000 7f48148b1700 1 -- 172.21.15.55:0/4061960184 shutdown_connections 2023-10-06T11:13:07.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.889+0000 7f48148b1700 1 -- 172.21.15.55:0/4061960184 wait complete. 2023-10-06T11:13:07.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 Processor -- start 2023-10-06T11:13:07.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 -- start start 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f8004810 0x7f481016b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f481014d0f0 0x7f481016a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 0x7f481015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481015dd30 con 0x7f481015d380 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48100b3710 con 0x7f481014d0f0 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.890+0000 7f48148b1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481016b350 con 0x7f47f8004810 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 0x7f481015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 0x7f481015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57472/0 (socket says 172.21.15.55:57472) 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 -- 172.21.15.55:0/492061970 learned_addr learned my addr 172.21.15.55:0/492061970 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480dd9b700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f481014d0f0 0x7f481016a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480e59c700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f8004810 0x7f481016b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 -- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f8004810 msgr2=0x7f481016b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f8004810 0x7f481016b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 -- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f481014d0f0 msgr2=0x7f481016a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f481014d0f0 0x7f481016a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 -- 172.21.15.55:0/492061970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100b33e0 con 0x7f481015d380 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f480ed9d700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 0x7f481015d7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48100cc070 tx=0x7f4808001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808006db0 con 0x7f481015d380 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480800c5a0 con 0x7f481015d380 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481016ad90 con 0x7f481015d380 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480800c960 con 0x7f481015d380 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.891+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481016baa0 con 0x7f481015d380 2023-10-06T11:13:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.892+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48100b3880 con 0x7f481015d380 2023-10-06T11:13:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.893+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f480800cd50 con 0x7f481015d380 2023-10-06T11:13:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.893+0000 7f47fe7fc700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47f0066f30 0x7f47f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.893+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4808083ff0 con 0x7f481015d380 2023-10-06T11:13:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.893+0000 7f480e59c700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47f0066f30 0x7f47f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.894+0000 7f480e59c700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47f0066f30 0x7f47f00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48000015a0 tx=0x7f4800001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:07.897+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4808051450 con 0x7f481015d380 2023-10-06T11:13:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.092+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4810064a90 con 0x7f481015d380 2023-10-06T11:13:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.093+0000 7f47fe7fc700 1 -- 172.21.15.55:0/492061970 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4808054a70 con 0x7f481015d380 2023-10-06T11:13:08.094 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47f0066f30 msgr2=0x7f47f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47f0066f30 0x7f47f00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48000015a0 tx=0x7f4800001e50 comp rx=0 tx=0).stop 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 msgr2=0x7f481015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 0x7f481015d7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48100cc070 tx=0x7f4808001640 comp rx=0 tx=0).stop 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 shutdown_connections 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47f0066f30 0x7f47f00693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f481015d380 0x7f481015d7f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f8004810 0x7f481016b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 --2- 172.21.15.55:0/492061970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f481014d0f0 0x7f481016a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 >> 172.21.15.55:0/492061970 conn(0x7f4810089e50 msgr2=0x7f481014e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 shutdown_connections 2023-10-06T11:13:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.095+0000 7f48148b1700 1 -- 172.21.15.55:0/492061970 wait complete. 2023-10-06T11:13:08.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:08.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.230+0000 7f1e82444700 1 Processor -- start 2023-10-06T11:13:08.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.230+0000 7f1e82444700 1 -- start start 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e82444700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0b49a0 0x7f1e7c0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e82444700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e7c0b0760 0x7f1e7c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e82444700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0b0c60 con 0x7f1e7c159560 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e82444700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0b0f40 con 0x7f1e7c0b0760 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e82444700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0b1220 con 0x7f1e7c0b49a0 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e7bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1e7c159560 0x7f1e7c0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50642/0 (socket says 172.21.15.55:50642) 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e7bfff700 1 -- 172.21.15.55:0/315170686 learned_addr learned my addr 172.21.15.55:0/315170686 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:08.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e809e1700 1 --2- 172.21.15.55:0/315170686 >> v2:172.21.15.55:3300/0 conn(0x7f1e7c0b0760 0x7f1e7c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e7b7fe700 1 --2- 172.21.15.55:0/315170686 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0b49a0 0x7f1e7c0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e809e1700 1 -- 172.21.15.55:0/315170686 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0b49a0 msgr2=0x7f1e7c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e809e1700 1 --2- 172.21.15.55:0/315170686 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0b49a0 0x7f1e7c0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e809e1700 1 -- 172.21.15.55:0/315170686 >> v1:172.21.15.55:6789/0 conn(0x7f1e7c159560 legacy=0x7f1e7c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e809e1700 1 -- 172.21.15.55:0/315170686 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0b1500 con 0x7f1e7c0b0760 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e7affd700 1 -- 172.21.15.55:0/315170686 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417581428 0 0) 0x7f1e7c0b0c60 con 0x7f1e7c159560 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.231+0000 7f1e809e1700 1 --2- 172.21.15.55:0/315170686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0b1bc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009e60 tx=0x7f1e74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781050ff8e2bebc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e7affd700 1 -- 172.21.15.55:0/315170686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400e070 con 0x7f1e7c0b0760 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e7affd700 1 -- 172.21.15.55:0/315170686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400bbf0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e7affd700 1 -- 172.21.15.55:0/315170686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74012430 con 0x7f1e7c0b0760 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 -- 172.21.15.55:0/315170686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 msgr2=0x7f1e7c0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 --2- 172.21.15.55:0/315170686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0b1bc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009e60 tx=0x7f1e74009780 comp rx=0 tx=0).stop 2023-10-06T11:13:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 -- 172.21.15.55:0/315170686 shutdown_connections 2023-10-06T11:13:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 --2- 172.21.15.55:0/315170686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0b1bc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 --2- 172.21.15.55:0/315170686 >> v2:172.21.15.142:3300/0 conn(0x7f1e7c0b49a0 0x7f1e7c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 -- 172.21.15.55:0/315170686 >> 172.21.15.55:0/315170686 conn(0x7f1e7c0997f0 msgr2=0x7f1e7c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 -- 172.21.15.55:0/315170686 shutdown_connections 2023-10-06T11:13:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.232+0000 7f1e82444700 1 -- 172.21.15.55:0/315170686 wait complete. 2023-10-06T11:13:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.233+0000 7f1e82444700 1 Processor -- start 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 -- start start 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0b49a0 0x7f1e7c09c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c159560 0x7f1e7c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c09d190 con 0x7f1e7c0b0760 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c09d470 con 0x7f1e7c159560 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e82444700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0ac630 con 0x7f1e7c0b49a0 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e7bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e7bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57486/0 (socket says 172.21.15.55:57486) 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.234+0000 7f1e7bfff700 1 -- 172.21.15.55:0/2651663246 learned_addr learned my addr 172.21.15.55:0/2651663246 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e809e1700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c159560 0x7f1e7c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7b7fe700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0b49a0 0x7f1e7c09c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7bfff700 1 -- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0b49a0 msgr2=0x7f1e7c09c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7bfff700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0b49a0 0x7f1e7c09c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7bfff700 1 -- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c159560 msgr2=0x7f1e7c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7bfff700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c159560 0x7f1e7c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7bfff700 1 -- 172.21.15.55:0/2651663246 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74009a20 con 0x7f1e7c0b0760 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e809e1700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c159560 0x7f1e7c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e7bfff700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0aea20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000c590 tx=0x7f1e70007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700072e0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70007480 con 0x7f1e7c0b0760 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c0ac910 con 0x7f1e7c0b0760 2023-10-06T11:13:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700057f0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.235+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c09a210 con 0x7f1e7c0b0760 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.236+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c064a90 con 0x7f1e7c0b0760 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.236+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e70005ba0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.237+0000 7f1e63fff700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1e68066f30 0x7f1e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.237+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1e70083790 con 0x7f1e7c0b0760 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.237+0000 7f1e7b7fe700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1e68066f30 0x7f1e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.238+0000 7f1e7b7fe700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1e68066f30 0x7f1e680693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c006fd0 tx=0x7f1e6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.241+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e70050ca0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:08.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.481+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e7c0b17e0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.481+0000 7f1e63fff700 1 -- 172.21.15.55:0/2651663246 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f1e700542c0 con 0x7f1e7c0b0760 2023-10-06T11:13:08.483 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:08.483 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1e68066f30 msgr2=0x7f1e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1e68066f30 0x7f1e680693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c006fd0 tx=0x7f1e6c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 msgr2=0x7f1e7c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0aea20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000c590 tx=0x7f1e70007e80 comp rx=0 tx=0).stop 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 shutdown_connections 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1e68066f30 0x7f1e680693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c0b0760 0x7f1e7c0aea20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e7c159560 0x7f1e7c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 --2- 172.21.15.55:0/2651663246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e7c0b49a0 0x7f1e7c09c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 >> 172.21.15.55:0/2651663246 conn(0x7f1e7c0997f0 msgr2=0x7f1e7c158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 shutdown_connections 2023-10-06T11:13:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.483+0000 7f1e82444700 1 -- 172.21.15.55:0/2651663246 wait complete. 2023-10-06T11:13:08.486 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2023-10-06T11:13:08.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.615+0000 7f251cfec700 1 Processor -- start 2023-10-06T11:13:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.615+0000 7f251cfec700 1 -- start start 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251cfec700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2518142d70 0x7f251806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251cfec700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f251806f930 0x7f25180d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251cfec700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180cc7a0 con 0x7f2518143140 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251cfec700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180ce3c0 con 0x7f251806f930 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251cfec700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180cca80 con 0x7f2518142d70 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f251806f930 0x7f25180d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f251806f930 0x7f25180d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57496/0 (socket says 172.21.15.55:57496) 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 -- 172.21.15.55:0/3990664728 learned_addr learned my addr 172.21.15.55:0/3990664728 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251659c700 1 --2- 172.21.15.55:0/3990664728 >> v2:172.21.15.142:3300/0 conn(0x7f2518142d70 0x7f251806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 -- 172.21.15.55:0/3990664728 >> v2:172.21.15.142:3300/0 conn(0x7f2518142d70 msgr2=0x7f251806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 --2- 172.21.15.55:0/3990664728 >> v2:172.21.15.142:3300/0 conn(0x7f2518142d70 0x7f251806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 -- 172.21.15.55:0/3990664728 >> v1:172.21.15.142:6789/0 conn(0x7f2518143140 legacy=0x7f251815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 -- 172.21.15.55:0/3990664728 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180ccd60 con 0x7f251806f930 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f2515d9b700 1 --2- 172.21.15.55:0/3990664728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f251806f930 0x7f25180d0370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25180701d0 tx=0x7f250c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecd6b99c572b2d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.616+0000 7f251559a700 1 -- 172.21.15.55:0/3990664728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00b820 con 0x7f251806f930 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251559a700 1 -- 172.21.15.55:0/3990664728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00b980 con 0x7f251806f930 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251559a700 1 -- 172.21.15.55:0/3990664728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00bd20 con 0x7f251806f930 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 -- 172.21.15.55:0/3990664728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f251806f930 msgr2=0x7f25180d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 --2- 172.21.15.55:0/3990664728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f251806f930 0x7f25180d0370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25180701d0 tx=0x7f250c009250 comp rx=0 tx=0).stop 2023-10-06T11:13:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 -- 172.21.15.55:0/3990664728 shutdown_connections 2023-10-06T11:13:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 --2- 172.21.15.55:0/3990664728 >> v2:172.21.15.142:3300/0 conn(0x7f2518142d70 0x7f251806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 --2- 172.21.15.55:0/3990664728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f251806f930 0x7f25180d0370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 -- 172.21.15.55:0/3990664728 >> 172.21.15.55:0/3990664728 conn(0x7f2518068d70 msgr2=0x7f251806ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 -- 172.21.15.55:0/3990664728 shutdown_connections 2023-10-06T11:13:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.617+0000 7f251cfec700 1 -- 172.21.15.55:0/3990664728 wait complete. 2023-10-06T11:13:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.618+0000 7f251cfec700 1 Processor -- start 2023-10-06T11:13:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.618+0000 7f251cfec700 1 -- start start 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251cfec700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 0x7f251813c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251cfec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2518143140 0x7f25180b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251cfec700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25180b42c0 0x7f25180b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251cfec700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b2040 con 0x7f2518142d70 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251cfec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b1780 con 0x7f2518143140 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251cfec700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b19f0 con 0x7f25180b42c0 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 0x7f251813c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 0x7f251813c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57512/0 (socket says 172.21.15.55:57512) 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 -- 172.21.15.55:0/512636142 learned_addr learned my addr 172.21.15.55:0/512636142 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f2515d9b700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2518143140 0x7f25180b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f2516d9d700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25180b42c0 0x7f25180b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 -- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25180b42c0 msgr2=0x7f25180b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25180b42c0 0x7f25180b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 -- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2518143140 msgr2=0x7f25180b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2518143140 0x7f25180b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.619+0000 7f251659c700 1 -- 172.21.15.55:0/512636142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0094f0 con 0x7f2518142d70 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.620+0000 7f251659c700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 0x7f251813c520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f250800d890 tx=0x7f2508008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.620+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080125f0 con 0x7f2518142d70 2023-10-06T11:13:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.620+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508012750 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.620+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508012af0 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.620+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25180b1cd0 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.620+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251813ca60 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.621+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2518064a90 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.621+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f250801e460 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.621+0000 7f25067fc700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24f8066f30 0x7f24f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.622+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f25080848b0 con 0x7f2518142d70 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.622+0000 7f2515d9b700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24f8066f30 0x7f24f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.622+0000 7f2515d9b700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24f8066f30 0x7f24f80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f251806a870 tx=0x7f250c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.626+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2508051d10 con 0x7f2518142d70 2023-10-06T11:13:08.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.820+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25180cd040 con 0x7f2518142d70 2023-10-06T11:13:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.820+0000 7f25067fc700 1 -- 172.21.15.55:0/512636142 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f2508055330 con 0x7f2518142d70 2023-10-06T11:13:08.822 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:08.822 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:08.060527+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24f8066f30 msgr2=0x7f24f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24f8066f30 0x7f24f80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f251806a870 tx=0x7f250c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 msgr2=0x7f251813c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 0x7f251813c520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f250800d890 tx=0x7f2508008040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 shutdown_connections 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24f8066f30 0x7f24f80693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2518142d70 0x7f251813c520 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.822+0000 7f251cfec700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25180b42c0 0x7f25180b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.823+0000 7f251cfec700 1 --2- 172.21.15.55:0/512636142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2518143140 0x7f25180b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.823+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 >> 172.21.15.55:0/512636142 conn(0x7f2518068d70 msgr2=0x7f25180af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.823+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 shutdown_connections 2023-10-06T11:13:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.823+0000 7f251cfec700 1 -- 172.21.15.55:0/512636142 wait complete. 2023-10-06T11:13:08.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:13:08.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.957+0000 7fc12ab48700 1 Processor -- start 2023-10-06T11:13:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.957+0000 7fc12ab48700 1 -- start start 2023-10-06T11:13:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc12ab48700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1241594d0 0x7fc1240cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc12ab48700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1240cbaa0 0x7fc1240ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc12ab48700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1240cbee0 con 0x7fc1241598a0 2023-10-06T11:13:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc12ab48700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240cf5d0 con 0x7fc1241594d0 2023-10-06T11:13:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc12ab48700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240cf8b0 con 0x7fc1240cbaa0 2023-10-06T11:13:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc1288e4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1241594d0 0x7fc1240cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc1288e4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1241594d0 0x7fc1240cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57516/0 (socket says 172.21.15.55:57516) 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc1288e4700 1 -- 172.21.15.55:0/4212773301 learned_addr learned my addr 172.21.15.55:0/4212773301 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.958+0000 7fc1290e5700 1 --2- 172.21.15.55:0/4212773301 >> v2:172.21.15.142:3300/0 conn(0x7fc1240cbaa0 0x7fc1240ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1288e4700 1 -- 172.21.15.55:0/4212773301 >> v2:172.21.15.142:3300/0 conn(0x7fc1240cbaa0 msgr2=0x7fc1240ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1288e4700 1 --2- 172.21.15.55:0/4212773301 >> v2:172.21.15.142:3300/0 conn(0x7fc1240cbaa0 0x7fc1240ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1288e4700 1 -- 172.21.15.55:0/4212773301 >> v1:172.21.15.142:6789/0 conn(0x7fc1241598a0 legacy=0x7fc1240ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1288e4700 1 -- 172.21.15.55:0/4212773301 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240cfb90 con 0x7fc1241594d0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1288e4700 1 --2- 172.21.15.55:0/4212773301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1241594d0 0x7fc1240cb560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc12406f950 tx=0x7fc11c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e188b8c2282512c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1237fe700 1 -- 172.21.15.55:0/4212773301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00e070 con 0x7fc1241594d0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1237fe700 1 -- 172.21.15.55:0/4212773301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00ba10 con 0x7fc1241594d0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc1237fe700 1 -- 172.21.15.55:0/4212773301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0092e0 con 0x7fc1241594d0 2023-10-06T11:13:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 -- 172.21.15.55:0/4212773301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1241594d0 msgr2=0x7fc1240cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 --2- 172.21.15.55:0/4212773301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1241594d0 0x7fc1240cb560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc12406f950 tx=0x7fc11c009840 comp rx=0 tx=0).stop 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 -- 172.21.15.55:0/4212773301 shutdown_connections 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 --2- 172.21.15.55:0/4212773301 >> v2:172.21.15.142:3300/0 conn(0x7fc1240cbaa0 0x7fc1240ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 --2- 172.21.15.55:0/4212773301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1241594d0 0x7fc1240cb560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 -- 172.21.15.55:0/4212773301 >> 172.21.15.55:0/4212773301 conn(0x7fc124089e50 msgr2=0x7fc124099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 -- 172.21.15.55:0/4212773301 shutdown_connections 2023-10-06T11:13:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.959+0000 7fc12ab48700 1 -- 172.21.15.55:0/4212773301 wait complete. 2023-10-06T11:13:08.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 Processor -- start 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 -- start start 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 0x7fc12414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1241594d0 0x7fc124068490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241598a0 0x7fc1240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240b32b0 con 0x7fc1240cbaa0 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240b3500 con 0x7fc1241598a0 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.961+0000 7fc12ab48700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240b37e0 con 0x7fc1241594d0 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 0x7fc12414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 0x7fc12414cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57528/0 (socket says 172.21.15.55:57528) 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 -- 172.21.15.55:0/889739868 learned_addr learned my addr 172.21.15.55:0/889739868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc123fff700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1241594d0 0x7fc124068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1290e5700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241598a0 0x7fc1240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 -- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1241594d0 msgr2=0x7fc124068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1241594d0 0x7fc124068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 -- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241598a0 msgr2=0x7fc1240689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241598a0 0x7fc1240689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 -- 172.21.15.55:0/889739868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c009ae0 con 0x7fc1240cbaa0 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc123fff700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1241594d0 0x7fc124068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1290e5700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241598a0 0x7fc1240689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc1288e4700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 0x7fc12414cec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1240cc070 tx=0x7fc11c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012950 con 0x7fc1240cbaa0 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c012ad0 con 0x7fc1240cbaa0 2023-10-06T11:13:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1240b3ac0 con 0x7fc1240cbaa0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012e90 con 0x7fc1240cbaa0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.962+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1240b42c0 con 0x7fc1240cbaa0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.963+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc124064a90 con 0x7fc1240cbaa0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.963+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc11c01d630 con 0x7fc1240cbaa0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.964+0000 7fc120ff9700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc104066f30 0x7fc1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.964+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc11c085970 con 0x7fc1240cbaa0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.964+0000 7fc123fff700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc104066f30 0x7fc1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.965+0000 7fc123fff700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc104066f30 0x7fc1040693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc114006fd0 tx=0x7fc114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:08.968+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc11c052dd0 con 0x7fc1240cbaa0 2023-10-06T11:13:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.165+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1240cfe70 con 0x7fc1240cbaa0 2023-10-06T11:13:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.165+0000 7fc120ff9700 1 -- 172.21.15.55:0/889739868 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc11c02a0a0 con 0x7fc1240cbaa0 2023-10-06T11:13:09.167 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:09.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc104066f30 msgr2=0x7fc1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc104066f30 0x7fc1040693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc114006fd0 tx=0x7fc114008040 comp rx=0 tx=0).stop 2023-10-06T11:13:09.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 msgr2=0x7fc12414cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 0x7fc12414cec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1240cc070 tx=0x7fc11c017000 comp rx=0 tx=0).stop 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 shutdown_connections 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc104066f30 0x7fc1040693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1240cbaa0 0x7fc12414cec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1241598a0 0x7fc1240689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 --2- 172.21.15.55:0/889739868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1241594d0 0x7fc124068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 >> 172.21.15.55:0/889739868 conn(0x7fc124089e50 msgr2=0x7fc12415bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.167+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 shutdown_connections 2023-10-06T11:13:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.168+0000 7fc12ab48700 1 -- 172.21.15.55:0/889739868 wait complete. 2023-10-06T11:13:09.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.300+0000 7f2c98e78700 1 Processor -- start 2023-10-06T11:13:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.300+0000 7f2c98e78700 1 -- start start 2023-10-06T11:13:09.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c98e78700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c941598a0 0x7f2c940ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c98e78700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c940cbc70 0x7f2c940ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c98e78700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940cf5d0 con 0x7f2c941594d0 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c98e78700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940cf8b0 con 0x7f2c941598a0 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c98e78700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940cfb90 con 0x7f2c940cbc70 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c91d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c941598a0 0x7f2c940ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c9259c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2c941594d0 0x7f2c940cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50652/0 (socket says 172.21.15.55:50652) 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.301+0000 7f2c9259c700 1 -- 172.21.15.55:0/789748060 learned_addr learned my addr 172.21.15.55:0/789748060 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c92d9d700 1 --2- 172.21.15.55:0/789748060 >> v2:172.21.15.142:3300/0 conn(0x7f2c940cbc70 0x7f2c940ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c9159a700 1 -- 172.21.15.55:0/789748060 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546583208 0 0) 0x7f2c940cf5d0 con 0x7f2c941594d0 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c9159a700 1 -- 172.21.15.55:0/789748060 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c80003570 con 0x7f2c941594d0 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c91d9b700 1 -- 172.21.15.55:0/789748060 >> v2:172.21.15.142:3300/0 conn(0x7f2c940cbc70 msgr2=0x7f2c940ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:09.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c91d9b700 1 --2- 172.21.15.55:0/789748060 >> v2:172.21.15.142:3300/0 conn(0x7f2c940cbc70 0x7f2c940ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c91d9b700 1 -- 172.21.15.55:0/789748060 >> v1:172.21.15.55:6789/0 conn(0x7f2c941594d0 legacy=0x7f2c940cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c91d9b700 1 -- 172.21.15.55:0/789748060 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940cfe70 con 0x7f2c941598a0 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c91d9b700 1 --2- 172.21.15.55:0/789748060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c940ce7e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406f950 tx=0x7f2c7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6175fb880bd2f987 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c9159a700 1 -- 172.21.15.55:0/789748060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c011630 con 0x7f2c941598a0 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c9159a700 1 -- 172.21.15.55:0/789748060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c0117b0 con 0x7f2c941598a0 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.302+0000 7f2c9159a700 1 -- 172.21.15.55:0/789748060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c011b70 con 0x7f2c941598a0 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 -- 172.21.15.55:0/789748060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 msgr2=0x7f2c940ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 --2- 172.21.15.55:0/789748060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c940ce7e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406f950 tx=0x7f2c7c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 -- 172.21.15.55:0/789748060 shutdown_connections 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 --2- 172.21.15.55:0/789748060 >> v2:172.21.15.142:3300/0 conn(0x7f2c940cbc70 0x7f2c940ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 --2- 172.21.15.55:0/789748060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c940ce7e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 -- 172.21.15.55:0/789748060 >> 172.21.15.55:0/789748060 conn(0x7f2c94089e50 msgr2=0x7f2c94099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:09.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 -- 172.21.15.55:0/789748060 shutdown_connections 2023-10-06T11:13:09.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.303+0000 7f2c98e78700 1 -- 172.21.15.55:0/789748060 wait complete. 2023-10-06T11:13:09.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.304+0000 7f2c98e78700 1 Processor -- start 2023-10-06T11:13:09.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.304+0000 7f2c98e78700 1 -- start start 2023-10-06T11:13:09.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c940cbc70 0x7f2c9415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c941594d0 0x7f2c941490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c94158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9416e180 con 0x7f2c941598a0 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9416d570 con 0x7f2c941594d0 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9416d850 con 0x7f2c940cbc70 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c94158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c94158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57548/0 (socket says 172.21.15.55:57548) 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 -- 172.21.15.55:0/3379274074 learned_addr learned my addr 172.21.15.55:0/3379274074 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c91d9b700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c941594d0 0x7f2c941490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c9259c700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c940cbc70 0x7f2c9415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 -- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c940cbc70 msgr2=0x7f2c9415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c940cbc70 0x7f2c9415ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 -- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c941594d0 msgr2=0x7f2c941490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c941594d0 0x7f2c941490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 -- 172.21.15.55:0/3379274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c009420 con 0x7f2c941598a0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c91d9b700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c941594d0 0x7f2c941490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c92d9d700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c94158540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009ec0 tx=0x7f2c8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400cc20 con 0x7f2c941598a0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8400f040 con 0x7f2c941598a0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84014480 con 0x7f2c941598a0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9416db30 con 0x7f2c941598a0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.305+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9415cac0 con 0x7f2c941598a0 2023-10-06T11:13:09.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.306+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c94064a90 con 0x7f2c941598a0 2023-10-06T11:13:09.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.307+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c84014810 con 0x7f2c941598a0 2023-10-06T11:13:09.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.307+0000 7f2c8a7fc700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2c74066f30 0x7f2c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.307+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c84084e30 con 0x7f2c941598a0 2023-10-06T11:13:09.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.307+0000 7f2c9259c700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2c74066f30 0x7f2c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.308+0000 7f2c9259c700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2c74066f30 0x7f2c740693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0058d0 tx=0x7f2c8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.312+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c84052290 con 0x7f2c941598a0 2023-10-06T11:13:09.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.505+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c940cf260 con 0x7f2c941598a0 2023-10-06T11:13:09.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.505+0000 7f2c8a7fc700 1 -- 172.21.15.55:0/3379274074 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c840180a0 con 0x7f2c941598a0 2023-10-06T11:13:09.507 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:09.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2c74066f30 msgr2=0x7f2c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2c74066f30 0x7f2c740693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0058d0 tx=0x7f2c8c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:09.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 msgr2=0x7f2c94158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c94158540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009ec0 tx=0x7f2c8400b040 comp rx=0 tx=0).stop 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 shutdown_connections 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2c74066f30 0x7f2c740693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c941598a0 0x7f2c94158540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c940cbc70 0x7f2c9415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 --2- 172.21.15.55:0/3379274074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c941594d0 0x7f2c941490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.507+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 >> 172.21.15.55:0/3379274074 conn(0x7f2c94089e50 msgr2=0x7f2c940c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.508+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 shutdown_connections 2023-10-06T11:13:09.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.508+0000 7f2c98e78700 1 -- 172.21.15.55:0/3379274074 wait complete. 2023-10-06T11:13:09.521 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:13:09.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.638+0000 7f991e59f700 1 Processor -- start 2023-10-06T11:13:09.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.638+0000 7f991e59f700 1 -- start start 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991e59f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99180cbc30 0x7f99180cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991e59f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99180b2100 0x7f99180b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991e59f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180cb7a0 con 0x7f9918159440 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991e59f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180b0860 con 0x7f99180b2100 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991e59f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180cb150 con 0x7f99180cbc30 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99180b2100 0x7f99180b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99180b2100 0x7f99180b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57564/0 (socket says 172.21.15.55:57564) 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 -- 172.21.15.55:0/160562301 learned_addr learned my addr 172.21.15.55:0/160562301 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991cd9c700 1 --2- 172.21.15.55:0/160562301 >> v2:172.21.15.142:3300/0 conn(0x7f99180cbc30 0x7f99180cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 -- 172.21.15.55:0/160562301 >> v2:172.21.15.142:3300/0 conn(0x7f99180cbc30 msgr2=0x7f99180cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 --2- 172.21.15.55:0/160562301 >> v2:172.21.15.142:3300/0 conn(0x7f99180cbc30 0x7f99180cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 -- 172.21.15.55:0/160562301 >> v1:172.21.15.142:6789/0 conn(0x7f9918159440 legacy=0x7f99180b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.639+0000 7f991dd9e700 1 -- 172.21.15.55:0/160562301 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180cb430 con 0x7f99180b2100 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991dd9e700 1 --2- 172.21.15.55:0/160562301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99180b2100 0x7f99180b2520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99180d0220 tx=0x7f9908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87a2e6259109a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f9917fff700 1 -- 172.21.15.55:0/160562301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800e070 con 0x7f99180b2100 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f9917fff700 1 -- 172.21.15.55:0/160562301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800ba50 con 0x7f99180b2100 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f9917fff700 1 -- 172.21.15.55:0/160562301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080092e0 con 0x7f99180b2100 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 -- 172.21.15.55:0/160562301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99180b2100 msgr2=0x7f99180b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 --2- 172.21.15.55:0/160562301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99180b2100 0x7f99180b2520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99180d0220 tx=0x7f9908009840 comp rx=0 tx=0).stop 2023-10-06T11:13:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 -- 172.21.15.55:0/160562301 shutdown_connections 2023-10-06T11:13:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 --2- 172.21.15.55:0/160562301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99180b2100 0x7f99180b2520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 --2- 172.21.15.55:0/160562301 >> v2:172.21.15.142:3300/0 conn(0x7f99180cbc30 0x7f99180cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 -- 172.21.15.55:0/160562301 >> 172.21.15.55:0/160562301 conn(0x7f991806ece0 msgr2=0x7f991806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 -- 172.21.15.55:0/160562301 shutdown_connections 2023-10-06T11:13:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.640+0000 7f991e59f700 1 -- 172.21.15.55:0/160562301 wait complete. 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.641+0000 7f991e59f700 1 Processor -- start 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 -- start start 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99180b2100 0x7f99180c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99180cbc30 0x7f99180ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 0x7f99180ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c8550 con 0x7f9918159440 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c3c80 con 0x7f99180cbc30 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.642+0000 7f991e59f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c7cb0 con 0x7f99180b2100 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 0x7f99180ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 0x7f99180ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57574/0 (socket says 172.21.15.55:57574) 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 -- 172.21.15.55:0/3438135055 learned_addr learned my addr 172.21.15.55:0/3438135055 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991cd9c700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99180cbc30 0x7f99180ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991d59d700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99180b2100 0x7f99180c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 -- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99180b2100 msgr2=0x7f99180c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99180b2100 0x7f99180c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 -- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99180cbc30 msgr2=0x7f99180ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99180cbc30 0x7f99180ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 -- 172.21.15.55:0/3438135055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009ae0 con 0x7f9918159440 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991dd9e700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 0x7f99180ce880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9908009fd0 tx=0x7f9908018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080094e0 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800be60 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99180c7f90 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908026460 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.643+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99180c9b50 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.644+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99180c3e10 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.645+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9908003040 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.645+0000 7f99157fa700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9904066f30 0x7f99040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.645+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9908086330 con 0x7f9918159440 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.645+0000 7f991d59d700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9904066f30 0x7f99040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.645+0000 7f991d59d700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9904066f30 0x7f99040693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99100039e0 tx=0x7f9910007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.649+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99080536f0 con 0x7f9918159440 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.843+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f991805f230 con 0x7f9918159440 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.843+0000 7f99157fa700 1 -- 172.21.15.55:0/3438135055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9908009940 con 0x7f9918159440 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:13:09.845 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:13:09.846 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:13:09.846 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:13:09.846 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:13:09.846 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:13:09.846 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:13:09.846 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:13:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9904066f30 msgr2=0x7f99040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9904066f30 0x7f99040693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99100039e0 tx=0x7f9910007ec0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 msgr2=0x7f99180ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 0x7f99180ce880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9908009fd0 tx=0x7f9908018000 comp rx=0 tx=0).stop 2023-10-06T11:13:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 shutdown_connections 2023-10-06T11:13:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9904066f30 0x7f99040693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9918159440 0x7f99180ce880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99180b2100 0x7f99180c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 --2- 172.21.15.55:0/3438135055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99180cbc30 0x7f99180ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 >> 172.21.15.55:0/3438135055 conn(0x7f991806ece0 msgr2=0x7f9918158430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 shutdown_connections 2023-10-06T11:13:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.845+0000 7f991e59f700 1 -- 172.21.15.55:0/3438135055 wait complete. 2023-10-06T11:13:09.859 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:13:09.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:13:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.982+0000 7fed4decc700 1 Processor -- start 2023-10-06T11:13:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.982+0000 7fed4decc700 1 -- start start 2023-10-06T11:13:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.982+0000 7fed4decc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.982+0000 7fed4decc700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480b2ce0 con 0x7fed4806ece0 2023-10-06T11:13:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.982+0000 7fed4decc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480b0410 con 0x7fed480b2360 2023-10-06T11:13:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.982+0000 7fed4decc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4806fb40 con 0x7fed4815a740 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed477fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fed4806ece0 0x7fed4806f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50660/0 (socket says 172.21.15.55:50660) 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed477fe700 1 -- 172.21.15.55:0/2701250409 learned_addr learned my addr 172.21.15.55:0/2701250409 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed47fff700 1 --2- 172.21.15.55:0/2701250409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638073971 0 0) 0x7fed480b2ce0 con 0x7fed4806ece0 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed30003570 con 0x7fed4806ece0 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185692460 0 0) 0x7fed480b0410 con 0x7fed480b2360 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed480b2ce0 con 0x7fed480b2360 2023-10-06T11:13:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed47fff700 1 -- 172.21.15.55:0/2701250409 >> v1:172.21.15.142:6789/0 conn(0x7fed480b2360 legacy=0x7fed480b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed47fff700 1 -- 172.21.15.55:0/2701250409 >> v1:172.21.15.55:6789/0 conn(0x7fed4806ece0 legacy=0x7fed4806f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed47fff700 1 -- 172.21.15.55:0/2701250409 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480b2a00 con 0x7fed4815a740 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed47fff700 1 --2- 172.21.15.55:0/2701250409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480aede0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed40009e90 tx=0x7fed40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276a4e0bcaab1d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000e070 con 0x7fed4815a740 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4000bb80 con 0x7fed4815a740 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.983+0000 7fed467fc700 1 -- 172.21.15.55:0/2701250409 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40012430 con 0x7fed4815a740 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 -- 172.21.15.55:0/2701250409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 msgr2=0x7fed480aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 --2- 172.21.15.55:0/2701250409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480aede0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed40009e90 tx=0x7fed40009780 comp rx=0 tx=0).stop 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 -- 172.21.15.55:0/2701250409 shutdown_connections 2023-10-06T11:13:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 --2- 172.21.15.55:0/2701250409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480aede0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 -- 172.21.15.55:0/2701250409 >> 172.21.15.55:0/2701250409 conn(0x7fed480682f0 msgr2=0x7fed480686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 -- 172.21.15.55:0/2701250409 shutdown_connections 2023-10-06T11:13:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.984+0000 7fed4decc700 1 -- 172.21.15.55:0/2701250409 wait complete. 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.985+0000 7fed4decc700 1 Processor -- start 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.985+0000 7fed4decc700 1 -- start start 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed4decc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 0x7fed4814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed4decc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed480b2360 0x7fed480cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed4decc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed4decc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed48155d00 con 0x7fed4806ece0 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed4decc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4816d9d0 con 0x7fed480b2360 2023-10-06T11:13:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed4decc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480ce160 con 0x7fed4815a740 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 0x7fed4814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 0x7fed4814b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57578/0 (socket says 172.21.15.55:57578) 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 -- 172.21.15.55:0/2910042900 learned_addr learned my addr 172.21.15.55:0/2910042900 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed47fff700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed46ffd700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed480b2360 0x7fed480cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 -- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 msgr2=0x7fed480c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 -- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed480b2360 msgr2=0x7fed480cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed480b2360 0x7fed480cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.986+0000 7fed477fe700 1 -- 172.21.15.55:0/2910042900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40009a20 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.987+0000 7fed477fe700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 0x7fed4814b740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed3800c790 tx=0x7fed38007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.987+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38005b30 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.987+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38005c90 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.987+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed480ce440 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.987+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38007300 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.987+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4814bc80 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.988+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed480cdfa0 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.988+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed3801b3b0 con 0x7fed4806ece0 2023-10-06T11:13:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.988+0000 7fed2f7fe700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.988+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fed380837d0 con 0x7fed4806ece0 2023-10-06T11:13:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.989+0000 7fed46ffd700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.989+0000 7fed46ffd700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed480b61f0 tx=0x7fed3c007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:09.993+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed380546c0 con 0x7fed4806ece0 2023-10-06T11:13:10.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:10.189+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fed48064a90 con 0x7fed4806ece0 2023-10-06T11:13:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.094+0000 7fed2f7fe700 1 -- 172.21.15.55:0/2910042900 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fed38017020 con 0x7fed4806ece0 2023-10-06T11:13:11.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.098+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed34066f30 msgr2=0x7fed340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.098+0000 7fed4decc700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed480b61f0 tx=0x7fed3c007d50 comp rx=0 tx=0).stop 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.098+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 msgr2=0x7fed4814b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.098+0000 7fed4decc700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 0x7fed4814b740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed3800c790 tx=0x7fed38007ea0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 shutdown_connections 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed4806ece0 0x7fed4814b740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed4815a740 0x7fed480c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 --2- 172.21.15.55:0/2910042900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed480b2360 0x7fed480cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 >> 172.21.15.55:0/2910042900 conn(0x7fed480682f0 msgr2=0x7fed4815b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 shutdown_connections 2023-10-06T11:13:11.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.099+0000 7fed4decc700 1 -- 172.21.15.55:0/2910042900 wait complete. 2023-10-06T11:13:11.102 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:13:11.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T11:13:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.246+0000 7f512422e700 1 Processor -- start 2023-10-06T11:13:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.247+0000 7f512422e700 1 -- start start 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.247+0000 7f512422e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f511c1598a0 0x7f511c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.247+0000 7f512422e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0cf5d0 con 0x7f511c0cbc70 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.247+0000 7f512422e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0cf8b0 con 0x7f511c1594d0 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.247+0000 7f512422e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0cfb90 con 0x7f511c1598a0 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51217c9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f511c1598a0 0x7f511c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51227cb700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f511c0cbc70 0x7f511c0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50672/0 (socket says 172.21.15.55:50672) 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51217c9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f511c1598a0 0x7f511c0ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57588/0 (socket says 172.21.15.55:57588) 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51227cb700 1 -- 172.21.15.55:0/3433047314 learned_addr learned my addr 172.21.15.55:0/3433047314 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:11.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51217c9700 1 -- 172.21.15.55:0/3433047314 >> v1:172.21.15.142:6789/0 conn(0x7f511c1594d0 legacy=0x7f511c0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51217c9700 1 -- 172.21.15.55:0/3433047314 >> v1:172.21.15.55:6789/0 conn(0x7f511c0cbc70 legacy=0x7f511c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f5120fc8700 1 -- 172.21.15.55:0/3433047314 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576386767 0 0) 0x7f511c0cf5d0 con 0x7f511c0cbc70 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51217c9700 1 -- 172.21.15.55:0/3433047314 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0cfe70 con 0x7f511c1598a0 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f51217c9700 1 --2- 172.21.15.55:0/3433047314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0ce7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51100098e0 tx=0x7f51100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f209ce7ffb84fb68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f5120fc8700 1 -- 172.21.15.55:0/3433047314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110009e80 con 0x7f511c1598a0 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f5120fc8700 1 -- 172.21.15.55:0/3433047314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000b860 con 0x7f511c1598a0 2023-10-06T11:13:11.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.248+0000 7f5120fc8700 1 -- 172.21.15.55:0/3433047314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000bbe0 con 0x7f511c1598a0 2023-10-06T11:13:11.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 -- 172.21.15.55:0/3433047314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 msgr2=0x7f511c0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 --2- 172.21.15.55:0/3433047314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0ce7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51100098e0 tx=0x7f51100091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 -- 172.21.15.55:0/3433047314 shutdown_connections 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 --2- 172.21.15.55:0/3433047314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0ce7e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 -- 172.21.15.55:0/3433047314 >> 172.21.15.55:0/3433047314 conn(0x7f511c089e50 msgr2=0x7f511c099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 -- 172.21.15.55:0/3433047314 shutdown_connections 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.249+0000 7f512422e700 1 -- 172.21.15.55:0/3433047314 wait complete. 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.250+0000 7f512422e700 1 Processor -- start 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.250+0000 7f512422e700 1 -- start start 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f512422e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c0cbc70 0x7f511c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f512422e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f511c1594d0 0x7f511c16d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:11.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f512422e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f512422e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c149c20 con 0x7f511c1598a0 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f512422e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c14db20 con 0x7f511c0cbc70 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f512422e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c16de20 con 0x7f511c1594d0 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57604/0 (socket says 172.21.15.55:57604) 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 -- 172.21.15.55:0/3256715114 learned_addr learned my addr 172.21.15.55:0/3256715114 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f5121fca700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c0cbc70 0x7f511c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51217c9700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f511c1594d0 0x7f511c16d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 -- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f511c1594d0 msgr2=0x7f511c16d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f511c1594d0 0x7f511c16d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 -- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c0cbc70 msgr2=0x7f511c1496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c0cbc70 0x7f511c1496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 -- 172.21.15.55:0/3256715114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110009420 con 0x7f511c1598a0 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f51227cb700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0b32b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f510c00cc10 tx=0x7f510c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.251+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00a8b0 con 0x7f511c1598a0 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.252+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c00aa30 con 0x7f511c1598a0 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.252+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c16e100 con 0x7f511c1598a0 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.252+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00adf0 con 0x7f511c1598a0 2023-10-06T11:13:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.252+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c14e080 con 0x7f511c1598a0 2023-10-06T11:13:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.253+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c14e270 con 0x7f511c1598a0 2023-10-06T11:13:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.253+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f510c007300 con 0x7f511c1598a0 2023-10-06T11:13:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.253+0000 7f5119ffb700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5108066f30 0x7f51080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.254+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f510c084790 con 0x7f511c1598a0 2023-10-06T11:13:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.254+0000 7f5121fca700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5108066f30 0x7f51080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.254+0000 7f5121fca700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5108066f30 0x7f51080693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5114003a80 tx=0x7f5114007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:11.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.258+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f510c051b00 con 0x7f511c1598a0 2023-10-06T11:13:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:11.449+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f511c064a90 con 0x7f511c1598a0 2023-10-06T11:13:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.091+0000 7f5119ffb700 1 -- 172.21.15.55:0/3256715114 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f510c055120 con 0x7f511c1598a0 2023-10-06T11:13:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5108066f30 msgr2=0x7f51080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5108066f30 0x7f51080693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5114003a80 tx=0x7f5114007ec0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 msgr2=0x7f511c0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0b32b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f510c00cc10 tx=0x7f510c0019c0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 shutdown_connections 2023-10-06T11:13:12.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5108066f30 0x7f51080693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c1598a0 0x7f511c0b32b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f511c0cbc70 0x7f511c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 --2- 172.21.15.55:0/3256715114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f511c1594d0 0x7f511c16d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.099+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 >> 172.21.15.55:0/3256715114 conn(0x7f511c089e50 msgr2=0x7f511c099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:12.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.100+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 shutdown_connections 2023-10-06T11:13:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.100+0000 7f512422e700 1 -- 172.21.15.55:0/3256715114 wait complete. 2023-10-06T11:13:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:13:12.125 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:13:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.251+0000 7fb8b78e1700 1 Processor -- start 2023-10-06T11:13:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b78e1700 1 -- start start 2023-10-06T11:13:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b78e1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8b00c4450 0x7fb8b00686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b78e1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00c9670 con 0x7fb8b00b0820 2023-10-06T11:13:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b78e1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b0159c00 con 0x7fb8b00cc740 2023-10-06T11:13:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b78e1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00c8a60 con 0x7fb8b00c4450 2023-10-06T11:13:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b567d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8b00b0820 0x7fb8b00cec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50686/0 (socket says 172.21.15.55:50686) 2023-10-06T11:13:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.252+0000 7fb8b567d700 1 -- 172.21.15.55:0/2688636488 learned_addr learned my addr 172.21.15.55:0/2688636488 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/2688636488 >> v2:172.21.15.142:3300/0 conn(0x7fb8b00c4450 0x7fb8b00686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232753390 0 0) 0x7fb8b00c9670 con 0x7fb8b00b0820 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb898003570 con 0x7fb8b00b0820 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238620340 0 0) 0x7fb898003570 con 0x7fb8b00b0820 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 >> v2:172.21.15.142:3300/0 conn(0x7fb8b00c4450 msgr2=0x7fb8b00686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 --2- 172.21.15.55:0/2688636488 >> v2:172.21.15.142:3300/0 conn(0x7fb8b00c4450 0x7fb8b00686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 >> v1:172.21.15.142:6789/0 conn(0x7fb8b00cc740 legacy=0x7fb8b00ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00c8d40 con 0x7fb8b00b0820 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fb8a0001970 con 0x7fb8b00b0820 2023-10-06T11:13:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 >> v1:172.21.15.55:6789/0 conn(0x7fb8b00b0820 legacy=0x7fb8b00cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb898003a60 0x7fb898003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb898004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8980051c0 0x7fb89800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00c8a60 con 0x7fb8980051c0 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800c0d0 con 0x7fb898004810 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800c290 con 0x7fb898003a60 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b5e7e700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8980051c0 0x7fb89800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb898004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b567d700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb898003a60 0x7fb898003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb898003a60 msgr2=0x7fb898003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb898003a60 0x7fb898003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/2688636488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8980051c0 msgr2=0x7fb89800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8980051c0 0x7fb89800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.253+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/2688636488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898003570 con 0x7fb898004810 2023-10-06T11:13:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b5e7e700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8980051c0 0x7fb89800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b5e7e700 1 -- 172.21.15.55:0/2688636488 reap_dead start 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb898004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009c00 tx=0x7fb8a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1c80e03432a18f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400e710 con 0x7fb898004810 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400e870 con 0x7fb898004810 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8affff700 1 -- 172.21.15.55:0/2688636488 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400ec30 con 0x7fb898004810 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 -- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 msgr2=0x7fb898004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb898004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009c00 tx=0x7fb8a40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 -- 172.21.15.55:0/2688636488 shutdown_connections 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/2688636488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb898004c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 -- 172.21.15.55:0/2688636488 >> 172.21.15.55:0/2688636488 conn(0x7fb8b0087fc0 msgr2=0x7fb8b00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 -- 172.21.15.55:0/2688636488 shutdown_connections 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.254+0000 7fb8b78e1700 1 -- 172.21.15.55:0/2688636488 wait complete. 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.255+0000 7fb8b78e1700 1 Processor -- start 2023-10-06T11:13:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 -- start start 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb8b014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 0x7fb8b00b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8b0069690 0x7fb8b0069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b27e0 con 0x7fb8b00b1a90 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b3640 con 0x7fb898004810 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.256+0000 7fb8b78e1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b006a020 con 0x7fb8b0069690 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 0x7fb8b00b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 0x7fb8b00b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57624/0 (socket says 172.21.15.55:57624) 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/3202596776 learned_addr learned my addr 172.21.15.55:0/3202596776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b567d700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb8b014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b5e7e700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8b0069690 0x7fb8b0069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8b0069690 msgr2=0x7fb8b0069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8b0069690 0x7fb8b0069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 msgr2=0x7fb8b014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb8b014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:12.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 -- 172.21.15.55:0/3202596776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00b2a30 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b4e7c700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 0x7fb8b00b1f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400e4b0 tx=0x7fb8a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4022070 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400e9e0 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b00b2d10 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4027470 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.257+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00b32d0 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.258+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b0064a90 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.259+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8a401c450 con 0x7fb8b00b1a90 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.259+0000 7fb8ad7fa700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:12.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.259+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fb8a40861a0 con 0x7fb8b00b1a90 2023-10-06T11:13:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.259+0000 7fb8b567d700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.260+0000 7fb8b567d700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb89c066f30 0x7fb89c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00031f0 tx=0x7fb8a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.264+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8a40533d0 con 0x7fb8b00b1a90 2023-10-06T11:13:12.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:12.501+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb8b00b27e0 con 0x7fb8b00b1a90 2023-10-06T11:13:13.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.127+0000 7fb8ad7fa700 1 -- 172.21.15.55:0/3202596776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb8a40569f0 con 0x7fb8b00b1a90 2023-10-06T11:13:13.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.134+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb89c066f30 msgr2=0x7fb89c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.134+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb89c066f30 0x7fb89c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00031f0 tx=0x7fb8a0009040 comp rx=0 tx=0).stop 2023-10-06T11:13:13.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.134+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 msgr2=0x7fb8b00b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.134+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 0x7fb8b00b1f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400e4b0 tx=0x7fb8a401a000 comp rx=0 tx=0).stop 2023-10-06T11:13:13.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 shutdown_connections 2023-10-06T11:13:13.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8b0069690 0x7fb8b0069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb898004810 0x7fb8b014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 --2- 172.21.15.55:0/3202596776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b00b1a90 0x7fb8b00b1f00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 >> 172.21.15.55:0/3202596776 conn(0x7fb8b0087fc0 msgr2=0x7fb8b0158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 shutdown_connections 2023-10-06T11:13:13.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.135+0000 7fb8b78e1700 1 -- 172.21.15.55:0/3202596776 wait complete. 2023-10-06T11:13:13.139 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T11:13:13.153 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T11:13:13.153 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T11:13:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.280+0000 7f3657fff700 1 Processor -- start 2023-10-06T11:13:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.280+0000 7f3657fff700 1 -- start start 2023-10-06T11:13:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3657fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36580cca70 0x7f36580d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3657fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36580d07f0 0x7f36580ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3657fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36580cdbf0 con 0x7f3658153990 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3657fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580cb4c0 con 0x7f36580d07f0 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3657fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580d0c10 con 0x7f36580cca70 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3656ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3658153990 0x7f365815a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50690/0 (socket says 172.21.15.55:50690) 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f36577fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36580d07f0 0x7f36580ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f3656ffd700 1 -- 172.21.15.55:0/1865318075 learned_addr learned my addr 172.21.15.55:0/1865318075 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.281+0000 7f36567fc700 1 --2- 172.21.15.55:0/1865318075 >> v2:172.21.15.142:3300/0 conn(0x7f36580cca70 0x7f36580d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f36577fe700 1 -- 172.21.15.55:0/1865318075 >> v2:172.21.15.142:3300/0 conn(0x7f36580cca70 msgr2=0x7f36580d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f36577fe700 1 --2- 172.21.15.55:0/1865318075 >> v2:172.21.15.142:3300/0 conn(0x7f36580cca70 0x7f36580d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f36577fe700 1 -- 172.21.15.55:0/1865318075 >> v1:172.21.15.55:6789/0 conn(0x7f3658153990 legacy=0x7f365815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3655ffb700 1 -- 172.21.15.55:0/1865318075 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255812785 0 0) 0x7f36580cdbf0 con 0x7f3658153990 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f36577fe700 1 -- 172.21.15.55:0/1865318075 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580ccfe0 con 0x7f36580d07f0 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f36577fe700 1 --2- 172.21.15.55:0/1865318075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580d07f0 0x7f36580ce860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3658088f40 tx=0x7f36500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539d944cce71a1a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3655ffb700 1 -- 172.21.15.55:0/1865318075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650011630 con 0x7f36580d07f0 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3655ffb700 1 -- 172.21.15.55:0/1865318075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650011790 con 0x7f36580d07f0 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3655ffb700 1 -- 172.21.15.55:0/1865318075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650011b30 con 0x7f36580d07f0 2023-10-06T11:13:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3657fff700 1 -- 172.21.15.55:0/1865318075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580d07f0 msgr2=0x7f36580ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3657fff700 1 --2- 172.21.15.55:0/1865318075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580d07f0 0x7f36580ce860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3658088f40 tx=0x7f36500091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3657fff700 1 -- 172.21.15.55:0/1865318075 shutdown_connections 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3657fff700 1 --2- 172.21.15.55:0/1865318075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580d07f0 0x7f36580ce860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3657fff700 1 --2- 172.21.15.55:0/1865318075 >> v2:172.21.15.142:3300/0 conn(0x7f36580cca70 0x7f36580d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.282+0000 7f3657fff700 1 -- 172.21.15.55:0/1865318075 >> 172.21.15.55:0/1865318075 conn(0x7f36580680c0 msgr2=0x7f3658068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.283+0000 7f3657fff700 1 -- 172.21.15.55:0/1865318075 shutdown_connections 2023-10-06T11:13:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.283+0000 7f3657fff700 1 -- 172.21.15.55:0/1865318075 wait complete. 2023-10-06T11:13:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.284+0000 7f3657fff700 1 Processor -- start 2023-10-06T11:13:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.284+0000 7f3657fff700 1 -- start start 2023-10-06T11:13:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.284+0000 7f3657fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 0x7f365814b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36580d07f0 0x7f36580c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3658153990 0x7f36580affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36581594b0 con 0x7f36580cca70 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36580b0500 con 0x7f36580d07f0 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580b1340 con 0x7f3658153990 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 0x7f365814b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 0x7f365814b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57634/0 (socket says 172.21.15.55:57634) 2023-10-06T11:13:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 -- 172.21.15.55:0/3174237776 learned_addr learned my addr 172.21.15.55:0/3174237776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f36567fc700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36580d07f0 0x7f36580c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f36577fe700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3658153990 0x7f36580affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 -- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3658153990 msgr2=0x7f36580affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3658153990 0x7f36580affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 -- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36580d07f0 msgr2=0x7f36580c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36580d07f0 0x7f36580c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 -- 172.21.15.55:0/3174237776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009420 con 0x7f36580cca70 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3656ffd700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 0x7f365814b2d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f364800cdb0 tx=0x7f3648001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364800aad0 con 0x7f36580cca70 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364800ac30 con 0x7f36580cca70 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36580b0730 con 0x7f36580cca70 2023-10-06T11:13:13.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36480070f0 con 0x7f36580cca70 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.285+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36580b0cf0 con 0x7f36580cca70 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.286+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365805f230 con 0x7f36580cca70 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.287+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36480074e0 con 0x7f36580cca70 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.287+0000 7f364effd700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.287+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3648084ae0 con 0x7f36580cca70 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.287+0000 7f36567fc700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.288+0000 7f36567fc700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3638066f30 0x7f36380693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3658159190 tx=0x7f36400091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.291+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3648051c70 con 0x7f36580cca70 2023-10-06T11:13:13.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:13.496+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f36580cd2c0 con 0x7f36580cca70 2023-10-06T11:13:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.127+0000 7f364effd700 1 -- 172.21.15.55:0/3174237776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3648001c20 con 0x7f36580cca70 2023-10-06T11:13:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.130+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3638066f30 msgr2=0x7f36380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.130+0000 7f3657fff700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3638066f30 0x7f36380693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3658159190 tx=0x7f36400091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.130+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 msgr2=0x7f365814b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.130+0000 7f3657fff700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 0x7f365814b2d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f364800cdb0 tx=0x7f3648001ae0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 shutdown_connections 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36580cca70 0x7f365814b2d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3658153990 0x7f36580affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 --2- 172.21.15.55:0/3174237776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36580d07f0 0x7f36580c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 >> 172.21.15.55:0/3174237776 conn(0x7f36580680c0 msgr2=0x7f3658157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 shutdown_connections 2023-10-06T11:13:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.131+0000 7f3657fff700 1 -- 172.21.15.55:0/3174237776 wait complete. 2023-10-06T11:13:14.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:13:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.279+0000 7f2224179700 1 Processor -- start 2023-10-06T11:13:14.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.280+0000 7f2224179700 1 -- start start 2023-10-06T11:13:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.280+0000 7f2224179700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c157820 0x7f221c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.280+0000 7f2224179700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f221c0c97a0 0x7f221c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.280+0000 7f2224179700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c0c40e0 con 0x7f221c157450 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.280+0000 7f2224179700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c0cf0a0 con 0x7f221c0c97a0 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.280+0000 7f2224179700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0c34d0 con 0x7f221c157820 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f221c0c97a0 0x7f221c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f221c0c97a0 0x7f221c0ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57646/0 (socket says 172.21.15.55:57646) 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 -- 172.21.15.55:0/2721317622 learned_addr learned my addr 172.21.15.55:0/2721317622 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2221714700 1 --2- 172.21.15.55:0/2721317622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c157820 0x7f221c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 -- 172.21.15.55:0/2721317622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c157820 msgr2=0x7f221c0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 --2- 172.21.15.55:0/2721317622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c157820 0x7f221c0b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 -- 172.21.15.55:0/2721317622 >> v1:172.21.15.142:6789/0 conn(0x7f221c157450 legacy=0x7f221c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 -- 172.21.15.55:0/2721317622 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0c37b0 con 0x7f221c0c97a0 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2222716700 1 --2- 172.21.15.55:0/2721317622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c0c97a0 0x7f221c0ccf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22140099b0 tx=0x7f2214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188c05053f0b9eec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2220f13700 1 -- 172.21.15.55:0/2721317622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400b860 con 0x7f221c0c97a0 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2220f13700 1 -- 172.21.15.55:0/2721317622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221400b9c0 con 0x7f221c0c97a0 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.281+0000 7f2220f13700 1 -- 172.21.15.55:0/2721317622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400bd60 con 0x7f221c0c97a0 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 -- 172.21.15.55:0/2721317622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c0c97a0 msgr2=0x7f221c0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 --2- 172.21.15.55:0/2721317622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c0c97a0 0x7f221c0ccf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22140099b0 tx=0x7f2214009250 comp rx=0 tx=0).stop 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 -- 172.21.15.55:0/2721317622 shutdown_connections 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 --2- 172.21.15.55:0/2721317622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c0c97a0 0x7f221c0ccf30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 --2- 172.21.15.55:0/2721317622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c157820 0x7f221c0b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 -- 172.21.15.55:0/2721317622 >> 172.21.15.55:0/2721317622 conn(0x7f221c067d90 msgr2=0x7f221c0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 -- 172.21.15.55:0/2721317622 shutdown_connections 2023-10-06T11:13:14.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.282+0000 7f2224179700 1 -- 172.21.15.55:0/2721317622 wait complete. 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.283+0000 7f2224179700 1 Processor -- start 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.283+0000 7f2224179700 1 -- start start 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0c97a0 0x7f221c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 0x7f221c16a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c157820 0x7f221c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0b0da0 con 0x7f221c157450 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c16a7d0 con 0x7f221c157820 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c06a3d0 con 0x7f221c0c97a0 2023-10-06T11:13:14.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 0x7f221c16a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 0x7f221c16a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57652/0 (socket says 172.21.15.55:57652) 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 -- 172.21.15.55:0/2112209468 learned_addr learned my addr 172.21.15.55:0/2112209468 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2222716700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c157820 0x7f221c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221f15700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0c97a0 0x7f221c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 -- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0c97a0 msgr2=0x7f221c0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0c97a0 0x7f221c0b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 -- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c157820 msgr2=0x7f221c0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c157820 0x7f221c0cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 -- 172.21.15.55:0/2112209468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140094f0 con 0x7f221c157450 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2221714700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 0x7f221c16a290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f221000d890 tx=0x7f2210008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000b600 con 0x7f221c157450 2023-10-06T11:13:14.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000b760 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c069aa0 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.284+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000bae0 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.285+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c06a060 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.286+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c06a580 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.286+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f221001e460 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.286+0000 7f2219ffb700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2208066f30 0x7f22080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.286+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f2210084e20 con 0x7f221c157450 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.287+0000 7f2221f15700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2208066f30 0x7f22080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.287+0000 7f2221f15700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2208066f30 0x7f22080693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f221c152550 tx=0x7f220c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.290+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f221c06a580 con 0x7f221c157450 2023-10-06T11:13:14.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:14.483+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f221c06a220 con 0x7f221c157450 2023-10-06T11:13:16.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.132+0000 7f2219ffb700 1 -- 172.21.15.55:0/2112209468 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f22100558e0 con 0x7f221c157450 2023-10-06T11:13:16.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2208066f30 msgr2=0x7f22080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2208066f30 0x7f22080693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f221c152550 tx=0x7f220c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 msgr2=0x7f221c16a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 0x7f221c16a290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f221000d890 tx=0x7f2210008040 comp rx=0 tx=0).stop 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 shutdown_connections 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2208066f30 0x7f22080693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f221c157820 0x7f221c0cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f221c0c97a0 0x7f221c0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 --2- 172.21.15.55:0/2112209468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f221c157450 0x7f221c16a290 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 >> 172.21.15.55:0/2112209468 conn(0x7f221c067d90 msgr2=0x7f221c06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.141+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 shutdown_connections 2023-10-06T11:13:16.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.142+0000 7f2224179700 1 -- 172.21.15.55:0/2112209468 wait complete. 2023-10-06T11:13:16.147 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data_ec' created 2023-10-06T11:13:16.161 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T11:13:16.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.288+0000 7f4ded97f700 1 Processor -- start 2023-10-06T11:13:16.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.288+0000 7f4ded97f700 1 -- start start 2023-10-06T11:13:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4ded97f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4ded97f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4de80ae550 0x7f4de80afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4ded97f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80af710 con 0x7f4de815d520 2023-10-06T11:13:16.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4ded97f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de815d970 con 0x7f4de80ae550 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4ded97f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80aeb00 con 0x7f4de8157120 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4de6ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4de77fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4de80ae550 0x7f4de80afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4de6ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:33010/0 (socket says 172.21.15.55:33010) 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4de77fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4de80ae550 0x7f4de80afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:56022/0 (socket says 172.21.15.55:56022) 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4de6ffd700 1 -- 172.21.15.55:0/47775886 learned_addr learned my addr 172.21.15.55:0/47775886 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:16.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.289+0000 7f4de67fc700 1 --1- 172.21.15.55:0/47775886 >> v1:172.21.15.142:6789/0 conn(0x7f4de815d520 0x7f4de80ade40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:47972/0 (socket says 172.21.15.55:47972) 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de77fe700 1 -- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 msgr2=0x7f4de815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de77fe700 1 --2- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de77fe700 1 -- 172.21.15.55:0/47775886 >> v1:172.21.15.142:6789/0 conn(0x7f4de815d520 legacy=0x7f4de80ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de5ffb700 1 -- 172.21.15.55:0/47775886 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29644650 0 0) 0x7f4de80af710 con 0x7f4de815d520 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de77fe700 1 -- 172.21.15.55:0/47775886 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80aede0 con 0x7f4de80ae550 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de6ffd700 1 --2- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de77fe700 1 --2- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de80ae550 0x7f4de80afde0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009e60 tx=0x7f4dd8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33faaeb4cdddd7f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de5ffb700 1 -- 172.21.15.55:0/47775886 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800e070 con 0x7f4de80ae550 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de5ffb700 1 -- 172.21.15.55:0/47775886 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800bb60 con 0x7f4de80ae550 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4de5ffb700 1 -- 172.21.15.55:0/47775886 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8012430 con 0x7f4de80ae550 2023-10-06T11:13:16.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4ded97f700 1 -- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de80ae550 msgr2=0x7f4de80afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4ded97f700 1 --2- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de80ae550 0x7f4de80afde0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009e60 tx=0x7f4dd8009780 comp rx=0 tx=0).stop 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4ded97f700 1 -- 172.21.15.55:0/47775886 shutdown_connections 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4ded97f700 1 --2- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de80ae550 0x7f4de80afde0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4ded97f700 1 --2- 172.21.15.55:0/47775886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.290+0000 7f4ded97f700 1 -- 172.21.15.55:0/47775886 >> 172.21.15.55:0/47775886 conn(0x7f4de806f4c0 msgr2=0x7f4de80d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.291+0000 7f4ded97f700 1 -- 172.21.15.55:0/47775886 shutdown_connections 2023-10-06T11:13:16.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.291+0000 7f4ded97f700 1 -- 172.21.15.55:0/47775886 wait complete. 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.292+0000 7f4ded97f700 1 Processor -- start 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.292+0000 7f4ded97f700 1 -- start start 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 0x7f4de809d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de815d520 0x7f4de8159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de809dea0 con 0x7f4de80ae550 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80b5b50 con 0x7f4de815d520 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8158060 con 0x7f4de8157120 2023-10-06T11:13:16.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 0x7f4de809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 0x7f4de809d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35062/0 (socket says 172.21.15.55:35062) 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 -- 172.21.15.55:0/290560008 learned_addr learned my addr 172.21.15.55:0/290560008 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de67fc700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de77fe700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de815d520 0x7f4de8159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 -- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 msgr2=0x7f4de80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 -- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de815d520 msgr2=0x7f4de8159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de815d520 0x7f4de8159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 -- 172.21.15.55:0/290560008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00094f0 con 0x7f4de80ae550 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4de6ffd700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 0x7f4de809d960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4de000ec50 tx=0x7f4de0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000c850 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000c9b0 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd8009a20 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000cd50 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.293+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de8157a10 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.294+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de805f230 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.295+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4de0013680 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.295+0000 7f4ddeffd700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4dc8066f30 0x7f4dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.295+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f4de0084c10 con 0x7f4de80ae550 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.295+0000 7f4de67fc700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4dc8066f30 0x7f4dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.296+0000 7f4de67fc700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4dc8066f30 0x7f4dc80693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0007180 tx=0x7f4dd0007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.300+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4de0051a50 con 0x7f4de80ae550 2023-10-06T11:13:16.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:16.493+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4de806faf0 con 0x7f4de80ae550 2023-10-06T11:13:17.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.135+0000 7f4ddeffd700 1 -- 172.21.15.55:0/290560008 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4de0055070 con 0x7f4de80ae550 2023-10-06T11:13:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.144+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4dc8066f30 msgr2=0x7f4dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.144+0000 7f4ded97f700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4dc8066f30 0x7f4dc80693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0007180 tx=0x7f4dd0007ef0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.144+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 msgr2=0x7f4de809d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.145+0000 7f4ded97f700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 0x7f4de809d960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4de000ec50 tx=0x7f4de0009250 comp rx=0 tx=0).stop 2023-10-06T11:13:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.146+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 shutdown_connections 2023-10-06T11:13:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.146+0000 7f4ded97f700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4dc8066f30 0x7f4dc80693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.146+0000 7f4ded97f700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de80ae550 0x7f4de809d960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.146+0000 7f4ded97f700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de815d520 0x7f4de8159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.146+0000 7f4ded97f700 1 --2- 172.21.15.55:0/290560008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4de8157120 0x7f4de80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.146+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 >> 172.21.15.55:0/290560008 conn(0x7f4de806f4c0 msgr2=0x7f4de815cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.150+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 shutdown_connections 2023-10-06T11:13:17.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.151+0000 7f4ded97f700 1 -- 172.21.15.55:0/290560008 wait complete. 2023-10-06T11:13:17.167 INFO:teuthology.orchestra.run.smithi055.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T11:13:17.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T11:13:17.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.303+0000 7fc769ae0700 1 Processor -- start 2023-10-06T11:13:17.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.303+0000 7fc769ae0700 1 -- start start 2023-10-06T11:13:17.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc769ae0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc7640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc769ae0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7640cf1b0 0x7fc7640cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc769ae0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7640cc970 con 0x7fc7640b29f0 2023-10-06T11:13:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc769ae0700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640cbd60 con 0x7fc7640cf1b0 2023-10-06T11:13:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc769ae0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640cc040 con 0x7fc7640b2620 2023-10-06T11:13:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7640cf1b0 0x7fc7640cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7640cf1b0 0x7fc7640cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35078/0 (socket says 172.21.15.55:35078) 2023-10-06T11:13:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 -- 172.21.15.55:0/2869829367 learned_addr learned my addr 172.21.15.55:0/2869829367 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc768ade700 1 --2- 172.21.15.55:0/2869829367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc7640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 -- 172.21.15.55:0/2869829367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 msgr2=0x7fc7640cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 --2- 172.21.15.55:0/2869829367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc7640cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 -- 172.21.15.55:0/2869829367 >> v1:172.21.15.142:6789/0 conn(0x7fc7640b29f0 legacy=0x7fc7640ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.304+0000 7fc7692df700 1 -- 172.21.15.55:0/2869829367 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640cc320 con 0x7fc7640cf1b0 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc7692df700 1 --2- 172.21.15.55:0/2869829367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640cd1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f20 tx=0x7fc75c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b475732843fc262 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc7637fe700 1 -- 172.21.15.55:0/2869829367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00e070 con 0x7fc7640cf1b0 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc7637fe700 1 -- 172.21.15.55:0/2869829367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00b9d0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc7637fe700 1 -- 172.21.15.55:0/2869829367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0092e0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 -- 172.21.15.55:0/2869829367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 msgr2=0x7fc7640cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2869829367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640cd1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f20 tx=0x7fc75c009840 comp rx=0 tx=0).stop 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 -- 172.21.15.55:0/2869829367 shutdown_connections 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2869829367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640cd1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2869829367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc7640cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 -- 172.21.15.55:0/2869829367 >> 172.21.15.55:0/2869829367 conn(0x7fc764099520 msgr2=0x7fc76406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 -- 172.21.15.55:0/2869829367 shutdown_connections 2023-10-06T11:13:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.305+0000 7fc769ae0700 1 -- 172.21.15.55:0/2869829367 wait complete. 2023-10-06T11:13:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.306+0000 7fc769ae0700 1 Processor -- start 2023-10-06T11:13:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 -- start start 2023-10-06T11:13:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc764139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7640b29f0 0x7fc764169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76413a4f0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640b49a0 con 0x7fc7640b29f0 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc769ae0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640b5800 con 0x7fc7640b2620 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc7692df700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc7692df700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35086/0 (socket says 172.21.15.55:35086) 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.307+0000 7fc7692df700 1 -- 172.21.15.55:0/2545078905 learned_addr learned my addr 172.21.15.55:0/2545078905 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc763fff700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7640b29f0 0x7fc764169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc768ade700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc764139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc7692df700 1 -- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 msgr2=0x7fc764139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc7692df700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc764139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc7692df700 1 -- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7640b29f0 msgr2=0x7fc764169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc7692df700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7640b29f0 0x7fc764169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc7692df700 1 -- 172.21.15.55:0/2545078905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c009ae0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc768ade700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc764139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc7692df700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640c6220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00b610 tx=0x7fc75c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c007c30 con 0x7fc7640cf1b0 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c007d90 con 0x7fc7640cf1b0 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7640b4bf0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c01e680 con 0x7fc7640cf1b0 2023-10-06T11:13:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.308+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7640b51b0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.309+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7640b5970 con 0x7fc7640cf1b0 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.309+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc75c003040 con 0x7fc7640cf1b0 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.310+0000 7fc760ff9700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc744066f30 0x7fc7440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.310+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fc75c086bf0 con 0x7fc7640cf1b0 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.310+0000 7fc768ade700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc744066f30 0x7fc7440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.311+0000 7fc768ade700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc744066f30 0x7fc7440693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc74c006ea0 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.314+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc75c053a30 con 0x7fc7640cf1b0 2023-10-06T11:13:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:17.558+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fc76405f290 con 0x7fc7640cf1b0 2023-10-06T11:13:18.164 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-10-06T11:13:18.162+0000 7fdf6c383700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:13:18.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.167+0000 7fc760ff9700 1 -- 172.21.15.55:0/2545078905 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fc75c057050 con 0x7fc7640cf1b0 2023-10-06T11:13:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc744066f30 msgr2=0x7fc7440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc744066f30 0x7fc7440693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc74c006ea0 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 msgr2=0x7fc7640c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640c6220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00b610 tx=0x7fc75c018000 comp rx=0 tx=0).stop 2023-10-06T11:13:18.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 shutdown_connections 2023-10-06T11:13:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc744066f30 0x7fc7440693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7640cf1b0 0x7fc7640c6220 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7640b2620 0x7fc764139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 --2- 172.21.15.55:0/2545078905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7640b29f0 0x7fc764169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 >> 172.21.15.55:0/2545078905 conn(0x7fc764099520 msgr2=0x7fc7641589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 shutdown_connections 2023-10-06T11:13:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.169+0000 7fc769ae0700 1 -- 172.21.15.55:0/2545078905 wait complete. 2023-10-06T11:13:18.175 INFO:teuthology.orchestra.run.smithi055.stderr:added data pool 5 to fsmap 2023-10-06T11:13:18.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.308+0000 7f377222c700 1 Processor -- start 2023-10-06T11:13:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.308+0000 7f377222c700 1 -- start start 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f377222c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f376c0b2810 0x7f376c0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f377222c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0cb7a0 con 0x7f376c0cbc30 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f377222c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0b0860 con 0x7f376c159440 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f377222c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0cb150 con 0x7f376c0b2810 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f3771a2b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f376c0b2810 0x7f376c0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f3770a29700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f376c0cbc30 0x7f376c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41050/0 (socket says 172.21.15.55:41050) 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f3770a29700 1 -- 172.21.15.55:0/3922618254 learned_addr learned my addr 172.21.15.55:0/3922618254 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f3771a2b700 1 -- 172.21.15.55:0/3922618254 >> v1:172.21.15.142:6789/0 conn(0x7f376c159440 legacy=0x7f376c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f3771a2b700 1 -- 172.21.15.55:0/3922618254 >> v1:172.21.15.55:6789/0 conn(0x7f376c0cbc30 legacy=0x7f376c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.309+0000 7f3771a2b700 1 -- 172.21.15.55:0/3922618254 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0cb430 con 0x7f376c0b2810 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f3771a2b700 1 --2- 172.21.15.55:0/3922618254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c0b2810 0x7f376c0cc080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37640098e0 tx=0x7f37640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c7f3949f74beb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f376bfff700 1 -- 172.21.15.55:0/3922618254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764009e80 con 0x7f376c0b2810 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f376bfff700 1 -- 172.21.15.55:0/3922618254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400b860 con 0x7f376c0b2810 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f376bfff700 1 -- 172.21.15.55:0/3922618254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400bbe0 con 0x7f376c0b2810 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 -- 172.21.15.55:0/3922618254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c0b2810 msgr2=0x7f376c0cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 --2- 172.21.15.55:0/3922618254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c0b2810 0x7f376c0cc080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37640098e0 tx=0x7f37640091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 -- 172.21.15.55:0/3922618254 shutdown_connections 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 --2- 172.21.15.55:0/3922618254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c0b2810 0x7f376c0cc080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 -- 172.21.15.55:0/3922618254 >> 172.21.15.55:0/3922618254 conn(0x7f376c06ece0 msgr2=0x7f376c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 -- 172.21.15.55:0/3922618254 shutdown_connections 2023-10-06T11:13:18.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.310+0000 7f377222c700 1 -- 172.21.15.55:0/3922618254 wait complete. 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.311+0000 7f377222c700 1 Processor -- start 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.311+0000 7f377222c700 1 -- start start 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f377222c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0b2810 0x7f376c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f377222c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c0cbc30 0x7f376c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f377222c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 0x7f376c0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f377222c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0c7ff0 con 0x7f376c159440 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f377222c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0c73e0 con 0x7f376c0cbc30 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f377222c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0c76c0 con 0x7f376c0b2810 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f3771a2b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 0x7f376c0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f3771a2b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 0x7f376c0c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35094/0 (socket says 172.21.15.55:35094) 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.312+0000 7f3771a2b700 1 -- 172.21.15.55:0/457241925 learned_addr learned my addr 172.21.15.55:0/457241925 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3770a29700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c0cbc30 0x7f376c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f377122a700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0b2810 0x7f376c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3771a2b700 1 -- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0b2810 msgr2=0x7f376c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3771a2b700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0b2810 0x7f376c154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3771a2b700 1 -- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c0cbc30 msgr2=0x7f376c0c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3771a2b700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c0cbc30 0x7f376c0c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3771a2b700 1 -- 172.21.15.55:0/457241925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009420 con 0x7f376c159440 2023-10-06T11:13:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f3771a2b700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 0x7f376c0c8480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f376c069150 tx=0x7f3764017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400bba0 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764025420 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640257e0 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0c79a0 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.313+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c154c50 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.314+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c05f230 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.315+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3764023070 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.315+0000 7f37697fa700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.315+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f37640861a0 con 0x7f376c159440 2023-10-06T11:13:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.315+0000 7f377122a700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.316+0000 7f377122a700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3758066f30 0x7f37580693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f375c007fd0 tx=0x7f375c001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.320+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3764052fc0 con 0x7f376c159440 2023-10-06T11:13:18.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.555+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f376c0c8130 con 0x7f376c159440 2023-10-06T11:13:18.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.556+0000 7f37697fa700 1 -- 172.21.15.55:0/457241925 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f37640565e0 con 0x7f376c159440 2023-10-06T11:13:18.559 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:18.559 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:18.157833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T11:13:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3758066f30 msgr2=0x7f37580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3758066f30 0x7f37580693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f375c007fd0 tx=0x7f375c001680 comp rx=0 tx=0).stop 2023-10-06T11:13:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 msgr2=0x7f376c0c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 0x7f376c0c8480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f376c069150 tx=0x7f3764017000 comp rx=0 tx=0).stop 2023-10-06T11:13:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 shutdown_connections 2023-10-06T11:13:18.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f376c159440 0x7f376c0c8480 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f376c0b2810 0x7f376c154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 --2- 172.21.15.55:0/457241925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f376c0cbc30 0x7f376c0c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 >> 172.21.15.55:0/457241925 conn(0x7f376c06ece0 msgr2=0x7f376c0b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 shutdown_connections 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.558+0000 7f377222c700 1 -- 172.21.15.55:0/457241925 wait complete. 2023-10-06T11:13:18.562 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 7 2023-10-06T11:13:18.573 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.689+0000 7f2739a85700 1 Processor -- start 2023-10-06T11:13:18.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.689+0000 7f2739a85700 1 -- start start 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2739a85700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2734159560 0x7f27340aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2739a85700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27340b0760 0x7f27340b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2739a85700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27340b0c60 con 0x7f27340b49a0 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2739a85700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340b0f40 con 0x7f2734159560 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2739a85700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340b1220 con 0x7f27340b0760 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2734159560 0x7f27340aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2734159560 0x7f27340aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35106/0 (socket says 172.21.15.55:35106) 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2732ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f27340b49a0 0x7f27340aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41066/0 (socket says 172.21.15.55:41066) 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 -- 172.21.15.55:0/1049520293 learned_addr learned my addr 172.21.15.55:0/1049520293 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2733fff700 1 --2- 172.21.15.55:0/1049520293 >> v2:172.21.15.142:3300/0 conn(0x7f27340b0760 0x7f27340b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 -- 172.21.15.55:0/1049520293 >> v2:172.21.15.142:3300/0 conn(0x7f27340b0760 msgr2=0x7f27340b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 --2- 172.21.15.55:0/1049520293 >> v2:172.21.15.142:3300/0 conn(0x7f27340b0760 0x7f27340b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 -- 172.21.15.55:0/1049520293 >> v1:172.21.15.55:6789/0 conn(0x7f27340b49a0 legacy=0x7f27340aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27327fc700 1 -- 172.21.15.55:0/1049520293 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312659883 0 0) 0x7f27340b0c60 con 0x7f27340b49a0 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 -- 172.21.15.55:0/1049520293 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340b1500 con 0x7f2734159560 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f2733fff700 1 --2- 172.21.15.55:0/1049520293 >> v2:172.21.15.142:3300/0 conn(0x7f27340b0760 0x7f27340b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27337fe700 1 --2- 172.21.15.55:0/1049520293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2734159560 0x7f27340aa530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d274e980a9a008 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27327fc700 1 -- 172.21.15.55:0/1049520293 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724005c10 con 0x7f2734159560 2023-10-06T11:13:18.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.690+0000 7f27327fc700 1 -- 172.21.15.55:0/1049520293 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724005d70 con 0x7f2734159560 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f27327fc700 1 -- 172.21.15.55:0/1049520293 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400b840 con 0x7f2734159560 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 -- 172.21.15.55:0/1049520293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2734159560 msgr2=0x7f27340aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 --2- 172.21.15.55:0/1049520293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2734159560 0x7f27340aa530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724009220 comp rx=0 tx=0).stop 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 -- 172.21.15.55:0/1049520293 shutdown_connections 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 --2- 172.21.15.55:0/1049520293 >> v2:172.21.15.142:3300/0 conn(0x7f27340b0760 0x7f27340b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 --2- 172.21.15.55:0/1049520293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2734159560 0x7f27340aa530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 -- 172.21.15.55:0/1049520293 >> 172.21.15.55:0/1049520293 conn(0x7f27340997f0 msgr2=0x7f273406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 -- 172.21.15.55:0/1049520293 shutdown_connections 2023-10-06T11:13:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.691+0000 7f2739a85700 1 -- 172.21.15.55:0/1049520293 wait complete. 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.692+0000 7f2739a85700 1 Processor -- start 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.692+0000 7f2739a85700 1 -- start start 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2739a85700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27340b0760 0x7f273416b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2739a85700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 0x7f2734157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2739a85700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2734159560 0x7f27340af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2739a85700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340af6a0 con 0x7f27340b49a0 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2739a85700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273416acb0 con 0x7f2734159560 2023-10-06T11:13:18.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2739a85700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27340ad750 con 0x7f27340b0760 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 0x7f2734157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 0x7f2734157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35112/0 (socket says 172.21.15.55:35112) 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 -- 172.21.15.55:0/3358699141 learned_addr learned my addr 172.21.15.55:0/3358699141 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2733fff700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2734159560 0x7f27340af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f27337fe700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27340b0760 0x7f273416b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 -- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27340b0760 msgr2=0x7f273416b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27340b0760 0x7f273416b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 -- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2734159560 msgr2=0x7f27340af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2734159560 0x7f27340af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2732ffd700 1 -- 172.21.15.55:0/3358699141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009480 con 0x7f27340b49a0 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.693+0000 7f2733fff700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2734159560 0x7f27340af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.694+0000 7f2732ffd700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 0x7f2734157c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f272800c7e0 tx=0x7f2728007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.694+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728005b40 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.694+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728005ca0 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.694+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27340ad420 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.694+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728007320 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.694+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273416a770 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.695+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273416aaf0 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.695+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f272801b3b0 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.696+0000 7f271b7fe700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2720066f30 0x7f27200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.696+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2728083f50 con 0x7f27340b49a0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.696+0000 7f27337fe700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2720066f30 0x7f27200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.696+0000 7f27337fe700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2720066f30 0x7f27200693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2724009260 tx=0x7f2724016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.700+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2728050d70 con 0x7f27340b49a0 2023-10-06T11:13:18.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.895+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27340b4510 con 0x7f27340b49a0 2023-10-06T11:13:18.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.896+0000 7f271b7fe700 1 -- 172.21.15.55:0/3358699141 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f2728017070 con 0x7f27340b49a0 2023-10-06T11:13:18.899 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:18.899 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:18.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2720066f30 msgr2=0x7f27200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2720066f30 0x7f27200693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2724009260 tx=0x7f2724016000 comp rx=0 tx=0).stop 2023-10-06T11:13:18.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 msgr2=0x7f2734157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 0x7f2734157c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f272800c7e0 tx=0x7f2728007db0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 shutdown_connections 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2720066f30 0x7f27200693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2734159560 0x7f27340af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27340b0760 0x7f273416b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 --2- 172.21.15.55:0/3358699141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27340b49a0 0x7f2734157c60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 >> 172.21.15.55:0/3358699141 conn(0x7f27340997f0 msgr2=0x7f2734158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 shutdown_connections 2023-10-06T11:13:18.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:18.898+0000 7f2739a85700 1 -- 172.21.15.55:0/3358699141 wait complete. 2023-10-06T11:13:18.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:19.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.033+0000 7f3949806700 1 Processor -- start 2023-10-06T11:13:19.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.033+0000 7f3949806700 1 -- start start 2023-10-06T11:13:19.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3949806700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f39440aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3949806700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39440b49a0 0x7f39440aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3949806700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39440b0760 0x7f39440b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3949806700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39440b0c60 con 0x7f39440b0760 2023-10-06T11:13:19.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3949806700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39440b0f40 con 0x7f39440b49a0 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3949806700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440b1220 con 0x7f3944159560 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39440b0760 0x7f39440b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39440b0760 0x7f39440b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35124/0 (socket says 172.21.15.55:35124) 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 -- 172.21.15.55:0/3387607685 learned_addr learned my addr 172.21.15.55:0/3387607685 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39427fc700 1 --2- 172.21.15.55:0/3387607685 >> v2:172.21.15.142:3300/0 conn(0x7f39440b49a0 0x7f39440aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3942ffd700 1 --2- 172.21.15.55:0/3387607685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f39440aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 -- 172.21.15.55:0/3387607685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 msgr2=0x7f39440aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 --2- 172.21.15.55:0/3387607685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f39440aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 -- 172.21.15.55:0/3387607685 >> v2:172.21.15.142:3300/0 conn(0x7f39440b49a0 msgr2=0x7f39440aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 --2- 172.21.15.55:0/3387607685 >> v2:172.21.15.142:3300/0 conn(0x7f39440b49a0 0x7f39440aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 -- 172.21.15.55:0/3387607685 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440b1500 con 0x7f39440b0760 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f39437fe700 1 --2- 172.21.15.55:0/3387607685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b0760 0x7f39440b3890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3944089020 tx=0x7f393c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e3efe9e1aa8e5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3941ffb700 1 -- 172.21.15.55:0/3387607685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00e070 con 0x7f39440b0760 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.034+0000 7f3941ffb700 1 -- 172.21.15.55:0/3387607685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c00ba50 con 0x7f39440b0760 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3941ffb700 1 -- 172.21.15.55:0/3387607685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0092e0 con 0x7f39440b0760 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 -- 172.21.15.55:0/3387607685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b0760 msgr2=0x7f39440b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 --2- 172.21.15.55:0/3387607685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b0760 0x7f39440b3890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3944089020 tx=0x7f393c009840 comp rx=0 tx=0).stop 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 -- 172.21.15.55:0/3387607685 shutdown_connections 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 --2- 172.21.15.55:0/3387607685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b0760 0x7f39440b3890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 --2- 172.21.15.55:0/3387607685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f39440aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 --2- 172.21.15.55:0/3387607685 >> v2:172.21.15.142:3300/0 conn(0x7f39440b49a0 0x7f39440aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 -- 172.21.15.55:0/3387607685 >> 172.21.15.55:0/3387607685 conn(0x7f39440997f0 msgr2=0x7f394406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 -- 172.21.15.55:0/3387607685 shutdown_connections 2023-10-06T11:13:19.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.035+0000 7f3949806700 1 -- 172.21.15.55:0/3387607685 wait complete. 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.036+0000 7f3949806700 1 Processor -- start 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.036+0000 7f3949806700 1 -- start start 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3949806700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39440b0760 0x7f394416a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3949806700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 0x7f394416aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3949806700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f394416c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3949806700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440cc240 con 0x7f39440b49a0 2023-10-06T11:13:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3949806700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440c53d0 con 0x7f39440b0760 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3949806700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440cb9a0 con 0x7f3944159560 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 0x7f394416aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 0x7f394416aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35136/0 (socket says 172.21.15.55:35136) 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 -- 172.21.15.55:0/2159420178 learned_addr learned my addr 172.21.15.55:0/2159420178 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f3942ffd700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39440b0760 0x7f394416a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39437fe700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f394416c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 -- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 msgr2=0x7f394416c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f394416c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 -- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39440b0760 msgr2=0x7f394416a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39440b0760 0x7f394416a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.037+0000 7f39427fc700 1 -- 172.21.15.55:0/2159420178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c009ae0 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.038+0000 7f39427fc700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 0x7f394416aa40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f392c00d860 tx=0x7f392c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.038+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0125f0 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.038+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c012750 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.038+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39440cbc80 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.038+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c012af0 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.038+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394416af80 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.039+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39440c5230 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.039+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f392c013480 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.039+0000 7f393affd700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3924066f30 0x7f39240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.040+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f392c084cd0 con 0x7f39440b49a0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.040+0000 7f3942ffd700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3924066f30 0x7f39240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.040+0000 7f3942ffd700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3924066f30 0x7f39240693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39340061f0 tx=0x7f3934008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.044+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39440c5230 con 0x7f39440b49a0 2023-10-06T11:13:19.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.239+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39440c5230 con 0x7f39440b49a0 2023-10-06T11:13:19.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.240+0000 7f393affd700 1 -- 172.21.15.55:0/2159420178 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f39440c5230 con 0x7f39440b49a0 2023-10-06T11:13:19.243 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:19.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3924066f30 msgr2=0x7f39240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3924066f30 0x7f39240693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39340061f0 tx=0x7f3934008040 comp rx=0 tx=0).stop 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 msgr2=0x7f394416aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 0x7f394416aa40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f392c00d860 tx=0x7f392c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 shutdown_connections 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3924066f30 0x7f39240693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3944159560 0x7f394416c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39440b0760 0x7f394416a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 --2- 172.21.15.55:0/2159420178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39440b49a0 0x7f394416aa40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 >> 172.21.15.55:0/2159420178 conn(0x7f39440997f0 msgr2=0x7f3944069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 shutdown_connections 2023-10-06T11:13:19.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.242+0000 7f3949806700 1 -- 172.21.15.55:0/2159420178 wait complete. 2023-10-06T11:13:19.270 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:19.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.386+0000 7fc8c9d3e700 1 Processor -- start 2023-10-06T11:13:19.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.386+0000 7fc8c9d3e700 1 -- start start 2023-10-06T11:13:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c9d3e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8c4159440 0x7fc8c40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c9d3e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8c40b35d0 0x7fc8c40cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c9d3e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40cb7a0 con 0x7fc8c40cc170 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c9d3e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40b0860 con 0x7fc8c40b35d0 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c9d3e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40cb150 con 0x7fc8c4159440 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8c40b35d0 0x7fc8c40cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8c40b35d0 0x7fc8c40cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35140/0 (socket says 172.21.15.55:35140) 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 -- 172.21.15.55:0/2487453171 learned_addr learned my addr 172.21.15.55:0/2487453171 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c8d3c700 1 --2- 172.21.15.55:0/2487453171 >> v2:172.21.15.142:3300/0 conn(0x7fc8c4159440 0x7fc8c40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 -- 172.21.15.55:0/2487453171 >> v2:172.21.15.142:3300/0 conn(0x7fc8c4159440 msgr2=0x7fc8c40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 --2- 172.21.15.55:0/2487453171 >> v2:172.21.15.142:3300/0 conn(0x7fc8c4159440 0x7fc8c40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 -- 172.21.15.55:0/2487453171 >> v1:172.21.15.142:6789/0 conn(0x7fc8c40cc170 legacy=0x7fc8c40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 -- 172.21.15.55:0/2487453171 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40cb430 con 0x7fc8c40b35d0 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.387+0000 7fc8c3fff700 1 --2- 172.21.15.55:0/2487453171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c40b35d0 0x7fc8c40cbc30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc8c406f9f0 tx=0x7fc8b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f782564fbddbb325 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c37fe700 1 -- 172.21.15.55:0/2487453171 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800b820 con 0x7fc8c40b35d0 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c37fe700 1 -- 172.21.15.55:0/2487453171 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800b980 con 0x7fc8c40b35d0 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c37fe700 1 -- 172.21.15.55:0/2487453171 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800bd20 con 0x7fc8c40b35d0 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/2487453171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c40b35d0 msgr2=0x7fc8c40cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/2487453171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c40b35d0 0x7fc8c40cbc30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc8c406f9f0 tx=0x7fc8b8009250 comp rx=0 tx=0).stop 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/2487453171 shutdown_connections 2023-10-06T11:13:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/2487453171 >> v2:172.21.15.142:3300/0 conn(0x7fc8c4159440 0x7fc8c40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/2487453171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c40b35d0 0x7fc8c40cbc30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/2487453171 >> 172.21.15.55:0/2487453171 conn(0x7fc8c406ece0 msgr2=0x7fc8c406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/2487453171 shutdown_connections 2023-10-06T11:13:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.388+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/2487453171 wait complete. 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.389+0000 7fc8c9d3e700 1 Processor -- start 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.389+0000 7fc8c9d3e700 1 -- start start 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c9d3e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8c40b35d0 0x7fc8c415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c9d3e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8c40cc170 0x7fc8c4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c9d3e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 0x7fc8c415e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c9d3e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40c72d0 con 0x7fc8c4159440 2023-10-06T11:13:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c9d3e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40ce120 con 0x7fc8c40cc170 2023-10-06T11:13:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c9d3e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40d04a0 con 0x7fc8c40b35d0 2023-10-06T11:13:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c953d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 0x7fc8c415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c953d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 0x7fc8c415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35156/0 (socket says 172.21.15.55:35156) 2023-10-06T11:13:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c953d700 1 -- 172.21.15.55:0/1398544905 learned_addr learned my addr 172.21.15.55:0/1398544905 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c8d3c700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8c40b35d0 0x7fc8c415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.390+0000 7fc8c3fff700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8c40cc170 0x7fc8c4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c953d700 1 -- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8c40b35d0 msgr2=0x7fc8c415f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c953d700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8c40b35d0 0x7fc8c415f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c953d700 1 -- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8c40cc170 msgr2=0x7fc8c4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c953d700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8c40cc170 0x7fc8c4154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c953d700 1 -- 172.21.15.55:0/1398544905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80094f0 con 0x7fc8c4159440 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c953d700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 0x7fc8c415e430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c930 tx=0x7fc8bc0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc012630 con 0x7fc8c4159440 2023-10-06T11:13:19.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0127d0 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c40d0750 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc012b90 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.391+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c40d0d10 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.392+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c40c7440 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.392+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8bc00a3b0 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.393+0000 7fc8c0ff9700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b0066f60 0x7fc8b0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.393+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc8bc084600 con 0x7fc8c4159440 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.393+0000 7fc8c8d3c700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b0066f60 0x7fc8b0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.394+0000 7fc8c8d3c700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b0066f60 0x7fc8b0069410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4006fd0 tx=0x7fc8b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.397+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8c40c7440 con 0x7fc8c4159440 2023-10-06T11:13:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.635+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c40c7410 con 0x7fc8c4159440 2023-10-06T11:13:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.636+0000 7fc8c0ff9700 1 -- 172.21.15.55:0/1398544905 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fc8bc051420 con 0x7fc8c4159440 2023-10-06T11:13:19.639 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:19.639 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:18.157833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b0066f60 msgr2=0x7fc8b0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b0066f60 0x7fc8b0069410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4006fd0 tx=0x7fc8b4008040 comp rx=0 tx=0).stop 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 msgr2=0x7fc8c415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 0x7fc8c415e430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c930 tx=0x7fc8bc0026e0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 shutdown_connections 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b0066f60 0x7fc8b0069410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8c4159440 0x7fc8c415e430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8c40b35d0 0x7fc8c415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 --2- 172.21.15.55:0/1398544905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8c40cc170 0x7fc8c4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 >> 172.21.15.55:0/1398544905 conn(0x7fc8c406ece0 msgr2=0x7fc8c40b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 shutdown_connections 2023-10-06T11:13:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.638+0000 7fc8c9d3e700 1 -- 172.21.15.55:0/1398544905 wait complete. 2023-10-06T11:13:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 7 2023-10-06T11:13:19.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.768+0000 7f979f249700 1 Processor -- start 2023-10-06T11:13:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.768+0000 7f979f249700 1 -- start start 2023-10-06T11:13:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.769+0000 7f979f249700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.769+0000 7f979f249700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980b0c60 con 0x7f97980b0760 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.769+0000 7f979f249700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980b0f40 con 0x7f97980b49a0 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.769+0000 7f979f249700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b1220 con 0x7f9798159560 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.769+0000 7f979d7e6700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97980b0760 0x7f97980b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41072/0 (socket says 172.21.15.55:41072) 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.769+0000 7f979d7e6700 1 -- 172.21.15.55:0/1906243880 learned_addr learned my addr 172.21.15.55:0/1906243880 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f979cfe5700 1 --2- 172.21.15.55:0/1906243880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307864291 0 0) 0x7f97980b0c60 con 0x7f97980b0760 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9780003570 con 0x7f97980b0760 2023-10-06T11:13:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893232074 0 0) 0x7f97980b0f40 con 0x7f97980b49a0 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97980b0c60 con 0x7f97980b49a0 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242137560 0 0) 0x7f9780003570 con 0x7f97980b0760 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f979cfe5700 1 -- 172.21.15.55:0/1906243880 >> v1:172.21.15.142:6789/0 conn(0x7f97980b49a0 legacy=0x7f97980aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f979cfe5700 1 -- 172.21.15.55:0/1906243880 >> v1:172.21.15.55:6789/0 conn(0x7f97980b0760 legacy=0x7f97980b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f979cfe5700 1 -- 172.21.15.55:0/1906243880 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980b1500 con 0x7f9798159560 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f979cfe5700 1 --2- 172.21.15.55:0/1906243880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980aa530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9788009900 tx=0x7f9788009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=496d96564d9cc8c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900017f0 con 0x7f9798159560 2023-10-06T11:13:19.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788011420 con 0x7f9798159560 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.770+0000 7f97977fe700 1 -- 172.21.15.55:0/1906243880 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880117c0 con 0x7f9798159560 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 -- 172.21.15.55:0/1906243880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 msgr2=0x7f97980aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 --2- 172.21.15.55:0/1906243880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980aa530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9788009900 tx=0x7f9788009120 comp rx=0 tx=0).stop 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 -- 172.21.15.55:0/1906243880 shutdown_connections 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 --2- 172.21.15.55:0/1906243880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980aa530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 -- 172.21.15.55:0/1906243880 >> 172.21.15.55:0/1906243880 conn(0x7f97980997f0 msgr2=0x7f979806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 -- 172.21.15.55:0/1906243880 shutdown_connections 2023-10-06T11:13:19.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.771+0000 7f979f249700 1 -- 172.21.15.55:0/1906243880 wait complete. 2023-10-06T11:13:19.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.772+0000 7f979f249700 1 Processor -- start 2023-10-06T11:13:19.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.772+0000 7f979f249700 1 -- start start 2023-10-06T11:13:19.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979f249700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97980b0760 0x7f9798144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979f249700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 0x7f9798159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979f249700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979f249700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798169960 con 0x7f97980b49a0 2023-10-06T11:13:19.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979f249700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980ae400 con 0x7f97980b0760 2023-10-06T11:13:19.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979f249700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980ad7f0 con 0x7f9798159560 2023-10-06T11:13:19.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 0x7f9798159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 0x7f9798159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35168/0 (socket says 172.21.15.55:35168) 2023-10-06T11:13:19.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 -- 172.21.15.55:0/3403442024 learned_addr learned my addr 172.21.15.55:0/3403442024 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:19.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979cfe5700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97980b0760 0x7f9798144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f979d7e6700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 -- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 msgr2=0x7f97980ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 -- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97980b0760 msgr2=0x7f9798144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97980b0760 0x7f9798144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 -- 172.21.15.55:0/3403442024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880093c0 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9797fff700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 0x7f9798159930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c7c0 tx=0x7f978c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.773+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c010510 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.774+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c010690 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.774+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97980adad0 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.774+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c010a50 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.774+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97980ae090 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.775+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97980ae570 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.775+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f978c01b400 con 0x7f97980b49a0 2023-10-06T11:13:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.775+0000 7f9794ff9700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9784066f30 0x7f97840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.776+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f978c084730 con 0x7f97980b49a0 2023-10-06T11:13:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.776+0000 7f979cfe5700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9784066f30 0x7f97840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.776+0000 7f979cfe5700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9784066f30 0x7f97840693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9788009160 tx=0x7f9788016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.780+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f978c051550 con 0x7f97980b49a0 2023-10-06T11:13:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.973+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9798064a90 con 0x7f97980b49a0 2023-10-06T11:13:19.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.974+0000 7f9794ff9700 1 -- 172.21.15.55:0/3403442024 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f978c054b70 con 0x7f97980b49a0 2023-10-06T11:13:19.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:19.978 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9784066f30 msgr2=0x7f97840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9784066f30 0x7f97840693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9788009160 tx=0x7f9788016000 comp rx=0 tx=0).stop 2023-10-06T11:13:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 msgr2=0x7f9798159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 0x7f9798159930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c7c0 tx=0x7f978c007de0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 shutdown_connections 2023-10-06T11:13:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9784066f30 0x7f97840693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9798159560 0x7f97980ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97980b0760 0x7f9798144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 --2- 172.21.15.55:0/3403442024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97980b49a0 0x7f9798159930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 >> 172.21.15.55:0/3403442024 conn(0x7f97980997f0 msgr2=0x7f97980b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 shutdown_connections 2023-10-06T11:13:19.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:19.976+0000 7f979f249700 1 -- 172.21.15.55:0/3403442024 wait complete. 2023-10-06T11:13:20.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:13:12.502638+0000', 'modified': '2023-10-06T11:13:18.157833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6836/2998784723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2998784723}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2998784723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T11:13:20.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:13:20.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T11:13:20.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.520+0000 7f563e78c700 1 Processor -- start 2023-10-06T11:13:20.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.520+0000 7f563e78c700 1 -- start start 2023-10-06T11:13:20.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563e78c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5638159440 0x7f56380b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563e78c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56380b2100 0x7f56380b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563e78c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56380cb7a0 con 0x7f56380b35d0 2023-10-06T11:13:20.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563e78c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56380b0860 con 0x7f56380b2100 2023-10-06T11:13:20.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563e78c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380cb150 con 0x7f5638159440 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56380b2100 0x7f56380b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56380b2100 0x7f56380b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35180/0 (socket says 172.21.15.55:35180) 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 -- 172.21.15.55:0/1254324302 learned_addr learned my addr 172.21.15.55:0/1254324302 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563d78a700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5638159440 0x7f56380b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 -- 172.21.15.55:0/1254324302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5638159440 msgr2=0x7f56380b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5638159440 0x7f56380b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 -- 172.21.15.55:0/1254324302 >> v1:172.21.15.142:6789/0 conn(0x7f56380b35d0 legacy=0x7f56380cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.521+0000 7f563df8b700 1 -- 172.21.15.55:0/1254324302 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380cb430 con 0x7f56380b2100 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563d78a700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5638159440 0x7f56380b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563df8b700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b2100 0x7f56380b2580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f56300099b0 tx=0x7f5630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca73b81bbeff5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f5637fff700 1 -- 172.21.15.55:0/1254324302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000b860 con 0x7f56380b2100 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f5637fff700 1 -- 172.21.15.55:0/1254324302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563000b9c0 con 0x7f56380b2100 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f5637fff700 1 -- 172.21.15.55:0/1254324302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000bd60 con 0x7f56380b2100 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 -- 172.21.15.55:0/1254324302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b2100 msgr2=0x7f56380b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b2100 0x7f56380b2580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f56300099b0 tx=0x7f5630009250 comp rx=0 tx=0).stop 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 -- 172.21.15.55:0/1254324302 shutdown_connections 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b2100 0x7f56380b2580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 --2- 172.21.15.55:0/1254324302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5638159440 0x7f56380b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 -- 172.21.15.55:0/1254324302 >> 172.21.15.55:0/1254324302 conn(0x7f563806ece0 msgr2=0x7f563806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 -- 172.21.15.55:0/1254324302 shutdown_connections 2023-10-06T11:13:20.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.522+0000 7f563e78c700 1 -- 172.21.15.55:0/1254324302 wait complete. 2023-10-06T11:13:20.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.523+0000 7f563e78c700 1 Processor -- start 2023-10-06T11:13:20.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 -- start start 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380b2100 0x7f56380cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 0x7f56380cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638159440 0x7f56380c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c4ac0 con 0x7f56380b35d0 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c4630 con 0x7f5638159440 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563e78c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c3a20 con 0x7f56380b2100 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.524+0000 7f563cf89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 0x7f56380cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 0x7f56380cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35196/0 (socket says 172.21.15.55:35196) 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 -- 172.21.15.55:0/3327144234 learned_addr learned my addr 172.21.15.55:0/3327144234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563df8b700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638159440 0x7f56380c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563d78a700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380b2100 0x7f56380cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 -- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380b2100 msgr2=0x7f56380cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380b2100 0x7f56380cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 -- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638159440 msgr2=0x7f56380c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638159440 0x7f56380c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 -- 172.21.15.55:0/3327144234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300094f0 con 0x7f56380b35d0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563cf89700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 0x7f56380cf520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c590 tx=0x7f562c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f56357fa700 1 -- 172.21.15.55:0/3327144234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011590 con 0x7f56380b35d0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f56357fa700 1 -- 172.21.15.55:0/3327144234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c0116f0 con 0x7f56380b35d0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f56357fa700 1 -- 172.21.15.55:0/3327144234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011ab0 con 0x7f56380b35d0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56380c3d00 con 0x7f56380b35d0 2023-10-06T11:13:20.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.525+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56380c42c0 con 0x7f56380b35d0 2023-10-06T11:13:20.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.526+0000 7f56357fa700 1 -- 172.21.15.55:0/3327144234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f562c01b3b0 con 0x7f56380b35d0 2023-10-06T11:13:20.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.527+0000 7f56357fa700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5624066f30 0x7f56240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.527+0000 7f56357fa700 1 -- 172.21.15.55:0/3327144234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f562c083ec0 con 0x7f56380b35d0 2023-10-06T11:13:20.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.527+0000 7f563d78a700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5624066f30 0x7f56240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.527+0000 7f563d78a700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5624066f30 0x7f56240693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5638156aa0 tx=0x7f5628009850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.529+0000 7f5648ce6b80 1 Processor -- start 2023-10-06T11:13:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.529+0000 7f5648ce6b80 1 -- start start 2023-10-06T11:13:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff32950 0x564feff32d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 0x564feff5b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff5be60 0x564feff2e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fefeb2c80 con 0x564feff7cbc0 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fefe89a70 con 0x564feff32950 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fefe87270 con 0x564feff5be60 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 0x564feff5b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 0x564feff5b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35212/0 (socket says 172.21.15.55:35212) 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 -- 172.21.15.55:0/3287868268 learned_addr learned my addr 172.21.15.55:0/3287868268 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563d78a700 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff32950 0x564feff32d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563df8b700 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff5be60 0x564feff2e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 -- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff5be60 msgr2=0x564feff2e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff5be60 0x564feff2e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 -- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff32950 msgr2=0x564feff32d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff32950 0x564feff32d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 -- 172.21.15.55:0/3287868268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fefd1d270 con 0x564feff7cbc0 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563df8b700 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff5be60 0x564feff2e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f563cf89700 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 0x564feff5b920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f562c00a040 tx=0x7f562c081ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4745008fe93d2954 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f561e7fc700 1 -- 172.21.15.55:0/3287868268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c057bf0 con 0x564feff7cbc0 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f561e7fc700 1 -- 172.21.15.55:0/3287868268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c05b940 con 0x564feff7cbc0 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.530+0000 7f561e7fc700 1 -- 172.21.15.55:0/3287868268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c011e20 con 0x564feff7cbc0 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3287868268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 msgr2=0x564feff5b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 0x564feff5b920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f562c00a040 tx=0x7f562c081ef0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3287868268 shutdown_connections 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff5be60 0x564feff2e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff32950 0x564feff32d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3287868268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff7cbc0 0x564feff5b920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3287868268 >> 172.21.15.55:0/3287868268 conn(0x564feff34270 msgr2=0x564feff34640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3287868268 shutdown_connections 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3287868268 wait complete. 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.531+0000 7f5648ce6b80 1 -- start start 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.532+0000 7f5648ce6b80 1 Processor -- start 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.532+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 0x564feff58540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.532+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff72f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.532+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff7cbc0 0x564feff799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fefe83060 con 0x564feff32950 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fefe2e890 con 0x564feff5be60 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fefe49ea0 con 0x564feff7cbc0 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 10 client.0 _ll_register_callbacks cb 0x564fefd1ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 0x564feff58540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 0x564feff58540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35216/0 (socket says 172.21.15.55:35216) 2023-10-06T11:13:20.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 -- 172.21.15.55:0/3147685351 learned_addr learned my addr 172.21.15.55:0/3147685351 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563df8b700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff7cbc0 0x564feff799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563cf89700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff72f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 -- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff7cbc0 msgr2=0x564feff799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff7cbc0 0x564feff799b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 -- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 msgr2=0x564feff72f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff72f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 -- 172.21.15.55:0/3147685351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56380c42c0 con 0x564feff32950 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f563d78a700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 0x564feff58540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5628016da0 tx=0x7f5628016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93e962332eeae08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f56177fe700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f56177fe700 1 -- 172.21.15.55:0/3147685351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628014b40 con 0x564feff32950 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564feff27690 con 0x564feff32950 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f56177fe700 1 -- 172.21.15.55:0/3147685351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5628014ca0 con 0x564feff32950 2023-10-06T11:13:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f56177fe700 1 -- 172.21.15.55:0/3147685351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5628014e60 con 0x564feff32950 2023-10-06T11:13:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 10 client.4440 fetch_fsmap learned FSMap version 7 2023-10-06T11:13:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.533+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564fefcbffe0 con 0x564feff32950 2023-10-06T11:13:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f56177fe700 1 -- 172.21.15.55:0/3147685351 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564feff27690 con 0x564feff32950 2023-10-06T11:13:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f56177fe700 1 -- 172.21.15.55:0/3147685351 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f5628021070 con 0x564feff32950 2023-10-06T11:13:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f5648ce6b80 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T11:13:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f5648ce6b80 10 client.4440 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f5648ce6b80 20 client.4440 populate_metadata read hostname 'smithi055' 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff88dd0 0x564feff5a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f5648ce6b80 4 client.4440 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 --> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564feff045c0 con 0x564feff88dd0 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f563cf89700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff88dd0 0x564feff5a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f56177fe700 10 client.4440 ms_handle_connect on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.534+0000 7f563cf89700 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff88dd0 0x564feff5a510 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b6baf3947ccd9f7 server_cookie=bf0769ae033b676f in_seq=0 out_seq=0 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f56177fe700 1 -- 172.21.15.55:0/3147685351 <== mds.0 v2:172.21.15.142:6834/2998784723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564feff045c0 con 0x564feff88dd0 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f56177fe700 10 client.4440 handle_command_reply: tid=0 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 client.4440 shutdown 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 msgr2=0x564feff58540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 0x564feff58540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5628016da0 tx=0x7f5628016000 comp rx=0 tx=0).stop 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 shutdown_connections 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff88dd0 0x564feff5a510 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff32950 0x564feff58540 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff7cbc0 0x564feff799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f56177fe700 0 client.4440 ms_handle_reset on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/3147685351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff72f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 >> 172.21.15.55:0/3147685351 conn(0x564feff34270 msgr2=0x564feff291a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 shutdown_connections 2023-10-06T11:13:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 1 -- 172.21.15.55:0/3147685351 wait complete. 2023-10-06T11:13:20.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.535+0000 7f5648ce6b80 20 client.4440 trim_cache size 0 max 16384 2023-10-06T11:13:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.552+0000 7f5648ce6b80 1 Processor -- start 2023-10-06T11:13:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.552+0000 7f5648ce6b80 1 -- start start 2023-10-06T11:13:20.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feff34640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff5aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff88230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fefd05e30 con 0x564feff34270 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564feff35b30 con 0x564feff5be60 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564feff727b0 con 0x564feff32950 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feff34640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feff34640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35228/0 (socket says 172.21.15.55:35228) 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 -- 172.21.15.55:0/2743000886 learned_addr learned my addr 172.21.15.55:0/2743000886 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563cf89700 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff5aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563df8b700 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff88230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 -- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 msgr2=0x564feff5aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff5aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 -- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 msgr2=0x564feff88230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff88230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 -- 172.21.15.55:0/2743000886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564feff74a80 con 0x564feff34270 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f563d78a700 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feff34640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5628009a00 tx=0x7f5628019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c68a3b2c23e7fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.553+0000 7f561effd700 1 -- 172.21.15.55:0/2743000886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628007e70 con 0x564feff34270 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f561effd700 1 -- 172.21.15.55:0/2743000886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628022740 con 0x564feff34270 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f561effd700 1 -- 172.21.15.55:0/2743000886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628022c40 con 0x564feff34270 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 -- 172.21.15.55:0/2743000886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 msgr2=0x564feff34640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feff34640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5628009a00 tx=0x7f5628019000 comp rx=0 tx=0).stop 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 -- 172.21.15.55:0/2743000886 shutdown_connections 2023-10-06T11:13:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feff34640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff88230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/2743000886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff5aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 -- 172.21.15.55:0/2743000886 >> 172.21.15.55:0/2743000886 conn(0x564feff318e0 msgr2=0x564feff784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 -- 172.21.15.55:0/2743000886 shutdown_connections 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.554+0000 7f5648ce6b80 1 -- 172.21.15.55:0/2743000886 wait complete. 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.555+0000 7f5648ce6b80 1 -- start start 2023-10-06T11:13:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.555+0000 7f5648ce6b80 1 Processor -- start 2023-10-06T11:13:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff75be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feffde4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff9b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564feff59200 con 0x564feff34270 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564feff76470 con 0x564feff5be60 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564feff56ad0 con 0x564feff32950 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 10 client.0 _ll_register_callbacks cb 0x564fefd1ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feffde4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feffde4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35240/0 (socket says 172.21.15.55:35240) 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 -- 172.21.15.55:0/4204889712 learned_addr learned my addr 172.21.15.55:0/4204889712 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563d78a700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff75be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563df8b700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff9b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 -- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 msgr2=0x564feff75be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff75be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 -- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 msgr2=0x564feff9b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff9b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 -- 172.21.15.55:0/4204889712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fefcbffe0 con 0x564feff34270 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f563cf89700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feffde4b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f562c052f90 tx=0x7f562c07f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c82930d8f270c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f56177fe700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f56177fe700 1 -- 172.21.15.55:0/4204889712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0544e0 con 0x564feff34270 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f56177fe700 1 -- 172.21.15.55:0/4204889712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f562c053e90 con 0x564feff34270 2023-10-06T11:13:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f562c05b940 con 0x564feff34270 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f56177fe700 1 -- 172.21.15.55:0/4204889712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f562c05b4b0 con 0x564feff34270 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.556+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564fefe51780 con 0x564feff34270 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f56177fe700 1 -- 172.21.15.55:0/4204889712 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c05b940 con 0x564feff34270 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f56177fe700 1 -- 172.21.15.55:0/4204889712 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f562c011c10 con 0x564feff34270 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 20 client.4446 populate_metadata read hostname 'smithi055' 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff7cbc0 0x564feff88230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 4 client.4446 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-10-06T11:13:20.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 --> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564fefe25e00 con 0x564feff7cbc0 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f563d78a700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff7cbc0 0x564feff88230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f563d78a700 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff7cbc0 0x564feff88230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33fa4d1c1bf8db3 server_cookie=46e1ddb511bf04a0 in_seq=0 out_seq=0 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f56177fe700 10 client.4446 ms_handle_connect on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f56177fe700 1 -- 172.21.15.55:0/4204889712 <== mds.0 v2:172.21.15.142:6834/2998784723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564fefe25e00 con 0x564feff7cbc0 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f56177fe700 10 client.4446 handle_command_reply: tid=0 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.557+0000 7f5648ce6b80 1 client.4446 shutdown 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 msgr2=0x564feffde4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feffde4b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f562c052f90 tx=0x7f562c07f040 comp rx=0 tx=0).stop 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 shutdown_connections 2023-10-06T11:13:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x564feff7cbc0 0x564feff88230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564feff5be60 0x564feff9b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564feff32950 0x564feff75be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f56177fe700 0 client.4446 ms_handle_reset on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 --2- 172.21.15.55:0/4204889712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564feff34270 0x564feffde4b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 >> 172.21.15.55:0/4204889712 conn(0x564feff318e0 msgr2=0x564feff5aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 shutdown_connections 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 1 -- 172.21.15.55:0/4204889712 wait complete. 2023-10-06T11:13:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f5648ce6b80 20 client.4446 trim_cache size 0 max 16384 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4290, 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 7.4397756429999999, 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 7, 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 28, 2023-10-06T11:13:20.569 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 28, 2023-10-06T11:13:20.570 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 13.405785686 2023-10-06T11:13:20.570 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:13:20.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5624066f30 msgr2=0x7f56240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5624066f30 0x7f56240693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5638156aa0 tx=0x7f5628009850 comp rx=0 tx=0).stop 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 msgr2=0x7f56380cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 0x7f56380cf520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f562c00c590 tx=0x7f562c00c950 comp rx=0 tx=0).stop 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 shutdown_connections 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5624066f30 0x7f56240693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5638159440 0x7f56380c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56380b2100 0x7f56380cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 --2- 172.21.15.55:0/3327144234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56380b35d0 0x7f56380cf520 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 >> 172.21.15.55:0/3327144234 conn(0x7f563806ece0 msgr2=0x7f5638155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 shutdown_connections 2023-10-06T11:13:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.558+0000 7f563e78c700 1 -- 172.21.15.55:0/3327144234 wait complete. 2023-10-06T11:13:20.573 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:13:20.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.689+0000 7f1cc68e6700 1 Processor -- start 2023-10-06T11:13:20.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.689+0000 7f1cc68e6700 1 -- start start 2023-10-06T11:13:20.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc68e6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cc00b49a0 0x7f1cc00aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc68e6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cc00b0760 0x7f1cc00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc68e6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00b0c60 con 0x7f1cc0159560 2023-10-06T11:13:20.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc68e6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00b0f40 con 0x7f1cc00b0760 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc68e6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00b1220 con 0x7f1cc00b49a0 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cc00b0760 0x7f1cc00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cc00b0760 0x7f1cc00b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35242/0 (socket says 172.21.15.55:35242) 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1019781236 learned_addr learned my addr 172.21.15.55:0/1019781236 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cbf7fe700 1 --2- 172.21.15.55:0/1019781236 >> v2:172.21.15.142:3300/0 conn(0x7f1cc00b49a0 0x7f1cc00aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1019781236 >> v2:172.21.15.142:3300/0 conn(0x7f1cc00b49a0 msgr2=0x7f1cc00aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 --2- 172.21.15.55:0/1019781236 >> v2:172.21.15.142:3300/0 conn(0x7f1cc00b49a0 0x7f1cc00aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1019781236 >> v1:172.21.15.142:6789/0 conn(0x7f1cc0159560 legacy=0x7f1cc00aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1019781236 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00b1500 con 0x7f1cc00b0760 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.690+0000 7f1cc4e83700 1 --2- 172.21.15.55:0/1019781236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc00b0760 0x7f1cc00b1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009f20 tx=0x7f1cb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbebf433502e6376 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cbeffd700 1 -- 172.21.15.55:0/1019781236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800e070 con 0x7f1cc00b0760 2023-10-06T11:13:20.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cbeffd700 1 -- 172.21.15.55:0/1019781236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800ba00 con 0x7f1cc00b0760 2023-10-06T11:13:20.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cbeffd700 1 -- 172.21.15.55:0/1019781236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80092e0 con 0x7f1cc00b0760 2023-10-06T11:13:20.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1019781236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc00b0760 msgr2=0x7f1cc00b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1019781236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc00b0760 0x7f1cc00b1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009f20 tx=0x7f1cb8009840 comp rx=0 tx=0).stop 2023-10-06T11:13:20.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1019781236 shutdown_connections 2023-10-06T11:13:20.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1019781236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc00b0760 0x7f1cc00b1bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1019781236 >> v2:172.21.15.142:3300/0 conn(0x7f1cc00b49a0 0x7f1cc00aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1019781236 >> 172.21.15.55:0/1019781236 conn(0x7f1cc00997f0 msgr2=0x7f1cc006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1019781236 shutdown_connections 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.691+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1019781236 wait complete. 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.692+0000 7f1cc68e6700 1 Processor -- start 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 -- start start 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc00b0760 0x7f1cc009d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cc00b49a0 0x7f1cc009a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 0x7f1cc0157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc009a590 con 0x7f1cc0159560 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00ac650 con 0x7f1cc00b0760 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc68e6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc009a7c0 con 0x7f1cc00b49a0 2023-10-06T11:13:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc4e83700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 0x7f1cc0157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc4e83700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 0x7f1cc0157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35254/0 (socket says 172.21.15.55:35254) 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.693+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1161391364 learned_addr learned my addr 172.21.15.55:0/1161391364 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cbf7fe700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cc00b49a0 0x7f1cc009a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cbffff700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc00b0760 0x7f1cc009d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cc00b49a0 msgr2=0x7f1cc009a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc4e83700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cc00b49a0 0x7f1cc009a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc00b0760 msgr2=0x7f1cc009d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc4e83700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc00b0760 0x7f1cc009d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc4e83700 1 -- 172.21.15.55:0/1161391364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009ae0 con 0x7f1cc0159560 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cbf7fe700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cc00b49a0 0x7f1cc009a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:20.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cbffff700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc00b0760 0x7f1cc009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:20.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc4e83700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 0x7f1cc0157b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0067c20 tx=0x7f1cb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8012e60 con 0x7f1cc0159560 2023-10-06T11:13:20.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb80092e0 con 0x7f1cc0159560 2023-10-06T11:13:20.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc009aaa0 con 0x7f1cc0159560 2023-10-06T11:13:20.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb801d670 con 0x7f1cc0159560 2023-10-06T11:13:20.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.694+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc009ad80 con 0x7f1cc0159560 2023-10-06T11:13:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.695+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00ac800 con 0x7f1cc0159560 2023-10-06T11:13:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.696+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cb801d9e0 con 0x7f1cc0159560 2023-10-06T11:13:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.696+0000 7f1ca7fff700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.696+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1cb80861d0 con 0x7f1cc0159560 2023-10-06T11:13:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.696+0000 7f1cbffff700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.697+0000 7f1cbffff700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1cac066f30 0x7f1cac0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40099f0 tx=0x7f1cb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.700+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cc00ac800 con 0x7f1cc0159560 2023-10-06T11:13:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.939+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1cc00ac7c0 con 0x7f1cc0159560 2023-10-06T11:13:20.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.939+0000 7f1ca7fff700 1 -- 172.21.15.55:0/1161391364 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1cb8052ff0 con 0x7f1cc0159560 2023-10-06T11:13:20.942 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T11:13:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1cac066f30 msgr2=0x7f1cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1cac066f30 0x7f1cac0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40099f0 tx=0x7f1cb4008040 comp rx=0 tx=0).stop 2023-10-06T11:13:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 msgr2=0x7f1cc0157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 0x7f1cc0157b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0067c20 tx=0x7f1cb8017000 comp rx=0 tx=0).stop 2023-10-06T11:13:20.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 shutdown_connections 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc0159560 0x7f1cc0157b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cc00b0760 0x7f1cc009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 --2- 172.21.15.55:0/1161391364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cc00b49a0 0x7f1cc009a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 >> 172.21.15.55:0/1161391364 conn(0x7f1cc00997f0 msgr2=0x7f1cc0158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 shutdown_connections 2023-10-06T11:13:20.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:20.941+0000 7f1cc68e6700 1 -- 172.21.15.55:0/1161391364 wait complete. 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:13:20.956 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T11:13:20.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:20.957 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:13:20.972 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:20.972 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:20.972 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:20.972 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:20.972 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42492sec preferred_lft 42492sec 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:20.974 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:20.974 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:13:20.974 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:20.974 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:20.974 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:13:20.974 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T11:13:20.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T11:13:20.975 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:21.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.203 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:13:21.248 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:13:21.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.250 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:13:21.303 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:13:21.303 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:13:21.303 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:13:21.303 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:13:21.303 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:13:21.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.304 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:21.304 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:21.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:13:21.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:13:21.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:13:21.304 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:21.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.520 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:13:21.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.537 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-10-06T11:13:21.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.592 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:21.592 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:21.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T11:13:21.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T11:13:21.592 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:21.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T11:13:21.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T11:13:21.683 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:21.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:21.878 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:21.878 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:21.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:13:21.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T11:13:21.879 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:21.972 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T11:13:21.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:21.972 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:21.988 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T11:13:21.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:21.988 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:22.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2023-10-06T11:13:22.109 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:13:22.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:13:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:13:22.175 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:13:22.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:22.177 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2023-10-06T11:13:22.231 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:13:22.232 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T11:13:22.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2023-10-06T11:13:22.298 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:13:22.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:13:22.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:2023-10-06T11:13:22.360+0000 7fbd93f87540 -1 init, newargv = 0x55d26d5b0150 newargc=15 2023-10-06T11:13:22.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:ceph-fuse[98117]: starting ceph client 2023-10-06T11:13:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:13:22.365 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:13:22.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:22.365 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2023-10-06T11:13:22.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:ceph-fuse[98117]: starting fuse 2023-10-06T11:13:22.383 INFO:teuthology.orchestra.run.smithi055.stdout:46 2023-10-06T11:13:22.384 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> import re 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> import os 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> 2023-10-06T11:13:22.384 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:13:22.385 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> return f 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.admin")) 2023-10-06T11:13:22.386 DEBUG:teuthology.orchestra.run.smithi055:> ' 2023-10-06T11:13:22.508 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.admin.98117.asok 2023-10-06T11:13:22.689 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.98117.asok 2023-10-06T11:13:22.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:22.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.98117.asok status 2023-10-06T11:13:22.844 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "admin", 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T11:13:22.845 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "98117", 2023-10-06T11:13:22.846 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2023-10-06T11:13:22.846 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:13:22.846 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2023-10-06T11:13:22.846 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2023-10-06T11:13:22.846 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4461, 2023-10-06T11:13:22.847 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2023-10-06T11:13:22.847 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2023-10-06T11:13:22.847 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2023-10-06T11:13:22.847 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 4461 2023-10-06T11:13:22.847 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:13:22.847 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2023-10-06T11:13:22.848 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2023-10-06T11:13:22.848 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:13:22.848 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3890226536 2023-10-06T11:13:22.848 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:13:22.848 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3890226536 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.4461 192.168.0.1:0/3890226536", 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/3890226536", 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 7, 2023-10-06T11:13:22.849 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 28, 2023-10-06T11:13:22.850 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:13:22.850 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2023-10-06T11:13:22.850 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2023-10-06T11:13:22.850 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:13:22.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:22.854 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2023-10-06T11:13:22.854 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:22.870 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2023-10-06T11:13:22.870 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:22.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:22.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:22.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:22.936 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T11:13:23.029 INFO:teuthology.orchestra.run.smithi055.stdout:# file: . 2023-10-06T11:13:23.030 INFO:teuthology.orchestra.run.smithi055.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T11:13:23.030 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:23.030 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2023-10-06T11:13:23.030 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:13:23.030 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T11:13:23.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi055.stderr:ceph-fuse[98117]: fuse finished with error 0 and tester_r 0 2023-10-06T11:13:23.063 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:13:23.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:13:23.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:23.155 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T11:13:23.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:23.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.328+0000 7fe62e6d9700 1 Processor -- start 2023-10-06T11:13:23.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.328+0000 7fe62e6d9700 1 -- start start 2023-10-06T11:13:23.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe62e6d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 0x7fe6280aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe62e6d9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280b0c60 con 0x7fe628159560 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe62e6d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280b0f40 con 0x7fe6280b0760 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe62e6d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280b1220 con 0x7fe6280b49a0 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe627fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe628159560 0x7fe6280aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41080/0 (socket says 172.21.15.55:41080) 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe627fff700 1 -- 172.21.15.55:0/1769746647 learned_addr learned my addr 172.21.15.55:0/1769746647 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe6277fe700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 0x7fe6280aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334802148 0 0) 0x7fe6280b0c60 con 0x7fe628159560 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe614003570 con 0x7fe628159560 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102977861 0 0) 0x7fe614003570 con 0x7fe628159560 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 msgr2=0x7fe6280aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:23.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 0x7fe6280aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 >> v1:172.21.15.142:6789/0 conn(0x7fe6280b0760 legacy=0x7fe6280b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280b1500 con 0x7fe628159560 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fe6180015f0 con 0x7fe628159560 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 >> v1:172.21.15.55:6789/0 conn(0x7fe628159560 legacy=0x7fe6280aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 0x7fe614003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe614004010 0x7fe614004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe6140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280b1220 con 0x7fe614004d50 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61400bbf0 con 0x7fe614004010 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.329+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61400bdb0 con 0x7fe6280b49a0 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe6140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe6277fe700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe614004010 0x7fe614004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe627fff700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 0x7fe614003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 -- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 msgr2=0x7fe614003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6280b49a0 0x7fe614003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 -- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe614004010 msgr2=0x7fe614004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe614004010 0x7fe614004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 -- 172.21.15.55:0/1769746647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614003570 con 0x7fe614004d50 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe62cc76700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe6140051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe620001f90 tx=0x7fe620001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480481029f52e2b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620001950 con 0x7fe614004d50 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000c8b0 con 0x7fe614004d50 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.330+0000 7fe626ffd700 1 -- 172.21.15.55:0/1769746647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000cc70 con 0x7fe614004d50 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1769746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 msgr2=0x7fe6140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1769746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe6140051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe620001f90 tx=0x7fe620001640 comp rx=0 tx=0).stop 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62cc76700 1 -- 172.21.15.55:0/1769746647 reap_dead start 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1769746647 shutdown_connections 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1769746647 >> 172.21.15.55:0/1769746647 conn(0x7fe6280997f0 msgr2=0x7fe62806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1769746647 shutdown_connections 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.331+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1769746647 wait complete. 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.332+0000 7fe62e6d9700 1 Processor -- start 2023-10-06T11:13:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.332+0000 7fe62e6d9700 1 -- start start 2023-10-06T11:13:23.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62e6d9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe62809db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62e6d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe62815c760 0x7fe62815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62e6d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe628156c60 0x7fe6281578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62e6d9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280af9e0 con 0x7fe614004d50 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62e6d9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62815e9a0 con 0x7fe628156c60 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62e6d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62815c2d0 con 0x7fe62815c760 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe62809db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe62809db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35272/0 (socket says 172.21.15.55:35272) 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 -- 172.21.15.55:0/1251764173 learned_addr learned my addr 172.21.15.55:0/1251764173 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe6277fe700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe62815c760 0x7fe62815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe62cc76700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe628156c60 0x7fe6281578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 -- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe62815c760 msgr2=0x7fe62815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe62815c760 0x7fe62815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 -- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe628156c60 msgr2=0x7fe6281578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe628156c60 0x7fe6281578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 -- 172.21.15.55:0/1251764173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62815cbd0 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.333+0000 7fe627fff700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe62809db10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe618001360 tx=0x7fe618009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.334+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180073b0 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.334+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe618007510 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.334+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62815e3e0 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.334+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618005a00 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.334+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62815bf60 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.335+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62815bdc0 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.335+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe61800d610 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.335+0000 7fe61ffff700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.336+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe618084bb0 con 0x7fe614004d50 2023-10-06T11:13:23.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.336+0000 7fe6277fe700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.336+0000 7fe6277fe700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe62815cda0 tx=0x7fe610008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.340+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe62815bdc0 con 0x7fe614004d50 2023-10-06T11:13:23.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.535+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe62815bdc0 con 0x7fe614004d50 2023-10-06T11:13:23.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.536+0000 7fe61ffff700 1 -- 172.21.15.55:0/1251764173 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fe62815bdc0 con 0x7fe614004d50 2023-10-06T11:13:23.538 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:23.538 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe608066f30 msgr2=0x7fe6080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe62815cda0 tx=0x7fe610008040 comp rx=0 tx=0).stop 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 msgr2=0x7fe62809db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe62809db10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe618001360 tx=0x7fe618009040 comp rx=0 tx=0).stop 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 shutdown_connections 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe614004d50 0x7fe62809db10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe628156c60 0x7fe6281578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 --2- 172.21.15.55:0/1251764173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe62815c760 0x7fe62815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 >> 172.21.15.55:0/1251764173 conn(0x7fe6280997f0 msgr2=0x7fe628158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 shutdown_connections 2023-10-06T11:13:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.538+0000 7fe62e6d9700 1 -- 172.21.15.55:0/1251764173 wait complete. 2023-10-06T11:13:23.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.669+0000 7efd7ccc4700 1 Processor -- start 2023-10-06T11:13:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.669+0000 7efd7ccc4700 1 -- start start 2023-10-06T11:13:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd7ccc4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd780ca370 0x7efd78158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd7ccc4700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd78157de0 con 0x7efd780ce8a0 2023-10-06T11:13:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd7ccc4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780cb5d0 con 0x7efd780adb60 2023-10-06T11:13:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd7ccc4700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780cbb90 con 0x7efd780ca370 2023-10-06T11:13:23.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd7659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd780ca370 0x7efd78158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd76d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efd780ce8a0 0x7efd7815aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41090/0 (socket says 172.21.15.55:41090) 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.670+0000 7efd76d9d700 1 -- 172.21.15.55:0/3777666802 learned_addr learned my addr 172.21.15.55:0/3777666802 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7659c700 1 -- 172.21.15.55:0/3777666802 >> v1:172.21.15.142:6789/0 conn(0x7efd780adb60 legacy=0x7efd780ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7559a700 1 -- 172.21.15.55:0/3777666802 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172857057 0 0) 0x7efd78157de0 con 0x7efd780ce8a0 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7659c700 1 -- 172.21.15.55:0/3777666802 >> v1:172.21.15.55:6789/0 conn(0x7efd780ce8a0 legacy=0x7efd7815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7659c700 1 -- 172.21.15.55:0/3777666802 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780cb8b0 con 0x7efd780ca370 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7659c700 1 --2- 172.21.15.55:0/3777666802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd78158270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd700098e0 tx=0x7efd700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df2a33071a6b68b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7559a700 1 -- 172.21.15.55:0/3777666802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70009e80 con 0x7efd780ca370 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7559a700 1 -- 172.21.15.55:0/3777666802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000b860 con 0x7efd780ca370 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7559a700 1 -- 172.21.15.55:0/3777666802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000bbe0 con 0x7efd780ca370 2023-10-06T11:13:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7ccc4700 1 -- 172.21.15.55:0/3777666802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 msgr2=0x7efd78158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.671+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/3777666802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd78158270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd700098e0 tx=0x7efd700091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.672+0000 7efd7ccc4700 1 -- 172.21.15.55:0/3777666802 shutdown_connections 2023-10-06T11:13:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.672+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/3777666802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd78158270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.672+0000 7efd7ccc4700 1 -- 172.21.15.55:0/3777666802 >> 172.21.15.55:0/3777666802 conn(0x7efd780707d0 msgr2=0x7efd78070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.672+0000 7efd7ccc4700 1 -- 172.21.15.55:0/3777666802 shutdown_connections 2023-10-06T11:13:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.672+0000 7efd7ccc4700 1 -- 172.21.15.55:0/3777666802 wait complete. 2023-10-06T11:13:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 Processor -- start 2023-10-06T11:13:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 -- start start 2023-10-06T11:13:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd780adb60 0x7efd7816a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd7814a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780ce8a0 0x7efd78069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7814a810 con 0x7efd780ca370 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd78153470 con 0x7efd780ce8a0 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd7ccc4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd78069f70 con 0x7efd780adb60 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.673+0000 7efd75d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd7814a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd7814a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35294/0 (socket says 172.21.15.55:35294) 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 -- 172.21.15.55:0/2653932015 learned_addr learned my addr 172.21.15.55:0/2653932015 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd76d9d700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780ce8a0 0x7efd78069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd7659c700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd780adb60 0x7efd7816a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 -- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd780adb60 msgr2=0x7efd7816a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd780adb60 0x7efd7816a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 -- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780ce8a0 msgr2=0x7efd78069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780ce8a0 0x7efd78069a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 -- 172.21.15.55:0/2653932015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009420 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd7659c700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd780adb60 0x7efd7816a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd75d9b700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd7814a2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c5c0 tx=0x7efd60007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60011590 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60011710 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd78169a50 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60011ad0 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.674+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd781539a0 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.675+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd78064a90 con 0x7efd780ca370 2023-10-06T11:13:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.676+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd6001b3b0 con 0x7efd780ca370 2023-10-06T11:13:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.676+0000 7efd6e7fc700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd58066f30 0x7efd580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.676+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efd60083cc0 con 0x7efd780ca370 2023-10-06T11:13:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.676+0000 7efd7659c700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd58066f30 0x7efd580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.677+0000 7efd7659c700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd58066f30 0x7efd580693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd700093f0 tx=0x7efd70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.681+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd60050ae0 con 0x7efd780ca370 2023-10-06T11:13:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.876+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd78157b00 con 0x7efd780ca370 2023-10-06T11:13:23.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.877+0000 7efd6e7fc700 1 -- 172.21.15.55:0/2653932015 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7efd60017070 con 0x7efd780ca370 2023-10-06T11:13:23.879 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:23.879 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:23.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd58066f30 msgr2=0x7efd580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd58066f30 0x7efd580693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd700093f0 tx=0x7efd70017000 comp rx=0 tx=0).stop 2023-10-06T11:13:23.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 msgr2=0x7efd7814a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd7814a2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c5c0 tx=0x7efd60007f50 comp rx=0 tx=0).stop 2023-10-06T11:13:23.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 shutdown_connections 2023-10-06T11:13:23.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd58066f30 0x7efd580693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd780ce8a0 0x7efd78069a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd780adb60 0x7efd7816a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 --2- 172.21.15.55:0/2653932015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd780ca370 0x7efd7814a2d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 >> 172.21.15.55:0/2653932015 conn(0x7efd780707d0 msgr2=0x7efd781596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:23.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 shutdown_connections 2023-10-06T11:13:23.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:23.879+0000 7efd7ccc4700 1 -- 172.21.15.55:0/2653932015 wait complete. 2023-10-06T11:13:23.893 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:13:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.012+0000 7fc66a5e7700 1 Processor -- start 2023-10-06T11:13:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.012+0000 7fc66a5e7700 1 -- start start 2023-10-06T11:13:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc66a5e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc6640cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc66a5e7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640cbec0 con 0x7fc6641598a0 2023-10-06T11:13:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc66a5e7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640cf5d0 con 0x7fc6640cbaa0 2023-10-06T11:13:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc66a5e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640cf8b0 con 0x7fc6641594d0 2023-10-06T11:13:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc6637fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6641598a0 0x7fc6640ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41102/0 (socket says 172.21.15.55:41102) 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc6637fe700 1 -- 172.21.15.55:0/306773502 learned_addr learned my addr 172.21.15.55:0/306773502 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc663fff700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc6640cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.013+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852387852 0 0) 0x7fc6640cbec0 con 0x7fc6641598a0 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc650003570 con 0x7fc6641598a0 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698071716 0 0) 0x7fc6640cf5d0 con 0x7fc6640cbaa0 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6640cbec0 con 0x7fc6640cbaa0 2023-10-06T11:13:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1808442118 0 0) 0x7fc650003570 con 0x7fc6641598a0 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 msgr2=0x7fc6640cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc6640cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 >> v1:172.21.15.142:6789/0 conn(0x7fc6640cbaa0 legacy=0x7fc6640c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640cfb90 con 0x7fc6641598a0 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fc64c001470 con 0x7fc6641598a0 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc663fff700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc6640cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 >> v1:172.21.15.55:6789/0 conn(0x7fc6641598a0 legacy=0x7fc6640ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc650003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500041b0 0x7fc650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc650004d50 0x7fc6500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640cf8b0 con 0x7fc650004d50 2023-10-06T11:13:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65000bbf0 con 0x7fc6500041b0 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65000bdb0 con 0x7fc6641594d0 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc650004d50 0x7fc6500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc663fff700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc650003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc6637fe700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500041b0 0x7fc650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 -- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 msgr2=0x7fc650003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6641594d0 0x7fc650003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 -- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500041b0 msgr2=0x7fc650004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6500041b0 0x7fc650004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 -- 172.21.15.55:0/306773502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009420 con 0x7fc650004d50 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.014+0000 7fc668b84700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc650004d50 0x7fc6500051c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc65c002120 tx=0x7fc65c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84bc8886d89915f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c001ab0 con 0x7fc650004d50 2023-10-06T11:13:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c00c980 con 0x7fc650004d50 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc662ffd700 1 -- 172.21.15.55:0/306773502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00cd20 con 0x7fc650004d50 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc66a5e7700 1 -- 172.21.15.55:0/306773502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc650004d50 msgr2=0x7fc6500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/306773502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc650004d50 0x7fc6500051c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc65c002120 tx=0x7fc65c0017a0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc668b84700 1 -- 172.21.15.55:0/306773502 reap_dead start 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc66a5e7700 1 -- 172.21.15.55:0/306773502 shutdown_connections 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc66a5e7700 1 -- 172.21.15.55:0/306773502 >> 172.21.15.55:0/306773502 conn(0x7fc664089e50 msgr2=0x7fc664099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:24.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc66a5e7700 1 -- 172.21.15.55:0/306773502 shutdown_connections 2023-10-06T11:13:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.015+0000 7fc66a5e7700 1 -- 172.21.15.55:0/306773502 wait complete. 2023-10-06T11:13:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.016+0000 7fc66a5e7700 1 Processor -- start 2023-10-06T11:13:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.016+0000 7fc66a5e7700 1 -- start start 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc66a5e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc650004d50 0x7fc66414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc66a5e7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 0x7fc66416ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc66a5e7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc664157380 0x7fc664157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc66a5e7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641556f0 con 0x7fc664150b00 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc66a5e7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664155f20 con 0x7fc664157380 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc66a5e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66414d5a0 con 0x7fc650004d50 2023-10-06T11:13:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc6637fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 0x7fc66416ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc663fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc650004d50 0x7fc66414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc6637fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 0x7fc66416ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35320/0 (socket says 172.21.15.55:35320) 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc6637fe700 1 -- 172.21.15.55:0/3190148888 learned_addr learned my addr 172.21.15.55:0/3190148888 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc663fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc650004d50 0x7fc66414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:33210/0 (socket says 172.21.15.55:33210) 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc668b84700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc664157380 0x7fc664157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc6637fe700 1 -- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc650004d50 msgr2=0x7fc66414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.017+0000 7fc6637fe700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc650004d50 0x7fc66414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc6637fe700 1 -- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc664157380 msgr2=0x7fc664157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc6637fe700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc664157380 0x7fc664157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc6637fe700 1 -- 172.21.15.55:0/3190148888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66416b040 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc6637fe700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 0x7fc66416ab00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc64c007fd0 tx=0x7fc64c001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c011590 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0116f0 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc664155960 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c011a70 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.018+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6641513b0 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.019+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc664151210 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.019+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc64c01d460 con 0x7fc664150b00 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.020+0000 7fc65bfff700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc644066f30 0x7fc6440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.020+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc64c084b10 con 0x7fc664150b00 2023-10-06T11:13:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.020+0000 7fc663fff700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc644066f30 0x7fc6440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.021+0000 7fc663fff700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc644066f30 0x7fc6440693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6640cb670 tx=0x7fc6540091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.024+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc664151210 con 0x7fc664150b00 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:24.263+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc664151210 con 0x7fc664150b00 2023-10-06T11:13:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.185+0000 7fc65bfff700 1 -- 172.21.15.55:0/3190148888 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc664151210 con 0x7fc664150b00 2023-10-06T11:13:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc644066f30 msgr2=0x7fc6440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc644066f30 0x7fc6440693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6640cb670 tx=0x7fc6540091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 msgr2=0x7fc66416ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 0x7fc66416ab00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc64c007fd0 tx=0x7fc64c001d20 comp rx=0 tx=0).stop 2023-10-06T11:13:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 shutdown_connections 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc644066f30 0x7fc6440693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc664157380 0x7fc664157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc650004d50 0x7fc66414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.187+0000 7fc66a5e7700 1 --2- 172.21.15.55:0/3190148888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc664150b00 0x7fc66416ab00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.188+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 >> 172.21.15.55:0/3190148888 conn(0x7fc664089e50 msgr2=0x7fc66415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.188+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 shutdown_connections 2023-10-06T11:13:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.188+0000 7fc66a5e7700 1 -- 172.21.15.55:0/3190148888 wait complete. 2023-10-06T11:13:25.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:13:25.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.331+0000 7f3bd3372700 1 Processor -- start 2023-10-06T11:13:25.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.331+0000 7f3bd3372700 1 -- start start 2023-10-06T11:13:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd3372700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1594d0 0x7f3bcc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd3372700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bcc1598a0 0x7f3bcc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd3372700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bcc0ce7e0 0x7f3bcc0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd3372700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0cf5d0 con 0x7f3bcc0ce7e0 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd3372700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0cf8b0 con 0x7f3bcc1598a0 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd3372700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0cfb90 con 0x7f3bcc1594d0 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bcc0ce7e0 0x7f3bcc0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bcc0ce7e0 0x7f3bcc0cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37086/0 (socket says 172.21.15.55:37086) 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 -- 172.21.15.55:0/3519336292 learned_addr learned my addr 172.21.15.55:0/3519336292 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd090d700 1 --2- 172.21.15.55:0/3519336292 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc1598a0 0x7f3bcc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd110e700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1594d0 0x7f3bcc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 -- 172.21.15.55:0/3519336292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1594d0 msgr2=0x7f3bcc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1594d0 0x7f3bcc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 -- 172.21.15.55:0/3519336292 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc1598a0 msgr2=0x7f3bcc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 --2- 172.21.15.55:0/3519336292 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc1598a0 0x7f3bcc0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 -- 172.21.15.55:0/3519336292 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0cfe70 con 0x7f3bcc0ce7e0 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd090d700 1 --2- 172.21.15.55:0/3519336292 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc1598a0 0x7f3bcc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd110e700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1594d0 0x7f3bcc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bd190f700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc0cec00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc089320 tx=0x7f3bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aff31684411ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.332+0000 7f3bcbfff700 1 -- 172.21.15.55:0/3519336292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00b860 con 0x7f3bcc0ce7e0 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bcbfff700 1 -- 172.21.15.55:0/3519336292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00b9c0 con 0x7f3bcc0ce7e0 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bcbfff700 1 -- 172.21.15.55:0/3519336292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00bd60 con 0x7f3bcc0ce7e0 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 -- 172.21.15.55:0/3519336292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc0ce7e0 msgr2=0x7f3bcc0cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc0cec00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc089320 tx=0x7f3bbc009250 comp rx=0 tx=0).stop 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 -- 172.21.15.55:0/3519336292 shutdown_connections 2023-10-06T11:13:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc0cec00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3519336292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1594d0 0x7f3bcc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3519336292 >> v2:172.21.15.142:3300/0 conn(0x7f3bcc1598a0 0x7f3bcc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 -- 172.21.15.55:0/3519336292 >> 172.21.15.55:0/3519336292 conn(0x7f3bcc089e50 msgr2=0x7f3bcc099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 -- 172.21.15.55:0/3519336292 shutdown_connections 2023-10-06T11:13:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.333+0000 7f3bd3372700 1 -- 172.21.15.55:0/3519336292 wait complete. 2023-10-06T11:13:25.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.334+0000 7f3bd3372700 1 Processor -- start 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.334+0000 7f3bd3372700 1 -- start start 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd3372700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd3372700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 0x7f3bcc14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd3372700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1598a0 0x7f3bcc14b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd3372700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc14ec70 con 0x7f3bcc1594d0 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd3372700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc152430 con 0x7f3bcc0ce7e0 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd3372700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc149910 con 0x7f3bcc1598a0 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd090d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 0x7f3bcc14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd090d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 0x7f3bcc14aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37094/0 (socket says 172.21.15.55:37094) 2023-10-06T11:13:25.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd110e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd090d700 1 -- 172.21.15.55:0/3307331589 learned_addr learned my addr 172.21.15.55:0/3307331589 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.335+0000 7f3bd190f700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1598a0 0x7f3bcc14b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd090d700 1 -- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1598a0 msgr2=0x7f3bcc14b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd090d700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1598a0 0x7f3bcc14b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd090d700 1 -- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bcc0ce7e0 msgr2=0x7f3bcc151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd090d700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd090d700 1 -- 172.21.15.55:0/3307331589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0094f0 con 0x7f3bcc1594d0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd090d700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 0x7f3bcc14aed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c8b0 tx=0x7f3bc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011600 con 0x7f3bcc1594d0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc0011760 con 0x7f3bcc1594d0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011b00 con 0x7f3bcc1594d0 2023-10-06T11:13:25.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc15c860 con 0x7f3bcc1594d0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.336+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc15c210 con 0x7f3bcc1594d0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.337+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc15c9f0 con 0x7f3bcc1594d0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.337+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bc00193b0 con 0x7f3bcc1594d0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.338+0000 7f3bc97fa700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3bb8066f30 0x7f3bb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.338+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3bc00848e0 con 0x7f3bcc1594d0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.338+0000 7f3bd110e700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3bb8066f30 0x7f3bb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.338+0000 7f3bd110e700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3bb8066f30 0x7f3bb80693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4007fd0 tx=0x7f3bc40077c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:25.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.342+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bc0051700 con 0x7f3bcc1594d0 2023-10-06T11:13:25.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:25.582+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3bcc0cf140 con 0x7f3bcc1594d0 2023-10-06T11:13:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.191+0000 7f3bc97fa700 1 -- 172.21.15.55:0/3307331589 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3bc0054d20 con 0x7f3bcc1594d0 2023-10-06T11:13:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3bb8066f30 msgr2=0x7f3bb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3bb8066f30 0x7f3bb80693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4007fd0 tx=0x7f3bc40077c0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 msgr2=0x7f3bcc14aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 0x7f3bcc14aed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c8b0 tx=0x7f3bc0008040 comp rx=0 tx=0).stop 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 shutdown_connections 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3bb8066f30 0x7f3bb80693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bcc1598a0 0x7f3bcc14b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bcc0ce7e0 0x7f3bcc151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 --2- 172.21.15.55:0/3307331589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bcc1594d0 0x7f3bcc14aed0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 >> 172.21.15.55:0/3307331589 conn(0x7f3bcc089e50 msgr2=0x7f3bcc099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 shutdown_connections 2023-10-06T11:13:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.193+0000 7f3bd3372700 1 -- 172.21.15.55:0/3307331589 wait complete. 2023-10-06T11:13:26.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:26.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.328+0000 7f1b7a9cb700 1 Processor -- start 2023-10-06T11:13:26.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.328+0000 7f1b7a9cb700 1 -- start start 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b7a9cb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 0x7f1b74069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b7a9cb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b7406d350 0x7f1b7406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b7a9cb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7406e6d0 con 0x7f1b740ada60 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b7a9cb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740cd000 con 0x7f1b7406d350 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b7a9cb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740aded0 con 0x7f1b740696e0 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 0x7f1b74069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b78f68700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b7406d350 0x7f1b7406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 0x7f1b74069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56138/0 (socket says 172.21.15.55:56138) 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 -- 172.21.15.55:0/1384298881 learned_addr learned my addr 172.21.15.55:0/1384298881 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 -- 172.21.15.55:0/1384298881 >> v2:172.21.15.142:3300/0 conn(0x7f1b7406d350 msgr2=0x7f1b7406eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 --2- 172.21.15.55:0/1384298881 >> v2:172.21.15.142:3300/0 conn(0x7f1b7406d350 0x7f1b7406eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 -- 172.21.15.55:0/1384298881 >> v1:172.21.15.142:6789/0 conn(0x7f1b740ada60 legacy=0x7f1b740aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 -- 172.21.15.55:0/1384298881 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7406dac0 con 0x7f1b740696e0 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.329+0000 7f1b73fff700 1 --2- 172.21.15.55:0/1384298881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 0x7f1b74069ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28acd51332fefd83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b72ffd700 1 -- 172.21.15.55:0/1384298881 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c009ea0 con 0x7f1b740696e0 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b72ffd700 1 -- 172.21.15.55:0/1384298881 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00b860 con 0x7f1b740696e0 2023-10-06T11:13:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b72ffd700 1 -- 172.21.15.55:0/1384298881 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00bc00 con 0x7f1b740696e0 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/1384298881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 msgr2=0x7f1b74069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/1384298881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 0x7f1b74069ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c009250 comp rx=0 tx=0).stop 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/1384298881 shutdown_connections 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/1384298881 >> v2:172.21.15.142:3300/0 conn(0x7f1b7406d350 0x7f1b7406eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/1384298881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b740696e0 0x7f1b74069ab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/1384298881 >> 172.21.15.55:0/1384298881 conn(0x7f1b74068080 msgr2=0x7f1b740cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/1384298881 shutdown_connections 2023-10-06T11:13:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.330+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/1384298881 wait complete. 2023-10-06T11:13:26.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.331+0000 7f1b7a9cb700 1 Processor -- start 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.331+0000 7f1b7a9cb700 1 -- start start 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b7a9cb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 0x7f1b740c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b7a9cb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b7406d350 0x7f1b7415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b7a9cb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b740ada60 0x7f1b7415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b7a9cb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741576f0 con 0x7f1b740696e0 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b7a9cb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415b1d0 con 0x7f1b740ada60 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b7a9cb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415aef0 con 0x7f1b7406d350 2023-10-06T11:13:26.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 0x7f1b740c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 0x7f1b740c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37108/0 (socket says 172.21.15.55:37108) 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b73fff700 1 -- 172.21.15.55:0/459996051 learned_addr learned my addr 172.21.15.55:0/459996051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b737fe700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b7406d350 0x7f1b7415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.332+0000 7f1b78f68700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b740ada60 0x7f1b7415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b73fff700 1 -- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b7406d350 msgr2=0x7f1b7415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b73fff700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b7406d350 0x7f1b7415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b73fff700 1 -- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b740ada60 msgr2=0x7f1b7415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b73fff700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b740ada60 0x7f1b7415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b73fff700 1 -- 172.21.15.55:0/459996051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0094f0 con 0x7f1b740696e0 2023-10-06T11:13:26.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b78f68700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b740ada60 0x7f1b7415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b73fff700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 0x7f1b740c56a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c006fd0 tx=0x7f1b5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00bbe0 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c011420 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b740bfc50 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0117e0 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.333+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b740c0210 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.334+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b740c0400 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.334+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b5c011bd0 con 0x7f1b740696e0 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.335+0000 7f1b6bfff700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b54066f30 0x7f1b540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.335+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1b5c086220 con 0x7f1b740696e0 2023-10-06T11:13:26.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.335+0000 7f1b737fe700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b54066f30 0x7f1b540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.335+0000 7f1b737fe700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b54066f30 0x7f1b540693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b740c30a0 tx=0x7f1b64007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.339+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b5c053040 con 0x7f1b740696e0 2023-10-06T11:13:26.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.576+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b74064a90 con 0x7f1b740696e0 2023-10-06T11:13:26.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.577+0000 7f1b6bfff700 1 -- 172.21.15.55:0/459996051 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f1b5c056660 con 0x7f1b740696e0 2023-10-06T11:13:26.579 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:26.579 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b54066f30 msgr2=0x7f1b540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b54066f30 0x7f1b540693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b740c30a0 tx=0x7f1b64007ec0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 msgr2=0x7f1b740c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 0x7f1b740c56a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c006fd0 tx=0x7f1b5c017000 comp rx=0 tx=0).stop 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 shutdown_connections 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b54066f30 0x7f1b540693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b740696e0 0x7f1b740c56a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b740ada60 0x7f1b7415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 --2- 172.21.15.55:0/459996051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b7406d350 0x7f1b7415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 >> 172.21.15.55:0/459996051 conn(0x7f1b74068080 msgr2=0x7f1b74159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 shutdown_connections 2023-10-06T11:13:26.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.579+0000 7f1b7a9cb700 1 -- 172.21.15.55:0/459996051 wait complete. 2023-10-06T11:13:26.582 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:26.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.710+0000 7f51a4814700 1 Processor -- start 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.710+0000 7f51a4814700 1 -- start start 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f51a4814700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f51a0170f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f51a4814700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a00ca4a0 con 0x7f51a00879d0 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f51a4814700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a00ca780 con 0x7f51a0165e60 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f51a4814700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00caa60 con 0x7f51a00c6c80 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f519effd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51a00879d0 0x7f51a00c6570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53550/0 (socket says 172.21.15.55:53550) 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f519effd700 1 -- 172.21.15.55:0/3698198455 learned_addr learned my addr 172.21.15.55:0/3698198455 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:26.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f519ffff700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f51a0170f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.711+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548016654 0 0) 0x7f51a00ca4a0 con 0x7f51a00879d0 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5188003570 con 0x7f51a00879d0 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637834858 0 0) 0x7f51a00ca780 con 0x7f51a0165e60 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a00ca4a0 con 0x7f51a0165e60 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827787712 0 0) 0x7f5188003570 con 0x7f51a00879d0 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 msgr2=0x7f51a0170f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f51a0170f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 >> v1:172.21.15.142:6789/0 conn(0x7f51a0165e60 legacy=0x7f51a00872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00cad40 con 0x7f51a00879d0 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f5194001470 con 0x7f51a00879d0 2023-10-06T11:13:26.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519ffff700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f51a0170f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 >> v1:172.21.15.55:6789/0 conn(0x7f51a00879d0 legacy=0x7f51a00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5188008290 0x7f518800a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f518800ad00 0x7f518800d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f518800f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00caa60 con 0x7f5188008290 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518800ff60 con 0x7f518800ad00 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.773+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5188010120 con 0x7f51a00c6c80 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5188008290 0x7f518800a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519effd700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f518800ad00 0x7f518800d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519ffff700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f518800f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 -- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 msgr2=0x7f518800f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c6c80 0x7f518800f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 -- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f518800ad00 msgr2=0x7f518800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f518800ad00 0x7f518800d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 -- 172.21.15.55:0/3698198455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198009a20 con 0x7f5188008290 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519f7fe700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5188008290 0x7f518800a690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5190001a10 tx=0x7f5190007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb9dcc01db2cfea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000c5d0 con 0x7f5188008290 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000c730 con 0x7f5188008290 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.774+0000 7f519e7fc700 1 -- 172.21.15.55:0/3698198455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000cad0 con 0x7f5188008290 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f51a4814700 1 -- 172.21.15.55:0/3698198455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5188008290 msgr2=0x7f518800a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f51a4814700 1 --2- 172.21.15.55:0/3698198455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5188008290 0x7f518800a690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5190001a10 tx=0x7f5190007d30 comp rx=0 tx=0).stop 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f519ffff700 1 -- 172.21.15.55:0/3698198455 reap_dead start 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f51a4814700 1 -- 172.21.15.55:0/3698198455 shutdown_connections 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f51a4814700 1 -- 172.21.15.55:0/3698198455 >> 172.21.15.55:0/3698198455 conn(0x7f51a0068080 msgr2=0x7f51a00cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f51a4814700 1 -- 172.21.15.55:0/3698198455 shutdown_connections 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.775+0000 7f51a4814700 1 -- 172.21.15.55:0/3698198455 wait complete. 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.776+0000 7f51a4814700 1 Processor -- start 2023-10-06T11:13:26.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.776+0000 7f51a4814700 1 -- start start 2023-10-06T11:13:26.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f51a4814700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5188008290 0x7f51a00c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f51a4814700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 0x7f51a0164c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f51a4814700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c2f70 0x7f51a00c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f51a4814700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00c3920 con 0x7f51a00ae000 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f51a4814700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00ab7a0 con 0x7f5188008290 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f51a4814700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00c5180 con 0x7f51a00c2f70 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5188008290 0x7f51a00c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 0x7f51a0164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5188008290 0x7f51a00c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50446/0 (socket says 172.21.15.55:50446) 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519f7fe700 1 -- 172.21.15.55:0/1235653221 learned_addr learned my addr 172.21.15.55:0/1235653221 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:26.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 0x7f51a0164c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37136/0 (socket says 172.21.15.55:37136) 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519ffff700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c2f70 0x7f51a00c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 -- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c2f70 msgr2=0x7f51a00c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c2f70 0x7f51a00c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 -- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5188008290 msgr2=0x7f51a00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5188008290 0x7f51a00c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.777+0000 7f519effd700 1 -- 172.21.15.55:0/1235653221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00c5460 con 0x7f51a00ae000 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.778+0000 7f519effd700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 0x7f51a0164c90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5194004fb0 tx=0x7f5194001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.778+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194011590 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.778+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51940116f0 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.778+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a00aba40 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.778+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194011a90 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.778+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00ae470 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.779+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a00c1e80 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.779+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f519401d460 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.780+0000 7f51877fe700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f518c066f30 0x7f518c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.780+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f51940849f0 con 0x7f51a00ae000 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.780+0000 7f519f7fe700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f518c066f30 0x7f518c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.780+0000 7f519f7fe700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f518c066f30 0x7f518c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5190008fd0 tx=0x7f5190015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.784+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5194051810 con 0x7f51a00ae000 2023-10-06T11:13:26.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.983+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51a005f230 con 0x7f51a00ae000 2023-10-06T11:13:26.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.984+0000 7f51877fe700 1 -- 172.21.15.55:0/1235653221 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f5194054e30 con 0x7f51a00ae000 2023-10-06T11:13:26.986 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:26.986 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:26.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f518c066f30 msgr2=0x7f518c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f518c066f30 0x7f518c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5190008fd0 tx=0x7f5190015000 comp rx=0 tx=0).stop 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 msgr2=0x7f51a0164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 0x7f51a0164c90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5194004fb0 tx=0x7f5194001d20 comp rx=0 tx=0).stop 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 shutdown_connections 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f518c066f30 0x7f518c0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51a00c2f70 0x7f51a00c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5188008290 0x7f51a00c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 --2- 172.21.15.55:0/1235653221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a00ae000 0x7f51a0164c90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.986+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 >> 172.21.15.55:0/1235653221 conn(0x7f51a0068080 msgr2=0x7f51a00c2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.987+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 shutdown_connections 2023-10-06T11:13:26.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:26.987+0000 7f51a4814700 1 -- 172.21.15.55:0/1235653221 wait complete. 2023-10-06T11:13:27.000 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:13:27.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:13:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.119+0000 7feade64a700 1 Processor -- start 2023-10-06T11:13:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.119+0000 7feade64a700 1 -- start start 2023-10-06T11:13:27.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feade64a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fead8159560 0x7fead80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feade64a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fead80b0760 0x7fead80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feade64a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead80b0c60 con 0x7fead80b49a0 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feade64a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead80b0f40 con 0x7fead80b0760 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feade64a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead80b1220 con 0x7fead8159560 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fead80b0760 0x7fead80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fead80b0760 0x7fead80b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37152/0 (socket says 172.21.15.55:37152) 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7fead77fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fead80b49a0 0x7fead80aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53564/0 (socket says 172.21.15.55:53564) 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 -- 172.21.15.55:0/998390811 learned_addr learned my addr 172.21.15.55:0/998390811 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7fead7fff700 1 --2- 172.21.15.55:0/998390811 >> v2:172.21.15.142:3300/0 conn(0x7fead8159560 0x7fead80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 -- 172.21.15.55:0/998390811 >> v2:172.21.15.142:3300/0 conn(0x7fead8159560 msgr2=0x7fead80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 --2- 172.21.15.55:0/998390811 >> v2:172.21.15.142:3300/0 conn(0x7fead8159560 0x7fead80aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 -- 172.21.15.55:0/998390811 >> v1:172.21.15.55:6789/0 conn(0x7fead80b49a0 legacy=0x7fead80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 -- 172.21.15.55:0/998390811 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80b1500 con 0x7fead80b0760 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7fead6ffd700 1 -- 172.21.15.55:0/998390811 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931882501 0 0) 0x7fead80b0c60 con 0x7fead80b49a0 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7feadcbe7700 1 --2- 172.21.15.55:0/998390811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead80b1bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fead0009f20 tx=0x7fead0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ef8c60c4148b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7fead6ffd700 1 -- 172.21.15.55:0/998390811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000e070 con 0x7fead80b0760 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7fead6ffd700 1 -- 172.21.15.55:0/998390811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000b990 con 0x7fead80b0760 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.120+0000 7fead6ffd700 1 -- 172.21.15.55:0/998390811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00092e0 con 0x7fead80b0760 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 -- 172.21.15.55:0/998390811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 msgr2=0x7fead80b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 --2- 172.21.15.55:0/998390811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead80b1bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fead0009f20 tx=0x7fead0009840 comp rx=0 tx=0).stop 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 -- 172.21.15.55:0/998390811 shutdown_connections 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 --2- 172.21.15.55:0/998390811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead80b1bc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 --2- 172.21.15.55:0/998390811 >> v2:172.21.15.142:3300/0 conn(0x7fead8159560 0x7fead80aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 -- 172.21.15.55:0/998390811 >> 172.21.15.55:0/998390811 conn(0x7fead80997f0 msgr2=0x7fead806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 -- 172.21.15.55:0/998390811 shutdown_connections 2023-10-06T11:13:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.121+0000 7feade64a700 1 -- 172.21.15.55:0/998390811 wait complete. 2023-10-06T11:13:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.122+0000 7feade64a700 1 Processor -- start 2023-10-06T11:13:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.122+0000 7feade64a700 1 -- start start 2023-10-06T11:13:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feade64a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead8158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feade64a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80b49a0 0x7fead815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feade64a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8159560 0x7fead809a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feade64a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8169780 con 0x7fead80b0760 2023-10-06T11:13:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feade64a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead815aad0 con 0x7fead8159560 2023-10-06T11:13:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feade64a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead815adb0 con 0x7fead80b49a0 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead8158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead8158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37162/0 (socket says 172.21.15.55:37162) 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 -- 172.21.15.55:0/3579018161 learned_addr learned my addr 172.21.15.55:0/3579018161 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7feadcbe7700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8159560 0x7fead809a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead77fe700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80b49a0 0x7fead815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 -- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80b49a0 msgr2=0x7fead815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80b49a0 0x7fead815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 -- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8159560 msgr2=0x7fead809a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8159560 0x7fead809a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.123+0000 7fead7fff700 1 -- 172.21.15.55:0/3579018161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009ae0 con 0x7fead80b0760 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.124+0000 7fead7fff700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead8158b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feac800ea00 tx=0x7feac8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.124+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800c850 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.124+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800c9b0 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.124+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead815b090 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.124+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800cd30 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.124+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead815cfd0 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.125+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead8169a00 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.125+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feac8013680 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.126+0000 7feabffff700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feac4066f30 0x7feac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.126+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feac8084fa0 con 0x7fead80b0760 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.126+0000 7fead77fe700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feac4066f30 0x7feac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.126+0000 7fead77fe700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feac4066f30 0x7feac40693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fead809dea0 tx=0x7feacc007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.130+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feac8051dc0 con 0x7fead80b0760 2023-10-06T11:13:27.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.319+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fead8064a90 con 0x7feac4066f30 2023-10-06T11:13:27.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.330+0000 7feabffff700 1 -- 172.21.15.55:0/3579018161 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367360 (secure 0 0 0) 0x7fead8064a90 con 0x7feac4066f30 2023-10-06T11:13:27.337 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feac4066f30 msgr2=0x7feac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feac4066f30 0x7feac40693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fead809dea0 tx=0x7feacc007bf0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 msgr2=0x7fead8158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead8158b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feac800ea00 tx=0x7feac8009120 comp rx=0 tx=0).stop 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 shutdown_connections 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feac4066f30 0x7feac40693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fead80b0760 0x7fead8158b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8159560 0x7fead809a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 --2- 172.21.15.55:0/3579018161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80b49a0 0x7fead815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 >> 172.21.15.55:0/3579018161 conn(0x7fead80997f0 msgr2=0x7fead80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 shutdown_connections 2023-10-06T11:13:27.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.334+0000 7feade64a700 1 -- 172.21.15.55:0/3579018161 wait complete. 2023-10-06T11:13:27.341 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:13:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-06T11:13:26.844072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381896,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592824,"statfs":{"total":773094113280,"available":770655051776,"internally_reserved":0,"allocated":3678208,"data_stored":2183560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.706192"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.138211+0000","last_change":"2023-10-06T11:13:13.121699+0000","last_active":"2023-10-06T11:13:17.138211+0000","last_peered":"2023-10-06T11:13:17.138211+0000","last_clean":"2023-10-06T11:13:17.138211+0000","last_became_active":"2023-10-06T11:13:13.121499+0000","last_became_peered":"2023-10-06T11:13:13.121499+0000","last_unstale":"2023-10-06T11:13:17.138211+0000","last_undegraded":"2023-10-06T11:13:17.138211+0000","last_fullsized":"2023-10-06T11:13:17.138211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155514+0000","last_change":"2023-10-06T11:13:13.120623+0000","last_active":"2023-10-06T11:13:17.155514+0000","last_peered":"2023-10-06T11:13:17.155514+0000","last_clean":"2023-10-06T11:13:17.155514+0000","last_became_active":"2023-10-06T11:13:13.120368+0000","last_became_peered":"2023-10-06T11:13:13.120368+0000","last_unstale":"2023-10-06T11:13:17.155514+0000","last_undegraded":"2023-10-06T11:13:17.155514+0000","last_fullsized":"2023-10-06T11:13:17.155514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144860+0000","last_change":"2023-10-06T11:13:13.118595+0000","last_active":"2023-10-06T11:13:17.144860+0000","last_peered":"2023-10-06T11:13:17.144860+0000","last_clean":"2023-10-06T11:13:17.144860+0000","last_became_active":"2023-10-06T11:13:13.118314+0000","last_became_peered":"2023-10-06T11:13:13.118314+0000","last_unstale":"2023-10-06T11:13:17.144860+0000","last_undegraded":"2023-10-06T11:13:17.144860+0000","last_fullsized":"2023-10-06T11:13:17.144860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:56.994826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.139864+0000","last_change":"2023-10-06T11:13:13.118767+0000","last_active":"2023-10-06T11:13:17.139864+0000","last_peered":"2023-10-06T11:13:17.139864+0000","last_clean":"2023-10-06T11:13:17.139864+0000","last_became_active":"2023-10-06T11:13:13.118462+0000","last_became_peered":"2023-10-06T11:13:13.118462+0000","last_unstale":"2023-10-06T11:13:17.139864+0000","last_undegraded":"2023-10-06T11:13:17.139864+0000","last_fullsized":"2023-10-06T11:13:17.139864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142961+0000","last_change":"2023-10-06T11:13:13.121812+0000","last_active":"2023-10-06T11:13:17.142961+0000","last_peered":"2023-10-06T11:13:17.142961+0000","last_clean":"2023-10-06T11:13:17.142961+0000","last_became_active":"2023-10-06T11:13:13.121530+0000","last_became_peered":"2023-10-06T11:13:13.121530+0000","last_unstale":"2023-10-06T11:13:17.142961+0000","last_undegraded":"2023-10-06T11:13:17.142961+0000","last_fullsized":"2023-10-06T11:13:17.142961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144619+0000","last_change":"2023-10-06T11:13:13.127391+0000","last_active":"2023-10-06T11:13:17.144619+0000","last_peered":"2023-10-06T11:13:17.144619+0000","last_clean":"2023-10-06T11:13:17.144619+0000","last_became_active":"2023-10-06T11:13:13.127090+0000","last_became_peered":"2023-10-06T11:13:13.127090+0000","last_unstale":"2023-10-06T11:13:17.144619+0000","last_undegraded":"2023-10-06T11:13:17.144619+0000","last_fullsized":"2023-10-06T11:13:17.144619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:29.195895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149465+0000","last_change":"2023-10-06T11:13:13.134965+0000","last_active":"2023-10-06T11:13:17.149465+0000","last_peered":"2023-10-06T11:13:17.149465+0000","last_clean":"2023-10-06T11:13:17.149465+0000","last_became_active":"2023-10-06T11:13:13.134668+0000","last_became_peered":"2023-10-06T11:13:13.134668+0000","last_unstale":"2023-10-06T11:13:17.149465+0000","last_undegraded":"2023-10-06T11:13:17.149465+0000","last_fullsized":"2023-10-06T11:13:17.149465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150571+0000","last_change":"2023-10-06T11:13:13.114957+0000","last_active":"2023-10-06T11:13:17.150571+0000","last_peered":"2023-10-06T11:13:17.150571+0000","last_clean":"2023-10-06T11:13:17.150571+0000","last_became_active":"2023-10-06T11:13:13.114673+0000","last_became_peered":"2023-10-06T11:13:13.114673+0000","last_unstale":"2023-10-06T11:13:17.150571+0000","last_undegraded":"2023-10-06T11:13:17.150571+0000","last_fullsized":"2023-10-06T11:13:17.150571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145256+0000","last_change":"2023-10-06T11:13:13.121976+0000","last_active":"2023-10-06T11:13:17.145256+0000","last_peered":"2023-10-06T11:13:17.145256+0000","last_clean":"2023-10-06T11:13:17.145256+0000","last_became_active":"2023-10-06T11:13:13.121523+0000","last_became_peered":"2023-10-06T11:13:13.121523+0000","last_unstale":"2023-10-06T11:13:17.145256+0000","last_undegraded":"2023-10-06T11:13:17.145256+0000","last_fullsized":"2023-10-06T11:13:17.145256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155701+0000","last_change":"2023-10-06T11:13:13.126240+0000","last_active":"2023-10-06T11:13:17.155701+0000","last_peered":"2023-10-06T11:13:17.155701+0000","last_clean":"2023-10-06T11:13:17.155701+0000","last_became_active":"2023-10-06T11:13:13.125943+0000","last_became_peered":"2023-10-06T11:13:13.125943+0000","last_unstale":"2023-10-06T11:13:17.155701+0000","last_undegraded":"2023-10-06T11:13:17.155701+0000","last_fullsized":"2023-10-06T11:13:17.155701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145009+0000","last_change":"2023-10-06T11:13:13.127706+0000","last_active":"2023-10-06T11:13:17.145009+0000","last_peered":"2023-10-06T11:13:17.145009+0000","last_clean":"2023-10-06T11:13:17.145009+0000","last_became_active":"2023-10-06T11:13:13.127484+0000","last_became_peered":"2023-10-06T11:13:13.127484+0000","last_unstale":"2023-10-06T11:13:17.145009+0000","last_undegraded":"2023-10-06T11:13:17.145009+0000","last_fullsized":"2023-10-06T11:13:17.145009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:11.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136986+0000","last_change":"2023-10-06T11:13:13.118366+0000","last_active":"2023-10-06T11:13:17.136986+0000","last_peered":"2023-10-06T11:13:17.136986+0000","last_clean":"2023-10-06T11:13:17.136986+0000","last_became_active":"2023-10-06T11:13:13.117530+0000","last_became_peered":"2023-10-06T11:13:13.117530+0000","last_unstale":"2023-10-06T11:13:17.136986+0000","last_undegraded":"2023-10-06T11:13:17.136986+0000","last_fullsized":"2023-10-06T11:13:17.136986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:30.505653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137568+0000","last_change":"2023-10-06T11:13:13.123055+0000","last_active":"2023-10-06T11:13:17.137568+0000","last_peered":"2023-10-06T11:13:17.137568+0000","last_clean":"2023-10-06T11:13:17.137568+0000","last_became_active":"2023-10-06T11:13:13.122747+0000","last_became_peered":"2023-10-06T11:13:13.122747+0000","last_unstale":"2023-10-06T11:13:17.137568+0000","last_undegraded":"2023-10-06T11:13:17.137568+0000","last_fullsized":"2023-10-06T11:13:17.137568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154823+0000","last_change":"2023-10-06T11:13:13.124824+0000","last_active":"2023-10-06T11:13:17.154823+0000","last_peered":"2023-10-06T11:13:17.154823+0000","last_clean":"2023-10-06T11:13:17.154823+0000","last_became_active":"2023-10-06T11:13:13.124503+0000","last_became_peered":"2023-10-06T11:13:13.124503+0000","last_unstale":"2023-10-06T11:13:17.154823+0000","last_undegraded":"2023-10-06T11:13:17.154823+0000","last_fullsized":"2023-10-06T11:13:17.154823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149286+0000","last_change":"2023-10-06T11:13:13.135539+0000","last_active":"2023-10-06T11:13:17.149286+0000","last_peered":"2023-10-06T11:13:17.149286+0000","last_clean":"2023-10-06T11:13:17.149286+0000","last_became_active":"2023-10-06T11:13:13.135269+0000","last_became_peered":"2023-10-06T11:13:13.135269+0000","last_unstale":"2023-10-06T11:13:17.149286+0000","last_undegraded":"2023-10-06T11:13:17.149286+0000","last_fullsized":"2023-10-06T11:13:17.149286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143826+0000","last_change":"2023-10-06T11:13:13.118179+0000","last_active":"2023-10-06T11:13:17.143826+0000","last_peered":"2023-10-06T11:13:17.143826+0000","last_clean":"2023-10-06T11:13:17.143826+0000","last_became_active":"2023-10-06T11:13:13.117933+0000","last_became_peered":"2023-10-06T11:13:13.117933+0000","last_unstale":"2023-10-06T11:13:17.143826+0000","last_undegraded":"2023-10-06T11:13:17.143826+0000","last_fullsized":"2023-10-06T11:13:17.143826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:38.942631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145356+0000","last_change":"2023-10-06T11:13:13.121835+0000","last_active":"2023-10-06T11:13:17.145356+0000","last_peered":"2023-10-06T11:13:17.145356+0000","last_clean":"2023-10-06T11:13:17.145356+0000","last_became_active":"2023-10-06T11:13:13.121140+0000","last_became_peered":"2023-10-06T11:13:13.121140+0000","last_unstale":"2023-10-06T11:13:17.145356+0000","last_undegraded":"2023-10-06T11:13:17.145356+0000","last_fullsized":"2023-10-06T11:13:17.145356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144097+0000","last_change":"2023-10-06T11:13:13.126361+0000","last_active":"2023-10-06T11:13:17.144097+0000","last_peered":"2023-10-06T11:13:17.144097+0000","last_clean":"2023-10-06T11:13:17.144097+0000","last_became_active":"2023-10-06T11:13:13.126088+0000","last_became_peered":"2023-10-06T11:13:13.126088+0000","last_unstale":"2023-10-06T11:13:17.144097+0000","last_undegraded":"2023-10-06T11:13:17.144097+0000","last_fullsized":"2023-10-06T11:13:17.144097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:20.523798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137234+0000","last_change":"2023-10-06T11:13:13.123624+0000","last_active":"2023-10-06T11:13:17.137234+0000","last_peered":"2023-10-06T11:13:17.137234+0000","last_clean":"2023-10-06T11:13:17.137234+0000","last_became_active":"2023-10-06T11:13:13.123377+0000","last_became_peered":"2023-10-06T11:13:13.123377+0000","last_unstale":"2023-10-06T11:13:17.137234+0000","last_undegraded":"2023-10-06T11:13:17.137234+0000","last_fullsized":"2023-10-06T11:13:17.137234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:10.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143778+0000","last_change":"2023-10-06T11:13:13.122220+0000","last_active":"2023-10-06T11:13:17.143778+0000","last_peered":"2023-10-06T11:13:17.143778+0000","last_clean":"2023-10-06T11:13:17.143778+0000","last_became_active":"2023-10-06T11:13:13.121971+0000","last_became_peered":"2023-10-06T11:13:13.121971+0000","last_unstale":"2023-10-06T11:13:17.143778+0000","last_undegraded":"2023-10-06T11:13:17.143778+0000","last_fullsized":"2023-10-06T11:13:17.143778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.288774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148367+0000","last_change":"2023-10-06T11:13:13.130138+0000","last_active":"2023-10-06T11:13:17.148367+0000","last_peered":"2023-10-06T11:13:17.148367+0000","last_clean":"2023-10-06T11:13:17.148367+0000","last_became_active":"2023-10-06T11:13:13.129957+0000","last_became_peered":"2023-10-06T11:13:13.129957+0000","last_unstale":"2023-10-06T11:13:17.148367+0000","last_undegraded":"2023-10-06T11:13:17.148367+0000","last_fullsized":"2023-10-06T11:13:17.148367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142383+0000","last_change":"2023-10-06T11:13:13.131599+0000","last_active":"2023-10-06T11:13:17.142383+0000","last_peered":"2023-10-06T11:13:17.142383+0000","last_clean":"2023-10-06T11:13:17.142383+0000","last_became_active":"2023-10-06T11:13:13.131351+0000","last_became_peered":"2023-10-06T11:13:13.131351+0000","last_unstale":"2023-10-06T11:13:17.142383+0000","last_undegraded":"2023-10-06T11:13:17.142383+0000","last_fullsized":"2023-10-06T11:13:17.142383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143350+0000","last_change":"2023-10-06T11:13:13.120698+0000","last_active":"2023-10-06T11:13:17.143350+0000","last_peered":"2023-10-06T11:13:17.143350+0000","last_clean":"2023-10-06T11:13:17.143350+0000","last_became_active":"2023-10-06T11:13:13.120409+0000","last_became_peered":"2023-10-06T11:13:13.120409+0000","last_unstale":"2023-10-06T11:13:17.143350+0000","last_undegraded":"2023-10-06T11:13:17.143350+0000","last_fullsized":"2023-10-06T11:13:17.143350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147544+0000","last_change":"2023-10-06T11:13:13.125155+0000","last_active":"2023-10-06T11:13:17.147544+0000","last_peered":"2023-10-06T11:13:17.147544+0000","last_clean":"2023-10-06T11:13:17.147544+0000","last_became_active":"2023-10-06T11:13:13.124909+0000","last_became_peered":"2023-10-06T11:13:13.124909+0000","last_unstale":"2023-10-06T11:13:17.147544+0000","last_undegraded":"2023-10-06T11:13:17.147544+0000","last_fullsized":"2023-10-06T11:13:17.147544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151721+0000","last_change":"2023-10-06T11:13:13.126695+0000","last_active":"2023-10-06T11:13:17.151721+0000","last_peered":"2023-10-06T11:13:17.151721+0000","last_clean":"2023-10-06T11:13:17.151721+0000","last_became_active":"2023-10-06T11:13:13.126107+0000","last_became_peered":"2023-10-06T11:13:13.126107+0000","last_unstale":"2023-10-06T11:13:17.151721+0000","last_undegraded":"2023-10-06T11:13:17.151721+0000","last_fullsized":"2023-10-06T11:13:17.151721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152340+0000","last_change":"2023-10-06T11:13:13.127518+0000","last_active":"2023-10-06T11:13:17.152340+0000","last_peered":"2023-10-06T11:13:17.152340+0000","last_clean":"2023-10-06T11:13:17.152340+0000","last_became_active":"2023-10-06T11:13:13.127277+0000","last_became_peered":"2023-10-06T11:13:13.127277+0000","last_unstale":"2023-10-06T11:13:17.152340+0000","last_undegraded":"2023-10-06T11:13:17.152340+0000","last_fullsized":"2023-10-06T11:13:17.152340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:45.902476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152956+0000","last_change":"2023-10-06T11:13:13.122605+0000","last_active":"2023-10-06T11:13:17.152956+0000","last_peered":"2023-10-06T11:13:17.152956+0000","last_clean":"2023-10-06T11:13:17.152956+0000","last_became_active":"2023-10-06T11:13:13.122169+0000","last_became_peered":"2023-10-06T11:13:13.122169+0000","last_unstale":"2023-10-06T11:13:17.152956+0000","last_undegraded":"2023-10-06T11:13:17.152956+0000","last_fullsized":"2023-10-06T11:13:17.152956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160038+0000","last_change":"2023-10-06T11:13:17.156729+0000","last_active":"2023-10-06T11:13:17.160038+0000","last_peered":"2023-10-06T11:13:17.160038+0000","last_clean":"2023-10-06T11:13:17.160038+0000","last_became_active":"2023-10-06T11:13:17.156340+0000","last_became_peered":"2023-10-06T11:13:17.156340+0000","last_unstale":"2023-10-06T11:13:17.160038+0000","last_undegraded":"2023-10-06T11:13:17.160038+0000","last_fullsized":"2023-10-06T11:13:17.160038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:32.463267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144410+0000","last_change":"2023-10-06T11:13:12.110036+0000","last_active":"2023-10-06T11:13:17.144410+0000","last_peered":"2023-10-06T11:13:17.144410+0000","last_clean":"2023-10-06T11:13:17.144410+0000","last_became_active":"2023-10-06T11:13:12.109584+0000","last_became_peered":"2023-10-06T11:13:12.109584+0000","last_unstale":"2023-10-06T11:13:17.144410+0000","last_undegraded":"2023-10-06T11:13:17.144410+0000","last_fullsized":"2023-10-06T11:13:17.144410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144471+0000","last_change":"2023-10-06T11:13:13.128382+0000","last_active":"2023-10-06T11:13:17.144471+0000","last_peered":"2023-10-06T11:13:17.144471+0000","last_clean":"2023-10-06T11:13:17.144471+0000","last_became_active":"2023-10-06T11:13:13.128089+0000","last_became_peered":"2023-10-06T11:13:13.128089+0000","last_unstale":"2023-10-06T11:13:17.144471+0000","last_undegraded":"2023-10-06T11:13:17.144471+0000","last_fullsized":"2023-10-06T11:13:17.144471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162772+0000","last_change":"2023-10-06T11:13:17.157622+0000","last_active":"2023-10-06T11:13:17.162772+0000","last_peered":"2023-10-06T11:13:17.162772+0000","last_clean":"2023-10-06T11:13:17.162772+0000","last_became_active":"2023-10-06T11:13:17.157240+0000","last_became_peered":"2023-10-06T11:13:17.157240+0000","last_unstale":"2023-10-06T11:13:17.162772+0000","last_undegraded":"2023-10-06T11:13:17.162772+0000","last_fullsized":"2023-10-06T11:13:17.162772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:08.312759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151403+0000","last_change":"2023-10-06T11:13:12.115710+0000","last_active":"2023-10-06T11:13:17.151403+0000","last_peered":"2023-10-06T11:13:17.151403+0000","last_clean":"2023-10-06T11:13:17.151403+0000","last_became_active":"2023-10-06T11:13:12.115446+0000","last_became_peered":"2023-10-06T11:13:12.115446+0000","last_unstale":"2023-10-06T11:13:17.151403+0000","last_undegraded":"2023-10-06T11:13:17.151403+0000","last_fullsized":"2023-10-06T11:13:17.151403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142885+0000","last_change":"2023-10-06T11:13:13.125846+0000","last_active":"2023-10-06T11:13:17.142885+0000","last_peered":"2023-10-06T11:13:17.142885+0000","last_clean":"2023-10-06T11:13:17.142885+0000","last_became_active":"2023-10-06T11:13:13.125581+0000","last_became_peered":"2023-10-06T11:13:13.125581+0000","last_unstale":"2023-10-06T11:13:17.142885+0000","last_undegraded":"2023-10-06T11:13:17.142885+0000","last_fullsized":"2023-10-06T11:13:17.142885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162796+0000","last_change":"2023-10-06T11:13:17.156222+0000","last_active":"2023-10-06T11:13:17.162796+0000","last_peered":"2023-10-06T11:13:17.162796+0000","last_clean":"2023-10-06T11:13:17.162796+0000","last_became_active":"2023-10-06T11:13:17.155785+0000","last_became_peered":"2023-10-06T11:13:17.155785+0000","last_unstale":"2023-10-06T11:13:17.162796+0000","last_undegraded":"2023-10-06T11:13:17.162796+0000","last_fullsized":"2023-10-06T11:13:17.162796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144138+0000","last_change":"2023-10-06T11:13:12.104094+0000","last_active":"2023-10-06T11:13:17.144138+0000","last_peered":"2023-10-06T11:13:17.144138+0000","last_clean":"2023-10-06T11:13:17.144138+0000","last_became_active":"2023-10-06T11:13:12.103658+0000","last_became_peered":"2023-10-06T11:13:12.103658+0000","last_unstale":"2023-10-06T11:13:17.144138+0000","last_undegraded":"2023-10-06T11:13:17.144138+0000","last_fullsized":"2023-10-06T11:13:17.144138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144641+0000","last_change":"2023-10-06T11:13:13.122756+0000","last_active":"2023-10-06T11:13:17.144641+0000","last_peered":"2023-10-06T11:13:17.144641+0000","last_clean":"2023-10-06T11:13:17.144641+0000","last_became_active":"2023-10-06T11:13:13.122498+0000","last_became_peered":"2023-10-06T11:13:13.122498+0000","last_unstale":"2023-10-06T11:13:17.144641+0000","last_undegraded":"2023-10-06T11:13:17.144641+0000","last_fullsized":"2023-10-06T11:13:17.144641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:30.671094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160480+0000","last_change":"2023-10-06T11:13:17.156830+0000","last_active":"2023-10-06T11:13:17.160480+0000","last_peered":"2023-10-06T11:13:17.160480+0000","last_clean":"2023-10-06T11:13:17.160480+0000","last_became_active":"2023-10-06T11:13:17.156440+0000","last_became_peered":"2023-10-06T11:13:17.156440+0000","last_unstale":"2023-10-06T11:13:17.160480+0000","last_undegraded":"2023-10-06T11:13:17.160480+0000","last_fullsized":"2023-10-06T11:13:17.160480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:15.214081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145470+0000","last_change":"2023-10-06T11:13:12.107048+0000","last_active":"2023-10-06T11:13:17.145470+0000","last_peered":"2023-10-06T11:13:17.145470+0000","last_clean":"2023-10-06T11:13:17.145470+0000","last_became_active":"2023-10-06T11:13:12.103664+0000","last_became_peered":"2023-10-06T11:13:12.103664+0000","last_unstale":"2023-10-06T11:13:17.145470+0000","last_undegraded":"2023-10-06T11:13:17.145470+0000","last_fullsized":"2023-10-06T11:13:17.145470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144060+0000","last_change":"2023-10-06T11:13:13.134983+0000","last_active":"2023-10-06T11:13:17.144060+0000","last_peered":"2023-10-06T11:13:17.144060+0000","last_clean":"2023-10-06T11:13:17.144060+0000","last_became_active":"2023-10-06T11:13:13.134636+0000","last_became_peered":"2023-10-06T11:13:13.134636+0000","last_unstale":"2023-10-06T11:13:17.144060+0000","last_undegraded":"2023-10-06T11:13:17.144060+0000","last_fullsized":"2023-10-06T11:13:17.144060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161534+0000","last_change":"2023-10-06T11:13:17.158372+0000","last_active":"2023-10-06T11:13:17.161534+0000","last_peered":"2023-10-06T11:13:17.161534+0000","last_clean":"2023-10-06T11:13:17.161534+0000","last_became_active":"2023-10-06T11:13:17.157994+0000","last_became_peered":"2023-10-06T11:13:17.157994+0000","last_unstale":"2023-10-06T11:13:17.161534+0000","last_undegraded":"2023-10-06T11:13:17.161534+0000","last_fullsized":"2023-10-06T11:13:17.161534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:12.841649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155603+0000","last_change":"2023-10-06T11:13:12.112958+0000","last_active":"2023-10-06T11:13:17.155603+0000","last_peered":"2023-10-06T11:13:17.155603+0000","last_clean":"2023-10-06T11:13:17.155603+0000","last_became_active":"2023-10-06T11:13:12.112670+0000","last_became_peered":"2023-10-06T11:13:12.112670+0000","last_unstale":"2023-10-06T11:13:17.155603+0000","last_undegraded":"2023-10-06T11:13:17.155603+0000","last_fullsized":"2023-10-06T11:13:17.155603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:44.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143449+0000","last_change":"2023-10-06T11:13:13.126318+0000","last_active":"2023-10-06T11:13:17.143449+0000","last_peered":"2023-10-06T11:13:17.143449+0000","last_clean":"2023-10-06T11:13:17.143449+0000","last_became_active":"2023-10-06T11:13:13.126070+0000","last_became_peered":"2023-10-06T11:13:13.126070+0000","last_unstale":"2023-10-06T11:13:17.143449+0000","last_undegraded":"2023-10-06T11:13:17.143449+0000","last_fullsized":"2023-10-06T11:13:17.143449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166081+0000","last_change":"2023-10-06T11:13:17.162541+0000","last_active":"2023-10-06T11:13:17.166081+0000","last_peered":"2023-10-06T11:13:17.166081+0000","last_clean":"2023-10-06T11:13:17.166081+0000","last_became_active":"2023-10-06T11:13:17.162167+0000","last_became_peered":"2023-10-06T11:13:17.162167+0000","last_unstale":"2023-10-06T11:13:17.166081+0000","last_undegraded":"2023-10-06T11:13:17.166081+0000","last_fullsized":"2023-10-06T11:13:17.166081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148499+0000","last_change":"2023-10-06T11:13:12.115343+0000","last_active":"2023-10-06T11:13:17.148499+0000","last_peered":"2023-10-06T11:13:17.148499+0000","last_clean":"2023-10-06T11:13:17.148499+0000","last_became_active":"2023-10-06T11:13:12.115140+0000","last_became_peered":"2023-10-06T11:13:12.115140+0000","last_unstale":"2023-10-06T11:13:17.148499+0000","last_undegraded":"2023-10-06T11:13:17.148499+0000","last_fullsized":"2023-10-06T11:13:17.148499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:45:40.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150826+0000","last_change":"2023-10-06T11:13:13.130679+0000","last_active":"2023-10-06T11:13:17.150826+0000","last_peered":"2023-10-06T11:13:17.150826+0000","last_clean":"2023-10-06T11:13:17.150826+0000","last_became_active":"2023-10-06T11:13:13.130159+0000","last_became_peered":"2023-10-06T11:13:13.130159+0000","last_unstale":"2023-10-06T11:13:17.150826+0000","last_undegraded":"2023-10-06T11:13:17.150826+0000","last_fullsized":"2023-10-06T11:13:17.150826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170593+0000","last_change":"2023-10-06T11:13:17.164392+0000","last_active":"2023-10-06T11:13:17.170593+0000","last_peered":"2023-10-06T11:13:17.170593+0000","last_clean":"2023-10-06T11:13:17.170593+0000","last_became_active":"2023-10-06T11:13:17.164000+0000","last_became_peered":"2023-10-06T11:13:17.164000+0000","last_unstale":"2023-10-06T11:13:17.170593+0000","last_undegraded":"2023-10-06T11:13:17.170593+0000","last_fullsized":"2023-10-06T11:13:17.170593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:54.257356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:13:23.026636+0000","last_change":"2023-10-06T11:13:12.108372+0000","last_active":"2023-10-06T11:13:23.026636+0000","last_peered":"2023-10-06T11:13:23.026636+0000","last_clean":"2023-10-06T11:13:23.026636+0000","last_became_active":"2023-10-06T11:13:12.108083+0000","last_became_peered":"2023-10-06T11:13:12.108083+0000","last_unstale":"2023-10-06T11:13:23.026636+0000","last_undegraded":"2023-10-06T11:13:23.026636+0000","last_fullsized":"2023-10-06T11:13:23.026636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143470+0000","last_change":"2023-10-06T11:13:13.125601+0000","last_active":"2023-10-06T11:13:17.143470+0000","last_peered":"2023-10-06T11:13:17.143470+0000","last_clean":"2023-10-06T11:13:17.143470+0000","last_became_active":"2023-10-06T11:13:13.125279+0000","last_became_peered":"2023-10-06T11:13:13.125279+0000","last_unstale":"2023-10-06T11:13:17.143470+0000","last_undegraded":"2023-10-06T11:13:17.143470+0000","last_fullsized":"2023-10-06T11:13:17.143470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168209+0000","last_change":"2023-10-06T11:13:17.164677+0000","last_active":"2023-10-06T11:13:17.168209+0000","last_peered":"2023-10-06T11:13:17.168209+0000","last_clean":"2023-10-06T11:13:17.168209+0000","last_became_active":"2023-10-06T11:13:17.163312+0000","last_became_peered":"2023-10-06T11:13:17.163312+0000","last_unstale":"2023-10-06T11:13:17.168209+0000","last_undegraded":"2023-10-06T11:13:17.168209+0000","last_fullsized":"2023-10-06T11:13:17.168209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.042784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148271+0000","last_change":"2023-10-06T11:13:12.113019+0000","last_active":"2023-10-06T11:13:17.148271+0000","last_peered":"2023-10-06T11:13:17.148271+0000","last_clean":"2023-10-06T11:13:17.148271+0000","last_became_active":"2023-10-06T11:13:12.112717+0000","last_became_peered":"2023-10-06T11:13:12.112717+0000","last_unstale":"2023-10-06T11:13:17.148271+0000","last_undegraded":"2023-10-06T11:13:17.148271+0000","last_fullsized":"2023-10-06T11:13:17.148271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144893+0000","last_change":"2023-10-06T11:13:13.128297+0000","last_active":"2023-10-06T11:13:17.144893+0000","last_peered":"2023-10-06T11:13:17.144893+0000","last_clean":"2023-10-06T11:13:17.144893+0000","last_became_active":"2023-10-06T11:13:13.128026+0000","last_became_peered":"2023-10-06T11:13:13.128026+0000","last_unstale":"2023-10-06T11:13:17.144893+0000","last_undegraded":"2023-10-06T11:13:17.144893+0000","last_fullsized":"2023-10-06T11:13:17.144893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162240+0000","last_change":"2023-10-06T11:13:17.160008+0000","last_active":"2023-10-06T11:13:17.162240+0000","last_peered":"2023-10-06T11:13:17.162240+0000","last_clean":"2023-10-06T11:13:17.162240+0000","last_became_active":"2023-10-06T11:13:17.159069+0000","last_became_peered":"2023-10-06T11:13:17.159069+0000","last_unstale":"2023-10-06T11:13:17.162240+0000","last_undegraded":"2023-10-06T11:13:17.162240+0000","last_fullsized":"2023-10-06T11:13:17.162240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142294+0000","last_change":"2023-10-06T11:13:12.113312+0000","last_active":"2023-10-06T11:13:17.142294+0000","last_peered":"2023-10-06T11:13:17.142294+0000","last_clean":"2023-10-06T11:13:17.142294+0000","last_became_active":"2023-10-06T11:13:12.112955+0000","last_became_peered":"2023-10-06T11:13:12.112955+0000","last_unstale":"2023-10-06T11:13:17.142294+0000","last_undegraded":"2023-10-06T11:13:17.142294+0000","last_fullsized":"2023-10-06T11:13:17.142294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152870+0000","last_change":"2023-10-06T11:13:13.122429+0000","last_active":"2023-10-06T11:13:17.152870+0000","last_peered":"2023-10-06T11:13:17.152870+0000","last_clean":"2023-10-06T11:13:17.152870+0000","last_became_active":"2023-10-06T11:13:13.121817+0000","last_became_peered":"2023-10-06T11:13:13.121817+0000","last_unstale":"2023-10-06T11:13:17.152870+0000","last_undegraded":"2023-10-06T11:13:17.152870+0000","last_fullsized":"2023-10-06T11:13:17.152870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158460+0000","last_change":"2023-10-06T11:13:17.154826+0000","last_active":"2023-10-06T11:13:17.158460+0000","last_peered":"2023-10-06T11:13:17.158460+0000","last_clean":"2023-10-06T11:13:17.158460+0000","last_became_active":"2023-10-06T11:13:17.154408+0000","last_became_peered":"2023-10-06T11:13:17.154408+0000","last_unstale":"2023-10-06T11:13:17.158460+0000","last_undegraded":"2023-10-06T11:13:17.158460+0000","last_fullsized":"2023-10-06T11:13:17.158460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149376+0000","last_change":"2023-10-06T11:13:12.112186+0000","last_active":"2023-10-06T11:13:17.149376+0000","last_peered":"2023-10-06T11:13:17.149376+0000","last_clean":"2023-10-06T11:13:17.149376+0000","last_became_active":"2023-10-06T11:13:12.111804+0000","last_became_peered":"2023-10-06T11:13:12.111804+0000","last_unstale":"2023-10-06T11:13:17.149376+0000","last_undegraded":"2023-10-06T11:13:17.149376+0000","last_fullsized":"2023-10-06T11:13:17.149376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142984+0000","last_change":"2023-10-06T11:13:13.127356+0000","last_active":"2023-10-06T11:13:17.142984+0000","last_peered":"2023-10-06T11:13:17.142984+0000","last_clean":"2023-10-06T11:13:17.142984+0000","last_became_active":"2023-10-06T11:13:13.127081+0000","last_became_peered":"2023-10-06T11:13:13.127081+0000","last_unstale":"2023-10-06T11:13:17.142984+0000","last_undegraded":"2023-10-06T11:13:17.142984+0000","last_fullsized":"2023-10-06T11:13:17.142984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168186+0000","last_change":"2023-10-06T11:13:17.164977+0000","last_active":"2023-10-06T11:13:17.168186+0000","last_peered":"2023-10-06T11:13:17.168186+0000","last_clean":"2023-10-06T11:13:17.168186+0000","last_became_active":"2023-10-06T11:13:17.162985+0000","last_became_peered":"2023-10-06T11:13:17.162985+0000","last_unstale":"2023-10-06T11:13:17.168186+0000","last_undegraded":"2023-10-06T11:13:17.168186+0000","last_fullsized":"2023-10-06T11:13:17.168186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140804+0000","last_change":"2023-10-06T11:13:12.104093+0000","last_active":"2023-10-06T11:13:17.140804+0000","last_peered":"2023-10-06T11:13:17.140804+0000","last_clean":"2023-10-06T11:13:17.140804+0000","last_became_active":"2023-10-06T11:13:12.103822+0000","last_became_peered":"2023-10-06T11:13:12.103822+0000","last_unstale":"2023-10-06T11:13:17.140804+0000","last_undegraded":"2023-10-06T11:13:17.140804+0000","last_fullsized":"2023-10-06T11:13:17.140804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144546+0000","last_change":"2023-10-06T11:13:13.125356+0000","last_active":"2023-10-06T11:13:17.144546+0000","last_peered":"2023-10-06T11:13:17.144546+0000","last_clean":"2023-10-06T11:13:17.144546+0000","last_became_active":"2023-10-06T11:13:13.125067+0000","last_became_peered":"2023-10-06T11:13:13.125067+0000","last_unstale":"2023-10-06T11:13:17.144546+0000","last_undegraded":"2023-10-06T11:13:17.144546+0000","last_fullsized":"2023-10-06T11:13:17.144546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169071+0000","last_change":"2023-10-06T11:13:17.167108+0000","last_active":"2023-10-06T11:13:17.169071+0000","last_peered":"2023-10-06T11:13:17.169071+0000","last_clean":"2023-10-06T11:13:17.169071+0000","last_became_active":"2023-10-06T11:13:17.166687+0000","last_became_peered":"2023-10-06T11:13:17.166687+0000","last_unstale":"2023-10-06T11:13:17.169071+0000","last_undegraded":"2023-10-06T11:13:17.169071+0000","last_fullsized":"2023-10-06T11:13:17.169071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149299+0000","last_change":"2023-10-06T11:13:12.111301+0000","last_active":"2023-10-06T11:13:17.149299+0000","last_peered":"2023-10-06T11:13:17.149299+0000","last_clean":"2023-10-06T11:13:17.149299+0000","last_became_active":"2023-10-06T11:13:12.111017+0000","last_became_peered":"2023-10-06T11:13:12.111017+0000","last_unstale":"2023-10-06T11:13:17.149299+0000","last_undegraded":"2023-10-06T11:13:17.149299+0000","last_fullsized":"2023-10-06T11:13:17.149299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150481+0000","last_change":"2023-10-06T11:13:13.122154+0000","last_active":"2023-10-06T11:13:17.150481+0000","last_peered":"2023-10-06T11:13:17.150481+0000","last_clean":"2023-10-06T11:13:17.150481+0000","last_became_active":"2023-10-06T11:13:13.121877+0000","last_became_peered":"2023-10-06T11:13:13.121877+0000","last_unstale":"2023-10-06T11:13:17.150481+0000","last_undegraded":"2023-10-06T11:13:17.150481+0000","last_fullsized":"2023-10-06T11:13:17.150481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170404+0000","last_change":"2023-10-06T11:13:17.157370+0000","last_active":"2023-10-06T11:13:17.170404+0000","last_peered":"2023-10-06T11:13:17.170404+0000","last_clean":"2023-10-06T11:13:17.170404+0000","last_became_active":"2023-10-06T11:13:17.156962+0000","last_became_peered":"2023-10-06T11:13:17.156962+0000","last_unstale":"2023-10-06T11:13:17.170404+0000","last_undegraded":"2023-10-06T11:13:17.170404+0000","last_fullsized":"2023-10-06T11:13:17.170404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:24.566268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148959+0000","last_change":"2023-10-06T11:13:12.113489+0000","last_active":"2023-10-06T11:13:17.148959+0000","last_peered":"2023-10-06T11:13:17.148959+0000","last_clean":"2023-10-06T11:13:17.148959+0000","last_became_active":"2023-10-06T11:13:12.113057+0000","last_became_peered":"2023-10-06T11:13:12.113057+0000","last_unstale":"2023-10-06T11:13:17.148959+0000","last_undegraded":"2023-10-06T11:13:17.148959+0000","last_fullsized":"2023-10-06T11:13:17.148959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142803+0000","last_change":"2023-10-06T11:13:13.120468+0000","last_active":"2023-10-06T11:13:17.142803+0000","last_peered":"2023-10-06T11:13:17.142803+0000","last_clean":"2023-10-06T11:13:17.142803+0000","last_became_active":"2023-10-06T11:13:13.120185+0000","last_became_peered":"2023-10-06T11:13:13.120185+0000","last_unstale":"2023-10-06T11:13:17.142803+0000","last_undegraded":"2023-10-06T11:13:17.142803+0000","last_fullsized":"2023-10-06T11:13:17.142803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:50.214886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171097+0000","last_change":"2023-10-06T11:13:17.164354+0000","last_active":"2023-10-06T11:13:17.171097+0000","last_peered":"2023-10-06T11:13:17.171097+0000","last_clean":"2023-10-06T11:13:17.171097+0000","last_became_active":"2023-10-06T11:13:17.163963+0000","last_became_peered":"2023-10-06T11:13:17.163963+0000","last_unstale":"2023-10-06T11:13:17.171097+0000","last_undegraded":"2023-10-06T11:13:17.171097+0000","last_fullsized":"2023-10-06T11:13:17.171097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.560835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148674+0000","last_change":"2023-10-06T11:13:12.106817+0000","last_active":"2023-10-06T11:13:17.148674+0000","last_peered":"2023-10-06T11:13:17.148674+0000","last_clean":"2023-10-06T11:13:17.148674+0000","last_became_active":"2023-10-06T11:13:12.106511+0000","last_became_peered":"2023-10-06T11:13:12.106511+0000","last_unstale":"2023-10-06T11:13:17.148674+0000","last_undegraded":"2023-10-06T11:13:17.148674+0000","last_fullsized":"2023-10-06T11:13:17.148674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:43.294693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142595+0000","last_change":"2023-10-06T11:13:13.131680+0000","last_active":"2023-10-06T11:13:17.142595+0000","last_peered":"2023-10-06T11:13:17.142595+0000","last_clean":"2023-10-06T11:13:17.142595+0000","last_became_active":"2023-10-06T11:13:13.131450+0000","last_became_peered":"2023-10-06T11:13:13.131450+0000","last_unstale":"2023-10-06T11:13:17.142595+0000","last_undegraded":"2023-10-06T11:13:17.142595+0000","last_fullsized":"2023-10-06T11:13:17.142595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:57.893509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170226+0000","last_change":"2023-10-06T11:13:17.157797+0000","last_active":"2023-10-06T11:13:17.170226+0000","last_peered":"2023-10-06T11:13:17.170226+0000","last_clean":"2023-10-06T11:13:17.170226+0000","last_became_active":"2023-10-06T11:13:17.156392+0000","last_became_peered":"2023-10-06T11:13:17.156392+0000","last_unstale":"2023-10-06T11:13:17.170226+0000","last_undegraded":"2023-10-06T11:13:17.170226+0000","last_fullsized":"2023-10-06T11:13:17.170226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:34.331244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149920+0000","last_change":"2023-10-06T11:13:12.101059+0000","last_active":"2023-10-06T11:13:17.149920+0000","last_peered":"2023-10-06T11:13:17.149920+0000","last_clean":"2023-10-06T11:13:17.149920+0000","last_became_active":"2023-10-06T11:13:12.100794+0000","last_became_peered":"2023-10-06T11:13:12.100794+0000","last_unstale":"2023-10-06T11:13:17.149920+0000","last_undegraded":"2023-10-06T11:13:17.149920+0000","last_fullsized":"2023-10-06T11:13:17.149920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143540+0000","last_change":"2023-10-06T11:13:13.131631+0000","last_active":"2023-10-06T11:13:17.143540+0000","last_peered":"2023-10-06T11:13:17.143540+0000","last_clean":"2023-10-06T11:13:17.143540+0000","last_became_active":"2023-10-06T11:13:13.131335+0000","last_became_peered":"2023-10-06T11:13:13.131335+0000","last_unstale":"2023-10-06T11:13:17.143540+0000","last_undegraded":"2023-10-06T11:13:17.143540+0000","last_fullsized":"2023-10-06T11:13:17.143540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170967+0000","last_change":"2023-10-06T11:13:17.161179+0000","last_active":"2023-10-06T11:13:17.170967+0000","last_peered":"2023-10-06T11:13:17.170967+0000","last_clean":"2023-10-06T11:13:17.170967+0000","last_became_active":"2023-10-06T11:13:17.160718+0000","last_became_peered":"2023-10-06T11:13:17.160718+0000","last_unstale":"2023-10-06T11:13:17.170967+0000","last_undegraded":"2023-10-06T11:13:17.170967+0000","last_fullsized":"2023-10-06T11:13:17.170967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.264892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143812+0000","last_change":"2023-10-06T11:13:12.112814+0000","last_active":"2023-10-06T11:13:17.143812+0000","last_peered":"2023-10-06T11:13:17.143812+0000","last_clean":"2023-10-06T11:13:17.143812+0000","last_became_active":"2023-10-06T11:13:12.112493+0000","last_became_peered":"2023-10-06T11:13:12.112493+0000","last_unstale":"2023-10-06T11:13:17.143812+0000","last_undegraded":"2023-10-06T11:13:17.143812+0000","last_fullsized":"2023-10-06T11:13:17.143812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143590+0000","last_change":"2023-10-06T11:13:13.116701+0000","last_active":"2023-10-06T11:13:17.143590+0000","last_peered":"2023-10-06T11:13:17.143590+0000","last_clean":"2023-10-06T11:13:17.143590+0000","last_became_active":"2023-10-06T11:13:13.116422+0000","last_became_peered":"2023-10-06T11:13:13.116422+0000","last_unstale":"2023-10-06T11:13:17.143590+0000","last_undegraded":"2023-10-06T11:13:17.143590+0000","last_fullsized":"2023-10-06T11:13:17.143590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170427+0000","last_change":"2023-10-06T11:13:17.162887+0000","last_active":"2023-10-06T11:13:17.170427+0000","last_peered":"2023-10-06T11:13:17.170427+0000","last_clean":"2023-10-06T11:13:17.170427+0000","last_became_active":"2023-10-06T11:13:17.162489+0000","last_became_peered":"2023-10-06T11:13:17.162489+0000","last_unstale":"2023-10-06T11:13:17.170427+0000","last_undegraded":"2023-10-06T11:13:17.170427+0000","last_fullsized":"2023-10-06T11:13:17.170427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142694+0000","last_change":"2023-10-06T11:13:12.108134+0000","last_active":"2023-10-06T11:13:17.142694+0000","last_peered":"2023-10-06T11:13:17.142694+0000","last_clean":"2023-10-06T11:13:17.142694+0000","last_became_active":"2023-10-06T11:13:12.107878+0000","last_became_peered":"2023-10-06T11:13:12.107878+0000","last_unstale":"2023-10-06T11:13:17.142694+0000","last_undegraded":"2023-10-06T11:13:17.142694+0000","last_fullsized":"2023-10-06T11:13:17.142694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:12.218554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144703+0000","last_change":"2023-10-06T11:13:13.118848+0000","last_active":"2023-10-06T11:13:17.144703+0000","last_peered":"2023-10-06T11:13:17.144703+0000","last_clean":"2023-10-06T11:13:17.144703+0000","last_became_active":"2023-10-06T11:13:13.118542+0000","last_became_peered":"2023-10-06T11:13:13.118542+0000","last_unstale":"2023-10-06T11:13:17.144703+0000","last_undegraded":"2023-10-06T11:13:17.144703+0000","last_fullsized":"2023-10-06T11:13:17.144703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.172331+0000","last_change":"2023-10-06T11:13:17.171309+0000","last_active":"2023-10-06T11:13:17.172331+0000","last_peered":"2023-10-06T11:13:17.172331+0000","last_clean":"2023-10-06T11:13:17.172331+0000","last_became_active":"2023-10-06T11:13:17.170940+0000","last_became_peered":"2023-10-06T11:13:17.170940+0000","last_unstale":"2023-10-06T11:13:17.172331+0000","last_undegraded":"2023-10-06T11:13:17.172331+0000","last_fullsized":"2023-10-06T11:13:17.172331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:04:35.275309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:12.110981+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:12.110564+0000","last_became_peered":"2023-10-06T11:13:12.110564+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144182+0000","last_change":"2023-10-06T11:13:13.122172+0000","last_active":"2023-10-06T11:13:17.144182+0000","last_peered":"2023-10-06T11:13:17.144182+0000","last_clean":"2023-10-06T11:13:17.144182+0000","last_became_active":"2023-10-06T11:13:13.121871+0000","last_became_peered":"2023-10-06T11:13:13.121871+0000","last_unstale":"2023-10-06T11:13:17.144182+0000","last_undegraded":"2023-10-06T11:13:17.144182+0000","last_fullsized":"2023-10-06T11:13:17.144182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169382+0000","last_change":"2023-10-06T11:13:17.164730+0000","last_active":"2023-10-06T11:13:17.169382+0000","last_peered":"2023-10-06T11:13:17.169382+0000","last_clean":"2023-10-06T11:13:17.169382+0000","last_became_active":"2023-10-06T11:13:17.163984+0000","last_became_peered":"2023-10-06T11:13:17.163984+0000","last_unstale":"2023-10-06T11:13:17.169382+0000","last_undegraded":"2023-10-06T11:13:17.169382+0000","last_fullsized":"2023-10-06T11:13:17.169382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:35.906494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143988+0000","last_change":"2023-10-06T11:13:12.114698+0000","last_active":"2023-10-06T11:13:17.143988+0000","last_peered":"2023-10-06T11:13:17.143988+0000","last_clean":"2023-10-06T11:13:17.143988+0000","last_became_active":"2023-10-06T11:13:12.114434+0000","last_became_peered":"2023-10-06T11:13:12.114434+0000","last_unstale":"2023-10-06T11:13:17.143988+0000","last_undegraded":"2023-10-06T11:13:17.143988+0000","last_fullsized":"2023-10-06T11:13:17.143988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151901+0000","last_change":"2023-10-06T11:13:13.134982+0000","last_active":"2023-10-06T11:13:17.151901+0000","last_peered":"2023-10-06T11:13:17.151901+0000","last_clean":"2023-10-06T11:13:17.151901+0000","last_became_active":"2023-10-06T11:13:13.134682+0000","last_became_peered":"2023-10-06T11:13:13.134682+0000","last_unstale":"2023-10-06T11:13:17.151901+0000","last_undegraded":"2023-10-06T11:13:17.151901+0000","last_fullsized":"2023-10-06T11:13:17.151901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.165861+0000","last_change":"2023-10-06T11:13:17.163360+0000","last_active":"2023-10-06T11:13:17.165861+0000","last_peered":"2023-10-06T11:13:17.165861+0000","last_clean":"2023-10-06T11:13:17.165861+0000","last_became_active":"2023-10-06T11:13:17.162962+0000","last_became_peered":"2023-10-06T11:13:17.162962+0000","last_unstale":"2023-10-06T11:13:17.165861+0000","last_undegraded":"2023-10-06T11:13:17.165861+0000","last_fullsized":"2023-10-06T11:13:17.165861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151036+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:13:17.151036+0000","last_peered":"2023-10-06T11:13:17.151036+0000","last_clean":"2023-10-06T11:13:17.151036+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:13:17.151036+0000","last_undegraded":"2023-10-06T11:13:17.151036+0000","last_fullsized":"2023-10-06T11:13:17.151036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152775+0000","last_change":"2023-10-06T11:13:12.104620+0000","last_active":"2023-10-06T11:13:17.152775+0000","last_peered":"2023-10-06T11:13:17.152775+0000","last_clean":"2023-10-06T11:13:17.152775+0000","last_became_active":"2023-10-06T11:13:12.104355+0000","last_became_peered":"2023-10-06T11:13:12.104355+0000","last_unstale":"2023-10-06T11:13:17.152775+0000","last_undegraded":"2023-10-06T11:13:17.152775+0000","last_fullsized":"2023-10-06T11:13:17.152775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150736+0000","last_change":"2023-10-06T11:13:13.130493+0000","last_active":"2023-10-06T11:13:17.150736+0000","last_peered":"2023-10-06T11:13:17.150736+0000","last_clean":"2023-10-06T11:13:17.150736+0000","last_became_active":"2023-10-06T11:13:13.129849+0000","last_became_peered":"2023-10-06T11:13:13.129849+0000","last_unstale":"2023-10-06T11:13:17.150736+0000","last_undegraded":"2023-10-06T11:13:17.150736+0000","last_fullsized":"2023-10-06T11:13:17.150736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162543+0000","last_change":"2023-10-06T11:13:17.157136+0000","last_active":"2023-10-06T11:13:17.162543+0000","last_peered":"2023-10-06T11:13:17.162543+0000","last_clean":"2023-10-06T11:13:17.162543+0000","last_became_active":"2023-10-06T11:13:17.156751+0000","last_became_peered":"2023-10-06T11:13:17.156751+0000","last_unstale":"2023-10-06T11:13:17.162543+0000","last_undegraded":"2023-10-06T11:13:17.162543+0000","last_fullsized":"2023-10-06T11:13:17.162543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154906+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:13:17.154906+0000","last_peered":"2023-10-06T11:13:17.154906+0000","last_clean":"2023-10-06T11:13:17.154906+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:13:17.154906+0000","last_undegraded":"2023-10-06T11:13:17.154906+0000","last_fullsized":"2023-10-06T11:13:17.154906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143311+0000","last_change":"2023-10-06T11:13:12.106188+0000","last_active":"2023-10-06T11:13:17.143311+0000","last_peered":"2023-10-06T11:13:17.143311+0000","last_clean":"2023-10-06T11:13:17.143311+0000","last_became_active":"2023-10-06T11:13:12.104759+0000","last_became_peered":"2023-10-06T11:13:12.104759+0000","last_unstale":"2023-10-06T11:13:17.143311+0000","last_undegraded":"2023-10-06T11:13:17.143311+0000","last_fullsized":"2023-10-06T11:13:17.143311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150950+0000","last_change":"2023-10-06T11:13:13.129472+0000","last_active":"2023-10-06T11:13:17.150950+0000","last_peered":"2023-10-06T11:13:17.150950+0000","last_clean":"2023-10-06T11:13:17.150950+0000","last_became_active":"2023-10-06T11:13:13.129098+0000","last_became_peered":"2023-10-06T11:13:13.129098+0000","last_unstale":"2023-10-06T11:13:17.150950+0000","last_undegraded":"2023-10-06T11:13:17.150950+0000","last_fullsized":"2023-10-06T11:13:17.150950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:48.407971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171118+0000","last_change":"2023-10-06T11:13:17.165728+0000","last_active":"2023-10-06T11:13:17.171118+0000","last_peered":"2023-10-06T11:13:17.171118+0000","last_clean":"2023-10-06T11:13:17.171118+0000","last_became_active":"2023-10-06T11:13:17.165346+0000","last_became_peered":"2023-10-06T11:13:17.165346+0000","last_unstale":"2023-10-06T11:13:17.171118+0000","last_undegraded":"2023-10-06T11:13:17.171118+0000","last_fullsized":"2023-10-06T11:13:17.171118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:50.894918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136729+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:13:17.136729+0000","last_peered":"2023-10-06T11:13:17.136729+0000","last_clean":"2023-10-06T11:13:17.136729+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:13:17.136729+0000","last_undegraded":"2023-10-06T11:13:17.136729+0000","last_fullsized":"2023-10-06T11:13:17.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152088+0000","last_change":"2023-10-06T11:13:12.113344+0000","last_active":"2023-10-06T11:13:17.152088+0000","last_peered":"2023-10-06T11:13:17.152088+0000","last_clean":"2023-10-06T11:13:17.152088+0000","last_became_active":"2023-10-06T11:13:12.113058+0000","last_became_peered":"2023-10-06T11:13:12.113058+0000","last_unstale":"2023-10-06T11:13:17.152088+0000","last_undegraded":"2023-10-06T11:13:17.152088+0000","last_fullsized":"2023-10-06T11:13:17.152088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151812+0000","last_change":"2023-10-06T11:13:13.126878+0000","last_active":"2023-10-06T11:13:17.151812+0000","last_peered":"2023-10-06T11:13:17.151812+0000","last_clean":"2023-10-06T11:13:17.151812+0000","last_became_active":"2023-10-06T11:13:13.126442+0000","last_became_peered":"2023-10-06T11:13:13.126442+0000","last_unstale":"2023-10-06T11:13:17.151812+0000","last_undegraded":"2023-10-06T11:13:17.151812+0000","last_fullsized":"2023-10-06T11:13:17.151812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:18.891306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168046+0000","last_change":"2023-10-06T11:13:17.162293+0000","last_active":"2023-10-06T11:13:17.168046+0000","last_peered":"2023-10-06T11:13:17.168046+0000","last_clean":"2023-10-06T11:13:17.168046+0000","last_became_active":"2023-10-06T11:13:17.161704+0000","last_became_peered":"2023-10-06T11:13:17.161704+0000","last_unstale":"2023-10-06T11:13:17.168046+0000","last_undegraded":"2023-10-06T11:13:17.168046+0000","last_fullsized":"2023-10-06T11:13:17.168046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:33.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154038+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:13:17.154038+0000","last_peered":"2023-10-06T11:13:17.154038+0000","last_clean":"2023-10-06T11:13:17.154038+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:13:17.154038+0000","last_undegraded":"2023-10-06T11:13:17.154038+0000","last_fullsized":"2023-10-06T11:13:17.154038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147427+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:13:17.147427+0000","last_peered":"2023-10-06T11:13:17.147427+0000","last_clean":"2023-10-06T11:13:17.147427+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:13:17.147427+0000","last_undegraded":"2023-10-06T11:13:17.147427+0000","last_fullsized":"2023-10-06T11:13:17.147427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143336+0000","last_change":"2023-10-06T11:13:12.105541+0000","last_active":"2023-10-06T11:13:17.143336+0000","last_peered":"2023-10-06T11:13:17.143336+0000","last_clean":"2023-10-06T11:13:17.143336+0000","last_became_active":"2023-10-06T11:13:12.105235+0000","last_became_peered":"2023-10-06T11:13:12.105235+0000","last_unstale":"2023-10-06T11:13:17.143336+0000","last_undegraded":"2023-10-06T11:13:17.143336+0000","last_fullsized":"2023-10-06T11:13:17.143336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140757+0000","last_change":"2023-10-06T11:13:13.123658+0000","last_active":"2023-10-06T11:13:17.140757+0000","last_peered":"2023-10-06T11:13:17.140757+0000","last_clean":"2023-10-06T11:13:17.140757+0000","last_became_active":"2023-10-06T11:13:13.123381+0000","last_became_peered":"2023-10-06T11:13:13.123381+0000","last_unstale":"2023-10-06T11:13:17.140757+0000","last_undegraded":"2023-10-06T11:13:17.140757+0000","last_fullsized":"2023-10-06T11:13:17.140757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:17.061401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.167581+0000","last_change":"2023-10-06T11:13:17.164198+0000","last_active":"2023-10-06T11:13:17.167581+0000","last_peered":"2023-10-06T11:13:17.167581+0000","last_clean":"2023-10-06T11:13:17.167581+0000","last_became_active":"2023-10-06T11:13:17.163841+0000","last_became_peered":"2023-10-06T11:13:17.163841+0000","last_unstale":"2023-10-06T11:13:17.167581+0000","last_undegraded":"2023-10-06T11:13:17.167581+0000","last_fullsized":"2023-10-06T11:13:17.167581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:25:37.062632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147593+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:13:17.147593+0000","last_peered":"2023-10-06T11:13:17.147593+0000","last_clean":"2023-10-06T11:13:17.147593+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:13:17.147593+0000","last_undegraded":"2023-10-06T11:13:17.147593+0000","last_fullsized":"2023-10-06T11:13:17.147593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142083+0000","last_change":"2023-10-06T11:13:12.110086+0000","last_active":"2023-10-06T11:13:17.142083+0000","last_peered":"2023-10-06T11:13:17.142083+0000","last_clean":"2023-10-06T11:13:17.142083+0000","last_became_active":"2023-10-06T11:13:12.109735+0000","last_became_peered":"2023-10-06T11:13:12.109735+0000","last_unstale":"2023-10-06T11:13:17.142083+0000","last_undegraded":"2023-10-06T11:13:17.142083+0000","last_fullsized":"2023-10-06T11:13:17.142083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142662+0000","last_change":"2023-10-06T11:13:13.131401+0000","last_active":"2023-10-06T11:13:17.142662+0000","last_peered":"2023-10-06T11:13:17.142662+0000","last_clean":"2023-10-06T11:13:17.142662+0000","last_became_active":"2023-10-06T11:13:13.131126+0000","last_became_peered":"2023-10-06T11:13:13.131126+0000","last_unstale":"2023-10-06T11:13:17.142662+0000","last_undegraded":"2023-10-06T11:13:17.142662+0000","last_fullsized":"2023-10-06T11:13:17.142662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.164232+0000","last_change":"2023-10-06T11:13:17.161961+0000","last_active":"2023-10-06T11:13:17.164232+0000","last_peered":"2023-10-06T11:13:17.164232+0000","last_clean":"2023-10-06T11:13:17.164232+0000","last_became_active":"2023-10-06T11:13:17.161594+0000","last_became_peered":"2023-10-06T11:13:17.161594+0000","last_unstale":"2023-10-06T11:13:17.164232+0000","last_undegraded":"2023-10-06T11:13:17.164232+0000","last_fullsized":"2023-10-06T11:13:17.164232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:37.366244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148583+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:13:17.148583+0000","last_peered":"2023-10-06T11:13:17.148583+0000","last_clean":"2023-10-06T11:13:17.148583+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:13:17.148583+0000","last_undegraded":"2023-10-06T11:13:17.148583+0000","last_fullsized":"2023-10-06T11:13:17.148583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151224+0000","last_change":"2023-10-06T11:13:12.113488+0000","last_active":"2023-10-06T11:13:17.151224+0000","last_peered":"2023-10-06T11:13:17.151224+0000","last_clean":"2023-10-06T11:13:17.151224+0000","last_became_active":"2023-10-06T11:13:12.113184+0000","last_became_peered":"2023-10-06T11:13:12.113184+0000","last_unstale":"2023-10-06T11:13:17.151224+0000","last_undegraded":"2023-10-06T11:13:17.151224+0000","last_fullsized":"2023-10-06T11:13:17.151224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142862+0000","last_change":"2023-10-06T11:13:13.122337+0000","last_active":"2023-10-06T11:13:17.142862+0000","last_peered":"2023-10-06T11:13:17.142862+0000","last_clean":"2023-10-06T11:13:17.142862+0000","last_became_active":"2023-10-06T11:13:13.122081+0000","last_became_peered":"2023-10-06T11:13:13.122081+0000","last_unstale":"2023-10-06T11:13:17.142862+0000","last_undegraded":"2023-10-06T11:13:17.142862+0000","last_fullsized":"2023-10-06T11:13:17.142862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:45.496026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166873+0000","last_change":"2023-10-06T11:13:17.157514+0000","last_active":"2023-10-06T11:13:17.166873+0000","last_peered":"2023-10-06T11:13:17.166873+0000","last_clean":"2023-10-06T11:13:17.166873+0000","last_became_active":"2023-10-06T11:13:17.157113+0000","last_became_peered":"2023-10-06T11:13:17.157113+0000","last_unstale":"2023-10-06T11:13:17.166873+0000","last_undegraded":"2023-10-06T11:13:17.166873+0000","last_fullsized":"2023-10-06T11:13:17.166873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:21:57.844604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144634+0000","last_change":"2023-10-06T11:13:12.117257+0000","last_active":"2023-10-06T11:13:17.144634+0000","last_peered":"2023-10-06T11:13:17.144634+0000","last_clean":"2023-10-06T11:13:17.144634+0000","last_became_active":"2023-10-06T11:13:12.116987+0000","last_became_peered":"2023-10-06T11:13:12.116987+0000","last_unstale":"2023-10-06T11:13:17.144634+0000","last_undegraded":"2023-10-06T11:13:17.144634+0000","last_fullsized":"2023-10-06T11:13:17.144634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152020+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:13:17.152020+0000","last_peered":"2023-10-06T11:13:17.152020+0000","last_clean":"2023-10-06T11:13:17.152020+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:13:17.152020+0000","last_undegraded":"2023-10-06T11:13:17.152020+0000","last_fullsized":"2023-10-06T11:13:17.152020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143909+0000","last_change":"2023-10-06T11:13:13.129882+0000","last_active":"2023-10-06T11:13:17.143909+0000","last_peered":"2023-10-06T11:13:17.143909+0000","last_clean":"2023-10-06T11:13:17.143909+0000","last_became_active":"2023-10-06T11:13:13.129592+0000","last_became_peered":"2023-10-06T11:13:13.129592+0000","last_unstale":"2023-10-06T11:13:17.143909+0000","last_undegraded":"2023-10-06T11:13:17.143909+0000","last_fullsized":"2023-10-06T11:13:17.143909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158501+0000","last_change":"2023-10-06T11:13:17.156066+0000","last_active":"2023-10-06T11:13:17.158501+0000","last_peered":"2023-10-06T11:13:17.158501+0000","last_clean":"2023-10-06T11:13:17.158501+0000","last_became_active":"2023-10-06T11:13:17.155623+0000","last_became_peered":"2023-10-06T11:13:17.155623+0000","last_unstale":"2023-10-06T11:13:17.158501+0000","last_undegraded":"2023-10-06T11:13:17.158501+0000","last_fullsized":"2023-10-06T11:13:17.158501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:42.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144618+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:13:17.144618+0000","last_peered":"2023-10-06T11:13:17.144618+0000","last_clean":"2023-10-06T11:13:17.144618+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:13:17.144618+0000","last_undegraded":"2023-10-06T11:13:17.144618+0000","last_fullsized":"2023-10-06T11:13:17.144618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168135+0000","last_change":"2023-10-06T11:13:12.109073+0000","last_active":"2023-10-06T11:13:17.168135+0000","last_peered":"2023-10-06T11:13:17.168135+0000","last_clean":"2023-10-06T11:13:17.168135+0000","last_became_active":"2023-10-06T11:13:12.108687+0000","last_became_peered":"2023-10-06T11:13:12.108687+0000","last_unstale":"2023-10-06T11:13:17.168135+0000","last_undegraded":"2023-10-06T11:13:17.168135+0000","last_fullsized":"2023-10-06T11:13:17.168135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142725+0000","last_change":"2023-10-06T11:13:13.113909+0000","last_active":"2023-10-06T11:13:17.142725+0000","last_peered":"2023-10-06T11:13:17.142725+0000","last_clean":"2023-10-06T11:13:17.142725+0000","last_became_active":"2023-10-06T11:13:13.113579+0000","last_became_peered":"2023-10-06T11:13:13.113579+0000","last_unstale":"2023-10-06T11:13:17.142725+0000","last_undegraded":"2023-10-06T11:13:17.142725+0000","last_fullsized":"2023-10-06T11:13:17.142725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170450+0000","last_change":"2023-10-06T11:13:17.164311+0000","last_active":"2023-10-06T11:13:17.170450+0000","last_peered":"2023-10-06T11:13:17.170450+0000","last_clean":"2023-10-06T11:13:17.170450+0000","last_became_active":"2023-10-06T11:13:17.159765+0000","last_became_peered":"2023-10-06T11:13:17.159765+0000","last_unstale":"2023-10-06T11:13:17.170450+0000","last_undegraded":"2023-10-06T11:13:17.170450+0000","last_fullsized":"2023-10-06T11:13:17.170450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145036+0000","last_change":"2023-10-06T11:13:12.108063+0000","last_active":"2023-10-06T11:13:17.145036+0000","last_peered":"2023-10-06T11:13:17.145036+0000","last_clean":"2023-10-06T11:13:17.145036+0000","last_became_active":"2023-10-06T11:13:12.107787+0000","last_became_peered":"2023-10-06T11:13:12.107787+0000","last_unstale":"2023-10-06T11:13:17.145036+0000","last_undegraded":"2023-10-06T11:13:17.145036+0000","last_fullsized":"2023-10-06T11:13:17.145036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137088+0000","last_change":"2023-10-06T11:13:13.128167+0000","last_active":"2023-10-06T11:13:17.137088+0000","last_peered":"2023-10-06T11:13:17.137088+0000","last_clean":"2023-10-06T11:13:17.137088+0000","last_became_active":"2023-10-06T11:13:13.127699+0000","last_became_peered":"2023-10-06T11:13:13.127699+0000","last_unstale":"2023-10-06T11:13:17.137088+0000","last_undegraded":"2023-10-06T11:13:17.137088+0000","last_fullsized":"2023-10-06T11:13:17.137088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:49.518740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161638+0000","last_change":"2023-10-06T11:13:17.158623+0000","last_active":"2023-10-06T11:13:17.161638+0000","last_peered":"2023-10-06T11:13:17.161638+0000","last_clean":"2023-10-06T11:13:17.161638+0000","last_became_active":"2023-10-06T11:13:17.158283+0000","last_became_peered":"2023-10-06T11:13:17.158283+0000","last_unstale":"2023-10-06T11:13:17.161638+0000","last_undegraded":"2023-10-06T11:13:17.161638+0000","last_fullsized":"2023-10-06T11:13:17.161638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150057+0000","last_change":"2023-10-06T11:13:12.105330+0000","last_active":"2023-10-06T11:13:17.150057+0000","last_peered":"2023-10-06T11:13:17.150057+0000","last_clean":"2023-10-06T11:13:17.150057+0000","last_became_active":"2023-10-06T11:13:12.104918+0000","last_became_peered":"2023-10-06T11:13:12.104918+0000","last_unstale":"2023-10-06T11:13:17.150057+0000","last_undegraded":"2023-10-06T11:13:17.150057+0000","last_fullsized":"2023-10-06T11:13:17.150057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143214+0000","last_change":"2023-10-06T11:13:13.113277+0000","last_active":"2023-10-06T11:13:17.143214+0000","last_peered":"2023-10-06T11:13:17.143214+0000","last_clean":"2023-10-06T11:13:17.143214+0000","last_became_active":"2023-10-06T11:13:13.112996+0000","last_became_peered":"2023-10-06T11:13:13.112996+0000","last_unstale":"2023-10-06T11:13:17.143214+0000","last_undegraded":"2023-10-06T11:13:17.143214+0000","last_fullsized":"2023-10-06T11:13:17.143214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168692+0000","last_change":"2023-10-06T11:13:17.164841+0000","last_active":"2023-10-06T11:13:17.168692+0000","last_peered":"2023-10-06T11:13:17.168692+0000","last_clean":"2023-10-06T11:13:17.168692+0000","last_became_active":"2023-10-06T11:13:17.164169+0000","last_became_peered":"2023-10-06T11:13:17.164169+0000","last_unstale":"2023-10-06T11:13:17.168692+0000","last_undegraded":"2023-10-06T11:13:17.168692+0000","last_fullsized":"2023-10-06T11:13:17.168692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152685+0000","last_change":"2023-10-06T11:13:12.106402+0000","last_active":"2023-10-06T11:13:17.152685+0000","last_peered":"2023-10-06T11:13:17.152685+0000","last_clean":"2023-10-06T11:13:17.152685+0000","last_became_active":"2023-10-06T11:13:12.106112+0000","last_became_peered":"2023-10-06T11:13:12.106112+0000","last_unstale":"2023-10-06T11:13:17.152685+0000","last_undegraded":"2023-10-06T11:13:17.152685+0000","last_fullsized":"2023-10-06T11:13:17.152685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:13.112738+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:13.112481+0000","last_became_peered":"2023-10-06T11:13:13.112481+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166864+0000","last_change":"2023-10-06T11:13:17.157509+0000","last_active":"2023-10-06T11:13:17.166864+0000","last_peered":"2023-10-06T11:13:17.166864+0000","last_clean":"2023-10-06T11:13:17.166864+0000","last_became_active":"2023-10-06T11:13:17.156662+0000","last_became_peered":"2023-10-06T11:13:17.156662+0000","last_unstale":"2023-10-06T11:13:17.166864+0000","last_undegraded":"2023-10-06T11:13:17.166864+0000","last_fullsized":"2023-10-06T11:13:17.166864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:05.195662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144326+0000","last_change":"2023-10-06T11:13:12.101845+0000","last_active":"2023-10-06T11:13:17.144326+0000","last_peered":"2023-10-06T11:13:17.144326+0000","last_clean":"2023-10-06T11:13:17.144326+0000","last_became_active":"2023-10-06T11:13:12.101436+0000","last_became_peered":"2023-10-06T11:13:12.101436+0000","last_unstale":"2023-10-06T11:13:17.144326+0000","last_undegraded":"2023-10-06T11:13:17.144326+0000","last_fullsized":"2023-10-06T11:13:17.144326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143534+0000","last_change":"2023-10-06T11:13:13.123861+0000","last_active":"2023-10-06T11:13:17.143534+0000","last_peered":"2023-10-06T11:13:17.143534+0000","last_clean":"2023-10-06T11:13:17.143534+0000","last_became_active":"2023-10-06T11:13:13.123660+0000","last_became_peered":"2023-10-06T11:13:13.123660+0000","last_unstale":"2023-10-06T11:13:17.143534+0000","last_undegraded":"2023-10-06T11:13:17.143534+0000","last_fullsized":"2023-10-06T11:13:17.143534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170721+0000","last_change":"2023-10-06T11:13:17.165451+0000","last_active":"2023-10-06T11:13:17.170721+0000","last_peered":"2023-10-06T11:13:17.170721+0000","last_clean":"2023-10-06T11:13:17.170721+0000","last_became_active":"2023-10-06T11:13:17.165075+0000","last_became_peered":"2023-10-06T11:13:17.165075+0000","last_unstale":"2023-10-06T11:13:17.170721+0000","last_undegraded":"2023-10-06T11:13:17.170721+0000","last_fullsized":"2023-10-06T11:13:17.170721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145478+0000","last_change":"2023-10-06T11:13:12.107593+0000","last_active":"2023-10-06T11:13:17.145478+0000","last_peered":"2023-10-06T11:13:17.145478+0000","last_clean":"2023-10-06T11:13:17.145478+0000","last_became_active":"2023-10-06T11:13:12.107352+0000","last_became_peered":"2023-10-06T11:13:12.107352+0000","last_unstale":"2023-10-06T11:13:17.145478+0000","last_undegraded":"2023-10-06T11:13:17.145478+0000","last_fullsized":"2023-10-06T11:13:17.145478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142457+0000","last_change":"2023-10-06T11:13:13.125513+0000","last_active":"2023-10-06T11:13:17.142457+0000","last_peered":"2023-10-06T11:13:17.142457+0000","last_clean":"2023-10-06T11:13:17.142457+0000","last_became_active":"2023-10-06T11:13:13.125218+0000","last_became_peered":"2023-10-06T11:13:13.125218+0000","last_unstale":"2023-10-06T11:13:17.142457+0000","last_undegraded":"2023-10-06T11:13:17.142457+0000","last_fullsized":"2023-10-06T11:13:17.142457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:38.222422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140901+0000","last_change":"2023-10-06T11:13:13.127823+0000","last_active":"2023-10-06T11:13:17.140901+0000","last_peered":"2023-10-06T11:13:17.140901+0000","last_clean":"2023-10-06T11:13:17.140901+0000","last_became_active":"2023-10-06T11:13:13.127598+0000","last_became_peered":"2023-10-06T11:13:13.127598+0000","last_unstale":"2023-10-06T11:13:17.140901+0000","last_undegraded":"2023-10-06T11:13:17.140901+0000","last_fullsized":"2023-10-06T11:13:17.140901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143675+0000","last_change":"2023-10-06T11:13:13.128681+0000","last_active":"2023-10-06T11:13:17.143675+0000","last_peered":"2023-10-06T11:13:17.143675+0000","last_clean":"2023-10-06T11:13:17.143675+0000","last_became_active":"2023-10-06T11:13:13.128410+0000","last_became_peered":"2023-10-06T11:13:13.128410+0000","last_unstale":"2023-10-06T11:13:17.143675+0000","last_undegraded":"2023-10-06T11:13:17.143675+0000","last_fullsized":"2023-10-06T11:13:17.143675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144507+0000","last_change":"2023-10-06T11:13:13.122593+0000","last_active":"2023-10-06T11:13:17.144507+0000","last_peered":"2023-10-06T11:13:17.144507+0000","last_clean":"2023-10-06T11:13:17.144507+0000","last_became_active":"2023-10-06T11:13:13.122348+0000","last_became_peered":"2023-10-06T11:13:13.122348+0000","last_unstale":"2023-10-06T11:13:17.144507+0000","last_undegraded":"2023-10-06T11:13:17.144507+0000","last_fullsized":"2023-10-06T11:13:17.144507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:42.518365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143721+0000","last_change":"2023-10-06T11:13:13.125197+0000","last_active":"2023-10-06T11:13:17.143721+0000","last_peered":"2023-10-06T11:13:17.143721+0000","last_clean":"2023-10-06T11:13:17.143721+0000","last_became_active":"2023-10-06T11:13:13.124919+0000","last_became_peered":"2023-10-06T11:13:13.124919+0000","last_unstale":"2023-10-06T11:13:17.143721+0000","last_undegraded":"2023-10-06T11:13:17.143721+0000","last_fullsized":"2023-10-06T11:13:17.143721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151139+0000","last_change":"2023-10-06T11:13:13.127447+0000","last_active":"2023-10-06T11:13:17.151139+0000","last_peered":"2023-10-06T11:13:17.151139+0000","last_clean":"2023-10-06T11:13:17.151139+0000","last_became_active":"2023-10-06T11:13:13.127144+0000","last_became_peered":"2023-10-06T11:13:13.127144+0000","last_unstale":"2023-10-06T11:13:17.151139+0000","last_undegraded":"2023-10-06T11:13:17.151139+0000","last_fullsized":"2023-10-06T11:13:17.151139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":715154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":124322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":128002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":124856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:13:27.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:13:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.508+0000 7f0d7b59e700 1 Processor -- start 2023-10-06T11:13:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.508+0000 7f0d7b59e700 1 -- start start 2023-10-06T11:13:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c159440 0x7f0d7c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7b59e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d7c0b35d0 0x7f0d7c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c0cb7a0 con 0x7f0d7c0cc170 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7b59e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0b0860 con 0x7f0d7c0b35d0 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0cb150 con 0x7f0d7c159440 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d7c0b35d0 0x7f0d7c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d7c0b35d0 0x7f0d7c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37174/0 (socket says 172.21.15.55:37174) 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 -- 172.21.15.55:0/1457356257 learned_addr learned my addr 172.21.15.55:0/1457356257 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7a59c700 1 --2- 172.21.15.55:0/1457356257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c159440 0x7f0d7c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 -- 172.21.15.55:0/1457356257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c159440 msgr2=0x7f0d7c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 --2- 172.21.15.55:0/1457356257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c159440 0x7f0d7c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 -- 172.21.15.55:0/1457356257 >> v1:172.21.15.142:6789/0 conn(0x7f0d7c0cc170 legacy=0x7f0d7c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 -- 172.21.15.55:0/1457356257 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0cb430 con 0x7f0d7c0b35d0 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d79d9b700 1 --2- 172.21.15.55:0/1457356257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b35d0 0x7f0d7c0cbc30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d700099b0 tx=0x7f0d70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4db377854e74f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.509+0000 7f0d7959a700 1 -- 172.21.15.55:0/1457356257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000b820 con 0x7f0d7c0b35d0 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7959a700 1 -- 172.21.15.55:0/1457356257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000b980 con 0x7f0d7c0b35d0 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7959a700 1 -- 172.21.15.55:0/1457356257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000bd20 con 0x7f0d7c0b35d0 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 -- 172.21.15.55:0/1457356257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b35d0 msgr2=0x7f0d7c0cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/1457356257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b35d0 0x7f0d7c0cbc30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d700099b0 tx=0x7f0d70009250 comp rx=0 tx=0).stop 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 -- 172.21.15.55:0/1457356257 shutdown_connections 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/1457356257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c159440 0x7f0d7c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/1457356257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c0b35d0 0x7f0d7c0cbc30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 -- 172.21.15.55:0/1457356257 >> 172.21.15.55:0/1457356257 conn(0x7f0d7c06ece0 msgr2=0x7f0d7c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 -- 172.21.15.55:0/1457356257 shutdown_connections 2023-10-06T11:13:27.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.510+0000 7f0d7b59e700 1 -- 172.21.15.55:0/1457356257 wait complete. 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.511+0000 7f0d7b59e700 1 Processor -- start 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.511+0000 7f0d7b59e700 1 -- start start 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c0b35d0 0x7f0d7c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d7c0cc170 0x7f0d7c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 0x7f0d7c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7b59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c159a90 con 0x7f0d7c159440 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c159d70 con 0x7f0d7c0cc170 2023-10-06T11:13:27.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0cffe0 con 0x7f0d7c0b35d0 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 0x7f0d7c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 0x7f0d7c0b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37176/0 (socket says 172.21.15.55:37176) 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 -- 172.21.15.55:0/3462220391 learned_addr learned my addr 172.21.15.55:0/3462220391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7a59c700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c0b35d0 0x7f0d7c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d79d9b700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d7c0cc170 0x7f0d7c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 -- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c0b35d0 msgr2=0x7f0d7c1547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c0b35d0 0x7f0d7c1547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 -- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d7c0cc170 msgr2=0x7f0d7c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d7c0cc170 0x7f0d7c0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.512+0000 7f0d7ad9d700 1 -- 172.21.15.55:0/3462220391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700094f0 con 0x7f0d7c159440 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.513+0000 7f0d7ad9d700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 0x7f0d7c0b3ab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c960 tx=0x7f0d740026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.513+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74012630 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.513+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74012790 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.513+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0d02c0 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.513+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74012b50 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.513+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0d0ae0 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.514+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c159f00 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.514+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d7401b400 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.514+0000 7f0d6a7fc700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d5c066f30 0x7f0d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.515+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0d74084bf0 con 0x7f0d7c159440 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.515+0000 7f0d7a59c700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d5c066f30 0x7f0d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.515+0000 7f0d7a59c700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d5c066f30 0x7f0d5c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c006fd0 tx=0x7f0d6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.519+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d740554a0 con 0x7f0d7c159440 2023-10-06T11:13:27.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.708+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d7c0d0d30 con 0x7f0d5c066f30 2023-10-06T11:13:27.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.719+0000 7f0d6a7fc700 1 -- 172.21.15.55:0/3462220391 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367360 (secure 0 0 0) 0x7f0d7c0d0d30 con 0x7f0d5c066f30 2023-10-06T11:13:27.725 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d5c066f30 msgr2=0x7f0d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d5c066f30 0x7f0d5c0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c006fd0 tx=0x7f0d6c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 msgr2=0x7f0d7c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 0x7f0d7c0b3ab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c960 tx=0x7f0d740026e0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 shutdown_connections 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d5c066f30 0x7f0d5c0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d7c159440 0x7f0d7c0b3ab0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d7c0b35d0 0x7f0d7c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 --2- 172.21.15.55:0/3462220391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d7c0cc170 0x7f0d7c0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 >> 172.21.15.55:0/3462220391 conn(0x7f0d7c06ece0 msgr2=0x7f0d7c155300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 shutdown_connections 2023-10-06T11:13:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.722+0000 7f0d7b59e700 1 -- 172.21.15.55:0/3462220391 wait complete. 2023-10-06T11:13:27.729 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:13:27.736 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-06T11:13:26.844072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381896,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592824,"statfs":{"total":773094113280,"available":770655051776,"internally_reserved":0,"allocated":3678208,"data_stored":2183560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.706192"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.138211+0000","last_change":"2023-10-06T11:13:13.121699+0000","last_active":"2023-10-06T11:13:17.138211+0000","last_peered":"2023-10-06T11:13:17.138211+0000","last_clean":"2023-10-06T11:13:17.138211+0000","last_became_active":"2023-10-06T11:13:13.121499+0000","last_became_peered":"2023-10-06T11:13:13.121499+0000","last_unstale":"2023-10-06T11:13:17.138211+0000","last_undegraded":"2023-10-06T11:13:17.138211+0000","last_fullsized":"2023-10-06T11:13:17.138211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155514+0000","last_change":"2023-10-06T11:13:13.120623+0000","last_active":"2023-10-06T11:13:17.155514+0000","last_peered":"2023-10-06T11:13:17.155514+0000","last_clean":"2023-10-06T11:13:17.155514+0000","last_became_active":"2023-10-06T11:13:13.120368+0000","last_became_peered":"2023-10-06T11:13:13.120368+0000","last_unstale":"2023-10-06T11:13:17.155514+0000","last_undegraded":"2023-10-06T11:13:17.155514+0000","last_fullsized":"2023-10-06T11:13:17.155514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144860+0000","last_change":"2023-10-06T11:13:13.118595+0000","last_active":"2023-10-06T11:13:17.144860+0000","last_peered":"2023-10-06T11:13:17.144860+0000","last_clean":"2023-10-06T11:13:17.144860+0000","last_became_active":"2023-10-06T11:13:13.118314+0000","last_became_peered":"2023-10-06T11:13:13.118314+0000","last_unstale":"2023-10-06T11:13:17.144860+0000","last_undegraded":"2023-10-06T11:13:17.144860+0000","last_fullsized":"2023-10-06T11:13:17.144860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:56.994826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.139864+0000","last_change":"2023-10-06T11:13:13.118767+0000","last_active":"2023-10-06T11:13:17.139864+0000","last_peered":"2023-10-06T11:13:17.139864+0000","last_clean":"2023-10-06T11:13:17.139864+0000","last_became_active":"2023-10-06T11:13:13.118462+0000","last_became_peered":"2023-10-06T11:13:13.118462+0000","last_unstale":"2023-10-06T11:13:17.139864+0000","last_undegraded":"2023-10-06T11:13:17.139864+0000","last_fullsized":"2023-10-06T11:13:17.139864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142961+0000","last_change":"2023-10-06T11:13:13.121812+0000","last_active":"2023-10-06T11:13:17.142961+0000","last_peered":"2023-10-06T11:13:17.142961+0000","last_clean":"2023-10-06T11:13:17.142961+0000","last_became_active":"2023-10-06T11:13:13.121530+0000","last_became_peered":"2023-10-06T11:13:13.121530+0000","last_unstale":"2023-10-06T11:13:17.142961+0000","last_undegraded":"2023-10-06T11:13:17.142961+0000","last_fullsized":"2023-10-06T11:13:17.142961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144619+0000","last_change":"2023-10-06T11:13:13.127391+0000","last_active":"2023-10-06T11:13:17.144619+0000","last_peered":"2023-10-06T11:13:17.144619+0000","last_clean":"2023-10-06T11:13:17.144619+0000","last_became_active":"2023-10-06T11:13:13.127090+0000","last_became_peered":"2023-10-06T11:13:13.127090+0000","last_unstale":"2023-10-06T11:13:17.144619+0000","last_undegraded":"2023-10-06T11:13:17.144619+0000","last_fullsized":"2023-10-06T11:13:17.144619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:29.195895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149465+0000","last_change":"2023-10-06T11:13:13.134965+0000","last_active":"2023-10-06T11:13:17.149465+0000","last_peered":"2023-10-06T11:13:17.149465+0000","last_clean":"2023-10-06T11:13:17.149465+0000","last_became_active":"2023-10-06T11:13:13.134668+0000","last_became_peered":"2023-10-06T11:13:13.134668+0000","last_unstale":"2023-10-06T11:13:17.149465+0000","last_undegraded":"2023-10-06T11:13:17.149465+0000","last_fullsized":"2023-10-06T11:13:17.149465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150571+0000","last_change":"2023-10-06T11:13:13.114957+0000","last_active":"2023-10-06T11:13:17.150571+0000","last_peered":"2023-10-06T11:13:17.150571+0000","last_clean":"2023-10-06T11:13:17.150571+0000","last_became_active":"2023-10-06T11:13:13.114673+0000","last_became_peered":"2023-10-06T11:13:13.114673+0000","last_unstale":"2023-10-06T11:13:17.150571+0000","last_undegraded":"2023-10-06T11:13:17.150571+0000","last_fullsized":"2023-10-06T11:13:17.150571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145256+0000","last_change":"2023-10-06T11:13:13.121976+0000","last_active":"2023-10-06T11:13:17.145256+0000","last_peered":"2023-10-06T11:13:17.145256+0000","last_clean":"2023-10-06T11:13:17.145256+0000","last_became_active":"2023-10-06T11:13:13.121523+0000","last_became_peered":"2023-10-06T11:13:13.121523+0000","last_unstale":"2023-10-06T11:13:17.145256+0000","last_undegraded":"2023-10-06T11:13:17.145256+0000","last_fullsized":"2023-10-06T11:13:17.145256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155701+0000","last_change":"2023-10-06T11:13:13.126240+0000","last_active":"2023-10-06T11:13:17.155701+0000","last_peered":"2023-10-06T11:13:17.155701+0000","last_clean":"2023-10-06T11:13:17.155701+0000","last_became_active":"2023-10-06T11:13:13.125943+0000","last_became_peered":"2023-10-06T11:13:13.125943+0000","last_unstale":"2023-10-06T11:13:17.155701+0000","last_undegraded":"2023-10-06T11:13:17.155701+0000","last_fullsized":"2023-10-06T11:13:17.155701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145009+0000","last_change":"2023-10-06T11:13:13.127706+0000","last_active":"2023-10-06T11:13:17.145009+0000","last_peered":"2023-10-06T11:13:17.145009+0000","last_clean":"2023-10-06T11:13:17.145009+0000","last_became_active":"2023-10-06T11:13:13.127484+0000","last_became_peered":"2023-10-06T11:13:13.127484+0000","last_unstale":"2023-10-06T11:13:17.145009+0000","last_undegraded":"2023-10-06T11:13:17.145009+0000","last_fullsized":"2023-10-06T11:13:17.145009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:11.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136986+0000","last_change":"2023-10-06T11:13:13.118366+0000","last_active":"2023-10-06T11:13:17.136986+0000","last_peered":"2023-10-06T11:13:17.136986+0000","last_clean":"2023-10-06T11:13:17.136986+0000","last_became_active":"2023-10-06T11:13:13.117530+0000","last_became_peered":"2023-10-06T11:13:13.117530+0000","last_unstale":"2023-10-06T11:13:17.136986+0000","last_undegraded":"2023-10-06T11:13:17.136986+0000","last_fullsized":"2023-10-06T11:13:17.136986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:30.505653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137568+0000","last_change":"2023-10-06T11:13:13.123055+0000","last_active":"2023-10-06T11:13:17.137568+0000","last_peered":"2023-10-06T11:13:17.137568+0000","last_clean":"2023-10-06T11:13:17.137568+0000","last_became_active":"2023-10-06T11:13:13.122747+0000","last_became_peered":"2023-10-06T11:13:13.122747+0000","last_unstale":"2023-10-06T11:13:17.137568+0000","last_undegraded":"2023-10-06T11:13:17.137568+0000","last_fullsized":"2023-10-06T11:13:17.137568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154823+0000","last_change":"2023-10-06T11:13:13.124824+0000","last_active":"2023-10-06T11:13:17.154823+0000","last_peered":"2023-10-06T11:13:17.154823+0000","last_clean":"2023-10-06T11:13:17.154823+0000","last_became_active":"2023-10-06T11:13:13.124503+0000","last_became_peered":"2023-10-06T11:13:13.124503+0000","last_unstale":"2023-10-06T11:13:17.154823+0000","last_undegraded":"2023-10-06T11:13:17.154823+0000","last_fullsized":"2023-10-06T11:13:17.154823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149286+0000","last_change":"2023-10-06T11:13:13.135539+0000","last_active":"2023-10-06T11:13:17.149286+0000","last_peered":"2023-10-06T11:13:17.149286+0000","last_clean":"2023-10-06T11:13:17.149286+0000","last_became_active":"2023-10-06T11:13:13.135269+0000","last_became_peered":"2023-10-06T11:13:13.135269+0000","last_unstale":"2023-10-06T11:13:17.149286+0000","last_undegraded":"2023-10-06T11:13:17.149286+0000","last_fullsized":"2023-10-06T11:13:17.149286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143826+0000","last_change":"2023-10-06T11:13:13.118179+0000","last_active":"2023-10-06T11:13:17.143826+0000","last_peered":"2023-10-06T11:13:17.143826+0000","last_clean":"2023-10-06T11:13:17.143826+0000","last_became_active":"2023-10-06T11:13:13.117933+0000","last_became_peered":"2023-10-06T11:13:13.117933+0000","last_unstale":"2023-10-06T11:13:17.143826+0000","last_undegraded":"2023-10-06T11:13:17.143826+0000","last_fullsized":"2023-10-06T11:13:17.143826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:38.942631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145356+0000","last_change":"2023-10-06T11:13:13.121835+0000","last_active":"2023-10-06T11:13:17.145356+0000","last_peered":"2023-10-06T11:13:17.145356+0000","last_clean":"2023-10-06T11:13:17.145356+0000","last_became_active":"2023-10-06T11:13:13.121140+0000","last_became_peered":"2023-10-06T11:13:13.121140+0000","last_unstale":"2023-10-06T11:13:17.145356+0000","last_undegraded":"2023-10-06T11:13:17.145356+0000","last_fullsized":"2023-10-06T11:13:17.145356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144097+0000","last_change":"2023-10-06T11:13:13.126361+0000","last_active":"2023-10-06T11:13:17.144097+0000","last_peered":"2023-10-06T11:13:17.144097+0000","last_clean":"2023-10-06T11:13:17.144097+0000","last_became_active":"2023-10-06T11:13:13.126088+0000","last_became_peered":"2023-10-06T11:13:13.126088+0000","last_unstale":"2023-10-06T11:13:17.144097+0000","last_undegraded":"2023-10-06T11:13:17.144097+0000","last_fullsized":"2023-10-06T11:13:17.144097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:20.523798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137234+0000","last_change":"2023-10-06T11:13:13.123624+0000","last_active":"2023-10-06T11:13:17.137234+0000","last_peered":"2023-10-06T11:13:17.137234+0000","last_clean":"2023-10-06T11:13:17.137234+0000","last_became_active":"2023-10-06T11:13:13.123377+0000","last_became_peered":"2023-10-06T11:13:13.123377+0000","last_unstale":"2023-10-06T11:13:17.137234+0000","last_undegraded":"2023-10-06T11:13:17.137234+0000","last_fullsized":"2023-10-06T11:13:17.137234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:10.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143778+0000","last_change":"2023-10-06T11:13:13.122220+0000","last_active":"2023-10-06T11:13:17.143778+0000","last_peered":"2023-10-06T11:13:17.143778+0000","last_clean":"2023-10-06T11:13:17.143778+0000","last_became_active":"2023-10-06T11:13:13.121971+0000","last_became_peered":"2023-10-06T11:13:13.121971+0000","last_unstale":"2023-10-06T11:13:17.143778+0000","last_undegraded":"2023-10-06T11:13:17.143778+0000","last_fullsized":"2023-10-06T11:13:17.143778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.288774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148367+0000","last_change":"2023-10-06T11:13:13.130138+0000","last_active":"2023-10-06T11:13:17.148367+0000","last_peered":"2023-10-06T11:13:17.148367+0000","last_clean":"2023-10-06T11:13:17.148367+0000","last_became_active":"2023-10-06T11:13:13.129957+0000","last_became_peered":"2023-10-06T11:13:13.129957+0000","last_unstale":"2023-10-06T11:13:17.148367+0000","last_undegraded":"2023-10-06T11:13:17.148367+0000","last_fullsized":"2023-10-06T11:13:17.148367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142383+0000","last_change":"2023-10-06T11:13:13.131599+0000","last_active":"2023-10-06T11:13:17.142383+0000","last_peered":"2023-10-06T11:13:17.142383+0000","last_clean":"2023-10-06T11:13:17.142383+0000","last_became_active":"2023-10-06T11:13:13.131351+0000","last_became_peered":"2023-10-06T11:13:13.131351+0000","last_unstale":"2023-10-06T11:13:17.142383+0000","last_undegraded":"2023-10-06T11:13:17.142383+0000","last_fullsized":"2023-10-06T11:13:17.142383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143350+0000","last_change":"2023-10-06T11:13:13.120698+0000","last_active":"2023-10-06T11:13:17.143350+0000","last_peered":"2023-10-06T11:13:17.143350+0000","last_clean":"2023-10-06T11:13:17.143350+0000","last_became_active":"2023-10-06T11:13:13.120409+0000","last_became_peered":"2023-10-06T11:13:13.120409+0000","last_unstale":"2023-10-06T11:13:17.143350+0000","last_undegraded":"2023-10-06T11:13:17.143350+0000","last_fullsized":"2023-10-06T11:13:17.143350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147544+0000","last_change":"2023-10-06T11:13:13.125155+0000","last_active":"2023-10-06T11:13:17.147544+0000","last_peered":"2023-10-06T11:13:17.147544+0000","last_clean":"2023-10-06T11:13:17.147544+0000","last_became_active":"2023-10-06T11:13:13.124909+0000","last_became_peered":"2023-10-06T11:13:13.124909+0000","last_unstale":"2023-10-06T11:13:17.147544+0000","last_undegraded":"2023-10-06T11:13:17.147544+0000","last_fullsized":"2023-10-06T11:13:17.147544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151721+0000","last_change":"2023-10-06T11:13:13.126695+0000","last_active":"2023-10-06T11:13:17.151721+0000","last_peered":"2023-10-06T11:13:17.151721+0000","last_clean":"2023-10-06T11:13:17.151721+0000","last_became_active":"2023-10-06T11:13:13.126107+0000","last_became_peered":"2023-10-06T11:13:13.126107+0000","last_unstale":"2023-10-06T11:13:17.151721+0000","last_undegraded":"2023-10-06T11:13:17.151721+0000","last_fullsized":"2023-10-06T11:13:17.151721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152340+0000","last_change":"2023-10-06T11:13:13.127518+0000","last_active":"2023-10-06T11:13:17.152340+0000","last_peered":"2023-10-06T11:13:17.152340+0000","last_clean":"2023-10-06T11:13:17.152340+0000","last_became_active":"2023-10-06T11:13:13.127277+0000","last_became_peered":"2023-10-06T11:13:13.127277+0000","last_unstale":"2023-10-06T11:13:17.152340+0000","last_undegraded":"2023-10-06T11:13:17.152340+0000","last_fullsized":"2023-10-06T11:13:17.152340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:45.902476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152956+0000","last_change":"2023-10-06T11:13:13.122605+0000","last_active":"2023-10-06T11:13:17.152956+0000","last_peered":"2023-10-06T11:13:17.152956+0000","last_clean":"2023-10-06T11:13:17.152956+0000","last_became_active":"2023-10-06T11:13:13.122169+0000","last_became_peered":"2023-10-06T11:13:13.122169+0000","last_unstale":"2023-10-06T11:13:17.152956+0000","last_undegraded":"2023-10-06T11:13:17.152956+0000","last_fullsized":"2023-10-06T11:13:17.152956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160038+0000","last_change":"2023-10-06T11:13:17.156729+0000","last_active":"2023-10-06T11:13:17.160038+0000","last_peered":"2023-10-06T11:13:17.160038+0000","last_clean":"2023-10-06T11:13:17.160038+0000","last_became_active":"2023-10-06T11:13:17.156340+0000","last_became_peered":"2023-10-06T11:13:17.156340+0000","last_unstale":"2023-10-06T11:13:17.160038+0000","last_undegraded":"2023-10-06T11:13:17.160038+0000","last_fullsized":"2023-10-06T11:13:17.160038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:32.463267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144410+0000","last_change":"2023-10-06T11:13:12.110036+0000","last_active":"2023-10-06T11:13:17.144410+0000","last_peered":"2023-10-06T11:13:17.144410+0000","last_clean":"2023-10-06T11:13:17.144410+0000","last_became_active":"2023-10-06T11:13:12.109584+0000","last_became_peered":"2023-10-06T11:13:12.109584+0000","last_unstale":"2023-10-06T11:13:17.144410+0000","last_undegraded":"2023-10-06T11:13:17.144410+0000","last_fullsized":"2023-10-06T11:13:17.144410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144471+0000","last_change":"2023-10-06T11:13:13.128382+0000","last_active":"2023-10-06T11:13:17.144471+0000","last_peered":"2023-10-06T11:13:17.144471+0000","last_clean":"2023-10-06T11:13:17.144471+0000","last_became_active":"2023-10-06T11:13:13.128089+0000","last_became_peered":"2023-10-06T11:13:13.128089+0000","last_unstale":"2023-10-06T11:13:17.144471+0000","last_undegraded":"2023-10-06T11:13:17.144471+0000","last_fullsized":"2023-10-06T11:13:17.144471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162772+0000","last_change":"2023-10-06T11:13:17.157622+0000","last_active":"2023-10-06T11:13:17.162772+0000","last_peered":"2023-10-06T11:13:17.162772+0000","last_clean":"2023-10-06T11:13:17.162772+0000","last_became_active":"2023-10-06T11:13:17.157240+0000","last_became_peered":"2023-10-06T11:13:17.157240+0000","last_unstale":"2023-10-06T11:13:17.162772+0000","last_undegraded":"2023-10-06T11:13:17.162772+0000","last_fullsized":"2023-10-06T11:13:17.162772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:08.312759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151403+0000","last_change":"2023-10-06T11:13:12.115710+0000","last_active":"2023-10-06T11:13:17.151403+0000","last_peered":"2023-10-06T11:13:17.151403+0000","last_clean":"2023-10-06T11:13:17.151403+0000","last_became_active":"2023-10-06T11:13:12.115446+0000","last_became_peered":"2023-10-06T11:13:12.115446+0000","last_unstale":"2023-10-06T11:13:17.151403+0000","last_undegraded":"2023-10-06T11:13:17.151403+0000","last_fullsized":"2023-10-06T11:13:17.151403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142885+0000","last_change":"2023-10-06T11:13:13.125846+0000","last_active":"2023-10-06T11:13:17.142885+0000","last_peered":"2023-10-06T11:13:17.142885+0000","last_clean":"2023-10-06T11:13:17.142885+0000","last_became_active":"2023-10-06T11:13:13.125581+0000","last_became_peered":"2023-10-06T11:13:13.125581+0000","last_unstale":"2023-10-06T11:13:17.142885+0000","last_undegraded":"2023-10-06T11:13:17.142885+0000","last_fullsized":"2023-10-06T11:13:17.142885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162796+0000","last_change":"2023-10-06T11:13:17.156222+0000","last_active":"2023-10-06T11:13:17.162796+0000","last_peered":"2023-10-06T11:13:17.162796+0000","last_clean":"2023-10-06T11:13:17.162796+0000","last_became_active":"2023-10-06T11:13:17.155785+0000","last_became_peered":"2023-10-06T11:13:17.155785+0000","last_unstale":"2023-10-06T11:13:17.162796+0000","last_undegraded":"2023-10-06T11:13:17.162796+0000","last_fullsized":"2023-10-06T11:13:17.162796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144138+0000","last_change":"2023-10-06T11:13:12.104094+0000","last_active":"2023-10-06T11:13:17.144138+0000","last_peered":"2023-10-06T11:13:17.144138+0000","last_clean":"2023-10-06T11:13:17.144138+0000","last_became_active":"2023-10-06T11:13:12.103658+0000","last_became_peered":"2023-10-06T11:13:12.103658+0000","last_unstale":"2023-10-06T11:13:17.144138+0000","last_undegraded":"2023-10-06T11:13:17.144138+0000","last_fullsized":"2023-10-06T11:13:17.144138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144641+0000","last_change":"2023-10-06T11:13:13.122756+0000","last_active":"2023-10-06T11:13:17.144641+0000","last_peered":"2023-10-06T11:13:17.144641+0000","last_clean":"2023-10-06T11:13:17.144641+0000","last_became_active":"2023-10-06T11:13:13.122498+0000","last_became_peered":"2023-10-06T11:13:13.122498+0000","last_unstale":"2023-10-06T11:13:17.144641+0000","last_undegraded":"2023-10-06T11:13:17.144641+0000","last_fullsized":"2023-10-06T11:13:17.144641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:30.671094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160480+0000","last_change":"2023-10-06T11:13:17.156830+0000","last_active":"2023-10-06T11:13:17.160480+0000","last_peered":"2023-10-06T11:13:17.160480+0000","last_clean":"2023-10-06T11:13:17.160480+0000","last_became_active":"2023-10-06T11:13:17.156440+0000","last_became_peered":"2023-10-06T11:13:17.156440+0000","last_unstale":"2023-10-06T11:13:17.160480+0000","last_undegraded":"2023-10-06T11:13:17.160480+0000","last_fullsized":"2023-10-06T11:13:17.160480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:15.214081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145470+0000","last_change":"2023-10-06T11:13:12.107048+0000","last_active":"2023-10-06T11:13:17.145470+0000","last_peered":"2023-10-06T11:13:17.145470+0000","last_clean":"2023-10-06T11:13:17.145470+0000","last_became_active":"2023-10-06T11:13:12.103664+0000","last_became_peered":"2023-10-06T11:13:12.103664+0000","last_unstale":"2023-10-06T11:13:17.145470+0000","last_undegraded":"2023-10-06T11:13:17.145470+0000","last_fullsized":"2023-10-06T11:13:17.145470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144060+0000","last_change":"2023-10-06T11:13:13.134983+0000","last_active":"2023-10-06T11:13:17.144060+0000","last_peered":"2023-10-06T11:13:17.144060+0000","last_clean":"2023-10-06T11:13:17.144060+0000","last_became_active":"2023-10-06T11:13:13.134636+0000","last_became_peered":"2023-10-06T11:13:13.134636+0000","last_unstale":"2023-10-06T11:13:17.144060+0000","last_undegraded":"2023-10-06T11:13:17.144060+0000","last_fullsized":"2023-10-06T11:13:17.144060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161534+0000","last_change":"2023-10-06T11:13:17.158372+0000","last_active":"2023-10-06T11:13:17.161534+0000","last_peered":"2023-10-06T11:13:17.161534+0000","last_clean":"2023-10-06T11:13:17.161534+0000","last_became_active":"2023-10-06T11:13:17.157994+0000","last_became_peered":"2023-10-06T11:13:17.157994+0000","last_unstale":"2023-10-06T11:13:17.161534+0000","last_undegraded":"2023-10-06T11:13:17.161534+0000","last_fullsized":"2023-10-06T11:13:17.161534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:12.841649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155603+0000","last_change":"2023-10-06T11:13:12.112958+0000","last_active":"2023-10-06T11:13:17.155603+0000","last_peered":"2023-10-06T11:13:17.155603+0000","last_clean":"2023-10-06T11:13:17.155603+0000","last_became_active":"2023-10-06T11:13:12.112670+0000","last_became_peered":"2023-10-06T11:13:12.112670+0000","last_unstale":"2023-10-06T11:13:17.155603+0000","last_undegraded":"2023-10-06T11:13:17.155603+0000","last_fullsized":"2023-10-06T11:13:17.155603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:44.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143449+0000","last_change":"2023-10-06T11:13:13.126318+0000","last_active":"2023-10-06T11:13:17.143449+0000","last_peered":"2023-10-06T11:13:17.143449+0000","last_clean":"2023-10-06T11:13:17.143449+0000","last_became_active":"2023-10-06T11:13:13.126070+0000","last_became_peered":"2023-10-06T11:13:13.126070+0000","last_unstale":"2023-10-06T11:13:17.143449+0000","last_undegraded":"2023-10-06T11:13:17.143449+0000","last_fullsized":"2023-10-06T11:13:17.143449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166081+0000","last_change":"2023-10-06T11:13:17.162541+0000","last_active":"2023-10-06T11:13:17.166081+0000","last_peered":"2023-10-06T11:13:17.166081+0000","last_clean":"2023-10-06T11:13:17.166081+0000","last_became_active":"2023-10-06T11:13:17.162167+0000","last_became_peered":"2023-10-06T11:13:17.162167+0000","last_unstale":"2023-10-06T11:13:17.166081+0000","last_undegraded":"2023-10-06T11:13:17.166081+0000","last_fullsized":"2023-10-06T11:13:17.166081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148499+0000","last_change":"2023-10-06T11:13:12.115343+0000","last_active":"2023-10-06T11:13:17.148499+0000","last_peered":"2023-10-06T11:13:17.148499+0000","last_clean":"2023-10-06T11:13:17.148499+0000","last_became_active":"2023-10-06T11:13:12.115140+0000","last_became_peered":"2023-10-06T11:13:12.115140+0000","last_unstale":"2023-10-06T11:13:17.148499+0000","last_undegraded":"2023-10-06T11:13:17.148499+0000","last_fullsized":"2023-10-06T11:13:17.148499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:45:40.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150826+0000","last_change":"2023-10-06T11:13:13.130679+0000","last_active":"2023-10-06T11:13:17.150826+0000","last_peered":"2023-10-06T11:13:17.150826+0000","last_clean":"2023-10-06T11:13:17.150826+0000","last_became_active":"2023-10-06T11:13:13.130159+0000","last_became_peered":"2023-10-06T11:13:13.130159+0000","last_unstale":"2023-10-06T11:13:17.150826+0000","last_undegraded":"2023-10-06T11:13:17.150826+0000","last_fullsized":"2023-10-06T11:13:17.150826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170593+0000","last_change":"2023-10-06T11:13:17.164392+0000","last_active":"2023-10-06T11:13:17.170593+0000","last_peered":"2023-10-06T11:13:17.170593+0000","last_clean":"2023-10-06T11:13:17.170593+0000","last_became_active":"2023-10-06T11:13:17.164000+0000","last_became_peered":"2023-10-06T11:13:17.164000+0000","last_unstale":"2023-10-06T11:13:17.170593+0000","last_undegraded":"2023-10-06T11:13:17.170593+0000","last_fullsized":"2023-10-06T11:13:17.170593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:54.257356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:13:23.026636+0000","last_change":"2023-10-06T11:13:12.108372+0000","last_active":"2023-10-06T11:13:23.026636+0000","last_peered":"2023-10-06T11:13:23.026636+0000","last_clean":"2023-10-06T11:13:23.026636+0000","last_became_active":"2023-10-06T11:13:12.108083+0000","last_became_peered":"2023-10-06T11:13:12.108083+0000","last_unstale":"2023-10-06T11:13:23.026636+0000","last_undegraded":"2023-10-06T11:13:23.026636+0000","last_fullsized":"2023-10-06T11:13:23.026636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143470+0000","last_change":"2023-10-06T11:13:13.125601+0000","last_active":"2023-10-06T11:13:17.143470+0000","last_peered":"2023-10-06T11:13:17.143470+0000","last_clean":"2023-10-06T11:13:17.143470+0000","last_became_active":"2023-10-06T11:13:13.125279+0000","last_became_peered":"2023-10-06T11:13:13.125279+0000","last_unstale":"2023-10-06T11:13:17.143470+0000","last_undegraded":"2023-10-06T11:13:17.143470+0000","last_fullsized":"2023-10-06T11:13:17.143470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168209+0000","last_change":"2023-10-06T11:13:17.164677+0000","last_active":"2023-10-06T11:13:17.168209+0000","last_peered":"2023-10-06T11:13:17.168209+0000","last_clean":"2023-10-06T11:13:17.168209+0000","last_became_active":"2023-10-06T11:13:17.163312+0000","last_became_peered":"2023-10-06T11:13:17.163312+0000","last_unstale":"2023-10-06T11:13:17.168209+0000","last_undegraded":"2023-10-06T11:13:17.168209+0000","last_fullsized":"2023-10-06T11:13:17.168209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.042784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148271+0000","last_change":"2023-10-06T11:13:12.113019+0000","last_active":"2023-10-06T11:13:17.148271+0000","last_peered":"2023-10-06T11:13:17.148271+0000","last_clean":"2023-10-06T11:13:17.148271+0000","last_became_active":"2023-10-06T11:13:12.112717+0000","last_became_peered":"2023-10-06T11:13:12.112717+0000","last_unstale":"2023-10-06T11:13:17.148271+0000","last_undegraded":"2023-10-06T11:13:17.148271+0000","last_fullsized":"2023-10-06T11:13:17.148271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144893+0000","last_change":"2023-10-06T11:13:13.128297+0000","last_active":"2023-10-06T11:13:17.144893+0000","last_peered":"2023-10-06T11:13:17.144893+0000","last_clean":"2023-10-06T11:13:17.144893+0000","last_became_active":"2023-10-06T11:13:13.128026+0000","last_became_peered":"2023-10-06T11:13:13.128026+0000","last_unstale":"2023-10-06T11:13:17.144893+0000","last_undegraded":"2023-10-06T11:13:17.144893+0000","last_fullsized":"2023-10-06T11:13:17.144893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162240+0000","last_change":"2023-10-06T11:13:17.160008+0000","last_active":"2023-10-06T11:13:17.162240+0000","last_peered":"2023-10-06T11:13:17.162240+0000","last_clean":"2023-10-06T11:13:17.162240+0000","last_became_active":"2023-10-06T11:13:17.159069+0000","last_became_peered":"2023-10-06T11:13:17.159069+0000","last_unstale":"2023-10-06T11:13:17.162240+0000","last_undegraded":"2023-10-06T11:13:17.162240+0000","last_fullsized":"2023-10-06T11:13:17.162240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142294+0000","last_change":"2023-10-06T11:13:12.113312+0000","last_active":"2023-10-06T11:13:17.142294+0000","last_peered":"2023-10-06T11:13:17.142294+0000","last_clean":"2023-10-06T11:13:17.142294+0000","last_became_active":"2023-10-06T11:13:12.112955+0000","last_became_peered":"2023-10-06T11:13:12.112955+0000","last_unstale":"2023-10-06T11:13:17.142294+0000","last_undegraded":"2023-10-06T11:13:17.142294+0000","last_fullsized":"2023-10-06T11:13:17.142294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152870+0000","last_change":"2023-10-06T11:13:13.122429+0000","last_active":"2023-10-06T11:13:17.152870+0000","last_peered":"2023-10-06T11:13:17.152870+0000","last_clean":"2023-10-06T11:13:17.152870+0000","last_became_active":"2023-10-06T11:13:13.121817+0000","last_became_peered":"2023-10-06T11:13:13.121817+0000","last_unstale":"2023-10-06T11:13:17.152870+0000","last_undegraded":"2023-10-06T11:13:17.152870+0000","last_fullsized":"2023-10-06T11:13:17.152870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158460+0000","last_change":"2023-10-06T11:13:17.154826+0000","last_active":"2023-10-06T11:13:17.158460+0000","last_peered":"2023-10-06T11:13:17.158460+0000","last_clean":"2023-10-06T11:13:17.158460+0000","last_became_active":"2023-10-06T11:13:17.154408+0000","last_became_peered":"2023-10-06T11:13:17.154408+0000","last_unstale":"2023-10-06T11:13:17.158460+0000","last_undegraded":"2023-10-06T11:13:17.158460+0000","last_fullsized":"2023-10-06T11:13:17.158460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149376+0000","last_change":"2023-10-06T11:13:12.112186+0000","last_active":"2023-10-06T11:13:17.149376+0000","last_peered":"2023-10-06T11:13:17.149376+0000","last_clean":"2023-10-06T11:13:17.149376+0000","last_became_active":"2023-10-06T11:13:12.111804+0000","last_became_peered":"2023-10-06T11:13:12.111804+0000","last_unstale":"2023-10-06T11:13:17.149376+0000","last_undegraded":"2023-10-06T11:13:17.149376+0000","last_fullsized":"2023-10-06T11:13:17.149376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142984+0000","last_change":"2023-10-06T11:13:13.127356+0000","last_active":"2023-10-06T11:13:17.142984+0000","last_peered":"2023-10-06T11:13:17.142984+0000","last_clean":"2023-10-06T11:13:17.142984+0000","last_became_active":"2023-10-06T11:13:13.127081+0000","last_became_peered":"2023-10-06T11:13:13.127081+0000","last_unstale":"2023-10-06T11:13:17.142984+0000","last_undegraded":"2023-10-06T11:13:17.142984+0000","last_fullsized":"2023-10-06T11:13:17.142984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168186+0000","last_change":"2023-10-06T11:13:17.164977+0000","last_active":"2023-10-06T11:13:17.168186+0000","last_peered":"2023-10-06T11:13:17.168186+0000","last_clean":"2023-10-06T11:13:17.168186+0000","last_became_active":"2023-10-06T11:13:17.162985+0000","last_became_peered":"2023-10-06T11:13:17.162985+0000","last_unstale":"2023-10-06T11:13:17.168186+0000","last_undegraded":"2023-10-06T11:13:17.168186+0000","last_fullsized":"2023-10-06T11:13:17.168186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140804+0000","last_change":"2023-10-06T11:13:12.104093+0000","last_active":"2023-10-06T11:13:17.140804+0000","last_peered":"2023-10-06T11:13:17.140804+0000","last_clean":"2023-10-06T11:13:17.140804+0000","last_became_active":"2023-10-06T11:13:12.103822+0000","last_became_peered":"2023-10-06T11:13:12.103822+0000","last_unstale":"2023-10-06T11:13:17.140804+0000","last_undegraded":"2023-10-06T11:13:17.140804+0000","last_fullsized":"2023-10-06T11:13:17.140804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144546+0000","last_change":"2023-10-06T11:13:13.125356+0000","last_active":"2023-10-06T11:13:17.144546+0000","last_peered":"2023-10-06T11:13:17.144546+0000","last_clean":"2023-10-06T11:13:17.144546+0000","last_became_active":"2023-10-06T11:13:13.125067+0000","last_became_peered":"2023-10-06T11:13:13.125067+0000","last_unstale":"2023-10-06T11:13:17.144546+0000","last_undegraded":"2023-10-06T11:13:17.144546+0000","last_fullsized":"2023-10-06T11:13:17.144546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169071+0000","last_change":"2023-10-06T11:13:17.167108+0000","last_active":"2023-10-06T11:13:17.169071+0000","last_peered":"2023-10-06T11:13:17.169071+0000","last_clean":"2023-10-06T11:13:17.169071+0000","last_became_active":"2023-10-06T11:13:17.166687+0000","last_became_peered":"2023-10-06T11:13:17.166687+0000","last_unstale":"2023-10-06T11:13:17.169071+0000","last_undegraded":"2023-10-06T11:13:17.169071+0000","last_fullsized":"2023-10-06T11:13:17.169071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149299+0000","last_change":"2023-10-06T11:13:12.111301+0000","last_active":"2023-10-06T11:13:17.149299+0000","last_peered":"2023-10-06T11:13:17.149299+0000","last_clean":"2023-10-06T11:13:17.149299+0000","last_became_active":"2023-10-06T11:13:12.111017+0000","last_became_peered":"2023-10-06T11:13:12.111017+0000","last_unstale":"2023-10-06T11:13:17.149299+0000","last_undegraded":"2023-10-06T11:13:17.149299+0000","last_fullsized":"2023-10-06T11:13:17.149299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150481+0000","last_change":"2023-10-06T11:13:13.122154+0000","last_active":"2023-10-06T11:13:17.150481+0000","last_peered":"2023-10-06T11:13:17.150481+0000","last_clean":"2023-10-06T11:13:17.150481+0000","last_became_active":"2023-10-06T11:13:13.121877+0000","last_became_peered":"2023-10-06T11:13:13.121877+0000","last_unstale":"2023-10-06T11:13:17.150481+0000","last_undegraded":"2023-10-06T11:13:17.150481+0000","last_fullsized":"2023-10-06T11:13:17.150481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170404+0000","last_change":"2023-10-06T11:13:17.157370+0000","last_active":"2023-10-06T11:13:17.170404+0000","last_peered":"2023-10-06T11:13:17.170404+0000","last_clean":"2023-10-06T11:13:17.170404+0000","last_became_active":"2023-10-06T11:13:17.156962+0000","last_became_peered":"2023-10-06T11:13:17.156962+0000","last_unstale":"2023-10-06T11:13:17.170404+0000","last_undegraded":"2023-10-06T11:13:17.170404+0000","last_fullsized":"2023-10-06T11:13:17.170404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:24.566268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148959+0000","last_change":"2023-10-06T11:13:12.113489+0000","last_active":"2023-10-06T11:13:17.148959+0000","last_peered":"2023-10-06T11:13:17.148959+0000","last_clean":"2023-10-06T11:13:17.148959+0000","last_became_active":"2023-10-06T11:13:12.113057+0000","last_became_peered":"2023-10-06T11:13:12.113057+0000","last_unstale":"2023-10-06T11:13:17.148959+0000","last_undegraded":"2023-10-06T11:13:17.148959+0000","last_fullsized":"2023-10-06T11:13:17.148959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142803+0000","last_change":"2023-10-06T11:13:13.120468+0000","last_active":"2023-10-06T11:13:17.142803+0000","last_peered":"2023-10-06T11:13:17.142803+0000","last_clean":"2023-10-06T11:13:17.142803+0000","last_became_active":"2023-10-06T11:13:13.120185+0000","last_became_peered":"2023-10-06T11:13:13.120185+0000","last_unstale":"2023-10-06T11:13:17.142803+0000","last_undegraded":"2023-10-06T11:13:17.142803+0000","last_fullsized":"2023-10-06T11:13:17.142803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:50.214886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171097+0000","last_change":"2023-10-06T11:13:17.164354+0000","last_active":"2023-10-06T11:13:17.171097+0000","last_peered":"2023-10-06T11:13:17.171097+0000","last_clean":"2023-10-06T11:13:17.171097+0000","last_became_active":"2023-10-06T11:13:17.163963+0000","last_became_peered":"2023-10-06T11:13:17.163963+0000","last_unstale":"2023-10-06T11:13:17.171097+0000","last_undegraded":"2023-10-06T11:13:17.171097+0000","last_fullsized":"2023-10-06T11:13:17.171097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.560835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148674+0000","last_change":"2023-10-06T11:13:12.106817+0000","last_active":"2023-10-06T11:13:17.148674+0000","last_peered":"2023-10-06T11:13:17.148674+0000","last_clean":"2023-10-06T11:13:17.148674+0000","last_became_active":"2023-10-06T11:13:12.106511+0000","last_became_peered":"2023-10-06T11:13:12.106511+0000","last_unstale":"2023-10-06T11:13:17.148674+0000","last_undegraded":"2023-10-06T11:13:17.148674+0000","last_fullsized":"2023-10-06T11:13:17.148674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:43.294693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142595+0000","last_change":"2023-10-06T11:13:13.131680+0000","last_active":"2023-10-06T11:13:17.142595+0000","last_peered":"2023-10-06T11:13:17.142595+0000","last_clean":"2023-10-06T11:13:17.142595+0000","last_became_active":"2023-10-06T11:13:13.131450+0000","last_became_peered":"2023-10-06T11:13:13.131450+0000","last_unstale":"2023-10-06T11:13:17.142595+0000","last_undegraded":"2023-10-06T11:13:17.142595+0000","last_fullsized":"2023-10-06T11:13:17.142595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:57.893509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170226+0000","last_change":"2023-10-06T11:13:17.157797+0000","last_active":"2023-10-06T11:13:17.170226+0000","last_peered":"2023-10-06T11:13:17.170226+0000","last_clean":"2023-10-06T11:13:17.170226+0000","last_became_active":"2023-10-06T11:13:17.156392+0000","last_became_peered":"2023-10-06T11:13:17.156392+0000","last_unstale":"2023-10-06T11:13:17.170226+0000","last_undegraded":"2023-10-06T11:13:17.170226+0000","last_fullsized":"2023-10-06T11:13:17.170226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:34.331244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149920+0000","last_change":"2023-10-06T11:13:12.101059+0000","last_active":"2023-10-06T11:13:17.149920+0000","last_peered":"2023-10-06T11:13:17.149920+0000","last_clean":"2023-10-06T11:13:17.149920+0000","last_became_active":"2023-10-06T11:13:12.100794+0000","last_became_peered":"2023-10-06T11:13:12.100794+0000","last_unstale":"2023-10-06T11:13:17.149920+0000","last_undegraded":"2023-10-06T11:13:17.149920+0000","last_fullsized":"2023-10-06T11:13:17.149920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143540+0000","last_change":"2023-10-06T11:13:13.131631+0000","last_active":"2023-10-06T11:13:17.143540+0000","last_peered":"2023-10-06T11:13:17.143540+0000","last_clean":"2023-10-06T11:13:17.143540+0000","last_became_active":"2023-10-06T11:13:13.131335+0000","last_became_peered":"2023-10-06T11:13:13.131335+0000","last_unstale":"2023-10-06T11:13:17.143540+0000","last_undegraded":"2023-10-06T11:13:17.143540+0000","last_fullsized":"2023-10-06T11:13:17.143540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170967+0000","last_change":"2023-10-06T11:13:17.161179+0000","last_active":"2023-10-06T11:13:17.170967+0000","last_peered":"2023-10-06T11:13:17.170967+0000","last_clean":"2023-10-06T11:13:17.170967+0000","last_became_active":"2023-10-06T11:13:17.160718+0000","last_became_peered":"2023-10-06T11:13:17.160718+0000","last_unstale":"2023-10-06T11:13:17.170967+0000","last_undegraded":"2023-10-06T11:13:17.170967+0000","last_fullsized":"2023-10-06T11:13:17.170967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.264892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143812+0000","last_change":"2023-10-06T11:13:12.112814+0000","last_active":"2023-10-06T11:13:17.143812+0000","last_peered":"2023-10-06T11:13:17.143812+0000","last_clean":"2023-10-06T11:13:17.143812+0000","last_became_active":"2023-10-06T11:13:12.112493+0000","last_became_peered":"2023-10-06T11:13:12.112493+0000","last_unstale":"2023-10-06T11:13:17.143812+0000","last_undegraded":"2023-10-06T11:13:17.143812+0000","last_fullsized":"2023-10-06T11:13:17.143812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143590+0000","last_change":"2023-10-06T11:13:13.116701+0000","last_active":"2023-10-06T11:13:17.143590+0000","last_peered":"2023-10-06T11:13:17.143590+0000","last_clean":"2023-10-06T11:13:17.143590+0000","last_became_active":"2023-10-06T11:13:13.116422+0000","last_became_peered":"2023-10-06T11:13:13.116422+0000","last_unstale":"2023-10-06T11:13:17.143590+0000","last_undegraded":"2023-10-06T11:13:17.143590+0000","last_fullsized":"2023-10-06T11:13:17.143590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170427+0000","last_change":"2023-10-06T11:13:17.162887+0000","last_active":"2023-10-06T11:13:17.170427+0000","last_peered":"2023-10-06T11:13:17.170427+0000","last_clean":"2023-10-06T11:13:17.170427+0000","last_became_active":"2023-10-06T11:13:17.162489+0000","last_became_peered":"2023-10-06T11:13:17.162489+0000","last_unstale":"2023-10-06T11:13:17.170427+0000","last_undegraded":"2023-10-06T11:13:17.170427+0000","last_fullsized":"2023-10-06T11:13:17.170427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142694+0000","last_change":"2023-10-06T11:13:12.108134+0000","last_active":"2023-10-06T11:13:17.142694+0000","last_peered":"2023-10-06T11:13:17.142694+0000","last_clean":"2023-10-06T11:13:17.142694+0000","last_became_active":"2023-10-06T11:13:12.107878+0000","last_became_peered":"2023-10-06T11:13:12.107878+0000","last_unstale":"2023-10-06T11:13:17.142694+0000","last_undegraded":"2023-10-06T11:13:17.142694+0000","last_fullsized":"2023-10-06T11:13:17.142694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:12.218554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144703+0000","last_change":"2023-10-06T11:13:13.118848+0000","last_active":"2023-10-06T11:13:17.144703+0000","last_peered":"2023-10-06T11:13:17.144703+0000","last_clean":"2023-10-06T11:13:17.144703+0000","last_became_active":"2023-10-06T11:13:13.118542+0000","last_became_peered":"2023-10-06T11:13:13.118542+0000","last_unstale":"2023-10-06T11:13:17.144703+0000","last_undegraded":"2023-10-06T11:13:17.144703+0000","last_fullsized":"2023-10-06T11:13:17.144703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.172331+0000","last_change":"2023-10-06T11:13:17.171309+0000","last_active":"2023-10-06T11:13:17.172331+0000","last_peered":"2023-10-06T11:13:17.172331+0000","last_clean":"2023-10-06T11:13:17.172331+0000","last_became_active":"2023-10-06T11:13:17.170940+0000","last_became_peered":"2023-10-06T11:13:17.170940+0000","last_unstale":"2023-10-06T11:13:17.172331+0000","last_undegraded":"2023-10-06T11:13:17.172331+0000","last_fullsized":"2023-10-06T11:13:17.172331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:04:35.275309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:12.110981+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:12.110564+0000","last_became_peered":"2023-10-06T11:13:12.110564+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144182+0000","last_change":"2023-10-06T11:13:13.122172+0000","last_active":"2023-10-06T11:13:17.144182+0000","last_peered":"2023-10-06T11:13:17.144182+0000","last_clean":"2023-10-06T11:13:17.144182+0000","last_became_active":"2023-10-06T11:13:13.121871+0000","last_became_peered":"2023-10-06T11:13:13.121871+0000","last_unstale":"2023-10-06T11:13:17.144182+0000","last_undegraded":"2023-10-06T11:13:17.144182+0000","last_fullsized":"2023-10-06T11:13:17.144182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169382+0000","last_change":"2023-10-06T11:13:17.164730+0000","last_active":"2023-10-06T11:13:17.169382+0000","last_peered":"2023-10-06T11:13:17.169382+0000","last_clean":"2023-10-06T11:13:17.169382+0000","last_became_active":"2023-10-06T11:13:17.163984+0000","last_became_peered":"2023-10-06T11:13:17.163984+0000","last_unstale":"2023-10-06T11:13:17.169382+0000","last_undegraded":"2023-10-06T11:13:17.169382+0000","last_fullsized":"2023-10-06T11:13:17.169382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:35.906494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143988+0000","last_change":"2023-10-06T11:13:12.114698+0000","last_active":"2023-10-06T11:13:17.143988+0000","last_peered":"2023-10-06T11:13:17.143988+0000","last_clean":"2023-10-06T11:13:17.143988+0000","last_became_active":"2023-10-06T11:13:12.114434+0000","last_became_peered":"2023-10-06T11:13:12.114434+0000","last_unstale":"2023-10-06T11:13:17.143988+0000","last_undegraded":"2023-10-06T11:13:17.143988+0000","last_fullsized":"2023-10-06T11:13:17.143988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151901+0000","last_change":"2023-10-06T11:13:13.134982+0000","last_active":"2023-10-06T11:13:17.151901+0000","last_peered":"2023-10-06T11:13:17.151901+0000","last_clean":"2023-10-06T11:13:17.151901+0000","last_became_active":"2023-10-06T11:13:13.134682+0000","last_became_peered":"2023-10-06T11:13:13.134682+0000","last_unstale":"2023-10-06T11:13:17.151901+0000","last_undegraded":"2023-10-06T11:13:17.151901+0000","last_fullsized":"2023-10-06T11:13:17.151901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.165861+0000","last_change":"2023-10-06T11:13:17.163360+0000","last_active":"2023-10-06T11:13:17.165861+0000","last_peered":"2023-10-06T11:13:17.165861+0000","last_clean":"2023-10-06T11:13:17.165861+0000","last_became_active":"2023-10-06T11:13:17.162962+0000","last_became_peered":"2023-10-06T11:13:17.162962+0000","last_unstale":"2023-10-06T11:13:17.165861+0000","last_undegraded":"2023-10-06T11:13:17.165861+0000","last_fullsized":"2023-10-06T11:13:17.165861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151036+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:13:17.151036+0000","last_peered":"2023-10-06T11:13:17.151036+0000","last_clean":"2023-10-06T11:13:17.151036+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:13:17.151036+0000","last_undegraded":"2023-10-06T11:13:17.151036+0000","last_fullsized":"2023-10-06T11:13:17.151036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152775+0000","last_change":"2023-10-06T11:13:12.104620+0000","last_active":"2023-10-06T11:13:17.152775+0000","last_peered":"2023-10-06T11:13:17.152775+0000","last_clean":"2023-10-06T11:13:17.152775+0000","last_became_active":"2023-10-06T11:13:12.104355+0000","last_became_peered":"2023-10-06T11:13:12.104355+0000","last_unstale":"2023-10-06T11:13:17.152775+0000","last_undegraded":"2023-10-06T11:13:17.152775+0000","last_fullsized":"2023-10-06T11:13:17.152775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150736+0000","last_change":"2023-10-06T11:13:13.130493+0000","last_active":"2023-10-06T11:13:17.150736+0000","last_peered":"2023-10-06T11:13:17.150736+0000","last_clean":"2023-10-06T11:13:17.150736+0000","last_became_active":"2023-10-06T11:13:13.129849+0000","last_became_peered":"2023-10-06T11:13:13.129849+0000","last_unstale":"2023-10-06T11:13:17.150736+0000","last_undegraded":"2023-10-06T11:13:17.150736+0000","last_fullsized":"2023-10-06T11:13:17.150736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162543+0000","last_change":"2023-10-06T11:13:17.157136+0000","last_active":"2023-10-06T11:13:17.162543+0000","last_peered":"2023-10-06T11:13:17.162543+0000","last_clean":"2023-10-06T11:13:17.162543+0000","last_became_active":"2023-10-06T11:13:17.156751+0000","last_became_peered":"2023-10-06T11:13:17.156751+0000","last_unstale":"2023-10-06T11:13:17.162543+0000","last_undegraded":"2023-10-06T11:13:17.162543+0000","last_fullsized":"2023-10-06T11:13:17.162543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154906+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:13:17.154906+0000","last_peered":"2023-10-06T11:13:17.154906+0000","last_clean":"2023-10-06T11:13:17.154906+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:13:17.154906+0000","last_undegraded":"2023-10-06T11:13:17.154906+0000","last_fullsized":"2023-10-06T11:13:17.154906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143311+0000","last_change":"2023-10-06T11:13:12.106188+0000","last_active":"2023-10-06T11:13:17.143311+0000","last_peered":"2023-10-06T11:13:17.143311+0000","last_clean":"2023-10-06T11:13:17.143311+0000","last_became_active":"2023-10-06T11:13:12.104759+0000","last_became_peered":"2023-10-06T11:13:12.104759+0000","last_unstale":"2023-10-06T11:13:17.143311+0000","last_undegraded":"2023-10-06T11:13:17.143311+0000","last_fullsized":"2023-10-06T11:13:17.143311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150950+0000","last_change":"2023-10-06T11:13:13.129472+0000","last_active":"2023-10-06T11:13:17.150950+0000","last_peered":"2023-10-06T11:13:17.150950+0000","last_clean":"2023-10-06T11:13:17.150950+0000","last_became_active":"2023-10-06T11:13:13.129098+0000","last_became_peered":"2023-10-06T11:13:13.129098+0000","last_unstale":"2023-10-06T11:13:17.150950+0000","last_undegraded":"2023-10-06T11:13:17.150950+0000","last_fullsized":"2023-10-06T11:13:17.150950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:48.407971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171118+0000","last_change":"2023-10-06T11:13:17.165728+0000","last_active":"2023-10-06T11:13:17.171118+0000","last_peered":"2023-10-06T11:13:17.171118+0000","last_clean":"2023-10-06T11:13:17.171118+0000","last_became_active":"2023-10-06T11:13:17.165346+0000","last_became_peered":"2023-10-06T11:13:17.165346+0000","last_unstale":"2023-10-06T11:13:17.171118+0000","last_undegraded":"2023-10-06T11:13:17.171118+0000","last_fullsized":"2023-10-06T11:13:17.171118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:50.894918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136729+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:13:17.136729+0000","last_peered":"2023-10-06T11:13:17.136729+0000","last_clean":"2023-10-06T11:13:17.136729+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:13:17.136729+0000","last_undegraded":"2023-10-06T11:13:17.136729+0000","last_fullsized":"2023-10-06T11:13:17.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152088+0000","last_change":"2023-10-06T11:13:12.113344+0000","last_active":"2023-10-06T11:13:17.152088+0000","last_peered":"2023-10-06T11:13:17.152088+0000","last_clean":"2023-10-06T11:13:17.152088+0000","last_became_active":"2023-10-06T11:13:12.113058+0000","last_became_peered":"2023-10-06T11:13:12.113058+0000","last_unstale":"2023-10-06T11:13:17.152088+0000","last_undegraded":"2023-10-06T11:13:17.152088+0000","last_fullsized":"2023-10-06T11:13:17.152088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151812+0000","last_change":"2023-10-06T11:13:13.126878+0000","last_active":"2023-10-06T11:13:17.151812+0000","last_peered":"2023-10-06T11:13:17.151812+0000","last_clean":"2023-10-06T11:13:17.151812+0000","last_became_active":"2023-10-06T11:13:13.126442+0000","last_became_peered":"2023-10-06T11:13:13.126442+0000","last_unstale":"2023-10-06T11:13:17.151812+0000","last_undegraded":"2023-10-06T11:13:17.151812+0000","last_fullsized":"2023-10-06T11:13:17.151812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:18.891306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168046+0000","last_change":"2023-10-06T11:13:17.162293+0000","last_active":"2023-10-06T11:13:17.168046+0000","last_peered":"2023-10-06T11:13:17.168046+0000","last_clean":"2023-10-06T11:13:17.168046+0000","last_became_active":"2023-10-06T11:13:17.161704+0000","last_became_peered":"2023-10-06T11:13:17.161704+0000","last_unstale":"2023-10-06T11:13:17.168046+0000","last_undegraded":"2023-10-06T11:13:17.168046+0000","last_fullsized":"2023-10-06T11:13:17.168046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:33.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154038+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:13:17.154038+0000","last_peered":"2023-10-06T11:13:17.154038+0000","last_clean":"2023-10-06T11:13:17.154038+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:13:17.154038+0000","last_undegraded":"2023-10-06T11:13:17.154038+0000","last_fullsized":"2023-10-06T11:13:17.154038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147427+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:13:17.147427+0000","last_peered":"2023-10-06T11:13:17.147427+0000","last_clean":"2023-10-06T11:13:17.147427+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:13:17.147427+0000","last_undegraded":"2023-10-06T11:13:17.147427+0000","last_fullsized":"2023-10-06T11:13:17.147427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143336+0000","last_change":"2023-10-06T11:13:12.105541+0000","last_active":"2023-10-06T11:13:17.143336+0000","last_peered":"2023-10-06T11:13:17.143336+0000","last_clean":"2023-10-06T11:13:17.143336+0000","last_became_active":"2023-10-06T11:13:12.105235+0000","last_became_peered":"2023-10-06T11:13:12.105235+0000","last_unstale":"2023-10-06T11:13:17.143336+0000","last_undegraded":"2023-10-06T11:13:17.143336+0000","last_fullsized":"2023-10-06T11:13:17.143336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140757+0000","last_change":"2023-10-06T11:13:13.123658+0000","last_active":"2023-10-06T11:13:17.140757+0000","last_peered":"2023-10-06T11:13:17.140757+0000","last_clean":"2023-10-06T11:13:17.140757+0000","last_became_active":"2023-10-06T11:13:13.123381+0000","last_became_peered":"2023-10-06T11:13:13.123381+0000","last_unstale":"2023-10-06T11:13:17.140757+0000","last_undegraded":"2023-10-06T11:13:17.140757+0000","last_fullsized":"2023-10-06T11:13:17.140757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:17.061401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.167581+0000","last_change":"2023-10-06T11:13:17.164198+0000","last_active":"2023-10-06T11:13:17.167581+0000","last_peered":"2023-10-06T11:13:17.167581+0000","last_clean":"2023-10-06T11:13:17.167581+0000","last_became_active":"2023-10-06T11:13:17.163841+0000","last_became_peered":"2023-10-06T11:13:17.163841+0000","last_unstale":"2023-10-06T11:13:17.167581+0000","last_undegraded":"2023-10-06T11:13:17.167581+0000","last_fullsized":"2023-10-06T11:13:17.167581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:25:37.062632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147593+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:13:17.147593+0000","last_peered":"2023-10-06T11:13:17.147593+0000","last_clean":"2023-10-06T11:13:17.147593+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:13:17.147593+0000","last_undegraded":"2023-10-06T11:13:17.147593+0000","last_fullsized":"2023-10-06T11:13:17.147593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142083+0000","last_change":"2023-10-06T11:13:12.110086+0000","last_active":"2023-10-06T11:13:17.142083+0000","last_peered":"2023-10-06T11:13:17.142083+0000","last_clean":"2023-10-06T11:13:17.142083+0000","last_became_active":"2023-10-06T11:13:12.109735+0000","last_became_peered":"2023-10-06T11:13:12.109735+0000","last_unstale":"2023-10-06T11:13:17.142083+0000","last_undegraded":"2023-10-06T11:13:17.142083+0000","last_fullsized":"2023-10-06T11:13:17.142083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142662+0000","last_change":"2023-10-06T11:13:13.131401+0000","last_active":"2023-10-06T11:13:17.142662+0000","last_peered":"2023-10-06T11:13:17.142662+0000","last_clean":"2023-10-06T11:13:17.142662+0000","last_became_active":"2023-10-06T11:13:13.131126+0000","last_became_peered":"2023-10-06T11:13:13.131126+0000","last_unstale":"2023-10-06T11:13:17.142662+0000","last_undegraded":"2023-10-06T11:13:17.142662+0000","last_fullsized":"2023-10-06T11:13:17.142662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.164232+0000","last_change":"2023-10-06T11:13:17.161961+0000","last_active":"2023-10-06T11:13:17.164232+0000","last_peered":"2023-10-06T11:13:17.164232+0000","last_clean":"2023-10-06T11:13:17.164232+0000","last_became_active":"2023-10-06T11:13:17.161594+0000","last_became_peered":"2023-10-06T11:13:17.161594+0000","last_unstale":"2023-10-06T11:13:17.164232+0000","last_undegraded":"2023-10-06T11:13:17.164232+0000","last_fullsized":"2023-10-06T11:13:17.164232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:37.366244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148583+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:13:17.148583+0000","last_peered":"2023-10-06T11:13:17.148583+0000","last_clean":"2023-10-06T11:13:17.148583+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:13:17.148583+0000","last_undegraded":"2023-10-06T11:13:17.148583+0000","last_fullsized":"2023-10-06T11:13:17.148583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151224+0000","last_change":"2023-10-06T11:13:12.113488+0000","last_active":"2023-10-06T11:13:17.151224+0000","last_peered":"2023-10-06T11:13:17.151224+0000","last_clean":"2023-10-06T11:13:17.151224+0000","last_became_active":"2023-10-06T11:13:12.113184+0000","last_became_peered":"2023-10-06T11:13:12.113184+0000","last_unstale":"2023-10-06T11:13:17.151224+0000","last_undegraded":"2023-10-06T11:13:17.151224+0000","last_fullsized":"2023-10-06T11:13:17.151224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142862+0000","last_change":"2023-10-06T11:13:13.122337+0000","last_active":"2023-10-06T11:13:17.142862+0000","last_peered":"2023-10-06T11:13:17.142862+0000","last_clean":"2023-10-06T11:13:17.142862+0000","last_became_active":"2023-10-06T11:13:13.122081+0000","last_became_peered":"2023-10-06T11:13:13.122081+0000","last_unstale":"2023-10-06T11:13:17.142862+0000","last_undegraded":"2023-10-06T11:13:17.142862+0000","last_fullsized":"2023-10-06T11:13:17.142862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:45.496026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166873+0000","last_change":"2023-10-06T11:13:17.157514+0000","last_active":"2023-10-06T11:13:17.166873+0000","last_peered":"2023-10-06T11:13:17.166873+0000","last_clean":"2023-10-06T11:13:17.166873+0000","last_became_active":"2023-10-06T11:13:17.157113+0000","last_became_peered":"2023-10-06T11:13:17.157113+0000","last_unstale":"2023-10-06T11:13:17.166873+0000","last_undegraded":"2023-10-06T11:13:17.166873+0000","last_fullsized":"2023-10-06T11:13:17.166873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:21:57.844604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144634+0000","last_change":"2023-10-06T11:13:12.117257+0000","last_active":"2023-10-06T11:13:17.144634+0000","last_peered":"2023-10-06T11:13:17.144634+0000","last_clean":"2023-10-06T11:13:17.144634+0000","last_became_active":"2023-10-06T11:13:12.116987+0000","last_became_peered":"2023-10-06T11:13:12.116987+0000","last_unstale":"2023-10-06T11:13:17.144634+0000","last_undegraded":"2023-10-06T11:13:17.144634+0000","last_fullsized":"2023-10-06T11:13:17.144634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152020+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:13:17.152020+0000","last_peered":"2023-10-06T11:13:17.152020+0000","last_clean":"2023-10-06T11:13:17.152020+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:13:17.152020+0000","last_undegraded":"2023-10-06T11:13:17.152020+0000","last_fullsized":"2023-10-06T11:13:17.152020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143909+0000","last_change":"2023-10-06T11:13:13.129882+0000","last_active":"2023-10-06T11:13:17.143909+0000","last_peered":"2023-10-06T11:13:17.143909+0000","last_clean":"2023-10-06T11:13:17.143909+0000","last_became_active":"2023-10-06T11:13:13.129592+0000","last_became_peered":"2023-10-06T11:13:13.129592+0000","last_unstale":"2023-10-06T11:13:17.143909+0000","last_undegraded":"2023-10-06T11:13:17.143909+0000","last_fullsized":"2023-10-06T11:13:17.143909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158501+0000","last_change":"2023-10-06T11:13:17.156066+0000","last_active":"2023-10-06T11:13:17.158501+0000","last_peered":"2023-10-06T11:13:17.158501+0000","last_clean":"2023-10-06T11:13:17.158501+0000","last_became_active":"2023-10-06T11:13:17.155623+0000","last_became_peered":"2023-10-06T11:13:17.155623+0000","last_unstale":"2023-10-06T11:13:17.158501+0000","last_undegraded":"2023-10-06T11:13:17.158501+0000","last_fullsized":"2023-10-06T11:13:17.158501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:42.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144618+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:13:17.144618+0000","last_peered":"2023-10-06T11:13:17.144618+0000","last_clean":"2023-10-06T11:13:17.144618+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:13:17.144618+0000","last_undegraded":"2023-10-06T11:13:17.144618+0000","last_fullsized":"2023-10-06T11:13:17.144618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168135+0000","last_change":"2023-10-06T11:13:12.109073+0000","last_active":"2023-10-06T11:13:17.168135+0000","last_peered":"2023-10-06T11:13:17.168135+0000","last_clean":"2023-10-06T11:13:17.168135+0000","last_became_active":"2023-10-06T11:13:12.108687+0000","last_became_peered":"2023-10-06T11:13:12.108687+0000","last_unstale":"2023-10-06T11:13:17.168135+0000","last_undegraded":"2023-10-06T11:13:17.168135+0000","last_fullsized":"2023-10-06T11:13:17.168135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142725+0000","last_change":"2023-10-06T11:13:13.113909+0000","last_active":"2023-10-06T11:13:17.142725+0000","last_peered":"2023-10-06T11:13:17.142725+0000","last_clean":"2023-10-06T11:13:17.142725+0000","last_became_active":"2023-10-06T11:13:13.113579+0000","last_became_peered":"2023-10-06T11:13:13.113579+0000","last_unstale":"2023-10-06T11:13:17.142725+0000","last_undegraded":"2023-10-06T11:13:17.142725+0000","last_fullsized":"2023-10-06T11:13:17.142725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170450+0000","last_change":"2023-10-06T11:13:17.164311+0000","last_active":"2023-10-06T11:13:17.170450+0000","last_peered":"2023-10-06T11:13:17.170450+0000","last_clean":"2023-10-06T11:13:17.170450+0000","last_became_active":"2023-10-06T11:13:17.159765+0000","last_became_peered":"2023-10-06T11:13:17.159765+0000","last_unstale":"2023-10-06T11:13:17.170450+0000","last_undegraded":"2023-10-06T11:13:17.170450+0000","last_fullsized":"2023-10-06T11:13:17.170450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145036+0000","last_change":"2023-10-06T11:13:12.108063+0000","last_active":"2023-10-06T11:13:17.145036+0000","last_peered":"2023-10-06T11:13:17.145036+0000","last_clean":"2023-10-06T11:13:17.145036+0000","last_became_active":"2023-10-06T11:13:12.107787+0000","last_became_peered":"2023-10-06T11:13:12.107787+0000","last_unstale":"2023-10-06T11:13:17.145036+0000","last_undegraded":"2023-10-06T11:13:17.145036+0000","last_fullsized":"2023-10-06T11:13:17.145036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137088+0000","last_change":"2023-10-06T11:13:13.128167+0000","last_active":"2023-10-06T11:13:17.137088+0000","last_peered":"2023-10-06T11:13:17.137088+0000","last_clean":"2023-10-06T11:13:17.137088+0000","last_became_active":"2023-10-06T11:13:13.127699+0000","last_became_peered":"2023-10-06T11:13:13.127699+0000","last_unstale":"2023-10-06T11:13:17.137088+0000","last_undegraded":"2023-10-06T11:13:17.137088+0000","last_fullsized":"2023-10-06T11:13:17.137088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:49.518740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161638+0000","last_change":"2023-10-06T11:13:17.158623+0000","last_active":"2023-10-06T11:13:17.161638+0000","last_peered":"2023-10-06T11:13:17.161638+0000","last_clean":"2023-10-06T11:13:17.161638+0000","last_became_active":"2023-10-06T11:13:17.158283+0000","last_became_peered":"2023-10-06T11:13:17.158283+0000","last_unstale":"2023-10-06T11:13:17.161638+0000","last_undegraded":"2023-10-06T11:13:17.161638+0000","last_fullsized":"2023-10-06T11:13:17.161638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150057+0000","last_change":"2023-10-06T11:13:12.105330+0000","last_active":"2023-10-06T11:13:17.150057+0000","last_peered":"2023-10-06T11:13:17.150057+0000","last_clean":"2023-10-06T11:13:17.150057+0000","last_became_active":"2023-10-06T11:13:12.104918+0000","last_became_peered":"2023-10-06T11:13:12.104918+0000","last_unstale":"2023-10-06T11:13:17.150057+0000","last_undegraded":"2023-10-06T11:13:17.150057+0000","last_fullsized":"2023-10-06T11:13:17.150057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143214+0000","last_change":"2023-10-06T11:13:13.113277+0000","last_active":"2023-10-06T11:13:17.143214+0000","last_peered":"2023-10-06T11:13:17.143214+0000","last_clean":"2023-10-06T11:13:17.143214+0000","last_became_active":"2023-10-06T11:13:13.112996+0000","last_became_peered":"2023-10-06T11:13:13.112996+0000","last_unstale":"2023-10-06T11:13:17.143214+0000","last_undegraded":"2023-10-06T11:13:17.143214+0000","last_fullsized":"2023-10-06T11:13:17.143214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168692+0000","last_change":"2023-10-06T11:13:17.164841+0000","last_active":"2023-10-06T11:13:17.168692+0000","last_peered":"2023-10-06T11:13:17.168692+0000","last_clean":"2023-10-06T11:13:17.168692+0000","last_became_active":"2023-10-06T11:13:17.164169+0000","last_became_peered":"2023-10-06T11:13:17.164169+0000","last_unstale":"2023-10-06T11:13:17.168692+0000","last_undegraded":"2023-10-06T11:13:17.168692+0000","last_fullsized":"2023-10-06T11:13:17.168692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152685+0000","last_change":"2023-10-06T11:13:12.106402+0000","last_active":"2023-10-06T11:13:17.152685+0000","last_peered":"2023-10-06T11:13:17.152685+0000","last_clean":"2023-10-06T11:13:17.152685+0000","last_became_active":"2023-10-06T11:13:12.106112+0000","last_became_peered":"2023-10-06T11:13:12.106112+0000","last_unstale":"2023-10-06T11:13:17.152685+0000","last_undegraded":"2023-10-06T11:13:17.152685+0000","last_fullsized":"2023-10-06T11:13:17.152685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:13.112738+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:13.112481+0000","last_became_peered":"2023-10-06T11:13:13.112481+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166864+0000","last_change":"2023-10-06T11:13:17.157509+0000","last_active":"2023-10-06T11:13:17.166864+0000","last_peered":"2023-10-06T11:13:17.166864+0000","last_clean":"2023-10-06T11:13:17.166864+0000","last_became_active":"2023-10-06T11:13:17.156662+0000","last_became_peered":"2023-10-06T11:13:17.156662+0000","last_unstale":"2023-10-06T11:13:17.166864+0000","last_undegraded":"2023-10-06T11:13:17.166864+0000","last_fullsized":"2023-10-06T11:13:17.166864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:05.195662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144326+0000","last_change":"2023-10-06T11:13:12.101845+0000","last_active":"2023-10-06T11:13:17.144326+0000","last_peered":"2023-10-06T11:13:17.144326+0000","last_clean":"2023-10-06T11:13:17.144326+0000","last_became_active":"2023-10-06T11:13:12.101436+0000","last_became_peered":"2023-10-06T11:13:12.101436+0000","last_unstale":"2023-10-06T11:13:17.144326+0000","last_undegraded":"2023-10-06T11:13:17.144326+0000","last_fullsized":"2023-10-06T11:13:17.144326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143534+0000","last_change":"2023-10-06T11:13:13.123861+0000","last_active":"2023-10-06T11:13:17.143534+0000","last_peered":"2023-10-06T11:13:17.143534+0000","last_clean":"2023-10-06T11:13:17.143534+0000","last_became_active":"2023-10-06T11:13:13.123660+0000","last_became_peered":"2023-10-06T11:13:13.123660+0000","last_unstale":"2023-10-06T11:13:17.143534+0000","last_undegraded":"2023-10-06T11:13:17.143534+0000","last_fullsized":"2023-10-06T11:13:17.143534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170721+0000","last_change":"2023-10-06T11:13:17.165451+0000","last_active":"2023-10-06T11:13:17.170721+0000","last_peered":"2023-10-06T11:13:17.170721+0000","last_clean":"2023-10-06T11:13:17.170721+0000","last_became_active":"2023-10-06T11:13:17.165075+0000","last_became_peered":"2023-10-06T11:13:17.165075+0000","last_unstale":"2023-10-06T11:13:17.170721+0000","last_undegraded":"2023-10-06T11:13:17.170721+0000","last_fullsized":"2023-10-06T11:13:17.170721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145478+0000","last_change":"2023-10-06T11:13:12.107593+0000","last_active":"2023-10-06T11:13:17.145478+0000","last_peered":"2023-10-06T11:13:17.145478+0000","last_clean":"2023-10-06T11:13:17.145478+0000","last_became_active":"2023-10-06T11:13:12.107352+0000","last_became_peered":"2023-10-06T11:13:12.107352+0000","last_unstale":"2023-10-06T11:13:17.145478+0000","last_undegraded":"2023-10-06T11:13:17.145478+0000","last_fullsized":"2023-10-06T11:13:17.145478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142457+0000","last_change":"2023-10-06T11:13:13.125513+0000","last_active":"2023-10-06T11:13:17.142457+0000","last_peered":"2023-10-06T11:13:17.142457+0000","last_clean":"2023-10-06T11:13:17.142457+0000","last_became_active":"2023-10-06T11:13:13.125218+0000","last_became_peered":"2023-10-06T11:13:13.125218+0000","last_unstale":"2023-10-06T11:13:17.142457+0000","last_undegraded":"2023-10-06T11:13:17.142457+0000","last_fullsized":"2023-10-06T11:13:17.142457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:38.222422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140901+0000","last_change":"2023-10-06T11:13:13.127823+0000","last_active":"2023-10-06T11:13:17.140901+0000","last_peered":"2023-10-06T11:13:17.140901+0000","last_clean":"2023-10-06T11:13:17.140901+0000","last_became_active":"2023-10-06T11:13:13.127598+0000","last_became_peered":"2023-10-06T11:13:13.127598+0000","last_unstale":"2023-10-06T11:13:17.140901+0000","last_undegraded":"2023-10-06T11:13:17.140901+0000","last_fullsized":"2023-10-06T11:13:17.140901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143675+0000","last_change":"2023-10-06T11:13:13.128681+0000","last_active":"2023-10-06T11:13:17.143675+0000","last_peered":"2023-10-06T11:13:17.143675+0000","last_clean":"2023-10-06T11:13:17.143675+0000","last_became_active":"2023-10-06T11:13:13.128410+0000","last_became_peered":"2023-10-06T11:13:13.128410+0000","last_unstale":"2023-10-06T11:13:17.143675+0000","last_undegraded":"2023-10-06T11:13:17.143675+0000","last_fullsized":"2023-10-06T11:13:17.143675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144507+0000","last_change":"2023-10-06T11:13:13.122593+0000","last_active":"2023-10-06T11:13:17.144507+0000","last_peered":"2023-10-06T11:13:17.144507+0000","last_clean":"2023-10-06T11:13:17.144507+0000","last_became_active":"2023-10-06T11:13:13.122348+0000","last_became_peered":"2023-10-06T11:13:13.122348+0000","last_unstale":"2023-10-06T11:13:17.144507+0000","last_undegraded":"2023-10-06T11:13:17.144507+0000","last_fullsized":"2023-10-06T11:13:17.144507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:42.518365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143721+0000","last_change":"2023-10-06T11:13:13.125197+0000","last_active":"2023-10-06T11:13:17.143721+0000","last_peered":"2023-10-06T11:13:17.143721+0000","last_clean":"2023-10-06T11:13:17.143721+0000","last_became_active":"2023-10-06T11:13:13.124919+0000","last_became_peered":"2023-10-06T11:13:13.124919+0000","last_unstale":"2023-10-06T11:13:17.143721+0000","last_undegraded":"2023-10-06T11:13:17.143721+0000","last_fullsized":"2023-10-06T11:13:17.143721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151139+0000","last_change":"2023-10-06T11:13:13.127447+0000","last_active":"2023-10-06T11:13:17.151139+0000","last_peered":"2023-10-06T11:13:17.151139+0000","last_clean":"2023-10-06T11:13:17.151139+0000","last_became_active":"2023-10-06T11:13:13.127144+0000","last_became_peered":"2023-10-06T11:13:13.127144+0000","last_unstale":"2023-10-06T11:13:17.151139+0000","last_undegraded":"2023-10-06T11:13:17.151139+0000","last_fullsized":"2023-10-06T11:13:17.151139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":715154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":124322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":128002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":124856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:13:27.743 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:13:27.743 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T11:13:27.743 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T11:13:27.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T11:13:27.744 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T11:13:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.892+0000 7fd249f7b700 1 Processor -- start 2023-10-06T11:13:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.892+0000 7fd249f7b700 1 -- start start 2023-10-06T11:13:27.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.893+0000 7fd249f7b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2440b49a0 0x7fd2440aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.893+0000 7fd249f7b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440b0c60 con 0x7fd244159560 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.893+0000 7fd249f7b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440b0f40 con 0x7fd2440b0760 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.893+0000 7fd249f7b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440b1220 con 0x7fd2440b49a0 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.893+0000 7fd2437fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd244159560 0x7fd2440aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53566/0 (socket says 172.21.15.55:53566) 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.893+0000 7fd2437fe700 1 -- 172.21.15.55:0/329302385 learned_addr learned my addr 172.21.15.55:0/329302385 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd242ffd700 1 --2- 172.21.15.55:0/329302385 >> v2:172.21.15.142:3300/0 conn(0x7fd2440b49a0 0x7fd2440aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd2427fc700 1 -- 172.21.15.55:0/329302385 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050432791 0 0) 0x7fd2440b0c60 con 0x7fd244159560 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd2427fc700 1 -- 172.21.15.55:0/329302385 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003570 con 0x7fd244159560 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd242ffd700 1 -- 172.21.15.55:0/329302385 >> v1:172.21.15.142:6789/0 conn(0x7fd2440b0760 legacy=0x7fd2440b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd242ffd700 1 -- 172.21.15.55:0/329302385 >> v1:172.21.15.55:6789/0 conn(0x7fd244159560 legacy=0x7fd2440aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd242ffd700 1 -- 172.21.15.55:0/329302385 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440b1500 con 0x7fd2440b49a0 2023-10-06T11:13:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd242ffd700 1 --2- 172.21.15.55:0/329302385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd2440aac40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd2380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4740d580c63b052 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd2427fc700 1 -- 172.21.15.55:0/329302385 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800b640 con 0x7fd2440b49a0 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd2427fc700 1 -- 172.21.15.55:0/329302385 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800b7a0 con 0x7fd2440b49a0 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.894+0000 7fd2427fc700 1 -- 172.21.15.55:0/329302385 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800bb60 con 0x7fd2440b49a0 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 -- 172.21.15.55:0/329302385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 msgr2=0x7fd2440aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 --2- 172.21.15.55:0/329302385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd2440aac40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd2380091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 -- 172.21.15.55:0/329302385 shutdown_connections 2023-10-06T11:13:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 --2- 172.21.15.55:0/329302385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd2440aac40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 -- 172.21.15.55:0/329302385 >> 172.21.15.55:0/329302385 conn(0x7fd2440997f0 msgr2=0x7fd24406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 -- 172.21.15.55:0/329302385 shutdown_connections 2023-10-06T11:13:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.895+0000 7fd249f7b700 1 -- 172.21.15.55:0/329302385 wait complete. 2023-10-06T11:13:27.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.896+0000 7fd249f7b700 1 Processor -- start 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.896+0000 7fd249f7b700 1 -- start start 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd249f7b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 0x7fd2440ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd249f7b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd24409d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd249f7b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244159560 0x7fd24409ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd249f7b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24409e090 con 0x7fd2440b0760 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd249f7b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440ab7d0 con 0x7fd2440b49a0 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd249f7b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24409ddb0 con 0x7fd244159560 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 0x7fd2440ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 0x7fd2440ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37182/0 (socket says 172.21.15.55:37182) 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 -- 172.21.15.55:0/1011351475 learned_addr learned my addr 172.21.15.55:0/1011351475 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd242ffd700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd24409d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd243fff700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244159560 0x7fd24409ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 -- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244159560 msgr2=0x7fd24409ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244159560 0x7fd24409ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 -- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 msgr2=0x7fd24409d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd24409d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 -- 172.21.15.55:0/1011351475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238009420 con 0x7fd2440b0760 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.897+0000 7fd2437fe700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 0x7fd2440ab290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c790 tx=0x7fd234007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.898+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340072e0 con 0x7fd2440b0760 2023-10-06T11:13:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.898+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234007440 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.898+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340057f0 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.898+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2440ada10 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.898+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440adfd0 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.899+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2440ad870 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.899+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd234005c20 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.899+0000 7fd22b7fe700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd230066f30 0x7fd2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.900+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd234083d80 con 0x7fd2440b0760 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.900+0000 7fd242ffd700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd230066f30 0x7fd2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.900+0000 7fd242ffd700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd230066f30 0x7fd2300693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd238017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:27.904+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd23404b5a0 con 0x7fd2440b0760 2023-10-06T11:13:28.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.153+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd2440ae1f0 con 0x7fd2440b0760 2023-10-06T11:13:28.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.156+0000 7fd22b7fe700 1 -- 172.21.15.55:0/1011351475 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163705 (secure 0 0 0) 0x7fd234048f90 con 0x7fd2440b0760 2023-10-06T11:13:28.160 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd230066f30 msgr2=0x7fd2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd230066f30 0x7fd2300693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd238017000 comp rx=0 tx=0).stop 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 msgr2=0x7fd2440ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 0x7fd2440ab290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c790 tx=0x7fd234007c80 comp rx=0 tx=0).stop 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 shutdown_connections 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd230066f30 0x7fd2300693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2440b0760 0x7fd2440ab290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244159560 0x7fd24409ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 --2- 172.21.15.55:0/1011351475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2440b49a0 0x7fd24409d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 >> 172.21.15.55:0/1011351475 conn(0x7fd2440997f0 msgr2=0x7fd2440688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 shutdown_connections 2023-10-06T11:13:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.159+0000 7fd249f7b700 1 -- 172.21.15.55:0/1011351475 wait complete. 2023-10-06T11:13:28.173 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":90269},{"type":"v1","addr":"172.21.15.142:6833","nonce":90269}]},"active_addr":"172.21.15.142:6833/90269","active_change":"2023-10-06T11:12:52.829089+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1913594167}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":4063845823}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":591293717}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1540419564}]}]} 2023-10-06T11:13:28.177 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T11:13:28.178 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T11:13:28.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:28.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.296+0000 7fa33a7d8700 1 Processor -- start 2023-10-06T11:13:28.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.296+0000 7fa33a7d8700 1 -- start start 2023-10-06T11:13:28.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa33a7d8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3340cbc30 0x7fa3340cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa33a7d8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340cb7a0 con 0x7fa3340b2100 2023-10-06T11:13:28.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa33a7d8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340b0860 con 0x7fa334159440 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa33a7d8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340cb150 con 0x7fa3340cbc30 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa339fd7700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa3340b2100 0x7fa3340b2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53582/0 (socket says 172.21.15.55:53582) 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa339fd7700 1 -- 172.21.15.55:0/142704434 learned_addr learned my addr 172.21.15.55:0/142704434 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa338fd5700 1 --2- 172.21.15.55:0/142704434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3340cbc30 0x7fa3340cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.297+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772980442 0 0) 0x7fa3340cb7a0 con 0x7fa3340b2100 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c003570 con 0x7fa3340b2100 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204369740 0 0) 0x7fa3340b0860 con 0x7fa334159440 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3340cb7a0 con 0x7fa334159440 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa338fd5700 1 -- 172.21.15.55:0/142704434 >> v1:172.21.15.142:6789/0 conn(0x7fa334159440 legacy=0x7fa3340b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa338fd5700 1 -- 172.21.15.55:0/142704434 >> v1:172.21.15.55:6789/0 conn(0x7fa3340b2100 legacy=0x7fa3340b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa338fd5700 1 -- 172.21.15.55:0/142704434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340cb430 con 0x7fa3340cbc30 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa338fd5700 1 --2- 172.21.15.55:0/142704434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3340cbc30 0x7fa3340cc080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa328009910 tx=0x7fa3280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9cc5d46a8d1cbd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011630 con 0x7fa3340cbc30 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328011790 con 0x7fa3340cbc30 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.298+0000 7fa333fff700 1 -- 172.21.15.55:0/142704434 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011b30 con 0x7fa3340cbc30 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 -- 172.21.15.55:0/142704434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3340cbc30 msgr2=0x7fa3340cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/142704434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3340cbc30 0x7fa3340cc080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa328009910 tx=0x7fa3280091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 -- 172.21.15.55:0/142704434 shutdown_connections 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/142704434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3340cbc30 0x7fa3340cc080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 -- 172.21.15.55:0/142704434 >> 172.21.15.55:0/142704434 conn(0x7fa33406ece0 msgr2=0x7fa33406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 -- 172.21.15.55:0/142704434 shutdown_connections 2023-10-06T11:13:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.299+0000 7fa33a7d8700 1 -- 172.21.15.55:0/142704434 wait complete. 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.300+0000 7fa33a7d8700 1 Processor -- start 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.300+0000 7fa33a7d8700 1 -- start start 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 0x7fa3340c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3340cbc30 0x7fa33414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa334159440 0x7fa334157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33416a9e0 con 0x7fa3340b2100 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340c4a60 con 0x7fa3340cbc30 2023-10-06T11:13:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340c3c00 con 0x7fa334159440 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 0x7fa3340c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 0x7fa3340c4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37188/0 (socket says 172.21.15.55:37188) 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 -- 172.21.15.55:0/687236027 learned_addr learned my addr 172.21.15.55:0/687236027 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa339fd7700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa334159440 0x7fa334157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa338fd5700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3340cbc30 0x7fa33414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 -- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa334159440 msgr2=0x7fa334157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa334159440 0x7fa334157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 -- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3340cbc30 msgr2=0x7fa33414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3340cbc30 0x7fa33414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 -- 172.21.15.55:0/687236027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009420 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa339fd7700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa334159440 0x7fa334157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa338fd5700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3340cbc30 0x7fa33414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3397d6700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 0x7fa3340c4fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c580 tx=0x7fa32c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c010510 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c010670 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3340c3e50 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.301+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c010a30 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.302+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3340c4410 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.302+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33405f230 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.303+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa32c01b400 con 0x7fa3340b2100 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.303+0000 7fa3317fa700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa320066f30 0x7fa3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.303+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa32c084750 con 0x7fa3340b2100 2023-10-06T11:13:28.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.303+0000 7fa338fd5700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa320066f30 0x7fa3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.304+0000 7fa338fd5700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa320066f30 0x7fa3200693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa328009860 tx=0x7fa328017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:28.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.308+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa32c0514d0 con 0x7fa3340b2100 2023-10-06T11:13:28.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.502+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3340c47b0 con 0x7fa3340b2100 2023-10-06T11:13:28.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.503+0000 7fa3317fa700 1 -- 172.21.15.55:0/687236027 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fa32c054af0 con 0x7fa3340b2100 2023-10-06T11:13:28.505 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:28.505 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa320066f30 msgr2=0x7fa3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa320066f30 0x7fa3200693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa328009860 tx=0x7fa328017000 comp rx=0 tx=0).stop 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 msgr2=0x7fa3340c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 0x7fa3340c4fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c580 tx=0x7fa32c007e10 comp rx=0 tx=0).stop 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 shutdown_connections 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa320066f30 0x7fa3200693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3340b2100 0x7fa3340c4fa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa334159440 0x7fa334157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 --2- 172.21.15.55:0/687236027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3340cbc30 0x7fa33414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 >> 172.21.15.55:0/687236027 conn(0x7fa33406ece0 msgr2=0x7fa334155910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 shutdown_connections 2023-10-06T11:13:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.505+0000 7fa33a7d8700 1 -- 172.21.15.55:0/687236027 wait complete. 2023-10-06T11:13:28.519 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T11:13:28.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:28.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.637+0000 7fe0dfdc6700 1 Processor -- start 2023-10-06T11:13:28.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.637+0000 7fe0dfdc6700 1 -- start start 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dfdc6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe0d8159560 0x7fe0d80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dfdc6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0d80b0760 0x7fe0d80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dfdc6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80b0c60 con 0x7fe0d80b49a0 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dfdc6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d80b0f40 con 0x7fe0d80b0760 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dfdc6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d80b1220 con 0x7fe0d8159560 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0de363700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0d80b0760 0x7fe0d80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dd361700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe0d80b49a0 0x7fe0d80aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53586/0 (socket says 172.21.15.55:53586) 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dd361700 1 -- 172.21.15.55:0/668525191 learned_addr learned my addr 172.21.15.55:0/668525191 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0ddb62700 1 --2- 172.21.15.55:0/668525191 >> v2:172.21.15.142:3300/0 conn(0x7fe0d8159560 0x7fe0d80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0de363700 1 -- 172.21.15.55:0/668525191 >> v2:172.21.15.142:3300/0 conn(0x7fe0d8159560 msgr2=0x7fe0d80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0de363700 1 --2- 172.21.15.55:0/668525191 >> v2:172.21.15.142:3300/0 conn(0x7fe0d8159560 0x7fe0d80aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0de363700 1 -- 172.21.15.55:0/668525191 >> v1:172.21.15.55:6789/0 conn(0x7fe0d80b49a0 legacy=0x7fe0d80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0dcb60700 1 -- 172.21.15.55:0/668525191 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814245714 0 0) 0x7fe0d80b0c60 con 0x7fe0d80b49a0 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0de363700 1 -- 172.21.15.55:0/668525191 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80b1500 con 0x7fe0d80b0760 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0ddb62700 1 --2- 172.21.15.55:0/668525191 >> v2:172.21.15.142:3300/0 conn(0x7fe0d8159560 0x7fe0d80aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.638+0000 7fe0de363700 1 --2- 172.21.15.55:0/668525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d80b0760 0x7fe0d80b1bc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009e60 tx=0x7fe0d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a264f8c89ea8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dcb60700 1 -- 172.21.15.55:0/668525191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000e070 con 0x7fe0d80b0760 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dcb60700 1 -- 172.21.15.55:0/668525191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000bbf0 con 0x7fe0d80b0760 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dcb60700 1 -- 172.21.15.55:0/668525191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0012430 con 0x7fe0d80b0760 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/668525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d80b0760 msgr2=0x7fe0d80b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/668525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d80b0760 0x7fe0d80b1bc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009e60 tx=0x7fe0d0009780 comp rx=0 tx=0).stop 2023-10-06T11:13:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/668525191 shutdown_connections 2023-10-06T11:13:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/668525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d80b0760 0x7fe0d80b1bc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/668525191 >> v2:172.21.15.142:3300/0 conn(0x7fe0d8159560 0x7fe0d80aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/668525191 >> 172.21.15.55:0/668525191 conn(0x7fe0d80997f0 msgr2=0x7fe0d806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/668525191 shutdown_connections 2023-10-06T11:13:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.639+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/668525191 wait complete. 2023-10-06T11:13:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.640+0000 7fe0dfdc6700 1 Processor -- start 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.640+0000 7fe0dfdc6700 1 -- start start 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dfdc6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0d80b0760 0x7fe0d8158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dfdc6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0d80b49a0 0x7fe0d815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dfdc6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 0x7fe0d809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dfdc6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8158e80 con 0x7fe0d8159560 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dfdc6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d809d400 con 0x7fe0d80b49a0 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dfdc6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d815c710 con 0x7fe0d80b0760 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 0x7fe0d809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 0x7fe0d809d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37208/0 (socket says 172.21.15.55:37208) 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 -- 172.21.15.55:0/1112787247 learned_addr learned my addr 172.21.15.55:0/1112787247 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0dd361700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0d80b49a0 0x7fe0d815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0ddb62700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0d80b0760 0x7fe0d8158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 -- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0d80b0760 msgr2=0x7fe0d8158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0d80b0760 0x7fe0d8158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 -- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0d80b49a0 msgr2=0x7fe0d815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0d80b49a0 0x7fe0d815c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.641+0000 7fe0de363700 1 -- 172.21.15.55:0/1112787247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0009a20 con 0x7fe0d8159560 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.642+0000 7fe0de363700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 0x7fe0d809d890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000b6c0 tx=0x7fe0d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.642+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0012e20 con 0x7fe0d8159560 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.642+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d001d630 con 0x7fe0d8159560 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.642+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d001d9d0 con 0x7fe0d8159560 2023-10-06T11:13:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.642+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d815c9b0 con 0x7fe0d8159560 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.642+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d815cff0 con 0x7fe0d8159560 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.643+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d8064a90 con 0x7fe0d8159560 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.643+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0d0024070 con 0x7fe0d8159560 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.644+0000 7fe0cdffb700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0bc066f30 0x7fe0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.644+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe0d0087200 con 0x7fe0d8159560 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.644+0000 7fe0ddb62700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0bc066f30 0x7fe0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.644+0000 7fe0ddb62700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0bc066f30 0x7fe0bc0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400aca0 tx=0x7fe0d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.648+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0d00540d0 con 0x7fe0d8159560 2023-10-06T11:13:28.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.847+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0d809d540 con 0x7fe0d8159560 2023-10-06T11:13:28.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.848+0000 7fe0cdffb700 1 -- 172.21.15.55:0/1112787247 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fe0d00576f0 con 0x7fe0d8159560 2023-10-06T11:13:28.850 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:28.850 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0bc066f30 msgr2=0x7fe0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0bc066f30 0x7fe0bc0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400aca0 tx=0x7fe0d4008040 comp rx=0 tx=0).stop 2023-10-06T11:13:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 msgr2=0x7fe0d809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 0x7fe0d809d890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000b6c0 tx=0x7fe0d0019000 comp rx=0 tx=0).stop 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 shutdown_connections 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0bc066f30 0x7fe0bc0693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d8159560 0x7fe0d809d890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0d80b0760 0x7fe0d8158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 --2- 172.21.15.55:0/1112787247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0d80b49a0 0x7fe0d815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 >> 172.21.15.55:0/1112787247 conn(0x7fe0d80997f0 msgr2=0x7fe0d80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.850+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 shutdown_connections 2023-10-06T11:13:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:28.851+0000 7fe0dfdc6700 1 -- 172.21.15.55:0/1112787247 wait complete. 2023-10-06T11:13:28.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T11:13:28.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T11:13:28.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T11:13:28.866 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T11:13:28.866 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T11:13:28.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T11:13:28.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T11:13:28.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T11:13:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.060+0000 7f485bc8e700 1 Processor -- start 2023-10-06T11:13:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.060+0000 7f485bc8e700 1 -- start start 2023-10-06T11:13:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.061+0000 7f485bc8e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48540b1de0 0x7f48540b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.061+0000 7f485bc8e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48540b0c50 0x7f48540b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.061+0000 7f485bc8e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48540b35c0 con 0x7f48540cc7e0 2023-10-06T11:13:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.061+0000 7f485bc8e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540b10d0 con 0x7f48540b0c50 2023-10-06T11:13:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.061+0000 7f485bc8e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540b13b0 con 0x7f48540b1de0 2023-10-06T11:13:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f4859a2a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48540b1de0 0x7f48540b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f485a22b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f48540cc7e0 0x7f48540b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56000/0 (socket says 172.21.15.55:56000) 2023-10-06T11:13:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f485a22b700 1 -- 172.21.15.55:0/639028010 learned_addr learned my addr 172.21.15.55:0/639028010 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f4859a2a700 1 -- 172.21.15.55:0/639028010 >> v2:172.21.15.55:3300/0 conn(0x7f48540b0c50 msgr2=0x7f48540b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f4859a2a700 1 --2- 172.21.15.55:0/639028010 >> v2:172.21.15.55:3300/0 conn(0x7f48540b0c50 0x7f48540b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f4859a2a700 1 -- 172.21.15.55:0/639028010 >> v1:172.21.15.142:6789/0 conn(0x7f48540cc7e0 legacy=0x7f48540b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.062+0000 7f4859a2a700 1 -- 172.21.15.55:0/639028010 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540b1690 con 0x7f48540b1de0 2023-10-06T11:13:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.064+0000 7f4859a2a700 1 --2- 172.21.15.55:0/639028010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f48540b0710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48540890c0 tx=0x7f4844009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44db25008b4940df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.065+0000 7f4858a28700 1 -- 172.21.15.55:0/639028010 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844011630 con 0x7f48540b1de0 2023-10-06T11:13:29.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.065+0000 7f4858a28700 1 -- 172.21.15.55:0/639028010 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4844011790 con 0x7f48540b1de0 2023-10-06T11:13:29.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.065+0000 7f4858a28700 1 -- 172.21.15.55:0/639028010 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844011b30 con 0x7f48540b1de0 2023-10-06T11:13:29.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.066+0000 7f485bc8e700 1 -- 172.21.15.55:0/639028010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 msgr2=0x7f48540b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.066+0000 7f485bc8e700 1 --2- 172.21.15.55:0/639028010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f48540b0710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48540890c0 tx=0x7f4844009120 comp rx=0 tx=0).stop 2023-10-06T11:13:29.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.067+0000 7f485bc8e700 1 -- 172.21.15.55:0/639028010 shutdown_connections 2023-10-06T11:13:29.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.067+0000 7f485bc8e700 1 --2- 172.21.15.55:0/639028010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f48540b0710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.067+0000 7f485bc8e700 1 --2- 172.21.15.55:0/639028010 >> v2:172.21.15.55:3300/0 conn(0x7f48540b0c50 0x7f48540b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.067+0000 7f485bc8e700 1 -- 172.21.15.55:0/639028010 >> 172.21.15.55:0/639028010 conn(0x7f48540997f0 msgr2=0x7f485406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.070+0000 7f485bc8e700 1 -- 172.21.15.55:0/639028010 shutdown_connections 2023-10-06T11:13:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.070+0000 7f485bc8e700 1 -- 172.21.15.55:0/639028010 wait complete. 2023-10-06T11:13:29.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.071+0000 7f485bc8e700 1 Processor -- start 2023-10-06T11:13:29.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.071+0000 7f485bc8e700 1 -- start start 2023-10-06T11:13:29.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485bc8e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f4854159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485bc8e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48540cc7e0 0x7f4854162d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f0c8107c700 1 Processor -- start 2023-10-06T11:13:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485bc8e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4854158200 0x7f485415f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485bc8e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854159380 con 0x7f4854158200 2023-10-06T11:13:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485bc8e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854158770 con 0x7f48540b1de0 2023-10-06T11:13:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485bc8e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4854158a50 con 0x7f48540cc7e0 2023-10-06T11:13:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f0c8107c700 1 -- start start 2023-10-06T11:13:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f49374db700 1 Processor -- start 2023-10-06T11:13:29.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f4859229700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48540cc7e0 0x7f4854162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f4859229700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48540cc7e0 0x7f4854162d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56246/0 (socket says 172.21.15.55:56246) 2023-10-06T11:13:29.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f4859229700 1 -- 172.21.15.55:0/3456749248 learned_addr learned my addr 172.21.15.55:0/3456749248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f485a22b700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4854158200 0x7f485415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.072+0000 7f4859a2a700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f4854159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859229700 1 -- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 msgr2=0x7f4854159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859229700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f4854159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859229700 1 -- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4854158200 msgr2=0x7f485415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859229700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4854158200 0x7f485415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859229700 1 -- 172.21.15.55:0/3456749248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440093c0 con 0x7f48540cc7e0 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859a2a700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48540b1de0 0x7f4854159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f485a22b700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4854158200 0x7f485415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:29.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f49374db700 1 -- start start 2023-10-06T11:13:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4859229700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48540cc7e0 0x7f4854162d10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f485000b810 tx=0x7f4850009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f5d301aa700 1 Processor -- start 2023-10-06T11:13:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f5d301aa700 1 -- start start 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000f5f0 con 0x7f48540cc7e0 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000f770 con 0x7f48540cc7e0 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000fb30 con 0x7f48540cc7e0 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4854158d30 con 0x7f48540cc7e0 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4854160030 con 0x7f48540cc7e0 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f0c8107c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f0c8107c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c7c15d8e0 0x7f0c7c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.073+0000 7f0c8107c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c15b920 con 0x7f0c7c159a20 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c8107c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c15a1e0 con 0x7f0c7c15d8e0 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c8107c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c15dd40 con 0x7f0c7c069c30 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56250/0 (socket says 172.21.15.55:56250) 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 -- 172.21.15.55:0/3569459651 learned_addr learned my addr 172.21.15.55:0/3569459651 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7b59e700 1 --2- 172.21.15.55:0/3569459651 >> v2:172.21.15.142:3300/0 conn(0x7f0c7c15d8e0 0x7f0c7c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f49374db700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300c8260 0x7f4930069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f49374db700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300c7dd0 con 0x7f4930155820 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f49374db700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300c71c0 con 0x7f493006e3d0 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f49374db700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c74a0 con 0x7f49300c8260 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d301aa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d28160df0 0x7f5d281611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d301aa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d280c82d0 0x7f5d28069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d301aa700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d280c8720 0x7f5d28069a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d301aa700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280c7e40 con 0x7f5d280c8720 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d301aa700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280c7230 con 0x7f5d280c82d0 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d301aa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280c7510 con 0x7f5d28160df0 2023-10-06T11:13:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d2d745700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d280c82d0 0x7f5d28069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d2d745700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d280c82d0 0x7f5d28069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50540/0 (socket says 172.21.15.55:50540) 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d2d745700 1 -- 172.21.15.55:0/765115632 learned_addr learned my addr 172.21.15.55:0/765115632 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f5d2df46700 1 --2- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d28160df0 0x7f5d281611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2e747700 1 --2- 172.21.15.55:0/765115632 >> v2:172.21.15.55:3300/0 conn(0x7f5d280c8720 0x7f5d28069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 -- 172.21.15.55:0/3569459651 >> v2:172.21.15.142:3300/0 conn(0x7f0c7c15d8e0 msgr2=0x7f0c7c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 --2- 172.21.15.55:0/3569459651 >> v2:172.21.15.142:3300/0 conn(0x7f0c7c15d8e0 0x7f0c7c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 -- 172.21.15.55:0/3569459651 >> v1:172.21.15.142:6789/0 conn(0x7f0c7c159a20 legacy=0x7f0c7c069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f0c7a59c700 1 -- 172.21.15.55:0/3569459651 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c15e2b0 con 0x7f0c7c069c30 2023-10-06T11:13:29.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f4935a78700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f493006e3d0 0x7f49300abc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56022/0 (socket says 172.21.15.55:56022) 2023-10-06T11:13:29.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.074+0000 7f4935a78700 1 -- 172.21.15.55:0/245769013 learned_addr learned my addr 172.21.15.55:0/245769013 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f0c7a59c700 1 --2- 172.21.15.55:0/3569459651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c15d3a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0099b0 tx=0x7f0c6c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb5612545245a957 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2d745700 1 -- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d28160df0 msgr2=0x7f5d281611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2d745700 1 --2- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d28160df0 0x7f5d281611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2d745700 1 -- 172.21.15.55:0/765115632 >> v2:172.21.15.55:3300/0 conn(0x7f5d280c8720 msgr2=0x7f5d28069a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2d745700 1 --2- 172.21.15.55:0/765115632 >> v2:172.21.15.55:3300/0 conn(0x7f5d280c8720 0x7f5d28069a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2d745700 1 -- 172.21.15.55:0/765115632 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280c77f0 con 0x7f5d280c82d0 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4934a76700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300c8260 0x7f4930069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236036121 0 0) 0x7f49300c71c0 con 0x7f493006e3d0 2023-10-06T11:13:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f491c003570 con 0x7f493006e3d0 2023-10-06T11:13:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f0c79d9b700 1 -- 172.21.15.55:0/3569459651 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c009ea0 con 0x7f0c7c069c30 2023-10-06T11:13:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f0c79d9b700 1 -- 172.21.15.55:0/3569459651 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00b820 con 0x7f0c7c069c30 2023-10-06T11:13:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f0c79d9b700 1 -- 172.21.15.55:0/3569459651 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00bbc0 con 0x7f0c7c069c30 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595050263 0 0) 0x7f491c003570 con 0x7f493006e3d0 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300c8260 msgr2=0x7f4930069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300c8260 0x7f4930069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 >> v1:172.21.15.55:6789/0 conn(0x7f4930155820 legacy=0x7f49300ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49300c7780 con 0x7f493006e3d0 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f4928001840 con 0x7f493006e3d0 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 >> v1:172.21.15.142:6789/0 conn(0x7f493006e3d0 legacy=0x7f49300abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f491c003a60 0x7f491c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f491c004810 0x7f491c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491c005210 0x7f491c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c74a0 con 0x7f491c003a60 2023-10-06T11:13:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c00c100 con 0x7f491c005210 2023-10-06T11:13:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c00c2c0 con 0x7f491c004810 2023-10-06T11:13:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935277700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f491c003a60 0x7f491c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4854064a90 con 0x7f48540cc7e0 2023-10-06T11:13:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f228c606700 1 Processor -- start 2023-10-06T11:13:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f228c606700 1 -- start start 2023-10-06T11:13:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 -- 172.21.15.55:0/3569459651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 msgr2=0x7f0c7c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 --2- 172.21.15.55:0/3569459651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c15d3a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0099b0 tx=0x7f0c6c009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2d745700 1 --2- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d280c82d0 0x7f5d28069520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806d140 tx=0x7f5d18009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395c64bddc43170f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.075+0000 7f5d2cf44700 1 -- 172.21.15.55:0/765115632 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18009e70 con 0x7f5d280c82d0 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f5d2cf44700 1 -- 172.21.15.55:0/765115632 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800b860 con 0x7f5d280c82d0 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f5d2cf44700 1 -- 172.21.15.55:0/765115632 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800bc00 con 0x7f5d280c82d0 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 -- 172.21.15.55:0/3569459651 shutdown_connections 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 --2- 172.21.15.55:0/3569459651 >> v2:172.21.15.142:3300/0 conn(0x7f0c7c15d8e0 0x7f0c7c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 --2- 172.21.15.55:0/3569459651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c15d3a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 -- 172.21.15.55:0/3569459651 >> 172.21.15.55:0/3569459651 conn(0x7f0c7c068080 msgr2=0x7f0c7c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7fb5616f2700 1 Processor -- start 2023-10-06T11:13:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f0c8107c700 1 -- 172.21.15.55:0/3569459651 shutdown_connections 2023-10-06T11:13:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f5d301aa700 1 -- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d280c82d0 msgr2=0x7f5d28069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f5d301aa700 1 --2- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d280c82d0 0x7f5d28069520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806d140 tx=0x7f5d18009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4850010480 con 0x7f48540cc7e0 2023-10-06T11:13:29.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f4849ffb700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4838067080 0x7f4838069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4850084900 con 0x7f48540cc7e0 2023-10-06T11:13:29.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f0c8107c700 1 -- 172.21.15.55:0/3569459651 wait complete. 2023-10-06T11:13:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7fb5616f2700 1 -- start start 2023-10-06T11:13:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f4859a2a700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4838067080 0x7f4838069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f4849ffb700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f4838070cd0 0x7f4838073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48380737d0 con 0x7f4838070cd0 2023-10-06T11:13:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4850051780 con 0x7f48540cc7e0 2023-10-06T11:13:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f228c606700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f228415ac40 0x7f22840c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f228c606700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840cdb40 con 0x7f228415a870 2023-10-06T11:13:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f228c606700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840c9180 con 0x7f22840c8d50 2023-10-06T11:13:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.077+0000 7f228c606700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22840ccf30 con 0x7f228415ac40 2023-10-06T11:13:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f4859a2a700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4838067080 0x7f4838069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4844009390 tx=0x7f4844016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4934a76700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f491c004810 0x7f491c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935a78700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491c005210 0x7f491c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935a78700 1 -- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f491c004810 msgr2=0x7f491c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935a78700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f491c004810 0x7f491c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935a78700 1 -- 172.21.15.55:0/245769013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f491c003a60 msgr2=0x7f491c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935a78700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f491c003a60 0x7f491c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.076+0000 7f4935a78700 1 -- 172.21.15.55:0/245769013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c003570 con 0x7f491c005210 2023-10-06T11:13:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f228a3a2700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f228415a870 0x7f22840ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53610/0 (socket says 172.21.15.55:53610) 2023-10-06T11:13:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f228a3a2700 1 -- 172.21.15.55:0/2304998985 learned_addr learned my addr 172.21.15.55:0/2304998985 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f2289ba1700 1 --2- 172.21.15.55:0/2304998985 >> v2:172.21.15.142:3300/0 conn(0x7f228415ac40 0x7f22840c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f485a22b700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f4838070cd0 0x7f4838073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb5616f2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067800 0x7fb55c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb5616f2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb55c067bd0 0x7fb55c06b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb5616f2700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c06b7c0 con 0x7fb55c0bf4b0 2023-10-06T11:13:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb5616f2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0af4c0 con 0x7fb55c067bd0 2023-10-06T11:13:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb5616f2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c06dfa0 con 0x7fb55c067800 2023-10-06T11:13:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb55a7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb55c067bd0 0x7fb55c06b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb55b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb55c0bf4b0 0x7fb55c0bf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53616/0 (socket says 172.21.15.55:53616) 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb55b7fe700 1 -- 172.21.15.55:0/4002652456 learned_addr learned my addr 172.21.15.55:0/4002652456 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7fb55affd700 1 --2- 172.21.15.55:0/4002652456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067800 0x7fb55c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f2289ba1700 1 -- 172.21.15.55:0/2304998985 >> v1:172.21.15.142:6789/0 conn(0x7f22840c8d50 legacy=0x7f22840ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f2289ba1700 1 -- 172.21.15.55:0/2304998985 >> v1:172.21.15.55:6789/0 conn(0x7f228415a870 legacy=0x7f22840ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.078+0000 7f2289ba1700 1 -- 172.21.15.55:0/2304998985 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840cd210 con 0x7f228415ac40 2023-10-06T11:13:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f485a22b700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f4838070cd0 0x7f4838073100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f2289ba1700 1 --2- 172.21.15.55:0/2304998985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228415ac40 0x7f22840c8810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f22740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f9698b651c96b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f4935a78700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491c005210 0x7f491c00ba60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f493006e810 tx=0x7f49280021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3a4d1c4a50f0d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb55a7fc700 1 -- 172.21.15.55:0/4002652456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067800 msgr2=0x7fb55c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb55a7fc700 1 --2- 172.21.15.55:0/4002652456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067800 0x7fb55c06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb55a7fc700 1 -- 172.21.15.55:0/4002652456 >> v1:172.21.15.55:6789/0 conn(0x7fb55c0bf4b0 legacy=0x7fb55c0bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb55a7fc700 1 -- 172.21.15.55:0/4002652456 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c06e280 con 0x7fb55c067bd0 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f0c8107c700 1 Processor -- start 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f5d301aa700 1 -- 172.21.15.55:0/765115632 shutdown_connections 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f5d301aa700 1 --2- 172.21.15.55:0/765115632 >> v2:172.21.15.55:3300/0 conn(0x7f5d280c8720 0x7f5d28069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f5d301aa700 1 --2- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d28160df0 0x7f5d281611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f5d301aa700 1 --2- 172.21.15.55:0/765115632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d280c82d0 0x7f5d28069520 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f5d301aa700 1 -- 172.21.15.55:0/765115632 >> 172.21.15.55:0/765115632 conn(0x7f5d28068080 msgr2=0x7f5d280cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f22893a0700 1 -- 172.21.15.55:0/2304998985 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274009e80 con 0x7f228415ac40 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f22893a0700 1 -- 172.21.15.55:0/2304998985 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400b860 con 0x7f228415ac40 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f22893a0700 1 -- 172.21.15.55:0/2304998985 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400bbe0 con 0x7f228415ac40 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb55a7fc700 1 --2- 172.21.15.55:0/4002652456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c067bd0 0x7fb55c06b280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb5500098e0 tx=0x7fb5500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7937bdc7103b751b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb559ffb700 1 -- 172.21.15.55:0/4002652456 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000b640 con 0x7fb55c067bd0 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb559ffb700 1 -- 172.21.15.55:0/4002652456 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000b7a0 con 0x7fb55c067bd0 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7fb559ffb700 1 -- 172.21.15.55:0/4002652456 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000bb40 con 0x7fb55c067bd0 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f0c8107c700 1 -- start start 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c8107c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 -- 172.21.15.55:0/2304998985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228415ac40 msgr2=0x7f22840c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 --2- 172.21.15.55:0/2304998985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228415ac40 0x7f22840c8810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f22740091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492800e370 con 0x7f491c005210 2023-10-06T11:13:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49280198d0 con 0x7f491c005210 2023-10-06T11:13:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.079+0000 7f4927fff700 1 -- 172.21.15.55:0/245769013 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928019c90 con 0x7f491c005210 2023-10-06T11:13:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f49374db700 1 -- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491c005210 msgr2=0x7f491c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f49374db700 1 --2- 172.21.15.55:0/245769013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491c005210 0x7f491c00ba60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f493006e810 tx=0x7f49280021e0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c8107c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c159a20 0x7f0c7c0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c8107c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7c15d8e0 0x7f0c7c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c8107c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0c5a70 con 0x7f0c7c159a20 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c8107c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0c51d0 con 0x7f0c7c15d8e0 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c8107c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0c54b0 con 0x7f0c7c069c30 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c159a20 0x7f0c7c0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c159a20 0x7f0c7c0c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37272/0 (socket says 172.21.15.55:37272) 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 -- 172.21.15.55:0/1984852222 learned_addr learned my addr 172.21.15.55:0/1984852222 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f4935a78700 1 -- 172.21.15.55:0/245769013 reap_dead start 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 -- 172.21.15.55:0/2304998985 shutdown_connections 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 --2- 172.21.15.55:0/2304998985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f228415ac40 0x7f22840c8810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 -- 172.21.15.55:0/2304998985 >> 172.21.15.55:0/2304998985 conn(0x7f2284067d90 msgr2=0x7f22840ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f49374db700 1 -- 172.21.15.55:0/245769013 shutdown_connections 2023-10-06T11:13:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f49374db700 1 -- 172.21.15.55:0/245769013 >> 172.21.15.55:0/245769013 conn(0x7f4930068080 msgr2=0x7f49300cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7b59e700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7c15d8e0 0x7f0c7c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 -- 172.21.15.55:0/2304998985 shutdown_connections 2023-10-06T11:13:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== osd.1 v2:172.21.15.55:6800/90686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f48380737d0 con 0x7f4838070cd0 2023-10-06T11:13:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f228c606700 1 -- 172.21.15.55:0/2304998985 wait complete. 2023-10-06T11:13:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 -- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 msgr2=0x7f0c7c154490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c7c069c30 0x7f0c7c154490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 -- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7c15d8e0 msgr2=0x7f0c7c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f0c7a59c700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7c15d8e0 0x7f0c7c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c7a59c700 1 -- 172.21.15.55:0/1984852222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0094f0 con 0x7f0c7c159a20 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c7a59c700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c159a20 0x7f0c7c0c7290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009290 tx=0x7f0c6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011be0 con 0x7f0c7c159a20 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c020070 con 0x7f0c7c159a20 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c01b450 con 0x7f0c7c159a20 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c0c5790 con 0x7f0c7c159a20 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c1549d0 con 0x7f0c7c159a20 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7fb5616f2700 1 -- 172.21.15.55:0/4002652456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c067bd0 msgr2=0x7fb55c06b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7fb5616f2700 1 --2- 172.21.15.55:0/4002652456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c067bd0 0x7fb55c06b280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb5500098e0 tx=0x7fb5500091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7fb5616f2700 1 -- 172.21.15.55:0/4002652456 shutdown_connections 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7fb5616f2700 1 --2- 172.21.15.55:0/4002652456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067800 0x7fb55c06d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7fb5616f2700 1 --2- 172.21.15.55:0/4002652456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c067bd0 0x7fb55c06b280 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.081+0000 7fb5616f2700 1 -- 172.21.15.55:0/4002652456 >> 172.21.15.55:0/4002652456 conn(0x7fb55c0cc6f0 msgr2=0x7fb55c0ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f49374db700 1 -- 172.21.15.55:0/245769013 shutdown_connections 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7fb5616f2700 1 -- 172.21.15.55:0/4002652456 shutdown_connections 2023-10-06T11:13:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7f228c606700 1 Processor -- start 2023-10-06T11:13:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.080+0000 7f49374db700 1 -- 172.21.15.55:0/245769013 wait complete. 2023-10-06T11:13:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7f49374db700 1 Processor -- start 2023-10-06T11:13:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c7c0c30f0 con 0x7f0c7c159a20 2023-10-06T11:13:29.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7f228c606700 1 -- start start 2023-10-06T11:13:29.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7f5d301aa700 1 -- 172.21.15.55:0/765115632 shutdown_connections 2023-10-06T11:13:29.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7f49374db700 1 -- start start 2023-10-06T11:13:29.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f5d301aa700 1 -- 172.21.15.55:0/765115632 wait complete. 2023-10-06T11:13:29.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.082+0000 7fb5616f2700 1 -- 172.21.15.55:0/4002652456 wait complete. 2023-10-06T11:13:29.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f228c606700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22840c8d50 0x7f22840c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f228c606700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228415a870 0x7f228416ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f228c606700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f228415ac40 0x7f2284171310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f228c606700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840c3d70 con 0x7f228415a870 2023-10-06T11:13:29.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f228c606700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840c3160 con 0x7f22840c8d50 2023-10-06T11:13:29.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.083+0000 7f228c606700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840c3440 con 0x7f228415ac40 2023-10-06T11:13:29.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f228aba3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f228415ac40 0x7f2284171310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f228aba3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f228415ac40 0x7f2284171310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56312/0 (socket says 172.21.15.55:56312) 2023-10-06T11:13:29.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f228aba3700 1 -- 172.21.15.55:0/304244854 learned_addr learned my addr 172.21.15.55:0/304244854 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f2289ba1700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228415a870 0x7f228416ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7fb5616f2700 1 Processor -- start 2023-10-06T11:13:29.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f49374db700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49301763d0 0x7f49300ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f49374db700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300ada90 0x7f49300bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f49374db700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300c0450 0x7f49300cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f49374db700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49300adf00 con 0x7f49300c0450 2023-10-06T11:13:29.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f49374db700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493015aa70 con 0x7f49301763d0 2023-10-06T11:13:29.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f49374db700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4930159ea0 con 0x7f49300ada90 2023-10-06T11:13:29.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f5d301aa700 1 Processor -- start 2023-10-06T11:13:29.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7fb5616f2700 1 -- start start 2023-10-06T11:13:29.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c6c022030 con 0x7f0c7c159a20 2023-10-06T11:13:29.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f4935a78700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300c0450 0x7f49300cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f4935a78700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300c0450 0x7f49300cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37298/0 (socket says 172.21.15.55:37298) 2023-10-06T11:13:29.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f4935a78700 1 -- 172.21.15.55:0/972750857 learned_addr learned my addr 172.21.15.55:0/972750857 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fcec51f7700 1 Processor -- start 2023-10-06T11:13:29.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fcec51f7700 1 -- start start 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f4935a78700 1 -- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300ada90 msgr2=0x7f49300bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f4935a78700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49300ada90 0x7f49300bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f4935a78700 1 -- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49301763d0 msgr2=0x7f49300ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f4935a78700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49301763d0 0x7f49300ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f4935a78700 1 -- 172.21.15.55:0/972750857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493015a140 con 0x7f49300c0450 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f4935a78700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300c0450 0x7f49300cabe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4928009010 tx=0x7f492801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928013030 con 0x7f49300c0450 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492800e370 con 0x7f49300c0450 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.085+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928019a40 con 0x7f49300c0450 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493015a420 con 0x7f49300c0450 2023-10-06T11:13:29.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49301767a0 con 0x7f49300c0450 2023-10-06T11:13:29.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f0c62ffd700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb5616f2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb55c067800 0x7fb55c0c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb5616f2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067bd0 0x7fb55c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb5616f2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c0bf4b0 0x7fb55c0be820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb5616f2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0c6810 con 0x7fb55c0bf4b0 2023-10-06T11:13:29.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb5616f2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c15f030 con 0x7fb55c067800 2023-10-06T11:13:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb5616f2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c16f370 con 0x7fb55c067bd0 2023-10-06T11:13:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f5d301aa700 1 -- start start 2023-10-06T11:13:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d301aa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d280c82d0 0x7f5d280c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d301aa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d280c8720 0x7f5d281595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d301aa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d28160df0 0x7f5d2815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d301aa700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280c0af0 con 0x7f5d280c8720 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d301aa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280c0d00 con 0x7f5d28160df0 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d301aa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280c0fe0 con 0x7f5d280c82d0 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f2289ba1700 1 -- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f228415ac40 msgr2=0x7f2284171310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f2289ba1700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f228415ac40 0x7f2284171310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f2289ba1700 1 -- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22840c8d50 msgr2=0x7f22840c2aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f2289ba1700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22840c8d50 0x7f22840c2aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.084+0000 7f2289ba1700 1 -- 172.21.15.55:0/304244854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009420 con 0x7f228415a870 2023-10-06T11:13:29.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d2df46700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d280c82d0 0x7f5d280c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d2e747700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d28160df0 0x7f5d2815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d2e747700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d28160df0 0x7f5d2815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50578/0 (socket says 172.21.15.55:50578) 2023-10-06T11:13:29.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f5d2e747700 1 -- 172.21.15.55:0/118845969 learned_addr learned my addr 172.21.15.55:0/118845969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f2289ba1700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228415a870 0x7f228416ef80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2274016000 tx=0x7f2274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7f0c7ad9d700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb55b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c0bf4b0 0x7fb55c0be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb55b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c0bf4b0 0x7fb55c0be820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37310/0 (socket says 172.21.15.55:37310) 2023-10-06T11:13:29.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb55b7fe700 1 -- 172.21.15.55:0/2875400113 learned_addr learned my addr 172.21.15.55:0/2875400113 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.086+0000 7fb55affd700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb55c067800 0x7fb55c0c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2d745700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d280c8720 0x7f5d281595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2df46700 1 -- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d28160df0 msgr2=0x7f5d2815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2df46700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d28160df0 0x7f5d2815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2df46700 1 -- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d280c8720 msgr2=0x7f5d281595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2df46700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d280c8720 0x7f5d281595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2df46700 1 -- 172.21.15.55:0/118845969 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180094f0 con 0x7f5d280c82d0 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55a7fc700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067bd0 0x7fb55c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55affd700 1 -- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067bd0 msgr2=0x7fb55c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55affd700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067bd0 0x7fb55c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55affd700 1 -- 172.21.15.55:0/2875400113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c0bf4b0 msgr2=0x7fb55c0be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55affd700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c0bf4b0 0x7fb55c0be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55affd700 1 -- 172.21.15.55:0/2875400113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009420 con 0x7fb55c067800 2023-10-06T11:13:29.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f5d2df46700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d280c82d0 0x7f5d280c2760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400d860 tx=0x7f5d24008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55a7fc700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb55c067bd0 0x7fb55c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:29.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb55affd700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb55c067800 0x7fb55c0c3700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ef0 tx=0x7fb55400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fcec51f7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcec00c8280 0x7fcec0069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fcec51f7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 0x7fcec00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fcec51f7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec00c7fa0 con 0x7fcec006de10 2023-10-06T11:13:29.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fcec51f7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec00b20a0 con 0x7fcec00c8280 2023-10-06T11:13:29.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fcec51f7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec0069ea0 con 0x7fcec0069a60 2023-10-06T11:13:29.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400baa0 con 0x7f228415a870 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274025420 con 0x7f228415a870 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22840c3720 con 0x7f228415a870 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228416f4c0 con 0x7f228415a870 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2284064a90 con 0x7f228415a870 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740257e0 con 0x7f228415a870 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c6c057860 con 0x7f0c7c159a20 2023-10-06T11:13:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f0c62ffd700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7f0c68070c00 0x7f0c68073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 --> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c68073700 con 0x7f0c68070c00 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c6c0534a0 con 0x7f0c7c159a20 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7f0c7ad9d700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c68066f30 0x7f0c680693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c700096c0 tx=0x7f0c70006be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400cc20 con 0x7fb55c067800 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55400f040 con 0x7fb55c067800 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.087+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554014480 con 0x7fb55c067800 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c16f090 con 0x7fb55c067800 2023-10-06T11:13:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0c04d0 con 0x7fb55c067800 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebf59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 0x7fcec00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcec00c8280 0x7fcec0069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcec00c8280 0x7fcec0069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50592/0 (socket says 172.21.15.55:50592) 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebf59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 0x7fcec00c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56362/0 (socket says 172.21.15.55:56362) 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 -- 172.21.15.55:0/384678219 learned_addr learned my addr 172.21.15.55:0/384678219 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 -- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 msgr2=0x7fcec00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 --2- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 0x7fcec00c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 -- 172.21.15.55:0/384678219 >> v1:172.21.15.142:6789/0 conn(0x7fcec006de10 legacy=0x7fcec0087840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 -- 172.21.15.55:0/384678219 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec00c7950 con 0x7fcec00c8280 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebf59e700 1 --2- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 0x7fcec00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.088+0000 7fcebe59c700 1 --2- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec00c8280 0x7fcec0069520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceb00099b0 tx=0x7fceb0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ed1d5ee4932309 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7fcebdd9b700 1 -- 172.21.15.55:0/384678219 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0009ea0 con 0x7fcec00c8280 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7fcebdd9b700 1 -- 172.21.15.55:0/384678219 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000b860 con 0x7fcec00c8280 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7fcebdd9b700 1 -- 172.21.15.55:0/384678219 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb000bc00 con 0x7fcec00c8280 2023-10-06T11:13:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4928019560 con 0x7f49300c0450 2023-10-06T11:13:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb55c064a90 con 0x7fb55c067800 2023-10-06T11:13:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7fcec51f7700 1 -- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec00c8280 msgr2=0x7fcec0069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7fcec51f7700 1 --2- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec00c8280 0x7fcec0069520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceb00099b0 tx=0x7fceb0009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f0c7b59e700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7f0c68070c00 0x7f0c68073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fcec51f7700 1 -- 172.21.15.55:0/384678219 shutdown_connections 2023-10-06T11:13:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fcec51f7700 1 --2- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec0069a60 0x7fcec00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fcec51f7700 1 --2- 172.21.15.55:0/384678219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec00c8280 0x7fcec0069520 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceb00099b0 tx=0x7fceb0009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fcec51f7700 1 -- 172.21.15.55:0/384678219 >> 172.21.15.55:0/384678219 conn(0x7fcec0068080 msgr2=0x7fcec00cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49300c2f10 con 0x7f49300c0450 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7f49257fa700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4914066f30 0x7f49140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.089+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4928014070 con 0x7f49300c0450 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f49257fa700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f4914070b80 0x7f4914072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 --> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4914073680 con 0x7f4914070b80 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4928053440 con 0x7f49300c0450 2023-10-06T11:13:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f4935277700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4914066f30 0x7f49140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fcec51f7700 1 -- 172.21.15.55:0/384678219 shutdown_connections 2023-10-06T11:13:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f4935277700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4914066f30 0x7f49140693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4920007e40 tx=0x7f4920007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24014620 con 0x7f5d280c82d0 2023-10-06T11:13:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d24014780 con 0x7f5d280c82d0 2023-10-06T11:13:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24014b20 con 0x7f5d280c82d0 2023-10-06T11:13:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280c12c0 con 0x7f5d280c82d0 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5540147f0 con 0x7fb55c067800 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fb542ffd700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5440670d0 0x7fb544069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb554085700 con 0x7fb55c067800 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7fb55a7fc700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5440670d0 0x7fb544069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7fb542ffd700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7fb544070da0 0x7fb5440731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 --> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5440738a0 con 0x7fb544070da0 2023-10-06T11:13:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb554087ca0 con 0x7fb55c067800 2023-10-06T11:13:29.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d280c2ca0 con 0x7f5d280c82d0 2023-10-06T11:13:29.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7f0c7b59e700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7f0c68070c00 0x7f0c68073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7f4934a76700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f4914070b80 0x7f4914072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7fb55a7fc700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5440670d0 0x7fb544069580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb550003080 tx=0x7fb550017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.090+0000 7fcec51f7700 1 -- 172.21.15.55:0/384678219 wait complete. 2023-10-06T11:13:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== osd.3 v2:172.21.15.55:6816/90688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0c68073700 con 0x7f0c68070c00 2023-10-06T11:13:29.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7fb55b7fe700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7fb544070da0 0x7fb5440731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d28064a90 con 0x7f5d280c82d0 2023-10-06T11:13:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.091+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2274023070 con 0x7f228415a870 2023-10-06T11:13:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f227a7fc700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2268067080 0x7f2268069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2274086640 con 0x7f228415a870 2023-10-06T11:13:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f227a7fc700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f2268070d50 0x7f2268073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 --> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2268073850 con 0x7f2268070d50 2023-10-06T11:13:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2274086970 con 0x7f228415a870 2023-10-06T11:13:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f228a3a2700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2268067080 0x7f2268069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7fcec51f7700 1 Processor -- start 2023-10-06T11:13:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7fcec51f7700 1 -- start start 2023-10-06T11:13:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f4934a76700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f4914070b80 0x7f4914072fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.092+0000 7f228aba3700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f2268070d50 0x7f2268073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7f228a3a2700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2268067080 0x7f2268069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22800058d0 tx=0x7f2280007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fb55b7fe700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7fb544070da0 0x7fb5440731d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7f228aba3700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f2268070d50 0x7f2268073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d2401d400 con 0x7f5d280c82d0 2023-10-06T11:13:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d1dffb700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5d0c067000 0x7f5d0c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5d24085740 con 0x7f5d280c82d0 2023-10-06T11:13:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d1dffb700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f5d0c070cd0 0x7f5d0c073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 --> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d0c0737d0 con 0x7f5d0c070cd0 2023-10-06T11:13:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d24085b10 con 0x7f5d280c82d0 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fcec51f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec0069a60 0x7fcec017e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fcec51f7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec006de10 0x7fcec00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fcec51f7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcec00c5cb0 0x7fcec00ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fcec51f7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00c4e70 con 0x7fcec00c5cb0 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fcec51f7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00c1210 con 0x7fcec0069a60 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7fcec51f7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00adc80 con 0x7fcec006de10 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec0069a60 0x7fcec017e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec0069a60 0x7fcec017e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50594/0 (socket says 172.21.15.55:50594) 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 -- 172.21.15.55:0/161651023 learned_addr learned my addr 172.21.15.55:0/161651023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebe59c700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec006de10 0x7fcec00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 -- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec006de10 msgr2=0x7fcec00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcec006de10 0x7fcec00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 -- 172.21.15.55:0/161651023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcec00c5cb0 msgr2=0x7fcec00ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcec00c5cb0 0x7fcec00ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fcebed9d700 1 -- 172.21.15.55:0/161651023 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009a20 con 0x7fcec0069a60 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.093+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== osd.7 v2:172.21.15.142:6800/90858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4914073680 con 0x7f4914070b80 2023-10-06T11:13:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== osd.2 v2:172.21.15.55:6817/90687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2268073850 con 0x7f2268070d50 2023-10-06T11:13:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d2e747700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f5d0c070cd0 0x7f5d0c073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7f5d2d745700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5d0c067000 0x7f5d0c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.094+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== osd.4 v2:172.21.15.142:6808/90857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb5440738a0 con 0x7fb544070da0 2023-10-06T11:13:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.095+0000 7f5d2e747700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f5d0c070cd0 0x7f5d0c073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.096+0000 7fcebed9d700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec0069a60 0x7fcec017e150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fceb400c590 tx=0x7fceb400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.096+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== osd.0 v2:172.21.15.55:6808/90685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5d0c0737d0 con 0x7f5d0c070cd0 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.096+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4011590 con 0x7fcec0069a60 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.096+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb4011710 con 0x7fcec0069a60 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.096+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4011ad0 con 0x7fcec0069a60 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.100+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb00094f0 con 0x7fcec0069a60 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.100+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec00c0bc0 con 0x7fcec0069a60 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.101+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcec0064a90 con 0x7fcec0069a60 2023-10-06T11:13:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.098+0000 7f5d2d745700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5d0c067000 0x7f5d0c0694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806d140 tx=0x7f5d18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.105+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fceb401c440 con 0x7fcec0069a60 2023-10-06T11:13:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.105+0000 7fcea6ffd700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fceac067080 0x7fceac069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.105+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fceb4084260 con 0x7fcec0069a60 2023-10-06T11:13:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.105+0000 7fcea6ffd700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7fceac070d50 0x7fceac073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.105+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 --> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fceac073850 con 0x7fceac070d50 2023-10-06T11:13:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.105+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb4084590 con 0x7fcec0069a60 2023-10-06T11:13:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.106+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48540b3250 con 0x7f4838070cd0 2023-10-06T11:13:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.106+0000 7fcebf59e700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7fceac070d50 0x7fceac073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.106+0000 7f4849ffb700 1 -- 172.21.15.55:0/3456749248 <== osd.1 v2:172.21.15.55:6800/90686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f48540b3250 con 0x7f4838070cd0 2023-10-06T11:13:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.107+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f4838070cd0 msgr2=0x7f4838073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.107+0000 7f485bc8e700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f4838070cd0 0x7f4838073100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7fcebe59c700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fceac067080 0x7fceac069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4838067080 msgr2=0x7f4838069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485bc8e700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4838067080 0x7f4838069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4844009390 tx=0x7f4844016000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48540cc7e0 msgr2=0x7f4854162d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485bc8e700 1 --2- 172.21.15.55:0/3456749248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48540cc7e0 0x7f4854162d10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f485000b810 tx=0x7f4850009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485a22b700 1 -- 172.21.15.55:0/3456749248 reap_dead start 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 shutdown_connections 2023-10-06T11:13:29.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 >> 172.21.15.55:0/3456749248 conn(0x7f48540997f0 msgr2=0x7f485415cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.110+0000 7fcebe59c700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fceac067080 0x7fceac069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fceb00099b0 tx=0x7fceb0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.114+0000 7ff74516d700 1 Processor -- start 2023-10-06T11:13:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.114+0000 7ff74516d700 1 -- start start 2023-10-06T11:13:29.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 shutdown_connections 2023-10-06T11:13:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.115+0000 7ff74516d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7400caa90 0x7ff74006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.115+0000 7ff74516d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74006ecd0 con 0x7ff7400675b0 2023-10-06T11:13:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.115+0000 7ff74516d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7400cb870 con 0x7ff74015cab0 2023-10-06T11:13:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.115+0000 7ff74516d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400cbb50 con 0x7ff7400caa90 2023-10-06T11:13:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73ed9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff74015cab0 0x7ff7400cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56048/0 (socket says 172.21.15.55:56048) 2023-10-06T11:13:29.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73ed9d700 1 -- 172.21.15.55:0/1337012942 learned_addr learned my addr 172.21.15.55:0/1337012942 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7f485bc8e700 1 -- 172.21.15.55:0/3456749248 wait complete. 2023-10-06T11:13:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73e59c700 1 --2- 172.21.15.55:0/1337012942 >> v2:172.21.15.55:3300/0 conn(0x7ff7400caa90 0x7ff74006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73e59c700 1 -- 172.21.15.55:0/1337012942 >> v1:172.21.15.142:6789/0 conn(0x7ff74015cab0 legacy=0x7ff7400cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73e59c700 1 -- 172.21.15.55:0/1337012942 >> v1:172.21.15.55:6789/0 conn(0x7ff7400675b0 legacy=0x7ff7400679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73e59c700 1 -- 172.21.15.55:0/1337012942 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74006e680 con 0x7ff7400caa90 2023-10-06T11:13:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7fcebf59e700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7fceac070d50 0x7fceac073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.116+0000 7ff73e59c700 1 --2- 172.21.15.55:0/1337012942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400caa90 0x7ff74006f160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7340098e0 tx=0x7ff7340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7739873ce85d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.117+0000 7ff73dd9b700 1 -- 172.21.15.55:0/1337012942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734009e80 con 0x7ff7400caa90 2023-10-06T11:13:29.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.117+0000 7ff73dd9b700 1 -- 172.21.15.55:0/1337012942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73400b820 con 0x7ff7400caa90 2023-10-06T11:13:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.117+0000 7ff73dd9b700 1 -- 172.21.15.55:0/1337012942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400bbe0 con 0x7ff7400caa90 2023-10-06T11:13:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.117+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== osd.6 v2:172.21.15.142:6816/90888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fceac073850 con 0x7fceac070d50 2023-10-06T11:13:29.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.118+0000 7ff74516d700 1 -- 172.21.15.55:0/1337012942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400caa90 msgr2=0x7ff74006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.118+0000 7ff74516d700 1 --2- 172.21.15.55:0/1337012942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400caa90 0x7ff74006f160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7340098e0 tx=0x7ff7340091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.118+0000 7ff74516d700 1 -- 172.21.15.55:0/1337012942 shutdown_connections 2023-10-06T11:13:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.118+0000 7ff74516d700 1 --2- 172.21.15.55:0/1337012942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400caa90 0x7ff74006f160 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.118+0000 7ff74516d700 1 -- 172.21.15.55:0/1337012942 >> 172.21.15.55:0/1337012942 conn(0x7ff7400cdeb0 msgr2=0x7ff7400c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.122+0000 7ff74516d700 1 -- 172.21.15.55:0/1337012942 shutdown_connections 2023-10-06T11:13:29.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.122+0000 7ff74516d700 1 -- 172.21.15.55:0/1337012942 wait complete. 2023-10-06T11:13:29.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.123+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 --> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c7c064a90 con 0x7f0c68070c00 2023-10-06T11:13:29.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.123+0000 7ff74516d700 1 Processor -- start 2023-10-06T11:13:29.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.123+0000 7ff74516d700 1 -- start start 2023-10-06T11:13:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.124+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 --> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22840cd4f0 con 0x7f2268070d50 2023-10-06T11:13:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.124+0000 7f227a7fc700 1 -- 172.21.15.55:0/304244854 <== osd.2 v2:172.21.15.55:6817/90687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22840cd4f0 con 0x7f2268070d50 2023-10-06T11:13:29.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff74516d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400675b0 0x7ff74015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff74516d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7400caa90 0x7ff74015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff74516d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74015a6d0 0x7ff7400b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff74516d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74016e0b0 con 0x7ff7400675b0 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff74516d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015c380 con 0x7ff7400caa90 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff74516d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015b9c0 con 0x7ff74015a6d0 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff73e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7400caa90 0x7ff74015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.125+0000 7ff73ed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400675b0 0x7ff74015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400675b0 0x7ff74015bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37336/0 (socket says 172.21.15.55:37336) 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 -- 172.21.15.55:0/1041012972 learned_addr learned my addr 172.21.15.55:0/1041012972 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 -- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74015a6d0 msgr2=0x7ff7400b2190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74015a6d0 0x7ff7400b2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 -- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7400caa90 msgr2=0x7ff74015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7400caa90 0x7ff74015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 -- 172.21.15.55:0/1041012972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff734009420 con 0x7ff7400675b0 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73e59c700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7400caa90 0x7ff74015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:29.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7ff73ed9d700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400675b0 0x7ff74015bda0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c5c0 tx=0x7ff730007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.126+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 --> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb55c06e560 con 0x7fb544070da0 2023-10-06T11:13:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.127+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730005b30 con 0x7ff7400675b0 2023-10-06T11:13:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.127+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74016f040 con 0x7ff7400675b0 2023-10-06T11:13:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.127+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730005c90 con 0x7ff7400675b0 2023-10-06T11:13:29.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.127+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730004a60 con 0x7ff7400675b0 2023-10-06T11:13:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.127+0000 7fb542ffd700 1 -- 172.21.15.55:0/2875400113 <== osd.4 v2:172.21.15.142:6808/90857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb55c06e560 con 0x7fb544070da0 2023-10-06T11:13:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.127+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74016ebb0 con 0x7ff7400675b0 2023-10-06T11:13:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7fb544070da0 msgr2=0x7fb5440731d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7fb544070da0 0x7fb5440731d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 --> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d280c1120 con 0x7f5d0c070cd0 2023-10-06T11:13:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5440670d0 msgr2=0x7fb544069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5440670d0 0x7fb544069580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb550003080 tx=0x7fb550017000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb55c067800 msgr2=0x7fb55c0c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 --2- 172.21.15.55:0/2875400113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb55c067800 0x7fb55c0c3700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ef0 tx=0x7fb55400b040 comp rx=0 tx=0).stop 2023-10-06T11:13:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb55b7fe700 1 -- 172.21.15.55:0/2875400113 reap_dead start 2023-10-06T11:13:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 shutdown_connections 2023-10-06T11:13:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 >> 172.21.15.55:0/2875400113 conn(0x7fb55c0cc6f0 msgr2=0x7fb55c0cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7f5d1dffb700 1 -- 172.21.15.55:0/118845969 <== osd.0 v2:172.21.15.55:6808/90685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d280c1120 con 0x7f5d0c070cd0 2023-10-06T11:13:29.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff740064a90 con 0x7ff7400675b0 2023-10-06T11:13:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 shutdown_connections 2023-10-06T11:13:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.129+0000 7fb5616f2700 1 -- 172.21.15.55:0/2875400113 wait complete. 2023-10-06T11:13:29.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.130+0000 7f0c62ffd700 1 -- 172.21.15.55:0/1984852222 <== osd.3 v2:172.21.15.55:6816/90688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c7c064a90 con 0x7f0c68070c00 2023-10-06T11:13:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.130+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff730005030 con 0x7ff7400675b0 2023-10-06T11:13:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.130+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f5d0c070cd0 msgr2=0x7f5d0c073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.130+0000 7f5d301aa700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f5d0c070cd0 0x7f5d0c073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.130+0000 7ff726ffd700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff72c067080 0x7ff72c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.130+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff730084040 con 0x7ff7400675b0 2023-10-06T11:13:29.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7ff73e59c700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff72c067080 0x7ff72c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7ff726ffd700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7ff72c070cd0 0x7ff72c073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 --> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff72c0737d0 con 0x7ff72c070cd0 2023-10-06T11:13:29.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f2268070d50 msgr2=0x7f2268073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f2268070d50 0x7f2268073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7ff73f59e700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7ff72c070cd0 0x7ff72c073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff730050e40 con 0x7ff7400675b0 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2268067080 msgr2=0x7f2268069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2268067080 0x7f2268069530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22800058d0 tx=0x7f2280007a60 comp rx=0 tx=0).stop 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228415a870 msgr2=0x7f228416ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 --2- 172.21.15.55:0/304244854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228415a870 0x7f228416ef80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2274016000 tx=0x7f2274017000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228aba3700 1 -- 172.21.15.55:0/304244854 reap_dead start 2023-10-06T11:13:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7ff73e59c700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff72c067080 0x7ff72c069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7340098e0 tx=0x7ff734016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5d0c067000 msgr2=0x7f5d0c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f5d301aa700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5d0c067000 0x7f5d0c0694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806d140 tx=0x7f5d18017000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d280c82d0 msgr2=0x7f5d280c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f5d301aa700 1 --2- 172.21.15.55:0/118845969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d280c82d0 0x7f5d280c2760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400d860 tx=0x7f5d24008040 comp rx=0 tx=0).stop 2023-10-06T11:13:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 shutdown_connections 2023-10-06T11:13:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 >> 172.21.15.55:0/304244854 conn(0x7f2284067d90 msgr2=0x7f22840cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.131+0000 7f5d2e747700 1 -- 172.21.15.55:0/118845969 reap_dead start 2023-10-06T11:13:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.132+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 shutdown_connections 2023-10-06T11:13:29.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.132+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 >> 172.21.15.55:0/118845969 conn(0x7f5d28068080 msgr2=0x7f5d280aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.132+0000 7ff73f59e700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7ff72c070cd0 0x7ff72c073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.132+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 --> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4930064a90 con 0x7f4914070b80 2023-10-06T11:13:29.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.132+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 shutdown_connections 2023-10-06T11:13:29.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.132+0000 7f49257fa700 1 -- 172.21.15.55:0/972750857 <== osd.7 v2:172.21.15.142:6800/90858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4930064a90 con 0x7f4914070b80 2023-10-06T11:13:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.133+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 shutdown_connections 2023-10-06T11:13:29.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.133+0000 7f228c606700 1 -- 172.21.15.55:0/304244854 wait complete. 2023-10-06T11:13:29.172 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:29.172 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T11:13:29.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.133+0000 7f5d301aa700 1 -- 172.21.15.55:0/118845969 wait complete. 2023-10-06T11:13:29.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.133+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== osd.5 v2:172.21.15.142:6817/90883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff72c0737d0 con 0x7ff72c070cd0 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.134+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f4914070b80 msgr2=0x7f4914072fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.134+0000 7f49374db700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f4914070b80 0x7f4914072fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.134+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4914066f30 msgr2=0x7f49140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.134+0000 7f49374db700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4914066f30 0x7f49140693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4920007e40 tx=0x7f4920007d30 comp rx=0 tx=0).stop 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.134+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300c0450 msgr2=0x7f49300cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.134+0000 7f49374db700 1 --2- 172.21.15.55:0/972750857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300c0450 0x7f49300cabe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4928009010 tx=0x7f492801d000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.135+0000 7f4935a78700 1 -- 172.21.15.55:0/972750857 reap_dead start 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.135+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 shutdown_connections 2023-10-06T11:13:29.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.135+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 >> 172.21.15.55:0/972750857 conn(0x7f4930068080 msgr2=0x7f49300cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.137+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 shutdown_connections 2023-10-06T11:13:29.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.137+0000 7f49374db700 1 -- 172.21.15.55:0/972750857 wait complete. 2023-10-06T11:13:29.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.147+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7f0c68070c00 msgr2=0x7f0c68073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.147+0000 7f0c8107c700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7f0c68070c00 0x7f0c68073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.176 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-10-06T11:13:29.176 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T11:13:29.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.149+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c68066f30 msgr2=0x7f0c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.149+0000 7f0c8107c700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c68066f30 0x7f0c680693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c700096c0 tx=0x7f0c70006be0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.149+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c159a20 msgr2=0x7f0c7c0c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.149+0000 7f0c8107c700 1 --2- 172.21.15.55:0/1984852222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c159a20 0x7f0c7c0c7290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009290 tx=0x7f0c6c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.149+0000 7f0c7b59e700 1 -- 172.21.15.55:0/1984852222 reap_dead start 2023-10-06T11:13:29.177 INFO:teuthology.orchestra.run.smithi055.stdout:55834574859 2023-10-06T11:13:29.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T11:13:29.178 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:29.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T11:13:29.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.154+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 --> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcec004bb40 con 0x7fceac070d50 2023-10-06T11:13:29.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.154+0000 7fcea6ffd700 1 -- 172.21.15.55:0/161651023 <== osd.6 v2:172.21.15.142:6816/90888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcec004bb40 con 0x7fceac070d50 2023-10-06T11:13:29.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7fceac070d50 msgr2=0x7fceac073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7fceac070d50 0x7fceac073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fceac067080 msgr2=0x7fceac069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fceac067080 0x7fceac069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fceb00099b0 tx=0x7fceb0017000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec0069a60 msgr2=0x7fcec017e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 --2- 172.21.15.55:0/161651023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcec0069a60 0x7fcec017e150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fceb400c590 tx=0x7fceb400c8a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcebf59e700 1 -- 172.21.15.55:0/161651023 reap_dead start 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 shutdown_connections 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 >> 172.21.15.55:0/161651023 conn(0x7fcec0068080 msgr2=0x7fcec00af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 shutdown_connections 2023-10-06T11:13:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.155+0000 7fcec51f7700 1 -- 172.21.15.55:0/161651023 wait complete. 2023-10-06T11:13:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.156+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 shutdown_connections 2023-10-06T11:13:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.156+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 >> 172.21.15.55:0/1984852222 conn(0x7f0c7c068080 msgr2=0x7f0c7c06eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.156+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 shutdown_connections 2023-10-06T11:13:29.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.156+0000 7f0c8107c700 1 -- 172.21.15.55:0/1984852222 wait complete. 2023-10-06T11:13:29.183 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:29.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T11:13:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.160+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 --> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff74016f040 con 0x7ff72c070cd0 2023-10-06T11:13:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.160+0000 7ff726ffd700 1 -- 172.21.15.55:0/1041012972 <== osd.5 v2:172.21.15.142:6817/90883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff74016f040 con 0x7ff72c070cd0 2023-10-06T11:13:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7ff72c070cd0 msgr2=0x7ff72c073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7ff72c070cd0 0x7ff72c073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff72c067080 msgr2=0x7ff72c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff72c067080 0x7ff72c069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7340098e0 tx=0x7ff734016000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400675b0 msgr2=0x7ff74015bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 --2- 172.21.15.55:0/1041012972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7400675b0 0x7ff74015bda0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c5c0 tx=0x7ff730007ee0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff73f59e700 1 -- 172.21.15.55:0/1041012972 reap_dead start 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 shutdown_connections 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 >> 172.21.15.55:0/1041012972 conn(0x7ff7400cdeb0 msgr2=0x7ff7400c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 shutdown_connections 2023-10-06T11:13:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.161+0000 7ff74516d700 1 -- 172.21.15.55:0/1041012972 wait complete. 2023-10-06T11:13:29.187 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:29.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T11:13:29.188 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-10-06T11:13:29.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T11:13:29.189 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:29.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T11:13:29.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.419+0000 7f9d01519700 1 Processor -- start 2023-10-06T11:13:29.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.419+0000 7f9d01519700 1 -- start start 2023-10-06T11:13:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.420+0000 7f94f7392700 1 Processor -- start 2023-10-06T11:13:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.420+0000 7fdde4fd6700 1 Processor -- start 2023-10-06T11:13:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.420+0000 7fdde4fd6700 1 -- start start 2023-10-06T11:13:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9d01519700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9cfc0bf320 0x7f9cfc0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9d01519700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 0x7f9cfc0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9d01519700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0c7fc0 con 0x7f9cfc0bf6f0 2023-10-06T11:13:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9d01519700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc15e190 con 0x7f9cfc0bf320 2023-10-06T11:13:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9d01519700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c73b0 con 0x7f9cfc069c30 2023-10-06T11:13:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f94f7392700 1 -- start start 2023-10-06T11:13:29.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f88e7bce700 1 Processor -- start 2023-10-06T11:13:29.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7fba1a65e700 1 Processor -- start 2023-10-06T11:13:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 0x7f9cfc0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 0x7f9cfc0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56384/0 (socket says 172.21.15.55:56384) 2023-10-06T11:13:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 -- 172.21.15.55:0/611186904 learned_addr learned my addr 172.21.15.55:0/611186904 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f88e7bce700 1 -- start start 2023-10-06T11:13:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 -- 172.21.15.55:0/611186904 >> v2:172.21.15.55:3300/0 conn(0x7f9cfc0bf320 msgr2=0x7f9cfc0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 --2- 172.21.15.55:0/611186904 >> v2:172.21.15.55:3300/0 conn(0x7f9cfc0bf320 0x7f9cfc0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 -- 172.21.15.55:0/611186904 >> v1:172.21.15.55:6789/0 conn(0x7f9cfc0bf6f0 legacy=0x7f9cfc069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7f9cfb7fe700 1 -- 172.21.15.55:0/611186904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0c7690 con 0x7f9cfc069c30 2023-10-06T11:13:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fdde4fd6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdde0070c50 0x7fdde0155600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fdde4fd6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde0068f20 con 0x7fdde00ac440 2023-10-06T11:13:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fdde4fd6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde00ac8d0 con 0x7fdde00707d0 2023-10-06T11:13:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fdde4fd6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00acbb0 con 0x7fdde0070c50 2023-10-06T11:13:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fddddd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdde00707d0 0x7fdde0068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56058/0 (socket says 172.21.15.55:56058) 2023-10-06T11:13:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fddddd9b700 1 -- 172.21.15.55:0/4205459480 learned_addr learned my addr 172.21.15.55:0/4205459480 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f9cfb7fe700 1 --2- 172.21.15.55:0/611186904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 0x7f9cfc0c6680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009f20 tx=0x7f9cf4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5774bb2683842cef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fdddd59a700 1 -- 172.21.15.55:0/4205459480 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820827133 0 0) 0x7fdde00ac8d0 con 0x7fdde00707d0 2023-10-06T11:13:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fdddd59a700 1 -- 172.21.15.55:0/4205459480 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc8003570 con 0x7fdde00707d0 2023-10-06T11:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f9cf9ffb700 1 -- 172.21.15.55:0/611186904 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400e070 con 0x7f9cfc069c30 2023-10-06T11:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f9cf9ffb700 1 -- 172.21.15.55:0/611186904 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400ba40 con 0x7f9cfc069c30 2023-10-06T11:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f9cf9ffb700 1 -- 172.21.15.55:0/611186904 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40092e0 con 0x7f9cfc069c30 2023-10-06T11:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f88e7bce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88e00bf320 0x7f88e00c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f88e7bce700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88e00bf6f0 0x7f88e0069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f88e7bce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 0x7f88e00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f88e7bce700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e015e190 con 0x7f88e00bf6f0 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f88e7bce700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e0069ee0 con 0x7f88e00bf320 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f88e7bce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c7fc0 con 0x7f88e0069a60 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f94f7392700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f00ca370 0x7f94f0158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f94f7392700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94f00ce8a0 0x7f94f015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f94f7392700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f0157de0 con 0x7f94f00adb60 2023-10-06T11:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f94f7392700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f00cbb90 con 0x7f94f00ce8a0 2023-10-06T11:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f94f7392700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00cb5d0 con 0x7f94f00ca370 2023-10-06T11:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 0x7f88e00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 0x7f88e00c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56402/0 (socket says 172.21.15.55:56402) 2023-10-06T11:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 -- 172.21.15.55:0/674513304 learned_addr learned my addr 172.21.15.55:0/674513304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7f94f492d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f94f00adb60 0x7f94f00ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56060/0 (socket says 172.21.15.55:56060) 2023-10-06T11:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94f492d700 1 -- 172.21.15.55:0/3421207083 learned_addr learned my addr 172.21.15.55:0/3421207083 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7fddded9d700 1 --2- 172.21.15.55:0/4205459480 >> v2:172.21.15.142:3300/0 conn(0x7fdde0070c50 0x7fdde0155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.421+0000 7fba1a65e700 1 -- start start 2023-10-06T11:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fba1a65e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba140b25e0 0x7fba140b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fba1a65e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140b29b0 0x7fba14159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fba1a65e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba14159660 0x7fba14068540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fba1a65e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140cbfa0 con 0x7fba14159660 2023-10-06T11:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fba1a65e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140cb390 con 0x7fba140b25e0 2023-10-06T11:13:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.422+0000 7fba1a65e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140cb670 con 0x7fba140b29b0 2023-10-06T11:13:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94f512e700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f00ca370 0x7f94f0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469517044 0 0) 0x7f94f0157de0 con 0x7f94f00adb60 2023-10-06T11:13:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94dc003570 con 0x7f94f00adb60 2023-10-06T11:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e596a700 1 --2- 172.21.15.55:0/674513304 >> v2:172.21.15.142:3300/0 conn(0x7f88e00bf320 0x7f88e00c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 -- 172.21.15.55:0/674513304 >> v2:172.21.15.142:3300/0 conn(0x7f88e00bf320 msgr2=0x7f88e00c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 --2- 172.21.15.55:0/674513304 >> v2:172.21.15.142:3300/0 conn(0x7f88e00bf320 0x7f88e00c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 -- 172.21.15.55:0/674513304 >> v2:172.21.15.55:3300/0 conn(0x7f88e00bf6f0 msgr2=0x7f88e0069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 --2- 172.21.15.55:0/674513304 >> v2:172.21.15.55:3300/0 conn(0x7f88e00bf6f0 0x7f88e0069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 -- 172.21.15.55:0/674513304 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00c73b0 con 0x7f88e0069a60 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838102800 0 0) 0x7f94dc003570 con 0x7f94f00adb60 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f00ca370 msgr2=0x7f94f0158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f00ca370 0x7f94f0158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 >> v2:172.21.15.142:3300/0 conn(0x7f94f00ce8a0 msgr2=0x7f94f015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 --2- 172.21.15.55:0/3421207083 >> v2:172.21.15.142:3300/0 conn(0x7f94f00ce8a0 0x7f94f015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00cb8b0 con 0x7f94f00adb60 2023-10-06T11:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7fba137fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140b29b0 0x7fba14159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f88e616b700 1 --2- 172.21.15.55:0/674513304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 0x7f88e00c6680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f88e006ce60 tx=0x7f88d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f91dc788416510 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7fddded9d700 1 -- 172.21.15.55:0/4205459480 >> v1:172.21.15.142:6789/0 conn(0x7fdde00707d0 legacy=0x7fdde0068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7fddded9d700 1 -- 172.21.15.55:0/4205459480 >> v1:172.21.15.55:6789/0 conn(0x7fdde00ac440 legacy=0x7fdde00afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7fddded9d700 1 -- 172.21.15.55:0/4205459480 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00ace90 con 0x7fdde0070c50 2023-10-06T11:13:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f9d01519700 1 -- 172.21.15.55:0/611186904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 msgr2=0x7f9cfc0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f9d01519700 1 --2- 172.21.15.55:0/611186904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 0x7f9cfc0c6680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009f20 tx=0x7f9cf4009840 comp rx=0 tx=0).stop 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f94ec001470 con 0x7f94f00adb60 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 >> v1:172.21.15.142:6789/0 conn(0x7f94f00adb60 legacy=0x7f94f00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94dc003ae0 0x7f94dc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc004810 0x7f94dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94dc005210 0x7f94dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00cbb90 con 0x7f94dc004810 2023-10-06T11:13:29.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00cb5d0 con 0x7f94dc003ae0 2023-10-06T11:13:29.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc00c100 con 0x7f94dc005210 2023-10-06T11:13:29.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.423+0000 7f9d01519700 1 -- 172.21.15.55:0/611186904 shutdown_connections 2023-10-06T11:13:29.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f9d01519700 1 --2- 172.21.15.55:0/611186904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc069c30 0x7f9cfc0c6680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f9d01519700 1 --2- 172.21.15.55:0/611186904 >> v2:172.21.15.55:3300/0 conn(0x7f9cfc0bf320 0x7f9cfc0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f9d01519700 1 -- 172.21.15.55:0/611186904 >> 172.21.15.55:0/611186904 conn(0x7f9cfc068080 msgr2=0x7f9cfc0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba140b25e0 0x7fba140b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba140b25e0 0x7fba140b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50630/0 (socket says 172.21.15.55:50630) 2023-10-06T11:13:29.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 -- 172.21.15.55:0/1006363187 learned_addr learned my addr 172.21.15.55:0/1006363187 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94dc003ae0 0x7f94dc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba18bfb700 1 --2- 172.21.15.55:0/1006363187 >> v2:172.21.15.55:3300/0 conn(0x7fba14159660 0x7fba14068540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fddded9d700 1 --2- 172.21.15.55:0/4205459480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde0155600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddd40098e0 tx=0x7fddd40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af62fbda59918c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f9d01519700 1 -- 172.21.15.55:0/611186904 shutdown_connections 2023-10-06T11:13:29.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f9d01519700 1 -- 172.21.15.55:0/611186904 wait complete. 2023-10-06T11:13:29.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f492d700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc004810 0x7f94dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 -- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140b29b0 msgr2=0x7fba14159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 --2- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140b29b0 0x7fba14159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 -- 172.21.15.55:0/1006363187 >> v2:172.21.15.55:3300/0 conn(0x7fba14159660 msgr2=0x7fba14068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 --2- 172.21.15.55:0/1006363187 >> v2:172.21.15.55:3300/0 conn(0x7fba14159660 0x7fba14068540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fba13fff700 1 -- 172.21.15.55:0/1006363187 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140cb950 con 0x7fba140b25e0 2023-10-06T11:13:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 -- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94dc005210 msgr2=0x7f94dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94dc005210 0x7f94dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 -- 172.21.15.55:0/3421207083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc004810 msgr2=0x7f94dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc004810 0x7f94dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 -- 172.21.15.55:0/3421207083 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00cb8b0 con 0x7f94dc003ae0 2023-10-06T11:13:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f94f512e700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94dc003ae0 0x7f94dc003ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94f00705d0 tx=0x7f94e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b692583ba98c885 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fba13fff700 1 --2- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b25e0 0x7fba140b0690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba140d0420 tx=0x7fba08009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f7e5cfb641c4737 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000e640 con 0x7f94dc003ae0 2023-10-06T11:13:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f88e4968700 1 -- 172.21.15.55:0/674513304 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800e070 con 0x7f88e0069a60 2023-10-06T11:13:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f88e4968700 1 -- 172.21.15.55:0/674513304 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800ba40 con 0x7f88e0069a60 2023-10-06T11:13:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7f88e4968700 1 -- 172.21.15.55:0/674513304 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80092e0 con 0x7f88e0069a60 2023-10-06T11:13:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7f88e7bce700 1 -- 172.21.15.55:0/674513304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 msgr2=0x7f88e00c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7f88e7bce700 1 --2- 172.21.15.55:0/674513304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 0x7f88e00c6680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f88e006ce60 tx=0x7f88d8009840 comp rx=0 tx=0).stop 2023-10-06T11:13:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e000e7a0 con 0x7f94dc003ae0 2023-10-06T11:13:29.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7f94e7fff700 1 -- 172.21.15.55:0/3421207083 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000eb40 con 0x7f94dc003ae0 2023-10-06T11:13:29.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fba12ffd700 1 -- 172.21.15.55:0/1006363187 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08005c10 con 0x7fba140b25e0 2023-10-06T11:13:29.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fba12ffd700 1 -- 172.21.15.55:0/1006363187 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08005d70 con 0x7fba140b25e0 2023-10-06T11:13:29.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fba12ffd700 1 -- 172.21.15.55:0/1006363187 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08006260 con 0x7fba140b25e0 2023-10-06T11:13:29.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f7392700 1 -- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94dc003ae0 msgr2=0x7f94dc003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f7392700 1 --2- 172.21.15.55:0/3421207083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94dc003ae0 0x7f94dc003ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94f00705d0 tx=0x7f94e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f592f700 1 -- 172.21.15.55:0/3421207083 reap_dead start 2023-10-06T11:13:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fdddd59a700 1 -- 172.21.15.55:0/4205459480 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011630 con 0x7fdde0070c50 2023-10-06T11:13:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.424+0000 7fdddd59a700 1 -- 172.21.15.55:0/4205459480 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4011790 con 0x7fdde0070c50 2023-10-06T11:13:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 -- 172.21.15.55:0/4205459480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 msgr2=0x7fdde0155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/4205459480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde0155600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddd40098e0 tx=0x7fddd40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 -- 172.21.15.55:0/4205459480 shutdown_connections 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/4205459480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde0155600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 -- 172.21.15.55:0/4205459480 >> 172.21.15.55:0/4205459480 conn(0x7fdde006de40 msgr2=0x7fdde006e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 -- 172.21.15.55:0/4205459480 shutdown_connections 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.425+0000 7fdde4fd6700 1 -- 172.21.15.55:0/4205459480 wait complete. 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f7392700 1 -- 172.21.15.55:0/3421207083 shutdown_connections 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f7392700 1 -- 172.21.15.55:0/3421207083 >> 172.21.15.55:0/3421207083 conn(0x7f94f00707d0 msgr2=0x7f94f0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f9d01519700 1 Processor -- start 2023-10-06T11:13:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f7392700 1 -- 172.21.15.55:0/3421207083 shutdown_connections 2023-10-06T11:13:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7f94f7392700 1 -- 172.21.15.55:0/3421207083 wait complete. 2023-10-06T11:13:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7fdde4fd6700 1 Processor -- start 2023-10-06T11:13:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.426+0000 7fdde4fd6700 1 -- start start 2023-10-06T11:13:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 -- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b25e0 msgr2=0x7fba140b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b25e0 0x7fba140b0690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba140d0420 tx=0x7fba08009220 comp rx=0 tx=0).stop 2023-10-06T11:13:29.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7f9d01519700 1 -- start start 2023-10-06T11:13:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 -- 172.21.15.55:0/1006363187 shutdown_connections 2023-10-06T11:13:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1006363187 >> v2:172.21.15.55:3300/0 conn(0x7fba14159660 0x7fba14068540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b25e0 0x7fba140b0690 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba140d0420 tx=0x7fba08009220 comp rx=0 tx=0).stop 2023-10-06T11:13:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1006363187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140b29b0 0x7fba14159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 -- 172.21.15.55:0/1006363187 >> 172.21.15.55:0/1006363187 conn(0x7fba1406ece0 msgr2=0x7fba1406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 -- 172.21.15.55:0/1006363187 shutdown_connections 2023-10-06T11:13:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fdde4fd6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdde00707d0 0x7fdde00a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fdde4fd6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde00c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fdde4fd6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdde00ac440 0x7fdde0149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fdde4fd6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00a7cd0 con 0x7fdde00707d0 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fdde4fd6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00a7fb0 con 0x7fdde0070c50 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fdde4fd6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00a7100 con 0x7fdde00ac440 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddded9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdde00ac440 0x7fdde0149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde00c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddded9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdde00ac440 0x7fdde0149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56430/0 (socket says 172.21.15.55:56430) 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddded9d700 1 -- 172.21.15.55:0/2355233218 learned_addr learned my addr 172.21.15.55:0/2355233218 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde00c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50646/0 (socket says 172.21.15.55:50646) 2023-10-06T11:13:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f94f7392700 1 Processor -- start 2023-10-06T11:13:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f94f7392700 1 -- start start 2023-10-06T11:13:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9d01519700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 0x7f9cfc0c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9d01519700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc0bf320 0x7f9cfc0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9d01519700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cfc0bf6f0 0x7f9cfc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9d01519700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c66d0 con 0x7f9cfc0bf6f0 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9d01519700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c5d00 con 0x7f9cfc069c30 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9d01519700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c50f0 con 0x7f9cfc0bf320 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 -- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdde00ac440 msgr2=0x7fdde0149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdde00ac440 0x7fdde0149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 -- 172.21.15.55:0/2355233218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdde00707d0 msgr2=0x7fdde00a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdde00707d0 0x7fdde00a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 -- 172.21.15.55:0/2355233218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4009420 con 0x7fdde0070c50 2023-10-06T11:13:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 0x7f9cfc0c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 0x7f9cfc0c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50656/0 (socket says 172.21.15.55:50656) 2023-10-06T11:13:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 -- 172.21.15.55:0/2162718328 learned_addr learned my addr 172.21.15.55:0/2162718328 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddddd9b700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde00c9060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddd00011e0 tx=0x7fddd0007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0005b30 con 0x7fdde0070c50 2023-10-06T11:13:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0005cb0 con 0x7fdde0070c50 2023-10-06T11:13:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00a73e0 con 0x7fdde0070c50 2023-10-06T11:13:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde00a6e10 con 0x7fdde0070c50 2023-10-06T11:13:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0007320 con 0x7fdde0070c50 2023-10-06T11:13:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.427+0000 7fba1a65e700 1 -- 172.21.15.55:0/1006363187 wait complete. 2023-10-06T11:13:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7fba1a65e700 1 Processor -- start 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 -- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc0bf320 msgr2=0x7f9cfc0c4380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc0bf320 0x7f9cfc0c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 -- 172.21.15.55:0/2162718328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cfc0bf6f0 msgr2=0x7f9cfc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cfc0bf6f0 0x7f9cfc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.428+0000 7f9cfaffd700 1 -- 172.21.15.55:0/2162718328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009ae0 con 0x7f9cfc069c30 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f9cfaffd700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 0x7f9cfc0c6190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00b840 tx=0x7f9cec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7fba1a65e700 1 -- start start 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00f590 con 0x7f9cfc069c30 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec00f6f0 con 0x7f9cfc069c30 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00fab0 con 0x7f9cfc069c30 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f94f7392700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc003ae0 0x7f94f01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f94f7392700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 0x7f94f016f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f94f7392700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f013c6b0 0x7f94f016f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f94f7392700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f0155100 con 0x7f94dc003ae0 2023-10-06T11:13:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f94f7392700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f016efc0 con 0x7f94f015a2c0 2023-10-06T11:13:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.429+0000 7f94f7392700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f0149550 con 0x7f94f013c6b0 2023-10-06T11:13:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc0c53d0 con 0x7f9cfc069c30 2023-10-06T11:13:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc0c5990 con 0x7f9cfc069c30 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba1a65e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b29b0 0x7fba141557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba1a65e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba14159660 0x7fba1416e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba1a65e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba14158440 0x7fba141508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba1a65e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c6eb0 con 0x7fba14159660 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba1a65e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c4da0 con 0x7fba140b29b0 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba1a65e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c66e0 con 0x7fba14158440 2023-10-06T11:13:29.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b29b0 0x7fba141557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b29b0 0x7fba141557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50658/0 (socket says 172.21.15.55:50658) 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba13fff700 1 -- 172.21.15.55:0/1341583590 learned_addr learned my addr 172.21.15.55:0/1341583590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba18bfb700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba14158440 0x7fba141508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7f94f492d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 0x7f94f016f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7f94f492d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 0x7f94f016f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50672/0 (socket says 172.21.15.55:50672) 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7f94f492d700 1 -- 172.21.15.55:0/3581294653 learned_addr learned my addr 172.21.15.55:0/3581294653 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc40052b0 con 0x7fdde0070c50 2023-10-06T11:13:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba18bfb700 1 -- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b29b0 msgr2=0x7fba141557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.430+0000 7fba18bfb700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b29b0 0x7fba141557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fba18bfb700 1 -- 172.21.15.55:0/1341583590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba14159660 msgr2=0x7fba1416e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fba18bfb700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba14159660 0x7fba1416e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fba18bfb700 1 -- 172.21.15.55:0/1341583590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009480 con 0x7fba14158440 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f592f700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f013c6b0 0x7f94f016f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f492d700 1 -- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f013c6b0 msgr2=0x7f94f016f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f492d700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f013c6b0 0x7f94f016f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f492d700 1 -- 172.21.15.55:0/3581294653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc003ae0 msgr2=0x7f94f01464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f492d700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc003ae0 0x7f94f01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f492d700 1 -- 172.21.15.55:0/3581294653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f013ccd0 con 0x7f94f015a2c0 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f592f700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f013c6b0 0x7f94f016f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fba18bfb700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba14158440 0x7fba141508b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00ecc0 tx=0x7fba0c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94f492d700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 0x7f94f016f450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00ec10 tx=0x7f94ec001ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00eed0 con 0x7fba14158440 2023-10-06T11:13:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00f040 con 0x7fba14158440 2023-10-06T11:13:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00cda0 con 0x7fba14158440 2023-10-06T11:13:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00c880 con 0x7f94f015a2c0 2023-10-06T11:13:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00ca00 con 0x7f94f015a2c0 2023-10-06T11:13:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.431+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00cdc0 con 0x7f94f015a2c0 2023-10-06T11:13:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.432+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddd001b3b0 con 0x7fdde0070c50 2023-10-06T11:13:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.432+0000 7fddce7fc700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fddc0066f60 0x7fddc0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.432+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba140c68f0 con 0x7fba14158440 2023-10-06T11:13:29.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.432+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba140c4f90 con 0x7fba14158440 2023-10-06T11:13:29.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.432+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cec01a460 con 0x7f9cfc069c30 2023-10-06T11:13:29.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.432+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fddd0083d90 con 0x7fdde0070c50 2023-10-06T11:13:29.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7fddde59c700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fddc0066f60 0x7fddc0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14064a90 con 0x7fba14158440 2023-10-06T11:13:29.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f9ce2ffd700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce4067160 0x7f9ce4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9cec084640 con 0x7f9cfc069c30 2023-10-06T11:13:29.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc0052b0 con 0x7f9cfc069c30 2023-10-06T11:13:29.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f01486e0 con 0x7f94f015a2c0 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f0154d90 con 0x7f94f015a2c0 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 -- 172.21.15.55:0/674513304 shutdown_connections 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 --2- 172.21.15.55:0/674513304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e0069a60 0x7f88e00c6680 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 --2- 172.21.15.55:0/674513304 >> v2:172.21.15.142:3300/0 conn(0x7f88e00bf320 0x7f88e00c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 --2- 172.21.15.55:0/674513304 >> v2:172.21.15.55:3300/0 conn(0x7f88e00bf6f0 0x7f88e0069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 -- 172.21.15.55:0/674513304 >> 172.21.15.55:0/674513304 conn(0x7f88e0068080 msgr2=0x7f88e00cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 -- 172.21.15.55:0/674513304 shutdown_connections 2023-10-06T11:13:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f88e7bce700 1 -- 172.21.15.55:0/674513304 wait complete. 2023-10-06T11:13:29.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f887578d700 1 Processor -- start 2023-10-06T11:13:29.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.433+0000 7f887578d700 1 -- start start 2023-10-06T11:13:29.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f9cfa7fc700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce4067160 0x7f9ce4069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f0148550 con 0x7f94f015a2c0 2023-10-06T11:13:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f887578d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 0x7f8870069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7fddde59c700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fddc0066f60 0x7fddc0069410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddd800ad10 tx=0x7fddd8009370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f887578d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700c7fa0 con 0x7f88700c8280 2023-10-06T11:13:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f887578d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700c8850 con 0x7f88700696e0 2023-10-06T11:13:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f887578d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700b20a0 con 0x7f887006de10 2023-10-06T11:13:29.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba0c014690 con 0x7fba14158440 2023-10-06T11:13:29.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f8867fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 0x7f8870069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f8867fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 0x7f8870069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56446/0 (socket says 172.21.15.55:56446) 2023-10-06T11:13:29.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f8867fff700 1 -- 172.21.15.55:0/2294819953 learned_addr learned my addr 172.21.15.55:0/2294819953 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.434+0000 7f9cfa7fc700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce4067160 0x7f9ce4069610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0c2810 tx=0x7f9cf0006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7f8867fff700 1 -- 172.21.15.55:0/2294819953 >> v1:172.21.15.142:6789/0 conn(0x7f88700696e0 legacy=0x7f8870087840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:13:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7f8867fff700 1 -- 172.21.15.55:0/2294819953 >> v1:172.21.15.55:6789/0 conn(0x7f88700c8280 legacy=0x7f88700af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7f8867fff700 1 -- 172.21.15.55:0/2294819953 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700c7950 con 0x7f887006de10 2023-10-06T11:13:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7fb9fbfff700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba00066fb0 0x7fba00069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7f8867fff700 1 --2- 172.21.15.55:0/2294819953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 0x7f8870069ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88580099e0 tx=0x7f8858009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710084b4ee10b77a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7f88e7bce700 1 Processor -- start 2023-10-06T11:13:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7f88e7bce700 1 -- start start 2023-10-06T11:13:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba0c085310 con 0x7fba14158440 2023-10-06T11:13:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.435+0000 7fba13fff700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba00066fb0 0x7fba00069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7fba13fff700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba00066fb0 0x7fba00069460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba08007fd0 tx=0x7fba08016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e7bce700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 0x7f88e015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e7bce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88e00bf320 0x7f88e00c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e7bce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e00bf6f0 0x7f88e015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e7bce700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0146e80 con 0x7f88e0069a60 2023-10-06T11:13:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e7bce700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e015efc0 con 0x7f88e00bf320 2023-10-06T11:13:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e7bce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c0b40 con 0x7f88e00bf6f0 2023-10-06T11:13:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f48d42d2700 1 Processor -- start 2023-10-06T11:13:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e596a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 0x7f88e015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e596a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 0x7f88e015ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37412/0 (socket says 172.21.15.55:37412) 2023-10-06T11:13:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e596a700 1 -- 172.21.15.55:0/128154441 learned_addr learned my addr 172.21.15.55:0/128154441 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e5169700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88e00bf320 0x7f88e00c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e616b700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e00bf6f0 0x7f88e015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f48d42d2700 1 -- start start 2023-10-06T11:13:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e596a700 1 -- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e00bf6f0 msgr2=0x7f88e015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.436+0000 7f88e596a700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e00bf6f0 0x7f88e015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e596a700 1 -- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88e00bf320 msgr2=0x7f88e00c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e596a700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88e00bf320 0x7f88e00c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e596a700 1 -- 172.21.15.55:0/128154441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009ae0 con 0x7f88e0069a60 2023-10-06T11:13:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e5169700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88e00bf320 0x7f88e00c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e596a700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 0x7f88e015ea80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00c7d0 tx=0x7f88dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011600 con 0x7f88e0069a60 2023-10-06T11:13:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc011760 con 0x7f88e0069a60 2023-10-06T11:13:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00bff30 con 0x7f88e0069a60 2023-10-06T11:13:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011b20 con 0x7f88e0069a60 2023-10-06T11:13:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddd0050bb0 con 0x7fdde0070c50 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f48d42d2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48cc155820 0x7f48cc0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f48d42d2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48cc0c8260 0x7f48cc069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f48d42d2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0c7dd0 con 0x7f48cc0cbc20 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f48d42d2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0acca0 con 0x7f48cc0c8260 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d42d2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0ae9c0 con 0x7f48cc155820 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d206e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48cc155820 0x7f48cc0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d286f700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f48cc0cbc20 0x7f48cc06dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56062/0 (socket says 172.21.15.55:56062) 2023-10-06T11:13:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d286f700 1 -- 172.21.15.55:0/98077841 learned_addr learned my addr 172.21.15.55:0/98077841 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.437+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00c04f0 con 0x7f88e0069a60 2023-10-06T11:13:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d206e700 1 -- 172.21.15.55:0/98077841 >> v2:172.21.15.55:3300/0 conn(0x7f48cc0c8260 msgr2=0x7f48cc069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d206e700 1 --2- 172.21.15.55:0/98077841 >> v2:172.21.15.55:3300/0 conn(0x7f48cc0c8260 0x7f48cc069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d206e700 1 -- 172.21.15.55:0/98077841 >> v1:172.21.15.142:6789/0 conn(0x7f48cc0cbc20 legacy=0x7f48cc06dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d206e700 1 -- 172.21.15.55:0/98077841 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0c71c0 con 0x7f48cc155820 2023-10-06T11:13:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e00c7bb0 con 0x7f88e0069a60 2023-10-06T11:13:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.438+0000 7f48d206e700 1 --2- 172.21.15.55:0/98077841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc155820 0x7f48cc0ae480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48cc06ab70 tx=0x7f48c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470148432e5a7bcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.439+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94ec013630 con 0x7f94f015a2c0 2023-10-06T11:13:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.439+0000 7f94e57fa700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f94dc068870 0x7f94dc06ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.439+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88dc0193f0 con 0x7f88e0069a60 2023-10-06T11:13:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f94f512e700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f94dc068870 0x7f94dc06ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f88d5ffb700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f88c4066f00 0x7f88c40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f88dc085230 con 0x7f88e0069a60 2023-10-06T11:13:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f886e7fc700 1 -- 172.21.15.55:0/2294819953 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800b7e0 con 0x7f887006de10 2023-10-06T11:13:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f886e7fc700 1 -- 172.21.15.55:0/2294819953 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800b940 con 0x7f887006de10 2023-10-06T11:13:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f886e7fc700 1 -- 172.21.15.55:0/2294819953 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800bce0 con 0x7f887006de10 2023-10-06T11:13:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f94f512e700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f94dc068870 0x7f94dc06ad20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94f00705d0 tx=0x7f94e001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7f88e5169700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f88c4066f00 0x7f88c40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.440+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba0c052090 con 0x7fba14158440 2023-10-06T11:13:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.441+0000 7f88e5169700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f88c4066f00 0x7f88c40693b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009f20 tx=0x7f88d00090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.442+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f94ec0567c0 con 0x7f94f015a2c0 2023-10-06T11:13:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.442+0000 7f48d106c700 1 -- 172.21.15.55:0/98077841 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400e070 con 0x7f48cc155820 2023-10-06T11:13:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.442+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cec0515c0 con 0x7f9cfc069c30 2023-10-06T11:13:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.444+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88dc0515a0 con 0x7f88e0069a60 2023-10-06T11:13:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.444+0000 7f887578d700 1 -- 172.21.15.55:0/2294819953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 msgr2=0x7f8870069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.444+0000 7f887578d700 1 --2- 172.21.15.55:0/2294819953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 0x7f8870069ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88580099e0 tx=0x7f8858009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.446+0000 7fe53ffff700 1 Processor -- start 2023-10-06T11:13:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.446+0000 7fe53ffff700 1 -- start start 2023-10-06T11:13:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.446+0000 7f48d106c700 1 -- 172.21.15.55:0/98077841 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400bc30 con 0x7f48cc155820 2023-10-06T11:13:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.446+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94ec052400 con 0x7f94f015a2c0 2023-10-06T11:13:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7fe53ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 0x7fe5400ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7fe53ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5400c6ce0 0x7fe5400685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7fe53ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54006aa30 con 0x7fe5400c7150 2023-10-06T11:13:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7fe53ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400ca7b0 con 0x7fe5400c6ce0 2023-10-06T11:13:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7fe53ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe540069e20 con 0x7fe540159430 2023-10-06T11:13:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7fe53effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 0x7fe5400ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.446+0000 7f48d106c700 1 -- 172.21.15.55:0/98077841 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4012430 con 0x7f48cc155820 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7f48d42d2700 1 -- 172.21.15.55:0/98077841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc155820 msgr2=0x7f48cc0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7f48d42d2700 1 --2- 172.21.15.55:0/98077841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc155820 0x7f48cc0ae480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48cc06ab70 tx=0x7f48c4009780 comp rx=0 tx=0).stop 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7f48d42d2700 1 -- 172.21.15.55:0/98077841 shutdown_connections 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7f48d42d2700 1 --2- 172.21.15.55:0/98077841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc155820 0x7f48cc0ae480 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48cc06ab70 tx=0x7f48c4009780 comp rx=0 tx=0).stop 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7f48d42d2700 1 --2- 172.21.15.55:0/98077841 >> v2:172.21.15.55:3300/0 conn(0x7f48cc0c8260 0x7f48cc069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.447+0000 7f48d42d2700 1 -- 172.21.15.55:0/98077841 >> 172.21.15.55:0/98077841 conn(0x7f48cc068080 msgr2=0x7f48cc0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 0x7fe5400ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56460/0 (socket says 172.21.15.55:56460) 2023-10-06T11:13:29.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 -- 172.21.15.55:0/722600625 learned_addr learned my addr 172.21.15.55:0/722600625 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7f48d42d2700 1 -- 172.21.15.55:0/98077841 shutdown_connections 2023-10-06T11:13:29.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7f48d42d2700 1 -- 172.21.15.55:0/98077841 wait complete. 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 -- 172.21.15.55:0/722600625 >> v2:172.21.15.142:3300/0 conn(0x7fe5400c6ce0 msgr2=0x7fe5400685c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 --2- 172.21.15.55:0/722600625 >> v2:172.21.15.142:3300/0 conn(0x7fe5400c6ce0 0x7fe5400685c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 -- 172.21.15.55:0/722600625 >> v1:172.21.15.142:6789/0 conn(0x7fe5400c7150 legacy=0x7fe54006aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 -- 172.21.15.55:0/722600625 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54006a100 con 0x7fe540159430 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53effd700 1 --2- 172.21.15.55:0/722600625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 0x7fe5400ca270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe5300099b0 tx=0x7fe530009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83537209a9aeebf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53dffb700 1 -- 172.21.15.55:0/722600625 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000b760 con 0x7fe540159430 2023-10-06T11:13:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53dffb700 1 -- 172.21.15.55:0/722600625 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000b8c0 con 0x7fe540159430 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.448+0000 7fe53dffb700 1 -- 172.21.15.55:0/722600625 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000bc60 con 0x7fe540159430 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7fe53ffff700 1 -- 172.21.15.55:0/722600625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 msgr2=0x7fe5400ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7fe53ffff700 1 --2- 172.21.15.55:0/722600625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 0x7fe5400ca270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe5300099b0 tx=0x7fe530009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7fe53ffff700 1 -- 172.21.15.55:0/722600625 shutdown_connections 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7fe53ffff700 1 --2- 172.21.15.55:0/722600625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe540159430 0x7fe5400ca270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7fe53ffff700 1 --2- 172.21.15.55:0/722600625 >> v2:172.21.15.142:3300/0 conn(0x7fe5400c6ce0 0x7fe5400685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7fe53ffff700 1 -- 172.21.15.55:0/722600625 >> 172.21.15.55:0/722600625 conn(0x7fe5400c9c10 msgr2=0x7fe54006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.449+0000 7f48d42d2700 1 Processor -- start 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.450+0000 7f48d42d2700 1 -- start start 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d42d2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48cc0c8260 0x7f48cc0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d42d2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc0cbc20 0x7f48cc0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d42d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 0x7f48cc0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d42d2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc141a10 con 0x7f48cc0c50a0 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d42d2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc1457f0 con 0x7f48cc0cbc20 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d42d2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0aee90 con 0x7f48cc0c8260 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d286f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 0x7f48cc0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d286f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 0x7f48cc0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37428/0 (socket says 172.21.15.55:37428) 2023-10-06T11:13:29.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d206e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48cc0c8260 0x7f48cc0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d286f700 1 -- 172.21.15.55:0/247747272 learned_addr learned my addr 172.21.15.55:0/247747272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d206e700 1 -- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc0cbc20 msgr2=0x7f48cc0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d206e700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc0cbc20 0x7f48cc0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d206e700 1 -- 172.21.15.55:0/247747272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 msgr2=0x7f48cc0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d206e700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 0x7f48cc0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d206e700 1 -- 172.21.15.55:0/247747272 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4009a20 con 0x7f48cc0c8260 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.451+0000 7f48d286f700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 0x7f48cc0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:29.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f887578d700 1 -- 172.21.15.55:0/2294819953 shutdown_connections 2023-10-06T11:13:29.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f887578d700 1 --2- 172.21.15.55:0/2294819953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f887006de10 0x7f8870069ab0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88580099e0 tx=0x7f8858009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f887578d700 1 -- 172.21.15.55:0/2294819953 >> 172.21.15.55:0/2294819953 conn(0x7f8870068080 msgr2=0x7f88700cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f48d206e700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48cc0c8260 0x7f48cc0c4b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c6600 tx=0x7f48c4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4012d70 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc0af170 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc0c4130 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c4027470 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.452+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4027830 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.453+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b40052b0 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.454+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48c4024070 con 0x7f48cc0c8260 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.454+0000 7f48c27fc700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.455+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f48c4086e30 con 0x7f48cc0c8260 2023-10-06T11:13:29.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.455+0000 7f887578d700 1 -- 172.21.15.55:0/2294819953 shutdown_connections 2023-10-06T11:13:29.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.455+0000 7f48d186d700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.455+0000 7f48d186d700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f48b0066f30 0x7f48b00693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006fd0 tx=0x7f48bc006db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.456+0000 7fe53ffff700 1 -- 172.21.15.55:0/722600625 shutdown_connections 2023-10-06T11:13:29.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.456+0000 7fe53ffff700 1 -- 172.21.15.55:0/722600625 wait complete. 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.458+0000 7fe53ffff700 1 Processor -- start 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.458+0000 7fe53ffff700 1 -- start start 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5400c7150 0x7fe5401538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 0x7fe5400c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400c8660 0x7fe540159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53ffff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c61d0 con 0x7fe540159430 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe540153de0 con 0x7fe5400c7150 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c55c0 con 0x7fe5400c8660 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 0x7fe5400c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5400c7150 0x7fe5401538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 0x7fe5400c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37444/0 (socket says 172.21.15.55:37444) 2023-10-06T11:13:29.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.459+0000 7fe53e7fc700 1 -- 172.21.15.55:0/1875005023 learned_addr learned my addr 172.21.15.55:0/1875005023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53f7fe700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400c8660 0x7fe540159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53e7fc700 1 -- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400c8660 msgr2=0x7fe540159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53e7fc700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400c8660 0x7fe540159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53e7fc700 1 -- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5400c7150 msgr2=0x7fe5401538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53e7fc700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5400c7150 0x7fe5401538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53e7fc700 1 -- 172.21.15.55:0/1875005023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300094f0 con 0x7fe540159430 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53e7fc700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 0x7fe5400c8120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b5e0 tx=0x7fe534009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f510 con 0x7fe540159430 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53400f670 con 0x7fe540159430 2023-10-06T11:13:29.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400fa10 con 0x7fe540159430 2023-10-06T11:13:29.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.461+0000 7f887578d700 1 -- 172.21.15.55:0/2294819953 wait complete. 2023-10-06T11:13:29.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.460+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5400c58a0 con 0x7fe540159430 2023-10-06T11:13:29.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.461+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5400c5e60 con 0x7fe540159430 2023-10-06T11:13:29.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.462+0000 7f887578d700 1 Processor -- start 2023-10-06T11:13:29.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.462+0000 7f887578d700 1 -- start start 2023-10-06T11:13:29.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.463+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe53401a400 con 0x7fe540159430 2023-10-06T11:13:29.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.463+0000 7fe526ffd700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.463+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe534084300 con 0x7fe540159430 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f887578d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88700696e0 0x7f88700ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f887578d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88700c8280 0x7f88700c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f887578d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 0x7f887017e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f887578d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700adde0 con 0x7f88700696e0 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f887578d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700c6180 con 0x7f88700c8280 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f887578d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700ad1d0 con 0x7f88701623a0 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f886f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 0x7f887017e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f886f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 0x7f887017e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56478/0 (socket says 172.21.15.55:56478) 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.464+0000 7f886f7fe700 1 -- 172.21.15.55:0/3124471380 learned_addr learned my addr 172.21.15.55:0/3124471380 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f886f7fe700 1 -- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88700c8280 msgr2=0x7f88700c5c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f886f7fe700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88700c8280 0x7f88700c5c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f886f7fe700 1 -- 172.21.15.55:0/3124471380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88700696e0 msgr2=0x7f88700ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f886f7fe700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88700696e0 0x7f88700ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f886f7fe700 1 -- 172.21.15.55:0/3124471380 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580094f0 con 0x7f88701623a0 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48c4053c50 con 0x7f48cc0c8260 2023-10-06T11:13:29.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.465+0000 7f886f7fe700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 0x7f887017e7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f886800bbb0 tx=0x7f8868009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.466+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54005f230 con 0x7fe540159430 2023-10-06T11:13:29.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.468+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680092e0 con 0x7f88701623a0 2023-10-06T11:13:29.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.468+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800c7a0 con 0x7f88701623a0 2023-10-06T11:13:29.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.468+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800cb40 con 0x7f88701623a0 2023-10-06T11:13:29.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.468+0000 7fe53effd700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5400c7150 0x7fe5401538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:29.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.475+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe534054c30 con 0x7fe540159430 2023-10-06T11:13:29.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.476+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88700ad4b0 con 0x7f88701623a0 2023-10-06T11:13:29.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.476+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88700ada70 con 0x7f88701623a0 2023-10-06T11:13:29.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.476+0000 7fe53effd700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.478+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8870064a90 con 0x7f88701623a0 2023-10-06T11:13:29.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.489+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8868012070 con 0x7f88701623a0 2023-10-06T11:13:29.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.489+0000 7f8866ffd700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8850067080 0x7f8850069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.489+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8868084740 con 0x7f88701623a0 2023-10-06T11:13:29.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.493+0000 7f886effd700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8850067080 0x7f8850069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.493+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8868051540 con 0x7f88701623a0 2023-10-06T11:13:29.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.503+0000 7fe53effd700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5300099b0 tx=0x7fe530016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.513+0000 7f886effd700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8850067080 0x7f8850069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88600097c0 tx=0x7f8860006ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.824+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fddc4005830 con 0x7fdde0070c50 2023-10-06T11:13:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.824+0000 7fddce7fc700 1 -- 172.21.15.55:0/2355233218 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddd0017090 con 0x7fdde0070c50 2023-10-06T11:13:29.829 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-10-06T11:13:29.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fddc0066f60 msgr2=0x7fddc0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fddc0066f60 0x7fddc0069410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddd800ad10 tx=0x7fddd8009370 comp rx=0 tx=0).stop 2023-10-06T11:13:29.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 msgr2=0x7fdde00c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde00c9060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddd00011e0 tx=0x7fddd0007d10 comp rx=0 tx=0).stop 2023-10-06T11:13:29.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 shutdown_connections 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fddc0066f60 0x7fddc0069410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdde00707d0 0x7fdde00a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdde00ac440 0x7fdde0149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 --2- 172.21.15.55:0/2355233218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdde0070c50 0x7fdde00c9060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.828+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 >> 172.21.15.55:0/2355233218 conn(0x7fdde006de40 msgr2=0x7fdde01484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.829+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 shutdown_connections 2023-10-06T11:13:29.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.829+0000 7fdde4fd6700 1 -- 172.21.15.55:0/2355233218 wait complete. 2023-10-06T11:13:29.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.839+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f88e0064a90 con 0x7f88e0069a60 2023-10-06T11:13:29.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.839+0000 7f88d5ffb700 1 -- 172.21.15.55:0/128154441 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88dc0556f0 con 0x7f88e0069a60 2023-10-06T11:13:29.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.842+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fba14155d00 con 0x7fba14158440 2023-10-06T11:13:29.844 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-10-06T11:13:29.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.843+0000 7fb9fbfff700 1 -- 172.21.15.55:0/1341583590 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba0c0556b0 con 0x7fba14158440 2023-10-06T11:13:29.845 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2023-10-06T11:13:29.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.843+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f94f0064a90 con 0x7f94f015a2c0 2023-10-06T11:13:29.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.843+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f88c4066f00 msgr2=0x7f88c40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.843+0000 7f88e7bce700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f88c4066f00 0x7f88c40693b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009f20 tx=0x7f88d00090f0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.843+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 msgr2=0x7f88e015ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.843+0000 7f88e7bce700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 0x7f88e015ea80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00c7d0 tx=0x7f88dc008040 comp rx=0 tx=0).stop 2023-10-06T11:13:29.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.844+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9cdc005830 con 0x7f9cfc069c30 2023-10-06T11:13:29.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f94e57fa700 1 -- 172.21.15.55:0/3581294653 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94ec055a20 con 0x7f94f015a2c0 2023-10-06T11:13:29.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 shutdown_connections 2023-10-06T11:13:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f88c4066f00 0x7f88c40693b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e0069a60 0x7f88e015ea80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88e00bf6f0 0x7f88e015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 --2- 172.21.15.55:0/128154441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88e00bf320 0x7f88e00c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 >> 172.21.15.55:0/128154441 conn(0x7f88e0068080 msgr2=0x7f88e00caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.850 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-10-06T11:13:29.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 shutdown_connections 2023-10-06T11:13:29.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f9ce2ffd700 1 -- 172.21.15.55:0/2162718328 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9cec054be0 con 0x7f9cfc069c30 2023-10-06T11:13:29.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.845+0000 7f88e7bce700 1 -- 172.21.15.55:0/128154441 wait complete. 2023-10-06T11:13:29.852 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-10-06T11:13:29.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2023-10-06T11:13:29.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba00066fb0 msgr2=0x7fba00069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba00066fb0 0x7fba00069460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba08007fd0 tx=0x7fba08016000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba14158440 msgr2=0x7fba141508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba14158440 0x7fba141508b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00ecc0 tx=0x7fba0c00b040 comp rx=0 tx=0).stop 2023-10-06T11:13:29.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f94dc068870 msgr2=0x7f94dc06ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f94f7392700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f94dc068870 0x7f94dc06ad20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94f00705d0 tx=0x7f94e001a000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 msgr2=0x7f94f016f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f94f7392700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 0x7f94f016f450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00ec10 tx=0x7f94ec001ca0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce4067160 msgr2=0x7f9ce4069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f9d01519700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce4067160 0x7f9ce4069610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0c2810 tx=0x7f9cf0006bc0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 msgr2=0x7f9cfc0c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.848+0000 7f9d01519700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 0x7f9cfc0c6190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00b840 tx=0x7f9cec009250 comp rx=0 tx=0).stop 2023-10-06T11:13:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 shutdown_connections 2023-10-06T11:13:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce4067160 0x7f9ce4069610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cfc0bf6f0 0x7f9cfc0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cfc069c30 0x7f9cfc0c6190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 --2- 172.21.15.55:0/2162718328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cfc0bf320 0x7f9cfc0c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 >> 172.21.15.55:0/2162718328 conn(0x7f9cfc068080 msgr2=0x7f9cfc0b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 shutdown_connections 2023-10-06T11:13:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f9d01519700 1 -- 172.21.15.55:0/2162718328 wait complete. 2023-10-06T11:13:29.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 shutdown_connections 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f94dc068870 0x7f94dc06ad20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94dc003ae0 0x7f94f01464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f013c6b0 0x7f94f016f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 --2- 172.21.15.55:0/3581294653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f015a2c0 0x7f94f016f450 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 >> 172.21.15.55:0/3581294653 conn(0x7f94f00707d0 msgr2=0x7f94f01554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 shutdown_connections 2023-10-06T11:13:29.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.850+0000 7f94f7392700 1 -- 172.21.15.55:0/3581294653 wait complete. 2023-10-06T11:13:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 shutdown_connections 2023-10-06T11:13:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba00066fb0 0x7fba00069460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba14158440 0x7fba141508b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140b29b0 0x7fba141557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 --2- 172.21.15.55:0/1341583590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba14159660 0x7fba1416e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 >> 172.21.15.55:0/1341583590 conn(0x7fba1406ece0 msgr2=0x7fba1415f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 shutdown_connections 2023-10-06T11:13:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.852+0000 7fba1a65e700 1 -- 172.21.15.55:0/1341583590 wait complete. 2023-10-06T11:13:29.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2023-10-06T11:13:29.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.866+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5400c6310 con 0x7fe540159430 2023-10-06T11:13:29.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.866+0000 7fe526ffd700 1 -- 172.21.15.55:0/1875005023 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5340547c0 con 0x7fe540159430 2023-10-06T11:13:29.868 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-10-06T11:13:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.870+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe52c066f30 msgr2=0x7fe52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.870+0000 7fe53ffff700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5300099b0 tx=0x7fe530016000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.870+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 msgr2=0x7fe5400c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.870+0000 7fe53ffff700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 0x7fe5400c8120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b5e0 tx=0x7fe534009120 comp rx=0 tx=0).stop 2023-10-06T11:13:29.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 shutdown_connections 2023-10-06T11:13:29.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5400c8660 0x7fe540159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5400c7150 0x7fe5401538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 --2- 172.21.15.55:0/1875005023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540159430 0x7fe5400c8120 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 >> 172.21.15.55:0/1875005023 conn(0x7fe5400c9c10 msgr2=0x7fe5400ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 shutdown_connections 2023-10-06T11:13:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7fe53ffff700 1 -- 172.21.15.55:0/1875005023 wait complete. 2023-10-06T11:13:29.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.871+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f48b4005830 con 0x7f48cc0c8260 2023-10-06T11:13:29.873 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2023-10-06T11:13:29.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.872+0000 7f48c27fc700 1 -- 172.21.15.55:0/247747272 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48c4057270 con 0x7f48cc0c8260 2023-10-06T11:13:29.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.4 2023-10-06T11:13:29.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2023-10-06T11:13:29.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2023-10-06T11:13:29.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f887004bb40 con 0x7f88701623a0 2023-10-06T11:13:29.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f48b0066f30 msgr2=0x7f48b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f48d42d2700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f48b0066f30 0x7f48b00693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006fd0 tx=0x7f48bc006db0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48cc0c8260 msgr2=0x7f48cc0c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f48d42d2700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48cc0c8260 0x7f48cc0c4b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0c6600 tx=0x7f48c4019000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 shutdown_connections 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.875+0000 7f48d42d2700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f48d42d2700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc0c50a0 0x7f48cc0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f48d42d2700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48cc0c8260 0x7f48cc0c4b60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f48d42d2700 1 --2- 172.21.15.55:0/247747272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48cc0cbc20 0x7f48cc0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 >> 172.21.15.55:0/247747272 conn(0x7f48cc068080 msgr2=0x7f48cc0c28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 shutdown_connections 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f48d42d2700 1 -- 172.21.15.55:0/247747272 wait complete. 2023-10-06T11:13:29.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.876+0000 7f8866ffd700 1 -- 172.21.15.55:0/3124471380 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8868054b60 con 0x7f88701623a0 2023-10-06T11:13:29.880 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8850067080 msgr2=0x7f8850069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8850067080 0x7f8850069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88600097c0 tx=0x7f8860006ce0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 msgr2=0x7f887017e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 0x7f887017e7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f886800bbb0 tx=0x7f8868009840 comp rx=0 tx=0).stop 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 shutdown_connections 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8850067080 0x7f8850069530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88700696e0 0x7f88700ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88701623a0 0x7f887017e7a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 --2- 172.21.15.55:0/3124471380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88700c8280 0x7f88700c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 >> 172.21.15.55:0/3124471380 conn(0x7f8870068080 msgr2=0x7f88700b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 shutdown_connections 2023-10-06T11:13:29.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:29.879+0000 7f887578d700 1 -- 172.21.15.55:0/3124471380 wait complete. 2023-10-06T11:13:29.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2023-10-06T11:13:29.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2023-10-06T11:13:29.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2023-10-06T11:13:30.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T11:13:30.868 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T11:13:30.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T11:13:30.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T11:13:30.878 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T11:13:30.890 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T11:13:30.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T11:13:30.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.052+0000 7f878b3a2700 1 Processor -- start 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.052+0000 7f878b3a2700 1 -- start start 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.053+0000 7f878b3a2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87840c8260 0x7f8784069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.053+0000 7f878b3a2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f878406e3d0 0x7f8784069a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.053+0000 7f878b3a2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87840c7dd0 con 0x7f8784155820 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.053+0000 7f878b3a2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840acca0 con 0x7f87840c8260 2023-10-06T11:13:31.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.053+0000 7f878b3a2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840c71c0 con 0x7f878406e3d0 2023-10-06T11:13:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.054+0000 7f878893d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87840c8260 0x7f8784069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.054+0000 7f878893d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87840c8260 0x7f8784069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37456/0 (socket says 172.21.15.55:37456) 2023-10-06T11:13:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.054+0000 7f878893d700 1 -- 172.21.15.55:0/463613038 learned_addr learned my addr 172.21.15.55:0/463613038 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.055+0000 7f878893d700 1 -- 172.21.15.55:0/463613038 >> v2:172.21.15.142:3300/0 conn(0x7f878406e3d0 msgr2=0x7f8784069a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:13:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.055+0000 7f878893d700 1 --2- 172.21.15.55:0/463613038 >> v2:172.21.15.142:3300/0 conn(0x7f878406e3d0 0x7f8784069a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.055+0000 7f878893d700 1 -- 172.21.15.55:0/463613038 >> v1:172.21.15.142:6789/0 conn(0x7f8784155820 legacy=0x7f87840ae480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:13:31.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.055+0000 7f878893d700 1 -- 172.21.15.55:0/463613038 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87840c74a0 con 0x7f87840c8260 2023-10-06T11:13:31.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.055+0000 7f878893d700 1 --2- 172.21.15.55:0/463613038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87840c8260 0x7f8784069520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f87840ccba0 tx=0x7f87740082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83274f5006f52f33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.056+0000 7f877bfff700 1 -- 172.21.15.55:0/463613038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774010070 con 0x7f87840c8260 2023-10-06T11:13:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.056+0000 7f877bfff700 1 -- 172.21.15.55:0/463613038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400dac0 con 0x7f87840c8260 2023-10-06T11:13:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.056+0000 7f877bfff700 1 -- 172.21.15.55:0/463613038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400de60 con 0x7f87840c8260 2023-10-06T11:13:31.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.057+0000 7f878b3a2700 1 -- 172.21.15.55:0/463613038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87840c8260 msgr2=0x7f8784069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.057+0000 7f878b3a2700 1 --2- 172.21.15.55:0/463613038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87840c8260 0x7f8784069520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f87840ccba0 tx=0x7f87740082d0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.058+0000 7f878b3a2700 1 -- 172.21.15.55:0/463613038 shutdown_connections 2023-10-06T11:13:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.058+0000 7f878b3a2700 1 --2- 172.21.15.55:0/463613038 >> v2:172.21.15.142:3300/0 conn(0x7f878406e3d0 0x7f8784069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.058+0000 7f878b3a2700 1 --2- 172.21.15.55:0/463613038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87840c8260 0x7f8784069520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.058+0000 7f878b3a2700 1 -- 172.21.15.55:0/463613038 >> 172.21.15.55:0/463613038 conn(0x7f8784068080 msgr2=0x7f87840cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.058+0000 7f878b3a2700 1 -- 172.21.15.55:0/463613038 shutdown_connections 2023-10-06T11:13:31.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.058+0000 7f878b3a2700 1 -- 172.21.15.55:0/463613038 wait complete. 2023-10-06T11:13:31.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.060+0000 7f878b3a2700 1 Processor -- start 2023-10-06T11:13:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.060+0000 7f878b3a2700 1 -- start start 2023-10-06T11:13:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878b3a2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878406e3d0 0x7f87840c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878b3a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87840c8260 0x7f87840c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878b3a2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 0x7f87840b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878b3a2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87840c4de0 con 0x7f8784155820 2023-10-06T11:13:31.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878b3a2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87840c5010 con 0x7f87840c8260 2023-10-06T11:13:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878b3a2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87840c52f0 con 0x7f878406e3d0 2023-10-06T11:13:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878993f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 0x7f87840b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878993f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 0x7f87840b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37462/0 (socket says 172.21.15.55:37462) 2023-10-06T11:13:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878993f700 1 -- 172.21.15.55:0/421342440 learned_addr learned my addr 172.21.15.55:0/421342440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.062+0000 7f878893d700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87840c8260 0x7f87840c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.063+0000 7f878993f700 1 -- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878406e3d0 msgr2=0x7f87840c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.063+0000 7f878993f700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878406e3d0 0x7f87840c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.063+0000 7f878993f700 1 -- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87840c8260 msgr2=0x7f87840c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.063+0000 7f878993f700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87840c8260 0x7f87840c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.063+0000 7f878993f700 1 -- 172.21.15.55:0/421342440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774008570 con 0x7f8784155820 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.063+0000 7f878993f700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 0x7f87840b1230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f878000b510 tx=0x7f87800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.064+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000f510 con 0x7f8784155820 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.064+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878000f690 con 0x7f8784155820 2023-10-06T11:13:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.064+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000fa50 con 0x7f8784155820 2023-10-06T11:13:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.064+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87840c55d0 con 0x7f8784155820 2023-10-06T11:13:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.064+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87840c5b90 con 0x7f8784155820 2023-10-06T11:13:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.068+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f878001a400 con 0x7f8784155820 2023-10-06T11:13:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.068+0000 7f87797fa700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8770067200 0x7f87700696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.068+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8780084310 con 0x7f8784155820 2023-10-06T11:13:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.070+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87680052e0 con 0x7f8784155820 2023-10-06T11:13:31.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.076+0000 7f878913e700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8770067200 0x7f87700696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.076+0000 7f878913e700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8770067200 0x7f87700696b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f877c00ad10 tx=0x7f877c009370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.078+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8780051190 con 0x7f8784155820 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.111+0000 7f0cabb31700 1 Processor -- start 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.111+0000 7f0cabb31700 1 -- start start 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0cabb31700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ca4155820 0x7f0ca40ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0cabb31700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 0x7f0ca40abc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0cabb31700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca40c7dd0 con 0x7f0ca40c8260 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0cabb31700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40ae9c0 con 0x7f0ca4155820 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0cabb31700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40c71c0 con 0x7f0ca4069c30 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.112+0000 7fbaa8ae8700 1 Processor -- start 2023-10-06T11:13:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.112+0000 7fbaa8ae8700 1 -- start start 2023-10-06T11:13:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0caa0ce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 0x7f0ca40abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0ca98cd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ca4155820 0x7f0ca40ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0caa0ce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 0x7f0ca40abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56496/0 (socket says 172.21.15.55:56496) 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.113+0000 7f0caa0ce700 1 -- 172.21.15.55:0/875565668 learned_addr learned my addr 172.21.15.55:0/875565668 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0caa0ce700 1 -- 172.21.15.55:0/875565668 >> v2:172.21.15.142:3300/0 conn(0x7f0ca4155820 msgr2=0x7f0ca40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0caa0ce700 1 --2- 172.21.15.55:0/875565668 >> v2:172.21.15.142:3300/0 conn(0x7f0ca4155820 0x7f0ca40ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0caa0ce700 1 -- 172.21.15.55:0/875565668 >> v1:172.21.15.142:6789/0 conn(0x7f0ca40c8260 legacy=0x7f0ca4069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa8ae8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa41531a0 0x7fbaa4156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa8ae8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbaa40ae4a0 0x7fbaa4069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa8ae8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa406e320 con 0x7fbaa406b540 2023-10-06T11:13:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa8ae8700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa4156ca0 con 0x7fbaa40ae4a0 2023-10-06T11:13:31.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa8ae8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa406e7b0 con 0x7fbaa41531a0 2023-10-06T11:13:31.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0caa0ce700 1 -- 172.21.15.55:0/875565668 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40c74a0 con 0x7f0ca4069c30 2023-10-06T11:13:31.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0caa0ce700 1 --2- 172.21.15.55:0/875565668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 0x7f0ca40abc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009990 tx=0x7f0c94009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ab464be87c9471 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa2d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbaa40ae4a0 0x7fbaa4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa2d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbaa40ae4a0 0x7fbaa4069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37464/0 (socket says 172.21.15.55:37464) 2023-10-06T11:13:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/2770416403 learned_addr learned my addr 172.21.15.55:0/2770416403 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0ca88cb700 1 -- 172.21.15.55:0/875565668 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94009e80 con 0x7f0ca4069c30 2023-10-06T11:13:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0ca88cb700 1 -- 172.21.15.55:0/875565668 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94005c60 con 0x7f0ca4069c30 2023-10-06T11:13:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f0ca88cb700 1 -- 172.21.15.55:0/875565668 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400b610 con 0x7f0ca4069c30 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/2770416403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa41531a0 msgr2=0x7fbaa4156760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7fbaa2d9d700 1 --2- 172.21.15.55:0/2770416403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa41531a0 0x7fbaa4156760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/2770416403 >> v1:172.21.15.142:6789/0 conn(0x7fbaa406b540 legacy=0x7fbaa40add90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/2770416403 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa406d710 con 0x7fbaa40ae4a0 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 -- 172.21.15.55:0/875565668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 msgr2=0x7f0ca40abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 --2- 172.21.15.55:0/875565668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 0x7f0ca40abc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009990 tx=0x7f0c94009250 comp rx=0 tx=0).stop 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 -- 172.21.15.55:0/875565668 shutdown_connections 2023-10-06T11:13:31.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 --2- 172.21.15.55:0/875565668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca4069c30 0x7f0ca40abc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 --2- 172.21.15.55:0/875565668 >> v2:172.21.15.142:3300/0 conn(0x7f0ca4155820 0x7f0ca40ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 -- 172.21.15.55:0/875565668 >> 172.21.15.55:0/875565668 conn(0x7f0ca4068080 msgr2=0x7f0ca40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7fbaa2d9d700 1 --2- 172.21.15.55:0/2770416403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4069520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba9800bc50 tx=0x7fba9800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1ed541260d4cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7fbaa159a700 1 -- 172.21.15.55:0/2770416403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800be60 con 0x7fbaa40ae4a0 2023-10-06T11:13:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 -- 172.21.15.55:0/875565668 shutdown_connections 2023-10-06T11:13:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f0cabb31700 1 -- 172.21.15.55:0/875565668 wait complete. 2023-10-06T11:13:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7fbaa159a700 1 -- 172.21.15.55:0/2770416403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800ddc0 con 0x7fbaa40ae4a0 2023-10-06T11:13:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7fbaa159a700 1 -- 172.21.15.55:0/2770416403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980106a0 con 0x7fbaa40ae4a0 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f4cd9763700 1 Processor -- start 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.114+0000 7f4cd9763700 1 -- start start 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7f4cd9763700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4cd4160df0 0x7f4cd41611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7f4cd9763700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd40c82d0 0x7f4cd4069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7f4cd9763700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c8750 0x7f4cd4069a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7f4cd9763700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd40c7e40 con 0x7f4cd4160df0 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7f4cd9763700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd40c7230 con 0x7f4cd40c82d0 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.115+0000 7f4cd9763700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd40c7510 con 0x7f4cd40c8750 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd40c82d0 0x7f4cd4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd40c82d0 0x7f4cd4069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50758/0 (socket says 172.21.15.55:50758) 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 -- 172.21.15.55:0/67995823 learned_addr learned my addr 172.21.15.55:0/67995823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd37fe700 1 --2- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c8750 0x7f4cd4069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd2ffd700 1 --2- 172.21.15.55:0/67995823 >> v2:172.21.15.55:3300/0 conn(0x7f4cd4160df0 0x7f4cd41611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 -- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c8750 msgr2=0x7f4cd4069a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 --2- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c8750 0x7f4cd4069a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 -- 172.21.15.55:0/67995823 >> v2:172.21.15.55:3300/0 conn(0x7f4cd4160df0 msgr2=0x7f4cd41611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 --2- 172.21.15.55:0/67995823 >> v2:172.21.15.55:3300/0 conn(0x7f4cd4160df0 0x7f4cd41611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.116+0000 7f4cd27fc700 1 -- 172.21.15.55:0/67995823 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40c77f0 con 0x7f4cd40c82d0 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7f4cd27fc700 1 --2- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd40c82d0 0x7f4cd4069520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4cd406b440 tx=0x7f4ccc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ec457dbddb86166 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7f4cd1ffb700 1 -- 172.21.15.55:0/67995823 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0090d0 con 0x7f4cd40c82d0 2023-10-06T11:13:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7f4cd1ffb700 1 -- 172.21.15.55:0/67995823 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc030070 con 0x7f4cd40c82d0 2023-10-06T11:13:31.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7f4cd1ffb700 1 -- 172.21.15.55:0/67995823 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00ba20 con 0x7f4cd40c82d0 2023-10-06T11:13:31.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/2770416403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa40ae4a0 msgr2=0x7fbaa4069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/2770416403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4069520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba9800bc50 tx=0x7fba9800b4f0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/2770416403 shutdown_connections 2023-10-06T11:13:31.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/2770416403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4069520 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/2770416403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa41531a0 0x7fbaa4156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.117+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/2770416403 >> 172.21.15.55:0/2770416403 conn(0x7fbaa4068080 msgr2=0x7fbaa40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/2770416403 shutdown_connections 2023-10-06T11:13:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/2770416403 wait complete. 2023-10-06T11:13:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 -- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd40c82d0 msgr2=0x7f4cd4069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 --2- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd40c82d0 0x7f4cd4069520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4cd406b440 tx=0x7f4ccc009840 comp rx=0 tx=0).stop 2023-10-06T11:13:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 -- 172.21.15.55:0/67995823 shutdown_connections 2023-10-06T11:13:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 --2- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c8750 0x7f4cd4069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 --2- 172.21.15.55:0/67995823 >> v2:172.21.15.55:3300/0 conn(0x7f4cd4160df0 0x7f4cd41611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 --2- 172.21.15.55:0/67995823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd40c82d0 0x7f4cd4069520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 -- 172.21.15.55:0/67995823 >> 172.21.15.55:0/67995823 conn(0x7f4cd4068080 msgr2=0x7f4cd40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f0cabb31700 1 Processor -- start 2023-10-06T11:13:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f4cd9763700 1 -- 172.21.15.55:0/67995823 shutdown_connections 2023-10-06T11:13:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.119+0000 7fbaa8ae8700 1 Processor -- start 2023-10-06T11:13:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.119+0000 7fbaa8ae8700 1 -- start start 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.118+0000 7f0cabb31700 1 -- start start 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.119+0000 7f0cabb31700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca4069c30 0x7f0ca40c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.119+0000 7f0cabb31700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca40c8260 0x7f0ca40b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.119+0000 7f0cabb31700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 0x7f0ca40c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0cabb31700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40bfc70 con 0x7f0ca4069c30 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0cabb31700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40bff50 con 0x7f0ca4155820 2023-10-06T11:13:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0cabb31700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40c0230 con 0x7f0ca40c8260 2023-10-06T11:13:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa8ae8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa406b540 0x7fbaa4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa8ae8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa8ae8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 0x7fbaa414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa8ae8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4169420 con 0x7fbaa41531a0 2023-10-06T11:13:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa8ae8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40c3320 con 0x7fbaa40ae4a0 2023-10-06T11:13:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa8ae8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4169650 con 0x7fbaa406b540 2023-10-06T11:13:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0caa0ce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 0x7f0ca40c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0caa0ce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 0x7f0ca40c1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50762/0 (socket says 172.21.15.55:50762) 2023-10-06T11:13:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0caa0ce700 1 -- 172.21.15.55:0/249100103 learned_addr learned my addr 172.21.15.55:0/249100103 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7f0ca98cd700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca4069c30 0x7f0ca40c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 0x7fbaa414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 0x7fbaa414d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37476/0 (socket says 172.21.15.55:37476) 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/530786666 learned_addr learned my addr 172.21.15.55:0/530786666 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa1d9b700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa406b540 msgr2=0x7fbaa4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa406b540 0x7fbaa4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaa40ae4a0 msgr2=0x7fbaa4168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.120+0000 7fbaa2d9d700 1 -- 172.21.15.55:0/530786666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9800b790 con 0x7fbaa41531a0 2023-10-06T11:13:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0ca90cc700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca40c8260 0x7f0ca40b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0caa0ce700 1 -- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca40c8260 msgr2=0x7f0ca40b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0caa0ce700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca40c8260 0x7f0ca40b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0caa0ce700 1 -- 172.21.15.55:0/249100103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca4069c30 msgr2=0x7f0ca40c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0caa0ce700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca4069c30 0x7f0ca40c0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0caa0ce700 1 -- 172.21.15.55:0/249100103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940094d0 con 0x7f0ca4155820 2023-10-06T11:13:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fa1a4dd9700 1 Processor -- start 2023-10-06T11:13:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0ca98cd700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca4069c30 0x7f0ca40c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.119+0000 7f4cd9763700 1 -- 172.21.15.55:0/67995823 wait complete. 2023-10-06T11:13:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f4cd9763700 1 Processor -- start 2023-10-06T11:13:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fbaa2d9d700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 0x7fbaa414d500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba9800e010 tx=0x7fba9801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fa1a4dd9700 1 -- start start 2023-10-06T11:13:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0ca90cc700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca40c8260 0x7f0ca40b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f4cd9763700 1 -- start start 2023-10-06T11:13:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd9763700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c82d0 0x7f4cd40c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd9763700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd40c8750 0x7f4cd40b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd9763700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd4160df0 0x7f4cd415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd9763700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4158040 con 0x7f4cd40c8750 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd9763700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4157430 con 0x7f4cd4160df0 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd9763700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4157710 con 0x7f4cd40c82d0 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7fa1a4dd9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1a0064490 0x7fa1a00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7fa1a4dd9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1a006e770 0x7fa1a0159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7fa1a4dd9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a006e2e0 con 0x7fa1a00675b0 2023-10-06T11:13:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7fa1a4dd9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a006dc90 con 0x7fa1a006e770 2023-10-06T11:13:31.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7fa1a4dd9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a006df70 con 0x7fa1a0064490 2023-10-06T11:13:31.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4cd37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd4160df0 0x7f4cd415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800be60 con 0x7fbaa41531a0 2023-10-06T11:13:31.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba98018bd0 con 0x7fbaa41531a0 2023-10-06T11:13:31.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98021420 con 0x7fbaa41531a0 2023-10-06T11:13:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4169930 con 0x7fbaa41531a0 2023-10-06T11:13:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa414da40 con 0x7fbaa41531a0 2023-10-06T11:13:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa40c30f0 con 0x7fbaa41531a0 2023-10-06T11:13:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7fa19e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1a0064490 0x7fa1a00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7fa19e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1a0064490 0x7fa1a00c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50784/0 (socket says 172.21.15.55:50784) 2023-10-06T11:13:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7fa19e59c700 1 -- 172.21.15.55:0/1704216402 learned_addr learned my addr 172.21.15.55:0/1704216402 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f3f89373700 1 Processor -- start 2023-10-06T11:13:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f3f89373700 1 -- start start 2023-10-06T11:13:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f3f89373700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 0x7f3f840b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f3f89373700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8415e130 con 0x7f3f840b2350 2023-10-06T11:13:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f3f89373700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840cbcc0 con 0x7f3f84161780 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f3f89373700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8415e300 con 0x7f3f84162330 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f3f837fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3f84161780 0x7f3f8415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:56098/0 (socket says 172.21.15.55:56098) 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f3f837fe700 1 -- 172.21.15.55:0/1541591300 learned_addr learned my addr 172.21.15.55:0/1541591300 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028555620 0 0) 0x7f3f840cbcc0 con 0x7f3f84161780 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f6c003570 con 0x7f3f84161780 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f827fc700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 0x7f3f840b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 177618915 0 0) 0x7f3f6c003570 con 0x7f3f84161780 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 msgr2=0x7f3f840b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 0x7f3f840b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 >> v1:172.21.15.55:6789/0 conn(0x7f3f840b2350 legacy=0x7f3f840cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840cbfa0 con 0x7f3f84161780 2023-10-06T11:13:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f4cd2ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c82d0 0x7f4cd40c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f3f74001470 con 0x7f3f84161780 2023-10-06T11:13:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 >> v1:172.21.15.142:6789/0 conn(0x7f3f84161780 legacy=0x7f3f8415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f6c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd4160df0 0x7f4cd415b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50772/0 (socket says 172.21.15.55:50772) 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd37fe700 1 -- 172.21.15.55:0/2827238495 learned_addr learned my addr 172.21.15.55:0/2827238495 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 0x7f3f6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c004f50 0x7f3f6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8415e300 con 0x7f3f6c004f50 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0055a0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00bfa0 con 0x7f3f84162330 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4476d68700 1 Processor -- start 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.122+0000 7f4476d68700 1 -- start start 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4476d68700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4470155840 0x7f44700685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4476d68700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 0x7f4470068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4476d68700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700b2630 con 0x7f44700aef10 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4476d68700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4470159790 con 0x7f4470155840 2023-10-06T11:13:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4476d68700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4470159a70 con 0x7f44700b2150 2023-10-06T11:13:31.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f6c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4475305700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 0x7f4470068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f3f827fc700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 0x7f3f6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4475305700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 0x7f4470068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56574/0 (socket says 172.21.15.55:56574) 2023-10-06T11:13:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4475305700 1 -- 172.21.15.55:0/1848925643 learned_addr learned my addr 172.21.15.55:0/1848925643 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7fa19e59c700 1 -- 172.21.15.55:0/1704216402 >> v2:172.21.15.55:3300/0 conn(0x7fa1a006e770 msgr2=0x7fa1a0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7fa19e59c700 1 --2- 172.21.15.55:0/1704216402 >> v2:172.21.15.55:3300/0 conn(0x7fa1a006e770 0x7fa1a0159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7fa19e59c700 1 -- 172.21.15.55:0/1704216402 >> v1:172.21.15.55:6789/0 conn(0x7fa1a00675b0 legacy=0x7fa1a0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7fa19e59c700 1 -- 172.21.15.55:0/1704216402 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a015d7c0 con 0x7fa1a0064490 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.121+0000 7f0caa0ce700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 0x7f0ca40c1340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009290 tx=0x7f0c94015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400b690 con 0x7f0ca4155820 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94011bd0 con 0x7f0ca4155820 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9401c420 con 0x7f0ca4155820 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca40c0510 con 0x7f0ca4155820 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.123+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca40b1840 con 0x7f0ca4155820 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca40c0a30 con 0x7f0ca4155820 2023-10-06T11:13:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7fa19e59c700 1 --2- 172.21.15.55:0/1704216402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a0064490 0x7fa1a00c7530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00c90c0 tx=0x7fa198009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17e9f99da4957e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f82ffd700 1 -- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 msgr2=0x7f3f6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f84162330 0x7f3f6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f82ffd700 1 -- 172.21.15.55:0/1541591300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c004f50 msgr2=0x7f3f6c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c004f50 0x7f3f6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f82ffd700 1 -- 172.21.15.55:0/1541591300 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840cbfa0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7fb5d1495700 1 Processor -- start 2023-10-06T11:13:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7fb5d1495700 1 -- start start 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd2ffd700 1 -- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd4160df0 msgr2=0x7f4cd415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd2ffd700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd4160df0 0x7f4cd415b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd2ffd700 1 -- 172.21.15.55:0/2827238495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd40c8750 msgr2=0x7f4cd40b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd2ffd700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd40c8750 0x7f4cd40b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd2ffd700 1 -- 172.21.15.55:0/2827238495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc009ae0 con 0x7f4cd40c82d0 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.124+0000 7f4cd2ffd700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c82d0 0x7f4cd40c0550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400d860 tx=0x7f4cc4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4014620 con 0x7f4cd40c82d0 2023-10-06T11:13:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc4014780 con 0x7f4cd40c82d0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4014b40 con 0x7f4cd40c82d0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd41579f0 con 0x7f4cd40c82d0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd40c1b70 con 0x7f4cd40c82d0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd4064a90 con 0x7f4cd40c82d0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f6c003ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c001ea0 tx=0x7f3f7c0014d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac4cbf8f14384a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00c6a0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00c820 con 0x7f3f6c003ae0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f3f81ffb700 1 -- 172.21.15.55:0/1541591300 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00cbe0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f89373700 1 -- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 msgr2=0x7f3f6c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f89373700 1 --2- 172.21.15.55:0/1541591300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f6c003ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c001ea0 tx=0x7f3f7c0014d0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f837fe700 1 -- 172.21.15.55:0/1541591300 reap_dead start 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f89373700 1 -- 172.21.15.55:0/1541591300 shutdown_connections 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f89373700 1 -- 172.21.15.55:0/1541591300 >> 172.21.15.55:0/1541591300 conn(0x7f3f840ccf30 msgr2=0x7f3f840cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba98021810 con 0x7fbaa41531a0 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4475305700 1 -- 172.21.15.55:0/1848925643 >> v2:172.21.15.55:3300/0 conn(0x7f4470155840 msgr2=0x7f44700685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4475305700 1 --2- 172.21.15.55:0/1848925643 >> v2:172.21.15.55:3300/0 conn(0x7f4470155840 0x7f44700685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4475305700 1 -- 172.21.15.55:0/1848925643 >> v1:172.21.15.55:6789/0 conn(0x7f44700aef10 legacy=0x7f44700ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4475305700 1 -- 172.21.15.55:0/1848925643 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470159d50 con 0x7f44700b2150 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.125+0000 7f4475305700 1 --2- 172.21.15.55:0/1848925643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 0x7f4470068b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e10 tx=0x7f4468009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19145740a8b228 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f446f7fe700 1 -- 172.21.15.55:0/1848925643 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680092e0 con 0x7f44700b2150 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f446f7fe700 1 -- 172.21.15.55:0/1848925643 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800caf0 con 0x7f44700b2150 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f446f7fe700 1 -- 172.21.15.55:0/1848925643 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468011400 con 0x7f44700b2150 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7fb5d1495700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5cc160df0 0x7fb5cc1611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7fb5d1495700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc0c7e40 con 0x7fb5cc0c82d0 2023-10-06T11:13:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7fb5d1495700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc0c7230 con 0x7fb5cc0c8750 2023-10-06T11:13:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7fb5d1495700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c7510 con 0x7fb5cc160df0 2023-10-06T11:13:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7fb5ca7fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb5cc0c82d0 0x7fb5cc069520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53680/0 (socket says 172.21.15.55:53680) 2023-10-06T11:13:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7fb5ca7fc700 1 -- 172.21.15.55:0/828081434 learned_addr learned my addr 172.21.15.55:0/828081434 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f89373700 1 -- 172.21.15.55:0/1541591300 shutdown_connections 2023-10-06T11:13:31.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.126+0000 7f3f89373700 1 -- 172.21.15.55:0/1541591300 wait complete. 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4476d68700 1 -- 172.21.15.55:0/1848925643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 msgr2=0x7f4470068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4476d68700 1 --2- 172.21.15.55:0/1848925643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 0x7f4470068b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e10 tx=0x7f4468009840 comp rx=0 tx=0).stop 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4476d68700 1 -- 172.21.15.55:0/1848925643 shutdown_connections 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4476d68700 1 --2- 172.21.15.55:0/1848925643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44700b2150 0x7f4470068b00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4476d68700 1 --2- 172.21.15.55:0/1848925643 >> v2:172.21.15.55:3300/0 conn(0x7f4470155840 0x7f44700685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4476d68700 1 -- 172.21.15.55:0/1848925643 >> 172.21.15.55:0/1848925643 conn(0x7f447006dcd0 msgr2=0x7f447006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7fb5caffd700 1 --2- 172.21.15.55:0/828081434 >> v2:172.21.15.55:3300/0 conn(0x7fb5cc160df0 0x7fb5cc1611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7fba927fc700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba84067080 0x7fba84069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba98014070 con 0x7fbaa41531a0 2023-10-06T11:13:31.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c9401c810 con 0x7f0ca4155820 2023-10-06T11:13:31.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f0c99ffb700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c88067080 0x7f0c88069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7fbaa259c700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba84067080 0x7fba84069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f4476d68700 1 -- 172.21.15.55:0/1848925643 shutdown_connections 2023-10-06T11:13:31.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.127+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cc401d400 con 0x7f4cd40c82d0 2023-10-06T11:13:31.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c94086550 con 0x7f0ca4155820 2023-10-06T11:13:31.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f4476d68700 1 -- 172.21.15.55:0/1848925643 wait complete. 2023-10-06T11:13:31.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f0ca98cd700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c88067080 0x7f0c88069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f4cbaffd700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4cc0067080 0x7f4cc0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fa19d59a700 1 -- 172.21.15.55:0/1704216402 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19800e070 con 0x7fa1a0064490 2023-10-06T11:13:31.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fa19d59a700 1 -- 172.21.15.55:0/1704216402 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19800baa0 con 0x7fa1a0064490 2023-10-06T11:13:31.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fa19d59a700 1 -- 172.21.15.55:0/1704216402 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980092e0 con 0x7fa1a0064490 2023-10-06T11:13:31.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4cc4084e70 con 0x7f4cd40c82d0 2023-10-06T11:13:31.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fbaa259c700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba84067080 0x7fba84069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba940025c0 tx=0x7fba94007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f3f89373700 1 Processor -- start 2023-10-06T11:13:31.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f4cd27fc700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4cc0067080 0x7f4cc0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7f0ca98cd700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c88067080 0x7f0c88069530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c470 tx=0x7f0ca000f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7f3f89373700 1 -- start start 2023-10-06T11:13:31.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7f4cd27fc700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4cc0067080 0x7f4cc0069530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cd406b440 tx=0x7f4ccc03a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/1704216402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a0064490 msgr2=0x7fa1a00c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fb5caffd700 1 -- 172.21.15.55:0/828081434 >> v1:172.21.15.142:6789/0 conn(0x7fb5cc0c8750 legacy=0x7fb5cc0aeeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:13:31.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fb5caffd700 1 -- 172.21.15.55:0/828081434 >> v1:172.21.15.55:6789/0 conn(0x7fb5cc0c82d0 legacy=0x7fb5cc069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/1704216402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a0064490 0x7fa1a00c7530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00c90c0 tx=0x7fa198009840 comp rx=0 tx=0).stop 2023-10-06T11:13:31.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.128+0000 7fb5caffd700 1 -- 172.21.15.55:0/828081434 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc0c77f0 con 0x7fb5cc160df0 2023-10-06T11:13:31.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/1704216402 shutdown_connections 2023-10-06T11:13:31.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/1704216402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a0064490 0x7fa1a00c7530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/1704216402 >> v2:172.21.15.55:3300/0 conn(0x7fa1a006e770 0x7fa1a0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/1704216402 >> 172.21.15.55:0/1704216402 conn(0x7fa1a00cc6f0 msgr2=0x7fa1a00ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fb5caffd700 1 --2- 172.21.15.55:0/828081434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc1611c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0098e0 tx=0x7fb5bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ad57db86110ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/1704216402 shutdown_connections 2023-10-06T11:13:31.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.129+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/1704216402 wait complete. 2023-10-06T11:13:31.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f89373700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f8415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f4476d68700 1 Processor -- start 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f89373700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f840cae00 0x7f3f840c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f89373700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f840c63a0 0x7f3f840c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f89373700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840c6810 con 0x7f3f840cae00 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f89373700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840ca970 con 0x7f3f6c003ae0 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f89373700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840c9d60 con 0x7f3f840c63a0 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f8415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f827fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f840cae00 0x7f3f840c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f8415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:50802/0 (socket says 172.21.15.55:50802) 2023-10-06T11:13:31.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 -- 172.21.15.55:0/2424750045 learned_addr learned my addr 172.21.15.55:0/2424750045 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f4476d68700 1 -- start start 2023-10-06T11:13:31.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f837fe700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f840c63a0 0x7f3f840c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 -- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f840c63a0 msgr2=0x7f3f840c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f840c63a0 0x7f3f840c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 -- 172.21.15.55:0/2424750045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f840cae00 msgr2=0x7f3f840c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f840cae00 0x7f3f840c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 -- 172.21.15.55:0/2424750045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840ca040 con 0x7f3f6c003ae0 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f827fc700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f840cae00 0x7f3f840c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.130+0000 7f3f82ffd700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f8415a2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00d010 tx=0x7f3f7c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7fa1a4dd9700 1 Processor -- start 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4476d68700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44700aef10 0x7f44701587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4476d68700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 0x7f4470144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4476d68700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4470155840 0x7f4470146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4476d68700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447014c4e0 con 0x7f44700b2150 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4476d68700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4470146e10 con 0x7f44700aef10 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4476d68700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44701470f0 con 0x7f4470155840 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 0x7f4470144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 0x7f4470144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37524/0 (socket says 172.21.15.55:37524) 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 -- 172.21.15.55:0/3993448029 learned_addr learned my addr 172.21.15.55:0/3993448029 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4474b04700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44700aef10 0x7f44701587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4475305700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4470155840 0x7f4470146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 -- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4470155840 msgr2=0x7f4470146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4470155840 0x7f4470146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 -- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44700aef10 msgr2=0x7f44701587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44700aef10 0x7f44701587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f446ffff700 1 -- 172.21.15.55:0/3993448029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446800d040 con 0x7f44700b2150 2023-10-06T11:13:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7f4474b04700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44700aef10 0x7f44701587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00c6a0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c012e80 con 0x7f3f6c003ae0 2023-10-06T11:13:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f840ca320 con 0x7f3f6c003ae0 2023-10-06T11:13:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ca40c0a30 con 0x7f0ca4155820 2023-10-06T11:13:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f446ffff700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 0x7f4470144410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f446400b600 tx=0x7f44640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f840cb270 con 0x7f3f6c003ae0 2023-10-06T11:13:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00cbc0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.131+0000 7fa1a4dd9700 1 -- start start 2023-10-06T11:13:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa1a4dd9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1a0064490 0x7fa1a01509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa1a4dd9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a00675b0 0x7fa1a00c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa1a4dd9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a006e770 0x7fa1a00c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa1a4dd9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015de00 con 0x7fa1a00675b0 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa1a4dd9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015cdd0 con 0x7fa1a006e770 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa1a4dd9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015bf20 con 0x7fa1a0064490 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1a0064490 0x7fa1a01509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1a0064490 0x7fa1a01509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56598/0 (socket says 172.21.15.55:56598) 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19e59c700 1 -- 172.21.15.55:0/25897859 learned_addr learned my addr 172.21.15.55:0/25897859 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19ed9d700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a006e770 0x7fa1a00c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19dd9b700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a00675b0 0x7fa1a00c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba98053340 con 0x7fbaa41531a0 2023-10-06T11:13:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19ed9d700 1 -- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1a0064490 msgr2=0x7fa1a01509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19ed9d700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1a0064490 0x7fa1a01509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19ed9d700 1 -- 172.21.15.55:0/25897859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a00675b0 msgr2=0x7fa1a00c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19ed9d700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a00675b0 0x7fa1a00c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fa19ed9d700 1 -- 172.21.15.55:0/25897859 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198009ae0 con 0x7fa1a006e770 2023-10-06T11:13:31.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.133+0000 7fa19ed9d700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a006e770 0x7fa1a00c6230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa19000b4c0 tx=0x7fa190009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.133+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cc4055700 con 0x7f4cd40c82d0 2023-10-06T11:13:31.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.133+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f640052b0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.132+0000 7fb5c9ffb700 1 -- 172.21.15.55:0/828081434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc009e80 con 0x7fb5cc160df0 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.133+0000 7fb5c9ffb700 1 -- 172.21.15.55:0/828081434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc00b820 con 0x7fb5cc160df0 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.133+0000 7fb5c9ffb700 1 -- 172.21.15.55:0/828081434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00bba0 con 0x7fb5cc160df0 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 -- 172.21.15.55:0/828081434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 msgr2=0x7fb5cc1611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 --2- 172.21.15.55:0/828081434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc1611c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0098e0 tx=0x7fb5bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 -- 172.21.15.55:0/828081434 shutdown_connections 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 --2- 172.21.15.55:0/828081434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc1611c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 -- 172.21.15.55:0/828081434 >> 172.21.15.55:0/828081434 conn(0x7fb5cc068080 msgr2=0x7fb5cc0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 -- 172.21.15.55:0/828081434 shutdown_connections 2023-10-06T11:13:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7fb5d1495700 1 -- 172.21.15.55:0/828081434 wait complete. 2023-10-06T11:13:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.135+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000be70 con 0x7fa1a006e770 2023-10-06T11:13:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.135+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19000f510 con 0x7fa1a006e770 2023-10-06T11:13:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.135+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a015c1c0 con 0x7fa1a006e770 2023-10-06T11:13:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.135+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a015c780 con 0x7fa1a006e770 2023-10-06T11:13:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f7c025020 con 0x7f3f6c003ae0 2023-10-06T11:13:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.134+0000 7f3f6affd700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f70066f30 0x7f3f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.135+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3f7c086ac0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.135+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000f8d0 con 0x7fa1a006e770 2023-10-06T11:13:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.136+0000 7f3f827fc700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f70066f30 0x7f3f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.136+0000 7fb5d1495700 1 Processor -- start 2023-10-06T11:13:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.136+0000 7fb5d1495700 1 -- start start 2023-10-06T11:13:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7f3f827fc700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f70066f30 0x7f3f700693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f840cfa20 tx=0x7f3f78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400f510 con 0x7f44700b2150 2023-10-06T11:13:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400f690 con 0x7f44700b2150 2023-10-06T11:13:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400fa50 con 0x7f44700b2150 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7fb5d1495700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5cc0c82d0 0x7fb5cc152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7fb5d1495700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 0x7fb5cc0bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7fb5d1495700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7fb5d1495700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c3ac0 con 0x7fb5cc160df0 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7fb5d1495700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c3190 con 0x7fb5cc0c82d0 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.137+0000 7fb5d1495700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c3470 con 0x7fb5cc0c8750 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 0x7fb5cc0bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5cb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 0x7fb5cc0bfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:56602/0 (socket says 172.21.15.55:56602) 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 -- 172.21.15.55:0/349654653 learned_addr learned my addr 172.21.15.55:0/349654653 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5caffd700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5cc0c82d0 0x7fb5cc152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 -- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5cc0c82d0 msgr2=0x7fb5cc152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5cc0c82d0 0x7fb5cc152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 -- 172.21.15.55:0/349654653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 msgr2=0x7fb5cc0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 -- 172.21.15.55:0/349654653 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009420 con 0x7fb5cc0c8750 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5cb7fe700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5caffd700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5cc0c82d0 0x7fb5cc152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.138+0000 7fb5ca7fc700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 0x7fb5cc0bfb20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c7c0 tx=0x7fb5c0007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44701473d0 con 0x7f44700b2150 2023-10-06T11:13:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44701476b0 con 0x7f44700b2150 2023-10-06T11:13:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0005b30 con 0x7fb5cc0c8750 2023-10-06T11:13:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f7c0538e0 con 0x7f3f6c003ae0 2023-10-06T11:13:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.136+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1840052b0 con 0x7fa1a006e770 2023-10-06T11:13:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0005c90 con 0x7fb5cc0c8750 2023-10-06T11:13:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc0c3750 con 0x7fb5cc0c8750 2023-10-06T11:13:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0004a80 con 0x7fb5cc0c8750 2023-10-06T11:13:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.139+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc0c0060 con 0x7fb5cc0c8750 2023-10-06T11:13:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.141+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa19000fc80 con 0x7fa1a006e770 2023-10-06T11:13:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.142+0000 7fa18e7fc700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa180067080 0x7fa180069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.142+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa190084cf0 con 0x7fa1a006e770 2023-10-06T11:13:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.142+0000 7fa19e59c700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa180067080 0x7fa180069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.141+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5c00070d0 con 0x7fb5cc0c8750 2023-10-06T11:13:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.141+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0c3c70 con 0x7fb5cc0c8750 2023-10-06T11:13:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.141+0000 7fb5b2ffd700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5b8067000 0x7fb5b80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.142+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb5c0083cd0 con 0x7fb5cc0c8750 2023-10-06T11:13:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.143+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447014c650 con 0x7f44700b2150 2023-10-06T11:13:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.143+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f446401a400 con 0x7f44700b2150 2023-10-06T11:13:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.143+0000 7fa19e59c700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa180067080 0x7fa180069530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa198009a80 tx=0x7fa198017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.144+0000 7f446cff9700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.144+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44640842d0 con 0x7f44700b2150 2023-10-06T11:13:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.144+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa190051b70 con 0x7fa1a006e770 2023-10-06T11:13:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.146+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5c004b5a0 con 0x7fb5cc0c8750 2023-10-06T11:13:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.152+0000 7fb5caffd700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5b8067000 0x7fb5b80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.157+0000 7fb5caffd700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5b8067000 0x7fb5b80694b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0030c0 tx=0x7fb5bc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.152+0000 7f4474b04700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.163+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f447014c650 con 0x7f44700b2150 2023-10-06T11:13:31.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.170+0000 7f4474b04700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f445c066f30 0x7f445c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4460009f20 tx=0x7f44600090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.480+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8768005590 con 0x7f8784155820 2023-10-06T11:13:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.482+0000 7f87797fa700 1 -- 172.21.15.55:0/421342440 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8780055e60 con 0x7f8784155820 2023-10-06T11:13:31.494 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:31.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8770067200 msgr2=0x7f87700696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8770067200 0x7f87700696b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f877c00ad10 tx=0x7f877c009370 comp rx=0 tx=0).stop 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 msgr2=0x7f87840b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 0x7f87840b1230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f878000b510 tx=0x7f87800090f0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 shutdown_connections 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8770067200 0x7f87700696b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8784155820 0x7f87840b1230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878406e3d0 0x7f87840c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 --2- 172.21.15.55:0/421342440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87840c8260 0x7f87840c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 >> 172.21.15.55:0/421342440 conn(0x7f8784068080 msgr2=0x7f8784153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.499+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 shutdown_connections 2023-10-06T11:13:31.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.500+0000 7f878b3a2700 1 -- 172.21.15.55:0/421342440 wait complete. 2023-10-06T11:13:31.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.513+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4cd4157e90 con 0x7f4cd40c82d0 2023-10-06T11:13:31.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.515+0000 7f4cbaffd700 1 -- 172.21.15.55:0/2827238495 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4cc4055290 con 0x7f4cd40c82d0 2023-10-06T11:13:31.516 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:31.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-10-06T11:13:31.519 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.518+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4cc0067080 msgr2=0x7f4cc0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.518+0000 7f4cd9763700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4cc0067080 0x7f4cc0069530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cd406b440 tx=0x7f4ccc03a000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.518+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c82d0 msgr2=0x7f4cd40c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.518+0000 7f4cd9763700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c82d0 0x7f4cd40c0550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400d860 tx=0x7f4cc4008040 comp rx=0 tx=0).stop 2023-10-06T11:13:31.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 shutdown_connections 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4cc0067080 0x7f4cc0069530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd4160df0 0x7f4cd415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd40c82d0 0x7f4cd40c0550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 --2- 172.21.15.55:0/2827238495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd40c8750 0x7f4cd40b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 >> 172.21.15.55:0/2827238495 conn(0x7f4cd4068080 msgr2=0x7f4cd40af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 shutdown_connections 2023-10-06T11:13:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.519+0000 7f4cd9763700 1 -- 172.21.15.55:0/2827238495 wait complete. 2023-10-06T11:13:31.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.531+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbaa40c30f0 con 0x7fbaa41531a0 2023-10-06T11:13:31.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.532+0000 7fba927fc700 1 -- 172.21.15.55:0/530786666 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba98026020 con 0x7fbaa41531a0 2023-10-06T11:13:31.533 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-10-06T11:13:31.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.533+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb5cc0c35b0 con 0x7fb5cc0c8750 2023-10-06T11:13:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0ca40c0a30 con 0x7f0ca4155820 2023-10-06T11:13:31.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba84067080 msgr2=0x7fba84069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba84067080 0x7fba84069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba940025c0 tx=0x7fba94007b50 comp rx=0 tx=0).stop 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 msgr2=0x7fbaa414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 0x7fbaa414d500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba9800e010 tx=0x7fba9801a000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 shutdown_connections 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fba84067080 0x7fba84069530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaa41531a0 0x7fbaa414d500 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaa406b540 0x7fbaa4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 --2- 172.21.15.55:0/530786666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaa40ae4a0 0x7fbaa4168ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 >> 172.21.15.55:0/530786666 conn(0x7fbaa4068080 msgr2=0x7fbaa40acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 shutdown_connections 2023-10-06T11:13:31.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.535+0000 7fbaa8ae8700 1 -- 172.21.15.55:0/530786666 wait complete. 2023-10-06T11:13:31.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.536+0000 7fb5b2ffd700 1 -- 172.21.15.55:0/349654653 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5cc0c35b0 con 0x7fb5cc0c8750 2023-10-06T11:13:31.539 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.538+0000 7f0c99ffb700 1 -- 172.21.15.55:0/249100103 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ca40c0a30 con 0x7f0ca4155820 2023-10-06T11:13:31.540 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:31.540 INFO:teuthology.orchestra.run.smithi055.stdout:55834574857 2023-10-06T11:13:31.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5b8067000 msgr2=0x7fb5b80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5b8067000 0x7fb5b80694b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0030c0 tx=0x7fb5bc016000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 msgr2=0x7fb5cc0bfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 0x7fb5cc0bfb20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c7c0 tx=0x7fb5c0007f70 comp rx=0 tx=0).stop 2023-10-06T11:13:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c88067080 msgr2=0x7f0c88069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c88067080 0x7f0c88069530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c470 tx=0x7f0ca000f040 comp rx=0 tx=0).stop 2023-10-06T11:13:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3f64005830 con 0x7f3f6c003ae0 2023-10-06T11:13:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 msgr2=0x7f0ca40c1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 0x7f0ca40c1340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009290 tx=0x7f0c94015000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 shutdown_connections 2023-10-06T11:13:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb5b8067000 0x7fb5b80694b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5cc160df0 0x7fb5cc0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5cc0c82d0 0x7fb5cc152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 --2- 172.21.15.55:0/349654653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5cc0c8750 0x7fb5cc0bfb20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 >> 172.21.15.55:0/349654653 conn(0x7fb5cc068080 msgr2=0x7fb5cc0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 shutdown_connections 2023-10-06T11:13:31.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c88067080 0x7f0c88069530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ca4069c30 0x7f0ca40c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ca4155820 0x7f0ca40c1340 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 --2- 172.21.15.55:0/249100103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ca40c8260 0x7f0ca40b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 >> 172.21.15.55:0/249100103 conn(0x7f0ca4068080 msgr2=0x7f0ca414e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 shutdown_connections 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 shutdown_connections 2023-10-06T11:13:31.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7fb5d1495700 1 -- 172.21.15.55:0/349654653 wait complete. 2023-10-06T11:13:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f0cabb31700 1 -- 172.21.15.55:0/249100103 wait complete. 2023-10-06T11:13:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.541+0000 7f3f6affd700 1 -- 172.21.15.55:0/2424750045 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f7c086e60 con 0x7f3f6c003ae0 2023-10-06T11:13:31.547 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.544+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f70066f30 msgr2=0x7f3f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.544+0000 7f3f89373700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f70066f30 0x7f3f700693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f840cfa20 tx=0x7f3f78008040 comp rx=0 tx=0).stop 2023-10-06T11:13:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.544+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 msgr2=0x7f3f8415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.544+0000 7f3f89373700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f8415a2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00d010 tx=0x7f3f7c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 shutdown_connections 2023-10-06T11:13:31.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f70066f30 0x7f3f700693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f840c63a0 0x7f3f840c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c003ae0 0x7f3f8415a2a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 --2- 172.21.15.55:0/2424750045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f840cae00 0x7f3f840c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 >> 172.21.15.55:0/2424750045 conn(0x7f3f840ccf30 msgr2=0x7f3f840cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 shutdown_connections 2023-10-06T11:13:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.546+0000 7f3f89373700 1 -- 172.21.15.55:0/2424750045 wait complete. 2023-10-06T11:13:31.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-10-06T11:13:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.554+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa184005830 con 0x7fa1a006e770 2023-10-06T11:13:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.555+0000 7fa18e7fc700 1 -- 172.21.15.55:0/25897859 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa190055190 con 0x7fa1a006e770 2023-10-06T11:13:31.557 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.557 INFO:teuthology.orchestra.run.smithi055.stdout:55834574858 2023-10-06T11:13:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa180067080 msgr2=0x7fa180069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa180067080 0x7fa180069530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa198009a80 tx=0x7fa198017000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a006e770 msgr2=0x7fa1a00c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a006e770 0x7fa1a00c6230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa19000b4c0 tx=0x7fa190009060 comp rx=0 tx=0).stop 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 shutdown_connections 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa180067080 0x7fa180069530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1a006e770 0x7fa1a00c6230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1a0064490 0x7fa1a01509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 --2- 172.21.15.55:0/25897859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a00675b0 0x7fa1a00c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 >> 172.21.15.55:0/25897859 conn(0x7fa1a00cc6f0 msgr2=0x7fa1a00c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 shutdown_connections 2023-10-06T11:13:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.559+0000 7fa1a4dd9700 1 -- 172.21.15.55:0/25897859 wait complete. 2023-10-06T11:13:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.560+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f447014c620 con 0x7f44700b2150 2023-10-06T11:13:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.561+0000 7f446cff9700 1 -- 172.21.15.55:0/3993448029 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4464051150 con 0x7f44700b2150 2023-10-06T11:13:31.562 INFO:teuthology.orchestra.run.smithi055.stdout:55834574859 2023-10-06T11:13:31.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-10-06T11:13:31.563 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-10-06T11:13:31.565 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.563+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f445c066f30 msgr2=0x7f445c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.563+0000 7f4476d68700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f445c066f30 0x7f445c0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4460009f20 tx=0x7f44600090f0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 msgr2=0x7f4470144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 0x7f4470144410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f446400b600 tx=0x7f44640091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 shutdown_connections 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4470155840 0x7f4470146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44700aef10 0x7f44701587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 --2- 172.21.15.55:0/3993448029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44700b2150 0x7f4470144410 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 >> 172.21.15.55:0/3993448029 conn(0x7f447006dcd0 msgr2=0x7f447006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 shutdown_connections 2023-10-06T11:13:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.564+0000 7f4476d68700 1 -- 172.21.15.55:0/3993448029 wait complete. 2023-10-06T11:13:31.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-10-06T11:13:31.568 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-10-06T11:13:31.576 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-10-06T11:13:31.578 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:31.578 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T11:13:31.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:13:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.736+0000 7f70980f7700 1 Processor -- start 2023-10-06T11:13:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.736+0000 7f70980f7700 1 -- start start 2023-10-06T11:13:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.737+0000 7f70980f7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7090159ad0 0x7f7090159f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.737+0000 7f70980f7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7090068d10 con 0x7f70900cb5f0 2023-10-06T11:13:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.737+0000 7f70980f7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709015a670 con 0x7f70900ca670 2023-10-06T11:13:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.737+0000 7f70980f7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709015a490 con 0x7f7090159ad0 2023-10-06T11:13:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.737+0000 7f7095e93700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f70900cb5f0 0x7f70900691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53682/0 (socket says 172.21.15.55:53682) 2023-10-06T11:13:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.737+0000 7f7095e93700 1 -- 172.21.15.55:0/4133050174 learned_addr learned my addr 172.21.15.55:0/4133050174 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7095692700 1 --2- 172.21.15.55:0/4133050174 >> v2:172.21.15.142:3300/0 conn(0x7f7090159ad0 0x7f7090159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128128827 0 0) 0x7f7090068d10 con 0x7f70900cb5f0 2023-10-06T11:13:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7078003570 con 0x7f70900cb5f0 2023-10-06T11:13:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909387608 0 0) 0x7f709015a670 con 0x7f70900ca670 2023-10-06T11:13:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7090068d10 con 0x7f70900ca670 2023-10-06T11:13:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7095692700 1 -- 172.21.15.55:0/4133050174 >> v1:172.21.15.142:6789/0 conn(0x7f70900ca670 legacy=0x7f70900ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7095692700 1 -- 172.21.15.55:0/4133050174 >> v1:172.21.15.55:6789/0 conn(0x7f70900cb5f0 legacy=0x7f70900691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7095692700 1 -- 172.21.15.55:0/4133050174 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709015a950 con 0x7f7090159ad0 2023-10-06T11:13:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7095692700 1 --2- 172.21.15.55:0/4133050174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f7090159f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70840098e0 tx=0x7f70840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0b025b2d638933c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011630 con 0x7f7090159ad0 2023-10-06T11:13:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084011790 con 0x7f7090159ad0 2023-10-06T11:13:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.738+0000 7f7094e91700 1 -- 172.21.15.55:0/4133050174 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011b30 con 0x7f7090159ad0 2023-10-06T11:13:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 -- 172.21.15.55:0/4133050174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 msgr2=0x7f7090159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 --2- 172.21.15.55:0/4133050174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f7090159f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70840098e0 tx=0x7f70840091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 -- 172.21.15.55:0/4133050174 shutdown_connections 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 --2- 172.21.15.55:0/4133050174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f7090159f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 -- 172.21.15.55:0/4133050174 >> 172.21.15.55:0/4133050174 conn(0x7f70900707d0 msgr2=0x7f7090070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 -- 172.21.15.55:0/4133050174 shutdown_connections 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.739+0000 7f70980f7700 1 -- 172.21.15.55:0/4133050174 wait complete. 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.740+0000 7f70980f7700 1 Processor -- start 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.740+0000 7f70980f7700 1 -- start start 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 0x7f70900b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70900cb5f0 0x7f70900b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f70900c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70900b3df0 con 0x7f70900ca670 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70900b2070 con 0x7f7090159ad0 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70900b2350 con 0x7f70900cb5f0 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 0x7f70900b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 0x7f70900b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37532/0 (socket says 172.21.15.55:37532) 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 -- 172.21.15.55:0/2901436928 learned_addr learned my addr 172.21.15.55:0/2901436928 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095692700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70900cb5f0 0x7f70900b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7096694700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f70900c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 -- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70900cb5f0 msgr2=0x7f70900b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70900cb5f0 0x7f70900b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 -- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 msgr2=0x7f70900c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f70900c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 -- 172.21.15.55:0/2901436928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084009420 con 0x7f70900ca670 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7096694700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f70900c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f7095e93700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 0x7f70900b1a40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f708800c790 tx=0x7f7088007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088005b30 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088005c90 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088007300 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.741+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70900b2630 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.742+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70901524f0 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.743+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70900b2b50 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.743+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f708801b400 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.743+0000 7f708dffb700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f707c066f30 0x7f707c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.743+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f70880844c0 con 0x7f70900ca670 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.743+0000 7f7095692700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f707c066f30 0x7f707c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.744+0000 7f7095692700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f707c066f30 0x7f707c0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70840093f0 tx=0x7f7084017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.748+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70900b2b50 con 0x7f70900ca670 2023-10-06T11:13:31.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.936+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70900b2b50 con 0x7f707c066f30 2023-10-06T11:13:31.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.946+0000 7f708dffb700 1 -- 172.21.15.55:0/2901436928 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367361 (secure 0 0 0) 0x7f70900b2b50 con 0x7f707c066f30 2023-10-06T11:13:31.952 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f707c066f30 msgr2=0x7f707c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f707c066f30 0x7f707c0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70840093f0 tx=0x7f7084017000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 msgr2=0x7f70900b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 0x7f70900b1a40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f708800c790 tx=0x7f7088007ea0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 shutdown_connections 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f707c066f30 0x7f707c0693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900ca670 0x7f70900b1a40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7090159ad0 0x7f70900c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 --2- 172.21.15.55:0/2901436928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70900cb5f0 0x7f70900b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 >> 172.21.15.55:0/2901436928 conn(0x7f70900707d0 msgr2=0x7f70901534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 shutdown_connections 2023-10-06T11:13:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:31.950+0000 7f70980f7700 1 -- 172.21.15.55:0/2901436928 wait complete. 2023-10-06T11:13:31.956 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:13:31.964 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-06T11:13:30.845143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381896,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592824,"statfs":{"total":773094113280,"available":770655051776,"internally_reserved":0,"allocated":3678208,"data_stored":2183560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003481"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.138211+0000","last_change":"2023-10-06T11:13:13.121699+0000","last_active":"2023-10-06T11:13:17.138211+0000","last_peered":"2023-10-06T11:13:17.138211+0000","last_clean":"2023-10-06T11:13:17.138211+0000","last_became_active":"2023-10-06T11:13:13.121499+0000","last_became_peered":"2023-10-06T11:13:13.121499+0000","last_unstale":"2023-10-06T11:13:17.138211+0000","last_undegraded":"2023-10-06T11:13:17.138211+0000","last_fullsized":"2023-10-06T11:13:17.138211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155514+0000","last_change":"2023-10-06T11:13:13.120623+0000","last_active":"2023-10-06T11:13:17.155514+0000","last_peered":"2023-10-06T11:13:17.155514+0000","last_clean":"2023-10-06T11:13:17.155514+0000","last_became_active":"2023-10-06T11:13:13.120368+0000","last_became_peered":"2023-10-06T11:13:13.120368+0000","last_unstale":"2023-10-06T11:13:17.155514+0000","last_undegraded":"2023-10-06T11:13:17.155514+0000","last_fullsized":"2023-10-06T11:13:17.155514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144860+0000","last_change":"2023-10-06T11:13:13.118595+0000","last_active":"2023-10-06T11:13:17.144860+0000","last_peered":"2023-10-06T11:13:17.144860+0000","last_clean":"2023-10-06T11:13:17.144860+0000","last_became_active":"2023-10-06T11:13:13.118314+0000","last_became_peered":"2023-10-06T11:13:13.118314+0000","last_unstale":"2023-10-06T11:13:17.144860+0000","last_undegraded":"2023-10-06T11:13:17.144860+0000","last_fullsized":"2023-10-06T11:13:17.144860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:56.994826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.139864+0000","last_change":"2023-10-06T11:13:13.118767+0000","last_active":"2023-10-06T11:13:17.139864+0000","last_peered":"2023-10-06T11:13:17.139864+0000","last_clean":"2023-10-06T11:13:17.139864+0000","last_became_active":"2023-10-06T11:13:13.118462+0000","last_became_peered":"2023-10-06T11:13:13.118462+0000","last_unstale":"2023-10-06T11:13:17.139864+0000","last_undegraded":"2023-10-06T11:13:17.139864+0000","last_fullsized":"2023-10-06T11:13:17.139864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142961+0000","last_change":"2023-10-06T11:13:13.121812+0000","last_active":"2023-10-06T11:13:17.142961+0000","last_peered":"2023-10-06T11:13:17.142961+0000","last_clean":"2023-10-06T11:13:17.142961+0000","last_became_active":"2023-10-06T11:13:13.121530+0000","last_became_peered":"2023-10-06T11:13:13.121530+0000","last_unstale":"2023-10-06T11:13:17.142961+0000","last_undegraded":"2023-10-06T11:13:17.142961+0000","last_fullsized":"2023-10-06T11:13:17.142961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144619+0000","last_change":"2023-10-06T11:13:13.127391+0000","last_active":"2023-10-06T11:13:17.144619+0000","last_peered":"2023-10-06T11:13:17.144619+0000","last_clean":"2023-10-06T11:13:17.144619+0000","last_became_active":"2023-10-06T11:13:13.127090+0000","last_became_peered":"2023-10-06T11:13:13.127090+0000","last_unstale":"2023-10-06T11:13:17.144619+0000","last_undegraded":"2023-10-06T11:13:17.144619+0000","last_fullsized":"2023-10-06T11:13:17.144619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:29.195895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149465+0000","last_change":"2023-10-06T11:13:13.134965+0000","last_active":"2023-10-06T11:13:17.149465+0000","last_peered":"2023-10-06T11:13:17.149465+0000","last_clean":"2023-10-06T11:13:17.149465+0000","last_became_active":"2023-10-06T11:13:13.134668+0000","last_became_peered":"2023-10-06T11:13:13.134668+0000","last_unstale":"2023-10-06T11:13:17.149465+0000","last_undegraded":"2023-10-06T11:13:17.149465+0000","last_fullsized":"2023-10-06T11:13:17.149465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150571+0000","last_change":"2023-10-06T11:13:13.114957+0000","last_active":"2023-10-06T11:13:17.150571+0000","last_peered":"2023-10-06T11:13:17.150571+0000","last_clean":"2023-10-06T11:13:17.150571+0000","last_became_active":"2023-10-06T11:13:13.114673+0000","last_became_peered":"2023-10-06T11:13:13.114673+0000","last_unstale":"2023-10-06T11:13:17.150571+0000","last_undegraded":"2023-10-06T11:13:17.150571+0000","last_fullsized":"2023-10-06T11:13:17.150571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145256+0000","last_change":"2023-10-06T11:13:13.121976+0000","last_active":"2023-10-06T11:13:17.145256+0000","last_peered":"2023-10-06T11:13:17.145256+0000","last_clean":"2023-10-06T11:13:17.145256+0000","last_became_active":"2023-10-06T11:13:13.121523+0000","last_became_peered":"2023-10-06T11:13:13.121523+0000","last_unstale":"2023-10-06T11:13:17.145256+0000","last_undegraded":"2023-10-06T11:13:17.145256+0000","last_fullsized":"2023-10-06T11:13:17.145256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155701+0000","last_change":"2023-10-06T11:13:13.126240+0000","last_active":"2023-10-06T11:13:17.155701+0000","last_peered":"2023-10-06T11:13:17.155701+0000","last_clean":"2023-10-06T11:13:17.155701+0000","last_became_active":"2023-10-06T11:13:13.125943+0000","last_became_peered":"2023-10-06T11:13:13.125943+0000","last_unstale":"2023-10-06T11:13:17.155701+0000","last_undegraded":"2023-10-06T11:13:17.155701+0000","last_fullsized":"2023-10-06T11:13:17.155701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145009+0000","last_change":"2023-10-06T11:13:13.127706+0000","last_active":"2023-10-06T11:13:17.145009+0000","last_peered":"2023-10-06T11:13:17.145009+0000","last_clean":"2023-10-06T11:13:17.145009+0000","last_became_active":"2023-10-06T11:13:13.127484+0000","last_became_peered":"2023-10-06T11:13:13.127484+0000","last_unstale":"2023-10-06T11:13:17.145009+0000","last_undegraded":"2023-10-06T11:13:17.145009+0000","last_fullsized":"2023-10-06T11:13:17.145009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:11.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136986+0000","last_change":"2023-10-06T11:13:13.118366+0000","last_active":"2023-10-06T11:13:17.136986+0000","last_peered":"2023-10-06T11:13:17.136986+0000","last_clean":"2023-10-06T11:13:17.136986+0000","last_became_active":"2023-10-06T11:13:13.117530+0000","last_became_peered":"2023-10-06T11:13:13.117530+0000","last_unstale":"2023-10-06T11:13:17.136986+0000","last_undegraded":"2023-10-06T11:13:17.136986+0000","last_fullsized":"2023-10-06T11:13:17.136986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:30.505653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137568+0000","last_change":"2023-10-06T11:13:13.123055+0000","last_active":"2023-10-06T11:13:17.137568+0000","last_peered":"2023-10-06T11:13:17.137568+0000","last_clean":"2023-10-06T11:13:17.137568+0000","last_became_active":"2023-10-06T11:13:13.122747+0000","last_became_peered":"2023-10-06T11:13:13.122747+0000","last_unstale":"2023-10-06T11:13:17.137568+0000","last_undegraded":"2023-10-06T11:13:17.137568+0000","last_fullsized":"2023-10-06T11:13:17.137568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154823+0000","last_change":"2023-10-06T11:13:13.124824+0000","last_active":"2023-10-06T11:13:17.154823+0000","last_peered":"2023-10-06T11:13:17.154823+0000","last_clean":"2023-10-06T11:13:17.154823+0000","last_became_active":"2023-10-06T11:13:13.124503+0000","last_became_peered":"2023-10-06T11:13:13.124503+0000","last_unstale":"2023-10-06T11:13:17.154823+0000","last_undegraded":"2023-10-06T11:13:17.154823+0000","last_fullsized":"2023-10-06T11:13:17.154823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149286+0000","last_change":"2023-10-06T11:13:13.135539+0000","last_active":"2023-10-06T11:13:17.149286+0000","last_peered":"2023-10-06T11:13:17.149286+0000","last_clean":"2023-10-06T11:13:17.149286+0000","last_became_active":"2023-10-06T11:13:13.135269+0000","last_became_peered":"2023-10-06T11:13:13.135269+0000","last_unstale":"2023-10-06T11:13:17.149286+0000","last_undegraded":"2023-10-06T11:13:17.149286+0000","last_fullsized":"2023-10-06T11:13:17.149286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143826+0000","last_change":"2023-10-06T11:13:13.118179+0000","last_active":"2023-10-06T11:13:17.143826+0000","last_peered":"2023-10-06T11:13:17.143826+0000","last_clean":"2023-10-06T11:13:17.143826+0000","last_became_active":"2023-10-06T11:13:13.117933+0000","last_became_peered":"2023-10-06T11:13:13.117933+0000","last_unstale":"2023-10-06T11:13:17.143826+0000","last_undegraded":"2023-10-06T11:13:17.143826+0000","last_fullsized":"2023-10-06T11:13:17.143826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:38.942631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145356+0000","last_change":"2023-10-06T11:13:13.121835+0000","last_active":"2023-10-06T11:13:17.145356+0000","last_peered":"2023-10-06T11:13:17.145356+0000","last_clean":"2023-10-06T11:13:17.145356+0000","last_became_active":"2023-10-06T11:13:13.121140+0000","last_became_peered":"2023-10-06T11:13:13.121140+0000","last_unstale":"2023-10-06T11:13:17.145356+0000","last_undegraded":"2023-10-06T11:13:17.145356+0000","last_fullsized":"2023-10-06T11:13:17.145356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144097+0000","last_change":"2023-10-06T11:13:13.126361+0000","last_active":"2023-10-06T11:13:17.144097+0000","last_peered":"2023-10-06T11:13:17.144097+0000","last_clean":"2023-10-06T11:13:17.144097+0000","last_became_active":"2023-10-06T11:13:13.126088+0000","last_became_peered":"2023-10-06T11:13:13.126088+0000","last_unstale":"2023-10-06T11:13:17.144097+0000","last_undegraded":"2023-10-06T11:13:17.144097+0000","last_fullsized":"2023-10-06T11:13:17.144097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:20.523798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137234+0000","last_change":"2023-10-06T11:13:13.123624+0000","last_active":"2023-10-06T11:13:17.137234+0000","last_peered":"2023-10-06T11:13:17.137234+0000","last_clean":"2023-10-06T11:13:17.137234+0000","last_became_active":"2023-10-06T11:13:13.123377+0000","last_became_peered":"2023-10-06T11:13:13.123377+0000","last_unstale":"2023-10-06T11:13:17.137234+0000","last_undegraded":"2023-10-06T11:13:17.137234+0000","last_fullsized":"2023-10-06T11:13:17.137234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:10.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143778+0000","last_change":"2023-10-06T11:13:13.122220+0000","last_active":"2023-10-06T11:13:17.143778+0000","last_peered":"2023-10-06T11:13:17.143778+0000","last_clean":"2023-10-06T11:13:17.143778+0000","last_became_active":"2023-10-06T11:13:13.121971+0000","last_became_peered":"2023-10-06T11:13:13.121971+0000","last_unstale":"2023-10-06T11:13:17.143778+0000","last_undegraded":"2023-10-06T11:13:17.143778+0000","last_fullsized":"2023-10-06T11:13:17.143778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.288774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148367+0000","last_change":"2023-10-06T11:13:13.130138+0000","last_active":"2023-10-06T11:13:17.148367+0000","last_peered":"2023-10-06T11:13:17.148367+0000","last_clean":"2023-10-06T11:13:17.148367+0000","last_became_active":"2023-10-06T11:13:13.129957+0000","last_became_peered":"2023-10-06T11:13:13.129957+0000","last_unstale":"2023-10-06T11:13:17.148367+0000","last_undegraded":"2023-10-06T11:13:17.148367+0000","last_fullsized":"2023-10-06T11:13:17.148367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142383+0000","last_change":"2023-10-06T11:13:13.131599+0000","last_active":"2023-10-06T11:13:17.142383+0000","last_peered":"2023-10-06T11:13:17.142383+0000","last_clean":"2023-10-06T11:13:17.142383+0000","last_became_active":"2023-10-06T11:13:13.131351+0000","last_became_peered":"2023-10-06T11:13:13.131351+0000","last_unstale":"2023-10-06T11:13:17.142383+0000","last_undegraded":"2023-10-06T11:13:17.142383+0000","last_fullsized":"2023-10-06T11:13:17.142383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143350+0000","last_change":"2023-10-06T11:13:13.120698+0000","last_active":"2023-10-06T11:13:17.143350+0000","last_peered":"2023-10-06T11:13:17.143350+0000","last_clean":"2023-10-06T11:13:17.143350+0000","last_became_active":"2023-10-06T11:13:13.120409+0000","last_became_peered":"2023-10-06T11:13:13.120409+0000","last_unstale":"2023-10-06T11:13:17.143350+0000","last_undegraded":"2023-10-06T11:13:17.143350+0000","last_fullsized":"2023-10-06T11:13:17.143350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147544+0000","last_change":"2023-10-06T11:13:13.125155+0000","last_active":"2023-10-06T11:13:17.147544+0000","last_peered":"2023-10-06T11:13:17.147544+0000","last_clean":"2023-10-06T11:13:17.147544+0000","last_became_active":"2023-10-06T11:13:13.124909+0000","last_became_peered":"2023-10-06T11:13:13.124909+0000","last_unstale":"2023-10-06T11:13:17.147544+0000","last_undegraded":"2023-10-06T11:13:17.147544+0000","last_fullsized":"2023-10-06T11:13:17.147544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151721+0000","last_change":"2023-10-06T11:13:13.126695+0000","last_active":"2023-10-06T11:13:17.151721+0000","last_peered":"2023-10-06T11:13:17.151721+0000","last_clean":"2023-10-06T11:13:17.151721+0000","last_became_active":"2023-10-06T11:13:13.126107+0000","last_became_peered":"2023-10-06T11:13:13.126107+0000","last_unstale":"2023-10-06T11:13:17.151721+0000","last_undegraded":"2023-10-06T11:13:17.151721+0000","last_fullsized":"2023-10-06T11:13:17.151721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152340+0000","last_change":"2023-10-06T11:13:13.127518+0000","last_active":"2023-10-06T11:13:17.152340+0000","last_peered":"2023-10-06T11:13:17.152340+0000","last_clean":"2023-10-06T11:13:17.152340+0000","last_became_active":"2023-10-06T11:13:13.127277+0000","last_became_peered":"2023-10-06T11:13:13.127277+0000","last_unstale":"2023-10-06T11:13:17.152340+0000","last_undegraded":"2023-10-06T11:13:17.152340+0000","last_fullsized":"2023-10-06T11:13:17.152340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:45.902476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152956+0000","last_change":"2023-10-06T11:13:13.122605+0000","last_active":"2023-10-06T11:13:17.152956+0000","last_peered":"2023-10-06T11:13:17.152956+0000","last_clean":"2023-10-06T11:13:17.152956+0000","last_became_active":"2023-10-06T11:13:13.122169+0000","last_became_peered":"2023-10-06T11:13:13.122169+0000","last_unstale":"2023-10-06T11:13:17.152956+0000","last_undegraded":"2023-10-06T11:13:17.152956+0000","last_fullsized":"2023-10-06T11:13:17.152956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160038+0000","last_change":"2023-10-06T11:13:17.156729+0000","last_active":"2023-10-06T11:13:17.160038+0000","last_peered":"2023-10-06T11:13:17.160038+0000","last_clean":"2023-10-06T11:13:17.160038+0000","last_became_active":"2023-10-06T11:13:17.156340+0000","last_became_peered":"2023-10-06T11:13:17.156340+0000","last_unstale":"2023-10-06T11:13:17.160038+0000","last_undegraded":"2023-10-06T11:13:17.160038+0000","last_fullsized":"2023-10-06T11:13:17.160038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:32.463267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144410+0000","last_change":"2023-10-06T11:13:12.110036+0000","last_active":"2023-10-06T11:13:17.144410+0000","last_peered":"2023-10-06T11:13:17.144410+0000","last_clean":"2023-10-06T11:13:17.144410+0000","last_became_active":"2023-10-06T11:13:12.109584+0000","last_became_peered":"2023-10-06T11:13:12.109584+0000","last_unstale":"2023-10-06T11:13:17.144410+0000","last_undegraded":"2023-10-06T11:13:17.144410+0000","last_fullsized":"2023-10-06T11:13:17.144410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144471+0000","last_change":"2023-10-06T11:13:13.128382+0000","last_active":"2023-10-06T11:13:17.144471+0000","last_peered":"2023-10-06T11:13:17.144471+0000","last_clean":"2023-10-06T11:13:17.144471+0000","last_became_active":"2023-10-06T11:13:13.128089+0000","last_became_peered":"2023-10-06T11:13:13.128089+0000","last_unstale":"2023-10-06T11:13:17.144471+0000","last_undegraded":"2023-10-06T11:13:17.144471+0000","last_fullsized":"2023-10-06T11:13:17.144471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162772+0000","last_change":"2023-10-06T11:13:17.157622+0000","last_active":"2023-10-06T11:13:17.162772+0000","last_peered":"2023-10-06T11:13:17.162772+0000","last_clean":"2023-10-06T11:13:17.162772+0000","last_became_active":"2023-10-06T11:13:17.157240+0000","last_became_peered":"2023-10-06T11:13:17.157240+0000","last_unstale":"2023-10-06T11:13:17.162772+0000","last_undegraded":"2023-10-06T11:13:17.162772+0000","last_fullsized":"2023-10-06T11:13:17.162772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:08.312759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151403+0000","last_change":"2023-10-06T11:13:12.115710+0000","last_active":"2023-10-06T11:13:17.151403+0000","last_peered":"2023-10-06T11:13:17.151403+0000","last_clean":"2023-10-06T11:13:17.151403+0000","last_became_active":"2023-10-06T11:13:12.115446+0000","last_became_peered":"2023-10-06T11:13:12.115446+0000","last_unstale":"2023-10-06T11:13:17.151403+0000","last_undegraded":"2023-10-06T11:13:17.151403+0000","last_fullsized":"2023-10-06T11:13:17.151403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142885+0000","last_change":"2023-10-06T11:13:13.125846+0000","last_active":"2023-10-06T11:13:17.142885+0000","last_peered":"2023-10-06T11:13:17.142885+0000","last_clean":"2023-10-06T11:13:17.142885+0000","last_became_active":"2023-10-06T11:13:13.125581+0000","last_became_peered":"2023-10-06T11:13:13.125581+0000","last_unstale":"2023-10-06T11:13:17.142885+0000","last_undegraded":"2023-10-06T11:13:17.142885+0000","last_fullsized":"2023-10-06T11:13:17.142885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162796+0000","last_change":"2023-10-06T11:13:17.156222+0000","last_active":"2023-10-06T11:13:17.162796+0000","last_peered":"2023-10-06T11:13:17.162796+0000","last_clean":"2023-10-06T11:13:17.162796+0000","last_became_active":"2023-10-06T11:13:17.155785+0000","last_became_peered":"2023-10-06T11:13:17.155785+0000","last_unstale":"2023-10-06T11:13:17.162796+0000","last_undegraded":"2023-10-06T11:13:17.162796+0000","last_fullsized":"2023-10-06T11:13:17.162796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144138+0000","last_change":"2023-10-06T11:13:12.104094+0000","last_active":"2023-10-06T11:13:17.144138+0000","last_peered":"2023-10-06T11:13:17.144138+0000","last_clean":"2023-10-06T11:13:17.144138+0000","last_became_active":"2023-10-06T11:13:12.103658+0000","last_became_peered":"2023-10-06T11:13:12.103658+0000","last_unstale":"2023-10-06T11:13:17.144138+0000","last_undegraded":"2023-10-06T11:13:17.144138+0000","last_fullsized":"2023-10-06T11:13:17.144138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144641+0000","last_change":"2023-10-06T11:13:13.122756+0000","last_active":"2023-10-06T11:13:17.144641+0000","last_peered":"2023-10-06T11:13:17.144641+0000","last_clean":"2023-10-06T11:13:17.144641+0000","last_became_active":"2023-10-06T11:13:13.122498+0000","last_became_peered":"2023-10-06T11:13:13.122498+0000","last_unstale":"2023-10-06T11:13:17.144641+0000","last_undegraded":"2023-10-06T11:13:17.144641+0000","last_fullsized":"2023-10-06T11:13:17.144641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:30.671094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160480+0000","last_change":"2023-10-06T11:13:17.156830+0000","last_active":"2023-10-06T11:13:17.160480+0000","last_peered":"2023-10-06T11:13:17.160480+0000","last_clean":"2023-10-06T11:13:17.160480+0000","last_became_active":"2023-10-06T11:13:17.156440+0000","last_became_peered":"2023-10-06T11:13:17.156440+0000","last_unstale":"2023-10-06T11:13:17.160480+0000","last_undegraded":"2023-10-06T11:13:17.160480+0000","last_fullsized":"2023-10-06T11:13:17.160480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:15.214081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145470+0000","last_change":"2023-10-06T11:13:12.107048+0000","last_active":"2023-10-06T11:13:17.145470+0000","last_peered":"2023-10-06T11:13:17.145470+0000","last_clean":"2023-10-06T11:13:17.145470+0000","last_became_active":"2023-10-06T11:13:12.103664+0000","last_became_peered":"2023-10-06T11:13:12.103664+0000","last_unstale":"2023-10-06T11:13:17.145470+0000","last_undegraded":"2023-10-06T11:13:17.145470+0000","last_fullsized":"2023-10-06T11:13:17.145470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144060+0000","last_change":"2023-10-06T11:13:13.134983+0000","last_active":"2023-10-06T11:13:17.144060+0000","last_peered":"2023-10-06T11:13:17.144060+0000","last_clean":"2023-10-06T11:13:17.144060+0000","last_became_active":"2023-10-06T11:13:13.134636+0000","last_became_peered":"2023-10-06T11:13:13.134636+0000","last_unstale":"2023-10-06T11:13:17.144060+0000","last_undegraded":"2023-10-06T11:13:17.144060+0000","last_fullsized":"2023-10-06T11:13:17.144060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161534+0000","last_change":"2023-10-06T11:13:17.158372+0000","last_active":"2023-10-06T11:13:17.161534+0000","last_peered":"2023-10-06T11:13:17.161534+0000","last_clean":"2023-10-06T11:13:17.161534+0000","last_became_active":"2023-10-06T11:13:17.157994+0000","last_became_peered":"2023-10-06T11:13:17.157994+0000","last_unstale":"2023-10-06T11:13:17.161534+0000","last_undegraded":"2023-10-06T11:13:17.161534+0000","last_fullsized":"2023-10-06T11:13:17.161534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:12.841649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155603+0000","last_change":"2023-10-06T11:13:12.112958+0000","last_active":"2023-10-06T11:13:17.155603+0000","last_peered":"2023-10-06T11:13:17.155603+0000","last_clean":"2023-10-06T11:13:17.155603+0000","last_became_active":"2023-10-06T11:13:12.112670+0000","last_became_peered":"2023-10-06T11:13:12.112670+0000","last_unstale":"2023-10-06T11:13:17.155603+0000","last_undegraded":"2023-10-06T11:13:17.155603+0000","last_fullsized":"2023-10-06T11:13:17.155603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:44.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143449+0000","last_change":"2023-10-06T11:13:13.126318+0000","last_active":"2023-10-06T11:13:17.143449+0000","last_peered":"2023-10-06T11:13:17.143449+0000","last_clean":"2023-10-06T11:13:17.143449+0000","last_became_active":"2023-10-06T11:13:13.126070+0000","last_became_peered":"2023-10-06T11:13:13.126070+0000","last_unstale":"2023-10-06T11:13:17.143449+0000","last_undegraded":"2023-10-06T11:13:17.143449+0000","last_fullsized":"2023-10-06T11:13:17.143449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166081+0000","last_change":"2023-10-06T11:13:17.162541+0000","last_active":"2023-10-06T11:13:17.166081+0000","last_peered":"2023-10-06T11:13:17.166081+0000","last_clean":"2023-10-06T11:13:17.166081+0000","last_became_active":"2023-10-06T11:13:17.162167+0000","last_became_peered":"2023-10-06T11:13:17.162167+0000","last_unstale":"2023-10-06T11:13:17.166081+0000","last_undegraded":"2023-10-06T11:13:17.166081+0000","last_fullsized":"2023-10-06T11:13:17.166081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148499+0000","last_change":"2023-10-06T11:13:12.115343+0000","last_active":"2023-10-06T11:13:17.148499+0000","last_peered":"2023-10-06T11:13:17.148499+0000","last_clean":"2023-10-06T11:13:17.148499+0000","last_became_active":"2023-10-06T11:13:12.115140+0000","last_became_peered":"2023-10-06T11:13:12.115140+0000","last_unstale":"2023-10-06T11:13:17.148499+0000","last_undegraded":"2023-10-06T11:13:17.148499+0000","last_fullsized":"2023-10-06T11:13:17.148499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:45:40.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150826+0000","last_change":"2023-10-06T11:13:13.130679+0000","last_active":"2023-10-06T11:13:17.150826+0000","last_peered":"2023-10-06T11:13:17.150826+0000","last_clean":"2023-10-06T11:13:17.150826+0000","last_became_active":"2023-10-06T11:13:13.130159+0000","last_became_peered":"2023-10-06T11:13:13.130159+0000","last_unstale":"2023-10-06T11:13:17.150826+0000","last_undegraded":"2023-10-06T11:13:17.150826+0000","last_fullsized":"2023-10-06T11:13:17.150826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170593+0000","last_change":"2023-10-06T11:13:17.164392+0000","last_active":"2023-10-06T11:13:17.170593+0000","last_peered":"2023-10-06T11:13:17.170593+0000","last_clean":"2023-10-06T11:13:17.170593+0000","last_became_active":"2023-10-06T11:13:17.164000+0000","last_became_peered":"2023-10-06T11:13:17.164000+0000","last_unstale":"2023-10-06T11:13:17.170593+0000","last_undegraded":"2023-10-06T11:13:17.170593+0000","last_fullsized":"2023-10-06T11:13:17.170593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:54.257356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:13:23.026636+0000","last_change":"2023-10-06T11:13:12.108372+0000","last_active":"2023-10-06T11:13:23.026636+0000","last_peered":"2023-10-06T11:13:23.026636+0000","last_clean":"2023-10-06T11:13:23.026636+0000","last_became_active":"2023-10-06T11:13:12.108083+0000","last_became_peered":"2023-10-06T11:13:12.108083+0000","last_unstale":"2023-10-06T11:13:23.026636+0000","last_undegraded":"2023-10-06T11:13:23.026636+0000","last_fullsized":"2023-10-06T11:13:23.026636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143470+0000","last_change":"2023-10-06T11:13:13.125601+0000","last_active":"2023-10-06T11:13:17.143470+0000","last_peered":"2023-10-06T11:13:17.143470+0000","last_clean":"2023-10-06T11:13:17.143470+0000","last_became_active":"2023-10-06T11:13:13.125279+0000","last_became_peered":"2023-10-06T11:13:13.125279+0000","last_unstale":"2023-10-06T11:13:17.143470+0000","last_undegraded":"2023-10-06T11:13:17.143470+0000","last_fullsized":"2023-10-06T11:13:17.143470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168209+0000","last_change":"2023-10-06T11:13:17.164677+0000","last_active":"2023-10-06T11:13:17.168209+0000","last_peered":"2023-10-06T11:13:17.168209+0000","last_clean":"2023-10-06T11:13:17.168209+0000","last_became_active":"2023-10-06T11:13:17.163312+0000","last_became_peered":"2023-10-06T11:13:17.163312+0000","last_unstale":"2023-10-06T11:13:17.168209+0000","last_undegraded":"2023-10-06T11:13:17.168209+0000","last_fullsized":"2023-10-06T11:13:17.168209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.042784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148271+0000","last_change":"2023-10-06T11:13:12.113019+0000","last_active":"2023-10-06T11:13:17.148271+0000","last_peered":"2023-10-06T11:13:17.148271+0000","last_clean":"2023-10-06T11:13:17.148271+0000","last_became_active":"2023-10-06T11:13:12.112717+0000","last_became_peered":"2023-10-06T11:13:12.112717+0000","last_unstale":"2023-10-06T11:13:17.148271+0000","last_undegraded":"2023-10-06T11:13:17.148271+0000","last_fullsized":"2023-10-06T11:13:17.148271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144893+0000","last_change":"2023-10-06T11:13:13.128297+0000","last_active":"2023-10-06T11:13:17.144893+0000","last_peered":"2023-10-06T11:13:17.144893+0000","last_clean":"2023-10-06T11:13:17.144893+0000","last_became_active":"2023-10-06T11:13:13.128026+0000","last_became_peered":"2023-10-06T11:13:13.128026+0000","last_unstale":"2023-10-06T11:13:17.144893+0000","last_undegraded":"2023-10-06T11:13:17.144893+0000","last_fullsized":"2023-10-06T11:13:17.144893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162240+0000","last_change":"2023-10-06T11:13:17.160008+0000","last_active":"2023-10-06T11:13:17.162240+0000","last_peered":"2023-10-06T11:13:17.162240+0000","last_clean":"2023-10-06T11:13:17.162240+0000","last_became_active":"2023-10-06T11:13:17.159069+0000","last_became_peered":"2023-10-06T11:13:17.159069+0000","last_unstale":"2023-10-06T11:13:17.162240+0000","last_undegraded":"2023-10-06T11:13:17.162240+0000","last_fullsized":"2023-10-06T11:13:17.162240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142294+0000","last_change":"2023-10-06T11:13:12.113312+0000","last_active":"2023-10-06T11:13:17.142294+0000","last_peered":"2023-10-06T11:13:17.142294+0000","last_clean":"2023-10-06T11:13:17.142294+0000","last_became_active":"2023-10-06T11:13:12.112955+0000","last_became_peered":"2023-10-06T11:13:12.112955+0000","last_unstale":"2023-10-06T11:13:17.142294+0000","last_undegraded":"2023-10-06T11:13:17.142294+0000","last_fullsized":"2023-10-06T11:13:17.142294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152870+0000","last_change":"2023-10-06T11:13:13.122429+0000","last_active":"2023-10-06T11:13:17.152870+0000","last_peered":"2023-10-06T11:13:17.152870+0000","last_clean":"2023-10-06T11:13:17.152870+0000","last_became_active":"2023-10-06T11:13:13.121817+0000","last_became_peered":"2023-10-06T11:13:13.121817+0000","last_unstale":"2023-10-06T11:13:17.152870+0000","last_undegraded":"2023-10-06T11:13:17.152870+0000","last_fullsized":"2023-10-06T11:13:17.152870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158460+0000","last_change":"2023-10-06T11:13:17.154826+0000","last_active":"2023-10-06T11:13:17.158460+0000","last_peered":"2023-10-06T11:13:17.158460+0000","last_clean":"2023-10-06T11:13:17.158460+0000","last_became_active":"2023-10-06T11:13:17.154408+0000","last_became_peered":"2023-10-06T11:13:17.154408+0000","last_unstale":"2023-10-06T11:13:17.158460+0000","last_undegraded":"2023-10-06T11:13:17.158460+0000","last_fullsized":"2023-10-06T11:13:17.158460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149376+0000","last_change":"2023-10-06T11:13:12.112186+0000","last_active":"2023-10-06T11:13:17.149376+0000","last_peered":"2023-10-06T11:13:17.149376+0000","last_clean":"2023-10-06T11:13:17.149376+0000","last_became_active":"2023-10-06T11:13:12.111804+0000","last_became_peered":"2023-10-06T11:13:12.111804+0000","last_unstale":"2023-10-06T11:13:17.149376+0000","last_undegraded":"2023-10-06T11:13:17.149376+0000","last_fullsized":"2023-10-06T11:13:17.149376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142984+0000","last_change":"2023-10-06T11:13:13.127356+0000","last_active":"2023-10-06T11:13:17.142984+0000","last_peered":"2023-10-06T11:13:17.142984+0000","last_clean":"2023-10-06T11:13:17.142984+0000","last_became_active":"2023-10-06T11:13:13.127081+0000","last_became_peered":"2023-10-06T11:13:13.127081+0000","last_unstale":"2023-10-06T11:13:17.142984+0000","last_undegraded":"2023-10-06T11:13:17.142984+0000","last_fullsized":"2023-10-06T11:13:17.142984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168186+0000","last_change":"2023-10-06T11:13:17.164977+0000","last_active":"2023-10-06T11:13:17.168186+0000","last_peered":"2023-10-06T11:13:17.168186+0000","last_clean":"2023-10-06T11:13:17.168186+0000","last_became_active":"2023-10-06T11:13:17.162985+0000","last_became_peered":"2023-10-06T11:13:17.162985+0000","last_unstale":"2023-10-06T11:13:17.168186+0000","last_undegraded":"2023-10-06T11:13:17.168186+0000","last_fullsized":"2023-10-06T11:13:17.168186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140804+0000","last_change":"2023-10-06T11:13:12.104093+0000","last_active":"2023-10-06T11:13:17.140804+0000","last_peered":"2023-10-06T11:13:17.140804+0000","last_clean":"2023-10-06T11:13:17.140804+0000","last_became_active":"2023-10-06T11:13:12.103822+0000","last_became_peered":"2023-10-06T11:13:12.103822+0000","last_unstale":"2023-10-06T11:13:17.140804+0000","last_undegraded":"2023-10-06T11:13:17.140804+0000","last_fullsized":"2023-10-06T11:13:17.140804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144546+0000","last_change":"2023-10-06T11:13:13.125356+0000","last_active":"2023-10-06T11:13:17.144546+0000","last_peered":"2023-10-06T11:13:17.144546+0000","last_clean":"2023-10-06T11:13:17.144546+0000","last_became_active":"2023-10-06T11:13:13.125067+0000","last_became_peered":"2023-10-06T11:13:13.125067+0000","last_unstale":"2023-10-06T11:13:17.144546+0000","last_undegraded":"2023-10-06T11:13:17.144546+0000","last_fullsized":"2023-10-06T11:13:17.144546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169071+0000","last_change":"2023-10-06T11:13:17.167108+0000","last_active":"2023-10-06T11:13:17.169071+0000","last_peered":"2023-10-06T11:13:17.169071+0000","last_clean":"2023-10-06T11:13:17.169071+0000","last_became_active":"2023-10-06T11:13:17.166687+0000","last_became_peered":"2023-10-06T11:13:17.166687+0000","last_unstale":"2023-10-06T11:13:17.169071+0000","last_undegraded":"2023-10-06T11:13:17.169071+0000","last_fullsized":"2023-10-06T11:13:17.169071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149299+0000","last_change":"2023-10-06T11:13:12.111301+0000","last_active":"2023-10-06T11:13:17.149299+0000","last_peered":"2023-10-06T11:13:17.149299+0000","last_clean":"2023-10-06T11:13:17.149299+0000","last_became_active":"2023-10-06T11:13:12.111017+0000","last_became_peered":"2023-10-06T11:13:12.111017+0000","last_unstale":"2023-10-06T11:13:17.149299+0000","last_undegraded":"2023-10-06T11:13:17.149299+0000","last_fullsized":"2023-10-06T11:13:17.149299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150481+0000","last_change":"2023-10-06T11:13:13.122154+0000","last_active":"2023-10-06T11:13:17.150481+0000","last_peered":"2023-10-06T11:13:17.150481+0000","last_clean":"2023-10-06T11:13:17.150481+0000","last_became_active":"2023-10-06T11:13:13.121877+0000","last_became_peered":"2023-10-06T11:13:13.121877+0000","last_unstale":"2023-10-06T11:13:17.150481+0000","last_undegraded":"2023-10-06T11:13:17.150481+0000","last_fullsized":"2023-10-06T11:13:17.150481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170404+0000","last_change":"2023-10-06T11:13:17.157370+0000","last_active":"2023-10-06T11:13:17.170404+0000","last_peered":"2023-10-06T11:13:17.170404+0000","last_clean":"2023-10-06T11:13:17.170404+0000","last_became_active":"2023-10-06T11:13:17.156962+0000","last_became_peered":"2023-10-06T11:13:17.156962+0000","last_unstale":"2023-10-06T11:13:17.170404+0000","last_undegraded":"2023-10-06T11:13:17.170404+0000","last_fullsized":"2023-10-06T11:13:17.170404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:24.566268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148959+0000","last_change":"2023-10-06T11:13:12.113489+0000","last_active":"2023-10-06T11:13:17.148959+0000","last_peered":"2023-10-06T11:13:17.148959+0000","last_clean":"2023-10-06T11:13:17.148959+0000","last_became_active":"2023-10-06T11:13:12.113057+0000","last_became_peered":"2023-10-06T11:13:12.113057+0000","last_unstale":"2023-10-06T11:13:17.148959+0000","last_undegraded":"2023-10-06T11:13:17.148959+0000","last_fullsized":"2023-10-06T11:13:17.148959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142803+0000","last_change":"2023-10-06T11:13:13.120468+0000","last_active":"2023-10-06T11:13:17.142803+0000","last_peered":"2023-10-06T11:13:17.142803+0000","last_clean":"2023-10-06T11:13:17.142803+0000","last_became_active":"2023-10-06T11:13:13.120185+0000","last_became_peered":"2023-10-06T11:13:13.120185+0000","last_unstale":"2023-10-06T11:13:17.142803+0000","last_undegraded":"2023-10-06T11:13:17.142803+0000","last_fullsized":"2023-10-06T11:13:17.142803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:50.214886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171097+0000","last_change":"2023-10-06T11:13:17.164354+0000","last_active":"2023-10-06T11:13:17.171097+0000","last_peered":"2023-10-06T11:13:17.171097+0000","last_clean":"2023-10-06T11:13:17.171097+0000","last_became_active":"2023-10-06T11:13:17.163963+0000","last_became_peered":"2023-10-06T11:13:17.163963+0000","last_unstale":"2023-10-06T11:13:17.171097+0000","last_undegraded":"2023-10-06T11:13:17.171097+0000","last_fullsized":"2023-10-06T11:13:17.171097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.560835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148674+0000","last_change":"2023-10-06T11:13:12.106817+0000","last_active":"2023-10-06T11:13:17.148674+0000","last_peered":"2023-10-06T11:13:17.148674+0000","last_clean":"2023-10-06T11:13:17.148674+0000","last_became_active":"2023-10-06T11:13:12.106511+0000","last_became_peered":"2023-10-06T11:13:12.106511+0000","last_unstale":"2023-10-06T11:13:17.148674+0000","last_undegraded":"2023-10-06T11:13:17.148674+0000","last_fullsized":"2023-10-06T11:13:17.148674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:43.294693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142595+0000","last_change":"2023-10-06T11:13:13.131680+0000","last_active":"2023-10-06T11:13:17.142595+0000","last_peered":"2023-10-06T11:13:17.142595+0000","last_clean":"2023-10-06T11:13:17.142595+0000","last_became_active":"2023-10-06T11:13:13.131450+0000","last_became_peered":"2023-10-06T11:13:13.131450+0000","last_unstale":"2023-10-06T11:13:17.142595+0000","last_undegraded":"2023-10-06T11:13:17.142595+0000","last_fullsized":"2023-10-06T11:13:17.142595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:57.893509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170226+0000","last_change":"2023-10-06T11:13:17.157797+0000","last_active":"2023-10-06T11:13:17.170226+0000","last_peered":"2023-10-06T11:13:17.170226+0000","last_clean":"2023-10-06T11:13:17.170226+0000","last_became_active":"2023-10-06T11:13:17.156392+0000","last_became_peered":"2023-10-06T11:13:17.156392+0000","last_unstale":"2023-10-06T11:13:17.170226+0000","last_undegraded":"2023-10-06T11:13:17.170226+0000","last_fullsized":"2023-10-06T11:13:17.170226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:34.331244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149920+0000","last_change":"2023-10-06T11:13:12.101059+0000","last_active":"2023-10-06T11:13:17.149920+0000","last_peered":"2023-10-06T11:13:17.149920+0000","last_clean":"2023-10-06T11:13:17.149920+0000","last_became_active":"2023-10-06T11:13:12.100794+0000","last_became_peered":"2023-10-06T11:13:12.100794+0000","last_unstale":"2023-10-06T11:13:17.149920+0000","last_undegraded":"2023-10-06T11:13:17.149920+0000","last_fullsized":"2023-10-06T11:13:17.149920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143540+0000","last_change":"2023-10-06T11:13:13.131631+0000","last_active":"2023-10-06T11:13:17.143540+0000","last_peered":"2023-10-06T11:13:17.143540+0000","last_clean":"2023-10-06T11:13:17.143540+0000","last_became_active":"2023-10-06T11:13:13.131335+0000","last_became_peered":"2023-10-06T11:13:13.131335+0000","last_unstale":"2023-10-06T11:13:17.143540+0000","last_undegraded":"2023-10-06T11:13:17.143540+0000","last_fullsized":"2023-10-06T11:13:17.143540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170967+0000","last_change":"2023-10-06T11:13:17.161179+0000","last_active":"2023-10-06T11:13:17.170967+0000","last_peered":"2023-10-06T11:13:17.170967+0000","last_clean":"2023-10-06T11:13:17.170967+0000","last_became_active":"2023-10-06T11:13:17.160718+0000","last_became_peered":"2023-10-06T11:13:17.160718+0000","last_unstale":"2023-10-06T11:13:17.170967+0000","last_undegraded":"2023-10-06T11:13:17.170967+0000","last_fullsized":"2023-10-06T11:13:17.170967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.264892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143812+0000","last_change":"2023-10-06T11:13:12.112814+0000","last_active":"2023-10-06T11:13:17.143812+0000","last_peered":"2023-10-06T11:13:17.143812+0000","last_clean":"2023-10-06T11:13:17.143812+0000","last_became_active":"2023-10-06T11:13:12.112493+0000","last_became_peered":"2023-10-06T11:13:12.112493+0000","last_unstale":"2023-10-06T11:13:17.143812+0000","last_undegraded":"2023-10-06T11:13:17.143812+0000","last_fullsized":"2023-10-06T11:13:17.143812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143590+0000","last_change":"2023-10-06T11:13:13.116701+0000","last_active":"2023-10-06T11:13:17.143590+0000","last_peered":"2023-10-06T11:13:17.143590+0000","last_clean":"2023-10-06T11:13:17.143590+0000","last_became_active":"2023-10-06T11:13:13.116422+0000","last_became_peered":"2023-10-06T11:13:13.116422+0000","last_unstale":"2023-10-06T11:13:17.143590+0000","last_undegraded":"2023-10-06T11:13:17.143590+0000","last_fullsized":"2023-10-06T11:13:17.143590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170427+0000","last_change":"2023-10-06T11:13:17.162887+0000","last_active":"2023-10-06T11:13:17.170427+0000","last_peered":"2023-10-06T11:13:17.170427+0000","last_clean":"2023-10-06T11:13:17.170427+0000","last_became_active":"2023-10-06T11:13:17.162489+0000","last_became_peered":"2023-10-06T11:13:17.162489+0000","last_unstale":"2023-10-06T11:13:17.170427+0000","last_undegraded":"2023-10-06T11:13:17.170427+0000","last_fullsized":"2023-10-06T11:13:17.170427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142694+0000","last_change":"2023-10-06T11:13:12.108134+0000","last_active":"2023-10-06T11:13:17.142694+0000","last_peered":"2023-10-06T11:13:17.142694+0000","last_clean":"2023-10-06T11:13:17.142694+0000","last_became_active":"2023-10-06T11:13:12.107878+0000","last_became_peered":"2023-10-06T11:13:12.107878+0000","last_unstale":"2023-10-06T11:13:17.142694+0000","last_undegraded":"2023-10-06T11:13:17.142694+0000","last_fullsized":"2023-10-06T11:13:17.142694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:12.218554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144703+0000","last_change":"2023-10-06T11:13:13.118848+0000","last_active":"2023-10-06T11:13:17.144703+0000","last_peered":"2023-10-06T11:13:17.144703+0000","last_clean":"2023-10-06T11:13:17.144703+0000","last_became_active":"2023-10-06T11:13:13.118542+0000","last_became_peered":"2023-10-06T11:13:13.118542+0000","last_unstale":"2023-10-06T11:13:17.144703+0000","last_undegraded":"2023-10-06T11:13:17.144703+0000","last_fullsized":"2023-10-06T11:13:17.144703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.172331+0000","last_change":"2023-10-06T11:13:17.171309+0000","last_active":"2023-10-06T11:13:17.172331+0000","last_peered":"2023-10-06T11:13:17.172331+0000","last_clean":"2023-10-06T11:13:17.172331+0000","last_became_active":"2023-10-06T11:13:17.170940+0000","last_became_peered":"2023-10-06T11:13:17.170940+0000","last_unstale":"2023-10-06T11:13:17.172331+0000","last_undegraded":"2023-10-06T11:13:17.172331+0000","last_fullsized":"2023-10-06T11:13:17.172331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:04:35.275309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:12.110981+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:12.110564+0000","last_became_peered":"2023-10-06T11:13:12.110564+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144182+0000","last_change":"2023-10-06T11:13:13.122172+0000","last_active":"2023-10-06T11:13:17.144182+0000","last_peered":"2023-10-06T11:13:17.144182+0000","last_clean":"2023-10-06T11:13:17.144182+0000","last_became_active":"2023-10-06T11:13:13.121871+0000","last_became_peered":"2023-10-06T11:13:13.121871+0000","last_unstale":"2023-10-06T11:13:17.144182+0000","last_undegraded":"2023-10-06T11:13:17.144182+0000","last_fullsized":"2023-10-06T11:13:17.144182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169382+0000","last_change":"2023-10-06T11:13:17.164730+0000","last_active":"2023-10-06T11:13:17.169382+0000","last_peered":"2023-10-06T11:13:17.169382+0000","last_clean":"2023-10-06T11:13:17.169382+0000","last_became_active":"2023-10-06T11:13:17.163984+0000","last_became_peered":"2023-10-06T11:13:17.163984+0000","last_unstale":"2023-10-06T11:13:17.169382+0000","last_undegraded":"2023-10-06T11:13:17.169382+0000","last_fullsized":"2023-10-06T11:13:17.169382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:35.906494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143988+0000","last_change":"2023-10-06T11:13:12.114698+0000","last_active":"2023-10-06T11:13:17.143988+0000","last_peered":"2023-10-06T11:13:17.143988+0000","last_clean":"2023-10-06T11:13:17.143988+0000","last_became_active":"2023-10-06T11:13:12.114434+0000","last_became_peered":"2023-10-06T11:13:12.114434+0000","last_unstale":"2023-10-06T11:13:17.143988+0000","last_undegraded":"2023-10-06T11:13:17.143988+0000","last_fullsized":"2023-10-06T11:13:17.143988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151901+0000","last_change":"2023-10-06T11:13:13.134982+0000","last_active":"2023-10-06T11:13:17.151901+0000","last_peered":"2023-10-06T11:13:17.151901+0000","last_clean":"2023-10-06T11:13:17.151901+0000","last_became_active":"2023-10-06T11:13:13.134682+0000","last_became_peered":"2023-10-06T11:13:13.134682+0000","last_unstale":"2023-10-06T11:13:17.151901+0000","last_undegraded":"2023-10-06T11:13:17.151901+0000","last_fullsized":"2023-10-06T11:13:17.151901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.165861+0000","last_change":"2023-10-06T11:13:17.163360+0000","last_active":"2023-10-06T11:13:17.165861+0000","last_peered":"2023-10-06T11:13:17.165861+0000","last_clean":"2023-10-06T11:13:17.165861+0000","last_became_active":"2023-10-06T11:13:17.162962+0000","last_became_peered":"2023-10-06T11:13:17.162962+0000","last_unstale":"2023-10-06T11:13:17.165861+0000","last_undegraded":"2023-10-06T11:13:17.165861+0000","last_fullsized":"2023-10-06T11:13:17.165861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151036+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:13:17.151036+0000","last_peered":"2023-10-06T11:13:17.151036+0000","last_clean":"2023-10-06T11:13:17.151036+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:13:17.151036+0000","last_undegraded":"2023-10-06T11:13:17.151036+0000","last_fullsized":"2023-10-06T11:13:17.151036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152775+0000","last_change":"2023-10-06T11:13:12.104620+0000","last_active":"2023-10-06T11:13:17.152775+0000","last_peered":"2023-10-06T11:13:17.152775+0000","last_clean":"2023-10-06T11:13:17.152775+0000","last_became_active":"2023-10-06T11:13:12.104355+0000","last_became_peered":"2023-10-06T11:13:12.104355+0000","last_unstale":"2023-10-06T11:13:17.152775+0000","last_undegraded":"2023-10-06T11:13:17.152775+0000","last_fullsized":"2023-10-06T11:13:17.152775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150736+0000","last_change":"2023-10-06T11:13:13.130493+0000","last_active":"2023-10-06T11:13:17.150736+0000","last_peered":"2023-10-06T11:13:17.150736+0000","last_clean":"2023-10-06T11:13:17.150736+0000","last_became_active":"2023-10-06T11:13:13.129849+0000","last_became_peered":"2023-10-06T11:13:13.129849+0000","last_unstale":"2023-10-06T11:13:17.150736+0000","last_undegraded":"2023-10-06T11:13:17.150736+0000","last_fullsized":"2023-10-06T11:13:17.150736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162543+0000","last_change":"2023-10-06T11:13:17.157136+0000","last_active":"2023-10-06T11:13:17.162543+0000","last_peered":"2023-10-06T11:13:17.162543+0000","last_clean":"2023-10-06T11:13:17.162543+0000","last_became_active":"2023-10-06T11:13:17.156751+0000","last_became_peered":"2023-10-06T11:13:17.156751+0000","last_unstale":"2023-10-06T11:13:17.162543+0000","last_undegraded":"2023-10-06T11:13:17.162543+0000","last_fullsized":"2023-10-06T11:13:17.162543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154906+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:13:17.154906+0000","last_peered":"2023-10-06T11:13:17.154906+0000","last_clean":"2023-10-06T11:13:17.154906+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:13:17.154906+0000","last_undegraded":"2023-10-06T11:13:17.154906+0000","last_fullsized":"2023-10-06T11:13:17.154906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143311+0000","last_change":"2023-10-06T11:13:12.106188+0000","last_active":"2023-10-06T11:13:17.143311+0000","last_peered":"2023-10-06T11:13:17.143311+0000","last_clean":"2023-10-06T11:13:17.143311+0000","last_became_active":"2023-10-06T11:13:12.104759+0000","last_became_peered":"2023-10-06T11:13:12.104759+0000","last_unstale":"2023-10-06T11:13:17.143311+0000","last_undegraded":"2023-10-06T11:13:17.143311+0000","last_fullsized":"2023-10-06T11:13:17.143311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150950+0000","last_change":"2023-10-06T11:13:13.129472+0000","last_active":"2023-10-06T11:13:17.150950+0000","last_peered":"2023-10-06T11:13:17.150950+0000","last_clean":"2023-10-06T11:13:17.150950+0000","last_became_active":"2023-10-06T11:13:13.129098+0000","last_became_peered":"2023-10-06T11:13:13.129098+0000","last_unstale":"2023-10-06T11:13:17.150950+0000","last_undegraded":"2023-10-06T11:13:17.150950+0000","last_fullsized":"2023-10-06T11:13:17.150950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:48.407971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171118+0000","last_change":"2023-10-06T11:13:17.165728+0000","last_active":"2023-10-06T11:13:17.171118+0000","last_peered":"2023-10-06T11:13:17.171118+0000","last_clean":"2023-10-06T11:13:17.171118+0000","last_became_active":"2023-10-06T11:13:17.165346+0000","last_became_peered":"2023-10-06T11:13:17.165346+0000","last_unstale":"2023-10-06T11:13:17.171118+0000","last_undegraded":"2023-10-06T11:13:17.171118+0000","last_fullsized":"2023-10-06T11:13:17.171118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:50.894918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136729+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:13:17.136729+0000","last_peered":"2023-10-06T11:13:17.136729+0000","last_clean":"2023-10-06T11:13:17.136729+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:13:17.136729+0000","last_undegraded":"2023-10-06T11:13:17.136729+0000","last_fullsized":"2023-10-06T11:13:17.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152088+0000","last_change":"2023-10-06T11:13:12.113344+0000","last_active":"2023-10-06T11:13:17.152088+0000","last_peered":"2023-10-06T11:13:17.152088+0000","last_clean":"2023-10-06T11:13:17.152088+0000","last_became_active":"2023-10-06T11:13:12.113058+0000","last_became_peered":"2023-10-06T11:13:12.113058+0000","last_unstale":"2023-10-06T11:13:17.152088+0000","last_undegraded":"2023-10-06T11:13:17.152088+0000","last_fullsized":"2023-10-06T11:13:17.152088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151812+0000","last_change":"2023-10-06T11:13:13.126878+0000","last_active":"2023-10-06T11:13:17.151812+0000","last_peered":"2023-10-06T11:13:17.151812+0000","last_clean":"2023-10-06T11:13:17.151812+0000","last_became_active":"2023-10-06T11:13:13.126442+0000","last_became_peered":"2023-10-06T11:13:13.126442+0000","last_unstale":"2023-10-06T11:13:17.151812+0000","last_undegraded":"2023-10-06T11:13:17.151812+0000","last_fullsized":"2023-10-06T11:13:17.151812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:18.891306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168046+0000","last_change":"2023-10-06T11:13:17.162293+0000","last_active":"2023-10-06T11:13:17.168046+0000","last_peered":"2023-10-06T11:13:17.168046+0000","last_clean":"2023-10-06T11:13:17.168046+0000","last_became_active":"2023-10-06T11:13:17.161704+0000","last_became_peered":"2023-10-06T11:13:17.161704+0000","last_unstale":"2023-10-06T11:13:17.168046+0000","last_undegraded":"2023-10-06T11:13:17.168046+0000","last_fullsized":"2023-10-06T11:13:17.168046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:33.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154038+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:13:17.154038+0000","last_peered":"2023-10-06T11:13:17.154038+0000","last_clean":"2023-10-06T11:13:17.154038+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:13:17.154038+0000","last_undegraded":"2023-10-06T11:13:17.154038+0000","last_fullsized":"2023-10-06T11:13:17.154038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147427+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:13:17.147427+0000","last_peered":"2023-10-06T11:13:17.147427+0000","last_clean":"2023-10-06T11:13:17.147427+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:13:17.147427+0000","last_undegraded":"2023-10-06T11:13:17.147427+0000","last_fullsized":"2023-10-06T11:13:17.147427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143336+0000","last_change":"2023-10-06T11:13:12.105541+0000","last_active":"2023-10-06T11:13:17.143336+0000","last_peered":"2023-10-06T11:13:17.143336+0000","last_clean":"2023-10-06T11:13:17.143336+0000","last_became_active":"2023-10-06T11:13:12.105235+0000","last_became_peered":"2023-10-06T11:13:12.105235+0000","last_unstale":"2023-10-06T11:13:17.143336+0000","last_undegraded":"2023-10-06T11:13:17.143336+0000","last_fullsized":"2023-10-06T11:13:17.143336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140757+0000","last_change":"2023-10-06T11:13:13.123658+0000","last_active":"2023-10-06T11:13:17.140757+0000","last_peered":"2023-10-06T11:13:17.140757+0000","last_clean":"2023-10-06T11:13:17.140757+0000","last_became_active":"2023-10-06T11:13:13.123381+0000","last_became_peered":"2023-10-06T11:13:13.123381+0000","last_unstale":"2023-10-06T11:13:17.140757+0000","last_undegraded":"2023-10-06T11:13:17.140757+0000","last_fullsized":"2023-10-06T11:13:17.140757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:17.061401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.167581+0000","last_change":"2023-10-06T11:13:17.164198+0000","last_active":"2023-10-06T11:13:17.167581+0000","last_peered":"2023-10-06T11:13:17.167581+0000","last_clean":"2023-10-06T11:13:17.167581+0000","last_became_active":"2023-10-06T11:13:17.163841+0000","last_became_peered":"2023-10-06T11:13:17.163841+0000","last_unstale":"2023-10-06T11:13:17.167581+0000","last_undegraded":"2023-10-06T11:13:17.167581+0000","last_fullsized":"2023-10-06T11:13:17.167581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:25:37.062632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147593+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:13:17.147593+0000","last_peered":"2023-10-06T11:13:17.147593+0000","last_clean":"2023-10-06T11:13:17.147593+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:13:17.147593+0000","last_undegraded":"2023-10-06T11:13:17.147593+0000","last_fullsized":"2023-10-06T11:13:17.147593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142083+0000","last_change":"2023-10-06T11:13:12.110086+0000","last_active":"2023-10-06T11:13:17.142083+0000","last_peered":"2023-10-06T11:13:17.142083+0000","last_clean":"2023-10-06T11:13:17.142083+0000","last_became_active":"2023-10-06T11:13:12.109735+0000","last_became_peered":"2023-10-06T11:13:12.109735+0000","last_unstale":"2023-10-06T11:13:17.142083+0000","last_undegraded":"2023-10-06T11:13:17.142083+0000","last_fullsized":"2023-10-06T11:13:17.142083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142662+0000","last_change":"2023-10-06T11:13:13.131401+0000","last_active":"2023-10-06T11:13:17.142662+0000","last_peered":"2023-10-06T11:13:17.142662+0000","last_clean":"2023-10-06T11:13:17.142662+0000","last_became_active":"2023-10-06T11:13:13.131126+0000","last_became_peered":"2023-10-06T11:13:13.131126+0000","last_unstale":"2023-10-06T11:13:17.142662+0000","last_undegraded":"2023-10-06T11:13:17.142662+0000","last_fullsized":"2023-10-06T11:13:17.142662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.164232+0000","last_change":"2023-10-06T11:13:17.161961+0000","last_active":"2023-10-06T11:13:17.164232+0000","last_peered":"2023-10-06T11:13:17.164232+0000","last_clean":"2023-10-06T11:13:17.164232+0000","last_became_active":"2023-10-06T11:13:17.161594+0000","last_became_peered":"2023-10-06T11:13:17.161594+0000","last_unstale":"2023-10-06T11:13:17.164232+0000","last_undegraded":"2023-10-06T11:13:17.164232+0000","last_fullsized":"2023-10-06T11:13:17.164232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:37.366244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148583+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:13:17.148583+0000","last_peered":"2023-10-06T11:13:17.148583+0000","last_clean":"2023-10-06T11:13:17.148583+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:13:17.148583+0000","last_undegraded":"2023-10-06T11:13:17.148583+0000","last_fullsized":"2023-10-06T11:13:17.148583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151224+0000","last_change":"2023-10-06T11:13:12.113488+0000","last_active":"2023-10-06T11:13:17.151224+0000","last_peered":"2023-10-06T11:13:17.151224+0000","last_clean":"2023-10-06T11:13:17.151224+0000","last_became_active":"2023-10-06T11:13:12.113184+0000","last_became_peered":"2023-10-06T11:13:12.113184+0000","last_unstale":"2023-10-06T11:13:17.151224+0000","last_undegraded":"2023-10-06T11:13:17.151224+0000","last_fullsized":"2023-10-06T11:13:17.151224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142862+0000","last_change":"2023-10-06T11:13:13.122337+0000","last_active":"2023-10-06T11:13:17.142862+0000","last_peered":"2023-10-06T11:13:17.142862+0000","last_clean":"2023-10-06T11:13:17.142862+0000","last_became_active":"2023-10-06T11:13:13.122081+0000","last_became_peered":"2023-10-06T11:13:13.122081+0000","last_unstale":"2023-10-06T11:13:17.142862+0000","last_undegraded":"2023-10-06T11:13:17.142862+0000","last_fullsized":"2023-10-06T11:13:17.142862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:45.496026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166873+0000","last_change":"2023-10-06T11:13:17.157514+0000","last_active":"2023-10-06T11:13:17.166873+0000","last_peered":"2023-10-06T11:13:17.166873+0000","last_clean":"2023-10-06T11:13:17.166873+0000","last_became_active":"2023-10-06T11:13:17.157113+0000","last_became_peered":"2023-10-06T11:13:17.157113+0000","last_unstale":"2023-10-06T11:13:17.166873+0000","last_undegraded":"2023-10-06T11:13:17.166873+0000","last_fullsized":"2023-10-06T11:13:17.166873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:21:57.844604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144634+0000","last_change":"2023-10-06T11:13:12.117257+0000","last_active":"2023-10-06T11:13:17.144634+0000","last_peered":"2023-10-06T11:13:17.144634+0000","last_clean":"2023-10-06T11:13:17.144634+0000","last_became_active":"2023-10-06T11:13:12.116987+0000","last_became_peered":"2023-10-06T11:13:12.116987+0000","last_unstale":"2023-10-06T11:13:17.144634+0000","last_undegraded":"2023-10-06T11:13:17.144634+0000","last_fullsized":"2023-10-06T11:13:17.144634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152020+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:13:17.152020+0000","last_peered":"2023-10-06T11:13:17.152020+0000","last_clean":"2023-10-06T11:13:17.152020+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:13:17.152020+0000","last_undegraded":"2023-10-06T11:13:17.152020+0000","last_fullsized":"2023-10-06T11:13:17.152020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143909+0000","last_change":"2023-10-06T11:13:13.129882+0000","last_active":"2023-10-06T11:13:17.143909+0000","last_peered":"2023-10-06T11:13:17.143909+0000","last_clean":"2023-10-06T11:13:17.143909+0000","last_became_active":"2023-10-06T11:13:13.129592+0000","last_became_peered":"2023-10-06T11:13:13.129592+0000","last_unstale":"2023-10-06T11:13:17.143909+0000","last_undegraded":"2023-10-06T11:13:17.143909+0000","last_fullsized":"2023-10-06T11:13:17.143909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158501+0000","last_change":"2023-10-06T11:13:17.156066+0000","last_active":"2023-10-06T11:13:17.158501+0000","last_peered":"2023-10-06T11:13:17.158501+0000","last_clean":"2023-10-06T11:13:17.158501+0000","last_became_active":"2023-10-06T11:13:17.155623+0000","last_became_peered":"2023-10-06T11:13:17.155623+0000","last_unstale":"2023-10-06T11:13:17.158501+0000","last_undegraded":"2023-10-06T11:13:17.158501+0000","last_fullsized":"2023-10-06T11:13:17.158501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:42.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144618+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:13:17.144618+0000","last_peered":"2023-10-06T11:13:17.144618+0000","last_clean":"2023-10-06T11:13:17.144618+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:13:17.144618+0000","last_undegraded":"2023-10-06T11:13:17.144618+0000","last_fullsized":"2023-10-06T11:13:17.144618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168135+0000","last_change":"2023-10-06T11:13:12.109073+0000","last_active":"2023-10-06T11:13:17.168135+0000","last_peered":"2023-10-06T11:13:17.168135+0000","last_clean":"2023-10-06T11:13:17.168135+0000","last_became_active":"2023-10-06T11:13:12.108687+0000","last_became_peered":"2023-10-06T11:13:12.108687+0000","last_unstale":"2023-10-06T11:13:17.168135+0000","last_undegraded":"2023-10-06T11:13:17.168135+0000","last_fullsized":"2023-10-06T11:13:17.168135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142725+0000","last_change":"2023-10-06T11:13:13.113909+0000","last_active":"2023-10-06T11:13:17.142725+0000","last_peered":"2023-10-06T11:13:17.142725+0000","last_clean":"2023-10-06T11:13:17.142725+0000","last_became_active":"2023-10-06T11:13:13.113579+0000","last_became_peered":"2023-10-06T11:13:13.113579+0000","last_unstale":"2023-10-06T11:13:17.142725+0000","last_undegraded":"2023-10-06T11:13:17.142725+0000","last_fullsized":"2023-10-06T11:13:17.142725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170450+0000","last_change":"2023-10-06T11:13:17.164311+0000","last_active":"2023-10-06T11:13:17.170450+0000","last_peered":"2023-10-06T11:13:17.170450+0000","last_clean":"2023-10-06T11:13:17.170450+0000","last_became_active":"2023-10-06T11:13:17.159765+0000","last_became_peered":"2023-10-06T11:13:17.159765+0000","last_unstale":"2023-10-06T11:13:17.170450+0000","last_undegraded":"2023-10-06T11:13:17.170450+0000","last_fullsized":"2023-10-06T11:13:17.170450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145036+0000","last_change":"2023-10-06T11:13:12.108063+0000","last_active":"2023-10-06T11:13:17.145036+0000","last_peered":"2023-10-06T11:13:17.145036+0000","last_clean":"2023-10-06T11:13:17.145036+0000","last_became_active":"2023-10-06T11:13:12.107787+0000","last_became_peered":"2023-10-06T11:13:12.107787+0000","last_unstale":"2023-10-06T11:13:17.145036+0000","last_undegraded":"2023-10-06T11:13:17.145036+0000","last_fullsized":"2023-10-06T11:13:17.145036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137088+0000","last_change":"2023-10-06T11:13:13.128167+0000","last_active":"2023-10-06T11:13:17.137088+0000","last_peered":"2023-10-06T11:13:17.137088+0000","last_clean":"2023-10-06T11:13:17.137088+0000","last_became_active":"2023-10-06T11:13:13.127699+0000","last_became_peered":"2023-10-06T11:13:13.127699+0000","last_unstale":"2023-10-06T11:13:17.137088+0000","last_undegraded":"2023-10-06T11:13:17.137088+0000","last_fullsized":"2023-10-06T11:13:17.137088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:49.518740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161638+0000","last_change":"2023-10-06T11:13:17.158623+0000","last_active":"2023-10-06T11:13:17.161638+0000","last_peered":"2023-10-06T11:13:17.161638+0000","last_clean":"2023-10-06T11:13:17.161638+0000","last_became_active":"2023-10-06T11:13:17.158283+0000","last_became_peered":"2023-10-06T11:13:17.158283+0000","last_unstale":"2023-10-06T11:13:17.161638+0000","last_undegraded":"2023-10-06T11:13:17.161638+0000","last_fullsized":"2023-10-06T11:13:17.161638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150057+0000","last_change":"2023-10-06T11:13:12.105330+0000","last_active":"2023-10-06T11:13:17.150057+0000","last_peered":"2023-10-06T11:13:17.150057+0000","last_clean":"2023-10-06T11:13:17.150057+0000","last_became_active":"2023-10-06T11:13:12.104918+0000","last_became_peered":"2023-10-06T11:13:12.104918+0000","last_unstale":"2023-10-06T11:13:17.150057+0000","last_undegraded":"2023-10-06T11:13:17.150057+0000","last_fullsized":"2023-10-06T11:13:17.150057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143214+0000","last_change":"2023-10-06T11:13:13.113277+0000","last_active":"2023-10-06T11:13:17.143214+0000","last_peered":"2023-10-06T11:13:17.143214+0000","last_clean":"2023-10-06T11:13:17.143214+0000","last_became_active":"2023-10-06T11:13:13.112996+0000","last_became_peered":"2023-10-06T11:13:13.112996+0000","last_unstale":"2023-10-06T11:13:17.143214+0000","last_undegraded":"2023-10-06T11:13:17.143214+0000","last_fullsized":"2023-10-06T11:13:17.143214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168692+0000","last_change":"2023-10-06T11:13:17.164841+0000","last_active":"2023-10-06T11:13:17.168692+0000","last_peered":"2023-10-06T11:13:17.168692+0000","last_clean":"2023-10-06T11:13:17.168692+0000","last_became_active":"2023-10-06T11:13:17.164169+0000","last_became_peered":"2023-10-06T11:13:17.164169+0000","last_unstale":"2023-10-06T11:13:17.168692+0000","last_undegraded":"2023-10-06T11:13:17.168692+0000","last_fullsized":"2023-10-06T11:13:17.168692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152685+0000","last_change":"2023-10-06T11:13:12.106402+0000","last_active":"2023-10-06T11:13:17.152685+0000","last_peered":"2023-10-06T11:13:17.152685+0000","last_clean":"2023-10-06T11:13:17.152685+0000","last_became_active":"2023-10-06T11:13:12.106112+0000","last_became_peered":"2023-10-06T11:13:12.106112+0000","last_unstale":"2023-10-06T11:13:17.152685+0000","last_undegraded":"2023-10-06T11:13:17.152685+0000","last_fullsized":"2023-10-06T11:13:17.152685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:13.112738+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:13.112481+0000","last_became_peered":"2023-10-06T11:13:13.112481+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166864+0000","last_change":"2023-10-06T11:13:17.157509+0000","last_active":"2023-10-06T11:13:17.166864+0000","last_peered":"2023-10-06T11:13:17.166864+0000","last_clean":"2023-10-06T11:13:17.166864+0000","last_became_active":"2023-10-06T11:13:17.156662+0000","last_became_peered":"2023-10-06T11:13:17.156662+0000","last_unstale":"2023-10-06T11:13:17.166864+0000","last_undegraded":"2023-10-06T11:13:17.166864+0000","last_fullsized":"2023-10-06T11:13:17.166864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:05.195662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144326+0000","last_change":"2023-10-06T11:13:12.101845+0000","last_active":"2023-10-06T11:13:17.144326+0000","last_peered":"2023-10-06T11:13:17.144326+0000","last_clean":"2023-10-06T11:13:17.144326+0000","last_became_active":"2023-10-06T11:13:12.101436+0000","last_became_peered":"2023-10-06T11:13:12.101436+0000","last_unstale":"2023-10-06T11:13:17.144326+0000","last_undegraded":"2023-10-06T11:13:17.144326+0000","last_fullsized":"2023-10-06T11:13:17.144326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143534+0000","last_change":"2023-10-06T11:13:13.123861+0000","last_active":"2023-10-06T11:13:17.143534+0000","last_peered":"2023-10-06T11:13:17.143534+0000","last_clean":"2023-10-06T11:13:17.143534+0000","last_became_active":"2023-10-06T11:13:13.123660+0000","last_became_peered":"2023-10-06T11:13:13.123660+0000","last_unstale":"2023-10-06T11:13:17.143534+0000","last_undegraded":"2023-10-06T11:13:17.143534+0000","last_fullsized":"2023-10-06T11:13:17.143534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170721+0000","last_change":"2023-10-06T11:13:17.165451+0000","last_active":"2023-10-06T11:13:17.170721+0000","last_peered":"2023-10-06T11:13:17.170721+0000","last_clean":"2023-10-06T11:13:17.170721+0000","last_became_active":"2023-10-06T11:13:17.165075+0000","last_became_peered":"2023-10-06T11:13:17.165075+0000","last_unstale":"2023-10-06T11:13:17.170721+0000","last_undegraded":"2023-10-06T11:13:17.170721+0000","last_fullsized":"2023-10-06T11:13:17.170721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145478+0000","last_change":"2023-10-06T11:13:12.107593+0000","last_active":"2023-10-06T11:13:17.145478+0000","last_peered":"2023-10-06T11:13:17.145478+0000","last_clean":"2023-10-06T11:13:17.145478+0000","last_became_active":"2023-10-06T11:13:12.107352+0000","last_became_peered":"2023-10-06T11:13:12.107352+0000","last_unstale":"2023-10-06T11:13:17.145478+0000","last_undegraded":"2023-10-06T11:13:17.145478+0000","last_fullsized":"2023-10-06T11:13:17.145478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142457+0000","last_change":"2023-10-06T11:13:13.125513+0000","last_active":"2023-10-06T11:13:17.142457+0000","last_peered":"2023-10-06T11:13:17.142457+0000","last_clean":"2023-10-06T11:13:17.142457+0000","last_became_active":"2023-10-06T11:13:13.125218+0000","last_became_peered":"2023-10-06T11:13:13.125218+0000","last_unstale":"2023-10-06T11:13:17.142457+0000","last_undegraded":"2023-10-06T11:13:17.142457+0000","last_fullsized":"2023-10-06T11:13:17.142457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:38.222422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140901+0000","last_change":"2023-10-06T11:13:13.127823+0000","last_active":"2023-10-06T11:13:17.140901+0000","last_peered":"2023-10-06T11:13:17.140901+0000","last_clean":"2023-10-06T11:13:17.140901+0000","last_became_active":"2023-10-06T11:13:13.127598+0000","last_became_peered":"2023-10-06T11:13:13.127598+0000","last_unstale":"2023-10-06T11:13:17.140901+0000","last_undegraded":"2023-10-06T11:13:17.140901+0000","last_fullsized":"2023-10-06T11:13:17.140901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143675+0000","last_change":"2023-10-06T11:13:13.128681+0000","last_active":"2023-10-06T11:13:17.143675+0000","last_peered":"2023-10-06T11:13:17.143675+0000","last_clean":"2023-10-06T11:13:17.143675+0000","last_became_active":"2023-10-06T11:13:13.128410+0000","last_became_peered":"2023-10-06T11:13:13.128410+0000","last_unstale":"2023-10-06T11:13:17.143675+0000","last_undegraded":"2023-10-06T11:13:17.143675+0000","last_fullsized":"2023-10-06T11:13:17.143675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144507+0000","last_change":"2023-10-06T11:13:13.122593+0000","last_active":"2023-10-06T11:13:17.144507+0000","last_peered":"2023-10-06T11:13:17.144507+0000","last_clean":"2023-10-06T11:13:17.144507+0000","last_became_active":"2023-10-06T11:13:13.122348+0000","last_became_peered":"2023-10-06T11:13:13.122348+0000","last_unstale":"2023-10-06T11:13:17.144507+0000","last_undegraded":"2023-10-06T11:13:17.144507+0000","last_fullsized":"2023-10-06T11:13:17.144507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:42.518365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143721+0000","last_change":"2023-10-06T11:13:13.125197+0000","last_active":"2023-10-06T11:13:17.143721+0000","last_peered":"2023-10-06T11:13:17.143721+0000","last_clean":"2023-10-06T11:13:17.143721+0000","last_became_active":"2023-10-06T11:13:13.124919+0000","last_became_peered":"2023-10-06T11:13:13.124919+0000","last_unstale":"2023-10-06T11:13:17.143721+0000","last_undegraded":"2023-10-06T11:13:17.143721+0000","last_fullsized":"2023-10-06T11:13:17.143721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151139+0000","last_change":"2023-10-06T11:13:13.127447+0000","last_active":"2023-10-06T11:13:17.151139+0000","last_peered":"2023-10-06T11:13:17.151139+0000","last_clean":"2023-10-06T11:13:17.151139+0000","last_became_active":"2023-10-06T11:13:13.127144+0000","last_became_peered":"2023-10-06T11:13:13.127144+0000","last_unstale":"2023-10-06T11:13:17.151139+0000","last_undegraded":"2023-10-06T11:13:17.151139+0000","last_fullsized":"2023-10-06T11:13:17.151139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":715154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":124322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":128002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":124856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:13:31.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:13:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 Processor -- start 2023-10-06T11:13:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 -- start start 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6bc159560 0x7fa6bc0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6bc0b0760 0x7fa6bc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0b0c60 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b0f40 con 0x7fa6bc159560 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.123+0000 7fa6c18f6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b1220 con 0x7fa6bc0b0760 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6baffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6bc159560 0x7fa6bc0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6ba7fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa6bc0b49a0 0x7fa6bc0aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53698/0 (socket says 172.21.15.55:53698) 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6ba7fc700 1 -- 172.21.15.55:0/1958853214 learned_addr learned my addr 172.21.15.55:0/1958853214 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6bb7fe700 1 --2- 172.21.15.55:0/1958853214 >> v2:172.21.15.142:3300/0 conn(0x7fa6bc0b0760 0x7fa6bc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6b9ffb700 1 -- 172.21.15.55:0/1958853214 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158325706 0 0) 0x7fa6bc0b0c60 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6b9ffb700 1 -- 172.21.15.55:0/1958853214 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a8003570 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6baffd700 1 -- 172.21.15.55:0/1958853214 >> v2:172.21.15.142:3300/0 conn(0x7fa6bc0b0760 msgr2=0x7fa6bc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6baffd700 1 --2- 172.21.15.55:0/1958853214 >> v2:172.21.15.142:3300/0 conn(0x7fa6bc0b0760 0x7fa6bc0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6baffd700 1 -- 172.21.15.55:0/1958853214 >> v1:172.21.15.55:6789/0 conn(0x7fa6bc0b49a0 legacy=0x7fa6bc0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6baffd700 1 -- 172.21.15.55:0/1958853214 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0b1500 con 0x7fa6bc159560 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6baffd700 1 --2- 172.21.15.55:0/1958853214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc159560 0x7fa6bc0aa530 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac009eb0 tx=0x7fa6ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f650f9c0a3563a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6b9ffb700 1 -- 172.21.15.55:0/1958853214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac00e070 con 0x7fa6bc159560 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6b9ffb700 1 -- 172.21.15.55:0/1958853214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac00bb40 con 0x7fa6bc159560 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.124+0000 7fa6b9ffb700 1 -- 172.21.15.55:0/1958853214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac012430 con 0x7fa6bc159560 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 -- 172.21.15.55:0/1958853214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc159560 msgr2=0x7fa6bc0aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/1958853214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc159560 0x7fa6bc0aa530 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac009eb0 tx=0x7fa6ac009780 comp rx=0 tx=0).stop 2023-10-06T11:13:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 -- 172.21.15.55:0/1958853214 shutdown_connections 2023-10-06T11:13:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/1958853214 >> v2:172.21.15.142:3300/0 conn(0x7fa6bc0b0760 0x7fa6bc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/1958853214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc159560 0x7fa6bc0aa530 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 -- 172.21.15.55:0/1958853214 >> 172.21.15.55:0/1958853214 conn(0x7fa6bc0997f0 msgr2=0x7fa6bc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 -- 172.21.15.55:0/1958853214 shutdown_connections 2023-10-06T11:13:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.125+0000 7fa6c18f6700 1 -- 172.21.15.55:0/1958853214 wait complete. 2023-10-06T11:13:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.126+0000 7fa6c18f6700 1 Processor -- start 2023-10-06T11:13:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.126+0000 7fa6c18f6700 1 -- start start 2023-10-06T11:13:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6c18f6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6bc0b0760 0x7fa6bc158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6c18f6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 0x7fa6bc159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6c18f6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6bc159560 0x7fa6bc159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6c18f6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc15b0b0 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6c18f6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc09a310 con 0x7fa6bc0b0760 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6c18f6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc15a4a0 con 0x7fa6bc159560 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 0x7fa6bc159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 0x7fa6bc159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37556/0 (socket says 172.21.15.55:37556) 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 -- 172.21.15.55:0/732706713 learned_addr learned my addr 172.21.15.55:0/732706713 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6baffd700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6bc0b0760 0x7fa6bc158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6bb7fe700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6bc159560 0x7fa6bc159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 -- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6bc159560 msgr2=0x7fa6bc159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6bc159560 0x7fa6bc159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 -- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6bc0b0760 msgr2=0x7fa6bc158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6bc0b0760 0x7fa6bc158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 -- 172.21.15.55:0/732706713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac009a20 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6bb7fe700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6bc159560 0x7fa6bc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.127+0000 7fa6ba7fc700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 0x7fa6bc159930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400c790 tx=0x7fa6a4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.128+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4005c00 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.128+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4005d60 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.128+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc15a780 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.128+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a40072e0 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.128+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc15ad40 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.129+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc15b260 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.129+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6a401b3b0 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.130+0000 7fa6b2ffd700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa69c066f30 0x7fa69c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.130+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa6a4083d80 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.130+0000 7fa6baffd700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa69c066f30 0x7fa69c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.130+0000 7fa6baffd700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa69c066f30 0x7fa69c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0097c0 tx=0x7fa6ac019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.134+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6a404b5a0 con 0x7fa6bc0b49a0 2023-10-06T11:13:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.323+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6bc064a90 con 0x7fa69c066f30 2023-10-06T11:13:32.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.334+0000 7fa6b2ffd700 1 -- 172.21.15.55:0/732706713 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367361 (secure 0 0 0) 0x7fa6bc064a90 con 0x7fa69c066f30 2023-10-06T11:13:32.339 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa69c066f30 msgr2=0x7fa69c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa69c066f30 0x7fa69c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0097c0 tx=0x7fa6ac019000 comp rx=0 tx=0).stop 2023-10-06T11:13:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 msgr2=0x7fa6bc159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 0x7fa6bc159930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400c790 tx=0x7fa6a4007db0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 shutdown_connections 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa69c066f30 0x7fa69c0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6bc159560 0x7fa6bc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6bc0b0760 0x7fa6bc158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 --2- 172.21.15.55:0/732706713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6bc0b49a0 0x7fa6bc159930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 >> 172.21.15.55:0/732706713 conn(0x7fa6bc0997f0 msgr2=0x7fa6bc0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.337+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 shutdown_connections 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.338+0000 7fa6c18f6700 1 -- 172.21.15.55:0/732706713 wait complete. 2023-10-06T11:13:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:13:32.351 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-06T11:13:30.845143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381896,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592824,"statfs":{"total":773094113280,"available":770655051776,"internally_reserved":0,"allocated":3678208,"data_stored":2183560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003481"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.138211+0000","last_change":"2023-10-06T11:13:13.121699+0000","last_active":"2023-10-06T11:13:17.138211+0000","last_peered":"2023-10-06T11:13:17.138211+0000","last_clean":"2023-10-06T11:13:17.138211+0000","last_became_active":"2023-10-06T11:13:13.121499+0000","last_became_peered":"2023-10-06T11:13:13.121499+0000","last_unstale":"2023-10-06T11:13:17.138211+0000","last_undegraded":"2023-10-06T11:13:17.138211+0000","last_fullsized":"2023-10-06T11:13:17.138211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155514+0000","last_change":"2023-10-06T11:13:13.120623+0000","last_active":"2023-10-06T11:13:17.155514+0000","last_peered":"2023-10-06T11:13:17.155514+0000","last_clean":"2023-10-06T11:13:17.155514+0000","last_became_active":"2023-10-06T11:13:13.120368+0000","last_became_peered":"2023-10-06T11:13:13.120368+0000","last_unstale":"2023-10-06T11:13:17.155514+0000","last_undegraded":"2023-10-06T11:13:17.155514+0000","last_fullsized":"2023-10-06T11:13:17.155514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144860+0000","last_change":"2023-10-06T11:13:13.118595+0000","last_active":"2023-10-06T11:13:17.144860+0000","last_peered":"2023-10-06T11:13:17.144860+0000","last_clean":"2023-10-06T11:13:17.144860+0000","last_became_active":"2023-10-06T11:13:13.118314+0000","last_became_peered":"2023-10-06T11:13:13.118314+0000","last_unstale":"2023-10-06T11:13:17.144860+0000","last_undegraded":"2023-10-06T11:13:17.144860+0000","last_fullsized":"2023-10-06T11:13:17.144860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:56.994826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.139864+0000","last_change":"2023-10-06T11:13:13.118767+0000","last_active":"2023-10-06T11:13:17.139864+0000","last_peered":"2023-10-06T11:13:17.139864+0000","last_clean":"2023-10-06T11:13:17.139864+0000","last_became_active":"2023-10-06T11:13:13.118462+0000","last_became_peered":"2023-10-06T11:13:13.118462+0000","last_unstale":"2023-10-06T11:13:17.139864+0000","last_undegraded":"2023-10-06T11:13:17.139864+0000","last_fullsized":"2023-10-06T11:13:17.139864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142961+0000","last_change":"2023-10-06T11:13:13.121812+0000","last_active":"2023-10-06T11:13:17.142961+0000","last_peered":"2023-10-06T11:13:17.142961+0000","last_clean":"2023-10-06T11:13:17.142961+0000","last_became_active":"2023-10-06T11:13:13.121530+0000","last_became_peered":"2023-10-06T11:13:13.121530+0000","last_unstale":"2023-10-06T11:13:17.142961+0000","last_undegraded":"2023-10-06T11:13:17.142961+0000","last_fullsized":"2023-10-06T11:13:17.142961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144619+0000","last_change":"2023-10-06T11:13:13.127391+0000","last_active":"2023-10-06T11:13:17.144619+0000","last_peered":"2023-10-06T11:13:17.144619+0000","last_clean":"2023-10-06T11:13:17.144619+0000","last_became_active":"2023-10-06T11:13:13.127090+0000","last_became_peered":"2023-10-06T11:13:13.127090+0000","last_unstale":"2023-10-06T11:13:17.144619+0000","last_undegraded":"2023-10-06T11:13:17.144619+0000","last_fullsized":"2023-10-06T11:13:17.144619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:29.195895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149465+0000","last_change":"2023-10-06T11:13:13.134965+0000","last_active":"2023-10-06T11:13:17.149465+0000","last_peered":"2023-10-06T11:13:17.149465+0000","last_clean":"2023-10-06T11:13:17.149465+0000","last_became_active":"2023-10-06T11:13:13.134668+0000","last_became_peered":"2023-10-06T11:13:13.134668+0000","last_unstale":"2023-10-06T11:13:17.149465+0000","last_undegraded":"2023-10-06T11:13:17.149465+0000","last_fullsized":"2023-10-06T11:13:17.149465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150571+0000","last_change":"2023-10-06T11:13:13.114957+0000","last_active":"2023-10-06T11:13:17.150571+0000","last_peered":"2023-10-06T11:13:17.150571+0000","last_clean":"2023-10-06T11:13:17.150571+0000","last_became_active":"2023-10-06T11:13:13.114673+0000","last_became_peered":"2023-10-06T11:13:13.114673+0000","last_unstale":"2023-10-06T11:13:17.150571+0000","last_undegraded":"2023-10-06T11:13:17.150571+0000","last_fullsized":"2023-10-06T11:13:17.150571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145256+0000","last_change":"2023-10-06T11:13:13.121976+0000","last_active":"2023-10-06T11:13:17.145256+0000","last_peered":"2023-10-06T11:13:17.145256+0000","last_clean":"2023-10-06T11:13:17.145256+0000","last_became_active":"2023-10-06T11:13:13.121523+0000","last_became_peered":"2023-10-06T11:13:13.121523+0000","last_unstale":"2023-10-06T11:13:17.145256+0000","last_undegraded":"2023-10-06T11:13:17.145256+0000","last_fullsized":"2023-10-06T11:13:17.145256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155701+0000","last_change":"2023-10-06T11:13:13.126240+0000","last_active":"2023-10-06T11:13:17.155701+0000","last_peered":"2023-10-06T11:13:17.155701+0000","last_clean":"2023-10-06T11:13:17.155701+0000","last_became_active":"2023-10-06T11:13:13.125943+0000","last_became_peered":"2023-10-06T11:13:13.125943+0000","last_unstale":"2023-10-06T11:13:17.155701+0000","last_undegraded":"2023-10-06T11:13:17.155701+0000","last_fullsized":"2023-10-06T11:13:17.155701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145009+0000","last_change":"2023-10-06T11:13:13.127706+0000","last_active":"2023-10-06T11:13:17.145009+0000","last_peered":"2023-10-06T11:13:17.145009+0000","last_clean":"2023-10-06T11:13:17.145009+0000","last_became_active":"2023-10-06T11:13:13.127484+0000","last_became_peered":"2023-10-06T11:13:13.127484+0000","last_unstale":"2023-10-06T11:13:17.145009+0000","last_undegraded":"2023-10-06T11:13:17.145009+0000","last_fullsized":"2023-10-06T11:13:17.145009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:11.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136986+0000","last_change":"2023-10-06T11:13:13.118366+0000","last_active":"2023-10-06T11:13:17.136986+0000","last_peered":"2023-10-06T11:13:17.136986+0000","last_clean":"2023-10-06T11:13:17.136986+0000","last_became_active":"2023-10-06T11:13:13.117530+0000","last_became_peered":"2023-10-06T11:13:13.117530+0000","last_unstale":"2023-10-06T11:13:17.136986+0000","last_undegraded":"2023-10-06T11:13:17.136986+0000","last_fullsized":"2023-10-06T11:13:17.136986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:30.505653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137568+0000","last_change":"2023-10-06T11:13:13.123055+0000","last_active":"2023-10-06T11:13:17.137568+0000","last_peered":"2023-10-06T11:13:17.137568+0000","last_clean":"2023-10-06T11:13:17.137568+0000","last_became_active":"2023-10-06T11:13:13.122747+0000","last_became_peered":"2023-10-06T11:13:13.122747+0000","last_unstale":"2023-10-06T11:13:17.137568+0000","last_undegraded":"2023-10-06T11:13:17.137568+0000","last_fullsized":"2023-10-06T11:13:17.137568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:39.944602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154823+0000","last_change":"2023-10-06T11:13:13.124824+0000","last_active":"2023-10-06T11:13:17.154823+0000","last_peered":"2023-10-06T11:13:17.154823+0000","last_clean":"2023-10-06T11:13:17.154823+0000","last_became_active":"2023-10-06T11:13:13.124503+0000","last_became_peered":"2023-10-06T11:13:13.124503+0000","last_unstale":"2023-10-06T11:13:17.154823+0000","last_undegraded":"2023-10-06T11:13:17.154823+0000","last_fullsized":"2023-10-06T11:13:17.154823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149286+0000","last_change":"2023-10-06T11:13:13.135539+0000","last_active":"2023-10-06T11:13:17.149286+0000","last_peered":"2023-10-06T11:13:17.149286+0000","last_clean":"2023-10-06T11:13:17.149286+0000","last_became_active":"2023-10-06T11:13:13.135269+0000","last_became_peered":"2023-10-06T11:13:13.135269+0000","last_unstale":"2023-10-06T11:13:17.149286+0000","last_undegraded":"2023-10-06T11:13:17.149286+0000","last_fullsized":"2023-10-06T11:13:17.149286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143826+0000","last_change":"2023-10-06T11:13:13.118179+0000","last_active":"2023-10-06T11:13:17.143826+0000","last_peered":"2023-10-06T11:13:17.143826+0000","last_clean":"2023-10-06T11:13:17.143826+0000","last_became_active":"2023-10-06T11:13:13.117933+0000","last_became_peered":"2023-10-06T11:13:13.117933+0000","last_unstale":"2023-10-06T11:13:17.143826+0000","last_undegraded":"2023-10-06T11:13:17.143826+0000","last_fullsized":"2023-10-06T11:13:17.143826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:38.942631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145356+0000","last_change":"2023-10-06T11:13:13.121835+0000","last_active":"2023-10-06T11:13:17.145356+0000","last_peered":"2023-10-06T11:13:17.145356+0000","last_clean":"2023-10-06T11:13:17.145356+0000","last_became_active":"2023-10-06T11:13:13.121140+0000","last_became_peered":"2023-10-06T11:13:13.121140+0000","last_unstale":"2023-10-06T11:13:17.145356+0000","last_undegraded":"2023-10-06T11:13:17.145356+0000","last_fullsized":"2023-10-06T11:13:17.145356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144097+0000","last_change":"2023-10-06T11:13:13.126361+0000","last_active":"2023-10-06T11:13:17.144097+0000","last_peered":"2023-10-06T11:13:17.144097+0000","last_clean":"2023-10-06T11:13:17.144097+0000","last_became_active":"2023-10-06T11:13:13.126088+0000","last_became_peered":"2023-10-06T11:13:13.126088+0000","last_unstale":"2023-10-06T11:13:17.144097+0000","last_undegraded":"2023-10-06T11:13:17.144097+0000","last_fullsized":"2023-10-06T11:13:17.144097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:20.523798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137234+0000","last_change":"2023-10-06T11:13:13.123624+0000","last_active":"2023-10-06T11:13:17.137234+0000","last_peered":"2023-10-06T11:13:17.137234+0000","last_clean":"2023-10-06T11:13:17.137234+0000","last_became_active":"2023-10-06T11:13:13.123377+0000","last_became_peered":"2023-10-06T11:13:13.123377+0000","last_unstale":"2023-10-06T11:13:17.137234+0000","last_undegraded":"2023-10-06T11:13:17.137234+0000","last_fullsized":"2023-10-06T11:13:17.137234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:10.993941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143778+0000","last_change":"2023-10-06T11:13:13.122220+0000","last_active":"2023-10-06T11:13:17.143778+0000","last_peered":"2023-10-06T11:13:17.143778+0000","last_clean":"2023-10-06T11:13:17.143778+0000","last_became_active":"2023-10-06T11:13:13.121971+0000","last_became_peered":"2023-10-06T11:13:13.121971+0000","last_unstale":"2023-10-06T11:13:17.143778+0000","last_undegraded":"2023-10-06T11:13:17.143778+0000","last_fullsized":"2023-10-06T11:13:17.143778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.288774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148367+0000","last_change":"2023-10-06T11:13:13.130138+0000","last_active":"2023-10-06T11:13:17.148367+0000","last_peered":"2023-10-06T11:13:17.148367+0000","last_clean":"2023-10-06T11:13:17.148367+0000","last_became_active":"2023-10-06T11:13:13.129957+0000","last_became_peered":"2023-10-06T11:13:13.129957+0000","last_unstale":"2023-10-06T11:13:17.148367+0000","last_undegraded":"2023-10-06T11:13:17.148367+0000","last_fullsized":"2023-10-06T11:13:17.148367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142383+0000","last_change":"2023-10-06T11:13:13.131599+0000","last_active":"2023-10-06T11:13:17.142383+0000","last_peered":"2023-10-06T11:13:17.142383+0000","last_clean":"2023-10-06T11:13:17.142383+0000","last_became_active":"2023-10-06T11:13:13.131351+0000","last_became_peered":"2023-10-06T11:13:13.131351+0000","last_unstale":"2023-10-06T11:13:17.142383+0000","last_undegraded":"2023-10-06T11:13:17.142383+0000","last_fullsized":"2023-10-06T11:13:17.142383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143350+0000","last_change":"2023-10-06T11:13:13.120698+0000","last_active":"2023-10-06T11:13:17.143350+0000","last_peered":"2023-10-06T11:13:17.143350+0000","last_clean":"2023-10-06T11:13:17.143350+0000","last_became_active":"2023-10-06T11:13:13.120409+0000","last_became_peered":"2023-10-06T11:13:13.120409+0000","last_unstale":"2023-10-06T11:13:17.143350+0000","last_undegraded":"2023-10-06T11:13:17.143350+0000","last_fullsized":"2023-10-06T11:13:17.143350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147544+0000","last_change":"2023-10-06T11:13:13.125155+0000","last_active":"2023-10-06T11:13:17.147544+0000","last_peered":"2023-10-06T11:13:17.147544+0000","last_clean":"2023-10-06T11:13:17.147544+0000","last_became_active":"2023-10-06T11:13:13.124909+0000","last_became_peered":"2023-10-06T11:13:13.124909+0000","last_unstale":"2023-10-06T11:13:17.147544+0000","last_undegraded":"2023-10-06T11:13:17.147544+0000","last_fullsized":"2023-10-06T11:13:17.147544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151721+0000","last_change":"2023-10-06T11:13:13.126695+0000","last_active":"2023-10-06T11:13:17.151721+0000","last_peered":"2023-10-06T11:13:17.151721+0000","last_clean":"2023-10-06T11:13:17.151721+0000","last_became_active":"2023-10-06T11:13:13.126107+0000","last_became_peered":"2023-10-06T11:13:13.126107+0000","last_unstale":"2023-10-06T11:13:17.151721+0000","last_undegraded":"2023-10-06T11:13:17.151721+0000","last_fullsized":"2023-10-06T11:13:17.151721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152340+0000","last_change":"2023-10-06T11:13:13.127518+0000","last_active":"2023-10-06T11:13:17.152340+0000","last_peered":"2023-10-06T11:13:17.152340+0000","last_clean":"2023-10-06T11:13:17.152340+0000","last_became_active":"2023-10-06T11:13:13.127277+0000","last_became_peered":"2023-10-06T11:13:13.127277+0000","last_unstale":"2023-10-06T11:13:17.152340+0000","last_undegraded":"2023-10-06T11:13:17.152340+0000","last_fullsized":"2023-10-06T11:13:17.152340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:45.902476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152956+0000","last_change":"2023-10-06T11:13:13.122605+0000","last_active":"2023-10-06T11:13:17.152956+0000","last_peered":"2023-10-06T11:13:17.152956+0000","last_clean":"2023-10-06T11:13:17.152956+0000","last_became_active":"2023-10-06T11:13:13.122169+0000","last_became_peered":"2023-10-06T11:13:13.122169+0000","last_unstale":"2023-10-06T11:13:17.152956+0000","last_undegraded":"2023-10-06T11:13:17.152956+0000","last_fullsized":"2023-10-06T11:13:17.152956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160038+0000","last_change":"2023-10-06T11:13:17.156729+0000","last_active":"2023-10-06T11:13:17.160038+0000","last_peered":"2023-10-06T11:13:17.160038+0000","last_clean":"2023-10-06T11:13:17.160038+0000","last_became_active":"2023-10-06T11:13:17.156340+0000","last_became_peered":"2023-10-06T11:13:17.156340+0000","last_unstale":"2023-10-06T11:13:17.160038+0000","last_undegraded":"2023-10-06T11:13:17.160038+0000","last_fullsized":"2023-10-06T11:13:17.160038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:32.463267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144410+0000","last_change":"2023-10-06T11:13:12.110036+0000","last_active":"2023-10-06T11:13:17.144410+0000","last_peered":"2023-10-06T11:13:17.144410+0000","last_clean":"2023-10-06T11:13:17.144410+0000","last_became_active":"2023-10-06T11:13:12.109584+0000","last_became_peered":"2023-10-06T11:13:12.109584+0000","last_unstale":"2023-10-06T11:13:17.144410+0000","last_undegraded":"2023-10-06T11:13:17.144410+0000","last_fullsized":"2023-10-06T11:13:17.144410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144471+0000","last_change":"2023-10-06T11:13:13.128382+0000","last_active":"2023-10-06T11:13:17.144471+0000","last_peered":"2023-10-06T11:13:17.144471+0000","last_clean":"2023-10-06T11:13:17.144471+0000","last_became_active":"2023-10-06T11:13:13.128089+0000","last_became_peered":"2023-10-06T11:13:13.128089+0000","last_unstale":"2023-10-06T11:13:17.144471+0000","last_undegraded":"2023-10-06T11:13:17.144471+0000","last_fullsized":"2023-10-06T11:13:17.144471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162772+0000","last_change":"2023-10-06T11:13:17.157622+0000","last_active":"2023-10-06T11:13:17.162772+0000","last_peered":"2023-10-06T11:13:17.162772+0000","last_clean":"2023-10-06T11:13:17.162772+0000","last_became_active":"2023-10-06T11:13:17.157240+0000","last_became_peered":"2023-10-06T11:13:17.157240+0000","last_unstale":"2023-10-06T11:13:17.162772+0000","last_undegraded":"2023-10-06T11:13:17.162772+0000","last_fullsized":"2023-10-06T11:13:17.162772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:08.312759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151403+0000","last_change":"2023-10-06T11:13:12.115710+0000","last_active":"2023-10-06T11:13:17.151403+0000","last_peered":"2023-10-06T11:13:17.151403+0000","last_clean":"2023-10-06T11:13:17.151403+0000","last_became_active":"2023-10-06T11:13:12.115446+0000","last_became_peered":"2023-10-06T11:13:12.115446+0000","last_unstale":"2023-10-06T11:13:17.151403+0000","last_undegraded":"2023-10-06T11:13:17.151403+0000","last_fullsized":"2023-10-06T11:13:17.151403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142885+0000","last_change":"2023-10-06T11:13:13.125846+0000","last_active":"2023-10-06T11:13:17.142885+0000","last_peered":"2023-10-06T11:13:17.142885+0000","last_clean":"2023-10-06T11:13:17.142885+0000","last_became_active":"2023-10-06T11:13:13.125581+0000","last_became_peered":"2023-10-06T11:13:13.125581+0000","last_unstale":"2023-10-06T11:13:17.142885+0000","last_undegraded":"2023-10-06T11:13:17.142885+0000","last_fullsized":"2023-10-06T11:13:17.142885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162796+0000","last_change":"2023-10-06T11:13:17.156222+0000","last_active":"2023-10-06T11:13:17.162796+0000","last_peered":"2023-10-06T11:13:17.162796+0000","last_clean":"2023-10-06T11:13:17.162796+0000","last_became_active":"2023-10-06T11:13:17.155785+0000","last_became_peered":"2023-10-06T11:13:17.155785+0000","last_unstale":"2023-10-06T11:13:17.162796+0000","last_undegraded":"2023-10-06T11:13:17.162796+0000","last_fullsized":"2023-10-06T11:13:17.162796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144138+0000","last_change":"2023-10-06T11:13:12.104094+0000","last_active":"2023-10-06T11:13:17.144138+0000","last_peered":"2023-10-06T11:13:17.144138+0000","last_clean":"2023-10-06T11:13:17.144138+0000","last_became_active":"2023-10-06T11:13:12.103658+0000","last_became_peered":"2023-10-06T11:13:12.103658+0000","last_unstale":"2023-10-06T11:13:17.144138+0000","last_undegraded":"2023-10-06T11:13:17.144138+0000","last_fullsized":"2023-10-06T11:13:17.144138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144641+0000","last_change":"2023-10-06T11:13:13.122756+0000","last_active":"2023-10-06T11:13:17.144641+0000","last_peered":"2023-10-06T11:13:17.144641+0000","last_clean":"2023-10-06T11:13:17.144641+0000","last_became_active":"2023-10-06T11:13:13.122498+0000","last_became_peered":"2023-10-06T11:13:13.122498+0000","last_unstale":"2023-10-06T11:13:17.144641+0000","last_undegraded":"2023-10-06T11:13:17.144641+0000","last_fullsized":"2023-10-06T11:13:17.144641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:30.671094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.160480+0000","last_change":"2023-10-06T11:13:17.156830+0000","last_active":"2023-10-06T11:13:17.160480+0000","last_peered":"2023-10-06T11:13:17.160480+0000","last_clean":"2023-10-06T11:13:17.160480+0000","last_became_active":"2023-10-06T11:13:17.156440+0000","last_became_peered":"2023-10-06T11:13:17.156440+0000","last_unstale":"2023-10-06T11:13:17.160480+0000","last_undegraded":"2023-10-06T11:13:17.160480+0000","last_fullsized":"2023-10-06T11:13:17.160480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:15.214081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145470+0000","last_change":"2023-10-06T11:13:12.107048+0000","last_active":"2023-10-06T11:13:17.145470+0000","last_peered":"2023-10-06T11:13:17.145470+0000","last_clean":"2023-10-06T11:13:17.145470+0000","last_became_active":"2023-10-06T11:13:12.103664+0000","last_became_peered":"2023-10-06T11:13:12.103664+0000","last_unstale":"2023-10-06T11:13:17.145470+0000","last_undegraded":"2023-10-06T11:13:17.145470+0000","last_fullsized":"2023-10-06T11:13:17.145470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144060+0000","last_change":"2023-10-06T11:13:13.134983+0000","last_active":"2023-10-06T11:13:17.144060+0000","last_peered":"2023-10-06T11:13:17.144060+0000","last_clean":"2023-10-06T11:13:17.144060+0000","last_became_active":"2023-10-06T11:13:13.134636+0000","last_became_peered":"2023-10-06T11:13:13.134636+0000","last_unstale":"2023-10-06T11:13:17.144060+0000","last_undegraded":"2023-10-06T11:13:17.144060+0000","last_fullsized":"2023-10-06T11:13:17.144060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161534+0000","last_change":"2023-10-06T11:13:17.158372+0000","last_active":"2023-10-06T11:13:17.161534+0000","last_peered":"2023-10-06T11:13:17.161534+0000","last_clean":"2023-10-06T11:13:17.161534+0000","last_became_active":"2023-10-06T11:13:17.157994+0000","last_became_peered":"2023-10-06T11:13:17.157994+0000","last_unstale":"2023-10-06T11:13:17.161534+0000","last_undegraded":"2023-10-06T11:13:17.161534+0000","last_fullsized":"2023-10-06T11:13:17.161534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:12.841649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.155603+0000","last_change":"2023-10-06T11:13:12.112958+0000","last_active":"2023-10-06T11:13:17.155603+0000","last_peered":"2023-10-06T11:13:17.155603+0000","last_clean":"2023-10-06T11:13:17.155603+0000","last_became_active":"2023-10-06T11:13:12.112670+0000","last_became_peered":"2023-10-06T11:13:12.112670+0000","last_unstale":"2023-10-06T11:13:17.155603+0000","last_undegraded":"2023-10-06T11:13:17.155603+0000","last_fullsized":"2023-10-06T11:13:17.155603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:44.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143449+0000","last_change":"2023-10-06T11:13:13.126318+0000","last_active":"2023-10-06T11:13:17.143449+0000","last_peered":"2023-10-06T11:13:17.143449+0000","last_clean":"2023-10-06T11:13:17.143449+0000","last_became_active":"2023-10-06T11:13:13.126070+0000","last_became_peered":"2023-10-06T11:13:13.126070+0000","last_unstale":"2023-10-06T11:13:17.143449+0000","last_undegraded":"2023-10-06T11:13:17.143449+0000","last_fullsized":"2023-10-06T11:13:17.143449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166081+0000","last_change":"2023-10-06T11:13:17.162541+0000","last_active":"2023-10-06T11:13:17.166081+0000","last_peered":"2023-10-06T11:13:17.166081+0000","last_clean":"2023-10-06T11:13:17.166081+0000","last_became_active":"2023-10-06T11:13:17.162167+0000","last_became_peered":"2023-10-06T11:13:17.162167+0000","last_unstale":"2023-10-06T11:13:17.166081+0000","last_undegraded":"2023-10-06T11:13:17.166081+0000","last_fullsized":"2023-10-06T11:13:17.166081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148499+0000","last_change":"2023-10-06T11:13:12.115343+0000","last_active":"2023-10-06T11:13:17.148499+0000","last_peered":"2023-10-06T11:13:17.148499+0000","last_clean":"2023-10-06T11:13:17.148499+0000","last_became_active":"2023-10-06T11:13:12.115140+0000","last_became_peered":"2023-10-06T11:13:12.115140+0000","last_unstale":"2023-10-06T11:13:17.148499+0000","last_undegraded":"2023-10-06T11:13:17.148499+0000","last_fullsized":"2023-10-06T11:13:17.148499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:45:40.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150826+0000","last_change":"2023-10-06T11:13:13.130679+0000","last_active":"2023-10-06T11:13:17.150826+0000","last_peered":"2023-10-06T11:13:17.150826+0000","last_clean":"2023-10-06T11:13:17.150826+0000","last_became_active":"2023-10-06T11:13:13.130159+0000","last_became_peered":"2023-10-06T11:13:13.130159+0000","last_unstale":"2023-10-06T11:13:17.150826+0000","last_undegraded":"2023-10-06T11:13:17.150826+0000","last_fullsized":"2023-10-06T11:13:17.150826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170593+0000","last_change":"2023-10-06T11:13:17.164392+0000","last_active":"2023-10-06T11:13:17.170593+0000","last_peered":"2023-10-06T11:13:17.170593+0000","last_clean":"2023-10-06T11:13:17.170593+0000","last_became_active":"2023-10-06T11:13:17.164000+0000","last_became_peered":"2023-10-06T11:13:17.164000+0000","last_unstale":"2023-10-06T11:13:17.170593+0000","last_undegraded":"2023-10-06T11:13:17.170593+0000","last_fullsized":"2023-10-06T11:13:17.170593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:54.257356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:13:23.026636+0000","last_change":"2023-10-06T11:13:12.108372+0000","last_active":"2023-10-06T11:13:23.026636+0000","last_peered":"2023-10-06T11:13:23.026636+0000","last_clean":"2023-10-06T11:13:23.026636+0000","last_became_active":"2023-10-06T11:13:12.108083+0000","last_became_peered":"2023-10-06T11:13:12.108083+0000","last_unstale":"2023-10-06T11:13:23.026636+0000","last_undegraded":"2023-10-06T11:13:23.026636+0000","last_fullsized":"2023-10-06T11:13:23.026636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143470+0000","last_change":"2023-10-06T11:13:13.125601+0000","last_active":"2023-10-06T11:13:17.143470+0000","last_peered":"2023-10-06T11:13:17.143470+0000","last_clean":"2023-10-06T11:13:17.143470+0000","last_became_active":"2023-10-06T11:13:13.125279+0000","last_became_peered":"2023-10-06T11:13:13.125279+0000","last_unstale":"2023-10-06T11:13:17.143470+0000","last_undegraded":"2023-10-06T11:13:17.143470+0000","last_fullsized":"2023-10-06T11:13:17.143470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.270289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168209+0000","last_change":"2023-10-06T11:13:17.164677+0000","last_active":"2023-10-06T11:13:17.168209+0000","last_peered":"2023-10-06T11:13:17.168209+0000","last_clean":"2023-10-06T11:13:17.168209+0000","last_became_active":"2023-10-06T11:13:17.163312+0000","last_became_peered":"2023-10-06T11:13:17.163312+0000","last_unstale":"2023-10-06T11:13:17.168209+0000","last_undegraded":"2023-10-06T11:13:17.168209+0000","last_fullsized":"2023-10-06T11:13:17.168209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:19.042784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148271+0000","last_change":"2023-10-06T11:13:12.113019+0000","last_active":"2023-10-06T11:13:17.148271+0000","last_peered":"2023-10-06T11:13:17.148271+0000","last_clean":"2023-10-06T11:13:17.148271+0000","last_became_active":"2023-10-06T11:13:12.112717+0000","last_became_peered":"2023-10-06T11:13:12.112717+0000","last_unstale":"2023-10-06T11:13:17.148271+0000","last_undegraded":"2023-10-06T11:13:17.148271+0000","last_fullsized":"2023-10-06T11:13:17.148271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144893+0000","last_change":"2023-10-06T11:13:13.128297+0000","last_active":"2023-10-06T11:13:17.144893+0000","last_peered":"2023-10-06T11:13:17.144893+0000","last_clean":"2023-10-06T11:13:17.144893+0000","last_became_active":"2023-10-06T11:13:13.128026+0000","last_became_peered":"2023-10-06T11:13:13.128026+0000","last_unstale":"2023-10-06T11:13:17.144893+0000","last_undegraded":"2023-10-06T11:13:17.144893+0000","last_fullsized":"2023-10-06T11:13:17.144893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162240+0000","last_change":"2023-10-06T11:13:17.160008+0000","last_active":"2023-10-06T11:13:17.162240+0000","last_peered":"2023-10-06T11:13:17.162240+0000","last_clean":"2023-10-06T11:13:17.162240+0000","last_became_active":"2023-10-06T11:13:17.159069+0000","last_became_peered":"2023-10-06T11:13:17.159069+0000","last_unstale":"2023-10-06T11:13:17.162240+0000","last_undegraded":"2023-10-06T11:13:17.162240+0000","last_fullsized":"2023-10-06T11:13:17.162240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142294+0000","last_change":"2023-10-06T11:13:12.113312+0000","last_active":"2023-10-06T11:13:17.142294+0000","last_peered":"2023-10-06T11:13:17.142294+0000","last_clean":"2023-10-06T11:13:17.142294+0000","last_became_active":"2023-10-06T11:13:12.112955+0000","last_became_peered":"2023-10-06T11:13:12.112955+0000","last_unstale":"2023-10-06T11:13:17.142294+0000","last_undegraded":"2023-10-06T11:13:17.142294+0000","last_fullsized":"2023-10-06T11:13:17.142294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152870+0000","last_change":"2023-10-06T11:13:13.122429+0000","last_active":"2023-10-06T11:13:17.152870+0000","last_peered":"2023-10-06T11:13:17.152870+0000","last_clean":"2023-10-06T11:13:17.152870+0000","last_became_active":"2023-10-06T11:13:13.121817+0000","last_became_peered":"2023-10-06T11:13:13.121817+0000","last_unstale":"2023-10-06T11:13:17.152870+0000","last_undegraded":"2023-10-06T11:13:17.152870+0000","last_fullsized":"2023-10-06T11:13:17.152870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158460+0000","last_change":"2023-10-06T11:13:17.154826+0000","last_active":"2023-10-06T11:13:17.158460+0000","last_peered":"2023-10-06T11:13:17.158460+0000","last_clean":"2023-10-06T11:13:17.158460+0000","last_became_active":"2023-10-06T11:13:17.154408+0000","last_became_peered":"2023-10-06T11:13:17.154408+0000","last_unstale":"2023-10-06T11:13:17.158460+0000","last_undegraded":"2023-10-06T11:13:17.158460+0000","last_fullsized":"2023-10-06T11:13:17.158460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149376+0000","last_change":"2023-10-06T11:13:12.112186+0000","last_active":"2023-10-06T11:13:17.149376+0000","last_peered":"2023-10-06T11:13:17.149376+0000","last_clean":"2023-10-06T11:13:17.149376+0000","last_became_active":"2023-10-06T11:13:12.111804+0000","last_became_peered":"2023-10-06T11:13:12.111804+0000","last_unstale":"2023-10-06T11:13:17.149376+0000","last_undegraded":"2023-10-06T11:13:17.149376+0000","last_fullsized":"2023-10-06T11:13:17.149376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142984+0000","last_change":"2023-10-06T11:13:13.127356+0000","last_active":"2023-10-06T11:13:17.142984+0000","last_peered":"2023-10-06T11:13:17.142984+0000","last_clean":"2023-10-06T11:13:17.142984+0000","last_became_active":"2023-10-06T11:13:13.127081+0000","last_became_peered":"2023-10-06T11:13:13.127081+0000","last_unstale":"2023-10-06T11:13:17.142984+0000","last_undegraded":"2023-10-06T11:13:17.142984+0000","last_fullsized":"2023-10-06T11:13:17.142984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168186+0000","last_change":"2023-10-06T11:13:17.164977+0000","last_active":"2023-10-06T11:13:17.168186+0000","last_peered":"2023-10-06T11:13:17.168186+0000","last_clean":"2023-10-06T11:13:17.168186+0000","last_became_active":"2023-10-06T11:13:17.162985+0000","last_became_peered":"2023-10-06T11:13:17.162985+0000","last_unstale":"2023-10-06T11:13:17.168186+0000","last_undegraded":"2023-10-06T11:13:17.168186+0000","last_fullsized":"2023-10-06T11:13:17.168186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:39.268540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140804+0000","last_change":"2023-10-06T11:13:12.104093+0000","last_active":"2023-10-06T11:13:17.140804+0000","last_peered":"2023-10-06T11:13:17.140804+0000","last_clean":"2023-10-06T11:13:17.140804+0000","last_became_active":"2023-10-06T11:13:12.103822+0000","last_became_peered":"2023-10-06T11:13:12.103822+0000","last_unstale":"2023-10-06T11:13:17.140804+0000","last_undegraded":"2023-10-06T11:13:17.140804+0000","last_fullsized":"2023-10-06T11:13:17.140804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144546+0000","last_change":"2023-10-06T11:13:13.125356+0000","last_active":"2023-10-06T11:13:17.144546+0000","last_peered":"2023-10-06T11:13:17.144546+0000","last_clean":"2023-10-06T11:13:17.144546+0000","last_became_active":"2023-10-06T11:13:13.125067+0000","last_became_peered":"2023-10-06T11:13:13.125067+0000","last_unstale":"2023-10-06T11:13:17.144546+0000","last_undegraded":"2023-10-06T11:13:17.144546+0000","last_fullsized":"2023-10-06T11:13:17.144546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169071+0000","last_change":"2023-10-06T11:13:17.167108+0000","last_active":"2023-10-06T11:13:17.169071+0000","last_peered":"2023-10-06T11:13:17.169071+0000","last_clean":"2023-10-06T11:13:17.169071+0000","last_became_active":"2023-10-06T11:13:17.166687+0000","last_became_peered":"2023-10-06T11:13:17.166687+0000","last_unstale":"2023-10-06T11:13:17.169071+0000","last_undegraded":"2023-10-06T11:13:17.169071+0000","last_fullsized":"2023-10-06T11:13:17.169071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149299+0000","last_change":"2023-10-06T11:13:12.111301+0000","last_active":"2023-10-06T11:13:17.149299+0000","last_peered":"2023-10-06T11:13:17.149299+0000","last_clean":"2023-10-06T11:13:17.149299+0000","last_became_active":"2023-10-06T11:13:12.111017+0000","last_became_peered":"2023-10-06T11:13:12.111017+0000","last_unstale":"2023-10-06T11:13:17.149299+0000","last_undegraded":"2023-10-06T11:13:17.149299+0000","last_fullsized":"2023-10-06T11:13:17.149299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150481+0000","last_change":"2023-10-06T11:13:13.122154+0000","last_active":"2023-10-06T11:13:17.150481+0000","last_peered":"2023-10-06T11:13:17.150481+0000","last_clean":"2023-10-06T11:13:17.150481+0000","last_became_active":"2023-10-06T11:13:13.121877+0000","last_became_peered":"2023-10-06T11:13:13.121877+0000","last_unstale":"2023-10-06T11:13:17.150481+0000","last_undegraded":"2023-10-06T11:13:17.150481+0000","last_fullsized":"2023-10-06T11:13:17.150481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:00.805677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170404+0000","last_change":"2023-10-06T11:13:17.157370+0000","last_active":"2023-10-06T11:13:17.170404+0000","last_peered":"2023-10-06T11:13:17.170404+0000","last_clean":"2023-10-06T11:13:17.170404+0000","last_became_active":"2023-10-06T11:13:17.156962+0000","last_became_peered":"2023-10-06T11:13:17.156962+0000","last_unstale":"2023-10-06T11:13:17.170404+0000","last_undegraded":"2023-10-06T11:13:17.170404+0000","last_fullsized":"2023-10-06T11:13:17.170404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:24.566268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148959+0000","last_change":"2023-10-06T11:13:12.113489+0000","last_active":"2023-10-06T11:13:17.148959+0000","last_peered":"2023-10-06T11:13:17.148959+0000","last_clean":"2023-10-06T11:13:17.148959+0000","last_became_active":"2023-10-06T11:13:12.113057+0000","last_became_peered":"2023-10-06T11:13:12.113057+0000","last_unstale":"2023-10-06T11:13:17.148959+0000","last_undegraded":"2023-10-06T11:13:17.148959+0000","last_fullsized":"2023-10-06T11:13:17.148959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142803+0000","last_change":"2023-10-06T11:13:13.120468+0000","last_active":"2023-10-06T11:13:17.142803+0000","last_peered":"2023-10-06T11:13:17.142803+0000","last_clean":"2023-10-06T11:13:17.142803+0000","last_became_active":"2023-10-06T11:13:13.120185+0000","last_became_peered":"2023-10-06T11:13:13.120185+0000","last_unstale":"2023-10-06T11:13:17.142803+0000","last_undegraded":"2023-10-06T11:13:17.142803+0000","last_fullsized":"2023-10-06T11:13:17.142803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:50.214886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171097+0000","last_change":"2023-10-06T11:13:17.164354+0000","last_active":"2023-10-06T11:13:17.171097+0000","last_peered":"2023-10-06T11:13:17.171097+0000","last_clean":"2023-10-06T11:13:17.171097+0000","last_became_active":"2023-10-06T11:13:17.163963+0000","last_became_peered":"2023-10-06T11:13:17.163963+0000","last_unstale":"2023-10-06T11:13:17.171097+0000","last_undegraded":"2023-10-06T11:13:17.171097+0000","last_fullsized":"2023-10-06T11:13:17.171097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.560835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148674+0000","last_change":"2023-10-06T11:13:12.106817+0000","last_active":"2023-10-06T11:13:17.148674+0000","last_peered":"2023-10-06T11:13:17.148674+0000","last_clean":"2023-10-06T11:13:17.148674+0000","last_became_active":"2023-10-06T11:13:12.106511+0000","last_became_peered":"2023-10-06T11:13:12.106511+0000","last_unstale":"2023-10-06T11:13:17.148674+0000","last_undegraded":"2023-10-06T11:13:17.148674+0000","last_fullsized":"2023-10-06T11:13:17.148674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:43.294693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142595+0000","last_change":"2023-10-06T11:13:13.131680+0000","last_active":"2023-10-06T11:13:17.142595+0000","last_peered":"2023-10-06T11:13:17.142595+0000","last_clean":"2023-10-06T11:13:17.142595+0000","last_became_active":"2023-10-06T11:13:13.131450+0000","last_became_peered":"2023-10-06T11:13:13.131450+0000","last_unstale":"2023-10-06T11:13:17.142595+0000","last_undegraded":"2023-10-06T11:13:17.142595+0000","last_fullsized":"2023-10-06T11:13:17.142595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:57.893509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170226+0000","last_change":"2023-10-06T11:13:17.157797+0000","last_active":"2023-10-06T11:13:17.170226+0000","last_peered":"2023-10-06T11:13:17.170226+0000","last_clean":"2023-10-06T11:13:17.170226+0000","last_became_active":"2023-10-06T11:13:17.156392+0000","last_became_peered":"2023-10-06T11:13:17.156392+0000","last_unstale":"2023-10-06T11:13:17.170226+0000","last_undegraded":"2023-10-06T11:13:17.170226+0000","last_fullsized":"2023-10-06T11:13:17.170226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:34.331244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.149920+0000","last_change":"2023-10-06T11:13:12.101059+0000","last_active":"2023-10-06T11:13:17.149920+0000","last_peered":"2023-10-06T11:13:17.149920+0000","last_clean":"2023-10-06T11:13:17.149920+0000","last_became_active":"2023-10-06T11:13:12.100794+0000","last_became_peered":"2023-10-06T11:13:12.100794+0000","last_unstale":"2023-10-06T11:13:17.149920+0000","last_undegraded":"2023-10-06T11:13:17.149920+0000","last_fullsized":"2023-10-06T11:13:17.149920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.882846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143540+0000","last_change":"2023-10-06T11:13:13.131631+0000","last_active":"2023-10-06T11:13:17.143540+0000","last_peered":"2023-10-06T11:13:17.143540+0000","last_clean":"2023-10-06T11:13:17.143540+0000","last_became_active":"2023-10-06T11:13:13.131335+0000","last_became_peered":"2023-10-06T11:13:13.131335+0000","last_unstale":"2023-10-06T11:13:17.143540+0000","last_undegraded":"2023-10-06T11:13:17.143540+0000","last_fullsized":"2023-10-06T11:13:17.143540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170967+0000","last_change":"2023-10-06T11:13:17.161179+0000","last_active":"2023-10-06T11:13:17.170967+0000","last_peered":"2023-10-06T11:13:17.170967+0000","last_clean":"2023-10-06T11:13:17.170967+0000","last_became_active":"2023-10-06T11:13:17.160718+0000","last_became_peered":"2023-10-06T11:13:17.160718+0000","last_unstale":"2023-10-06T11:13:17.170967+0000","last_undegraded":"2023-10-06T11:13:17.170967+0000","last_fullsized":"2023-10-06T11:13:17.170967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:42.264892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143812+0000","last_change":"2023-10-06T11:13:12.112814+0000","last_active":"2023-10-06T11:13:17.143812+0000","last_peered":"2023-10-06T11:13:17.143812+0000","last_clean":"2023-10-06T11:13:17.143812+0000","last_became_active":"2023-10-06T11:13:12.112493+0000","last_became_peered":"2023-10-06T11:13:12.112493+0000","last_unstale":"2023-10-06T11:13:17.143812+0000","last_undegraded":"2023-10-06T11:13:17.143812+0000","last_fullsized":"2023-10-06T11:13:17.143812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:04.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143590+0000","last_change":"2023-10-06T11:13:13.116701+0000","last_active":"2023-10-06T11:13:17.143590+0000","last_peered":"2023-10-06T11:13:17.143590+0000","last_clean":"2023-10-06T11:13:17.143590+0000","last_became_active":"2023-10-06T11:13:13.116422+0000","last_became_peered":"2023-10-06T11:13:13.116422+0000","last_unstale":"2023-10-06T11:13:17.143590+0000","last_undegraded":"2023-10-06T11:13:17.143590+0000","last_fullsized":"2023-10-06T11:13:17.143590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170427+0000","last_change":"2023-10-06T11:13:17.162887+0000","last_active":"2023-10-06T11:13:17.170427+0000","last_peered":"2023-10-06T11:13:17.170427+0000","last_clean":"2023-10-06T11:13:17.170427+0000","last_became_active":"2023-10-06T11:13:17.162489+0000","last_became_peered":"2023-10-06T11:13:17.162489+0000","last_unstale":"2023-10-06T11:13:17.170427+0000","last_undegraded":"2023-10-06T11:13:17.170427+0000","last_fullsized":"2023-10-06T11:13:17.170427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:34.505394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142694+0000","last_change":"2023-10-06T11:13:12.108134+0000","last_active":"2023-10-06T11:13:17.142694+0000","last_peered":"2023-10-06T11:13:17.142694+0000","last_clean":"2023-10-06T11:13:17.142694+0000","last_became_active":"2023-10-06T11:13:12.107878+0000","last_became_peered":"2023-10-06T11:13:12.107878+0000","last_unstale":"2023-10-06T11:13:17.142694+0000","last_undegraded":"2023-10-06T11:13:17.142694+0000","last_fullsized":"2023-10-06T11:13:17.142694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:12.218554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144703+0000","last_change":"2023-10-06T11:13:13.118848+0000","last_active":"2023-10-06T11:13:17.144703+0000","last_peered":"2023-10-06T11:13:17.144703+0000","last_clean":"2023-10-06T11:13:17.144703+0000","last_became_active":"2023-10-06T11:13:13.118542+0000","last_became_peered":"2023-10-06T11:13:13.118542+0000","last_unstale":"2023-10-06T11:13:17.144703+0000","last_undegraded":"2023-10-06T11:13:17.144703+0000","last_fullsized":"2023-10-06T11:13:17.144703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.172331+0000","last_change":"2023-10-06T11:13:17.171309+0000","last_active":"2023-10-06T11:13:17.172331+0000","last_peered":"2023-10-06T11:13:17.172331+0000","last_clean":"2023-10-06T11:13:17.172331+0000","last_became_active":"2023-10-06T11:13:17.170940+0000","last_became_peered":"2023-10-06T11:13:17.170940+0000","last_unstale":"2023-10-06T11:13:17.172331+0000","last_undegraded":"2023-10-06T11:13:17.172331+0000","last_fullsized":"2023-10-06T11:13:17.172331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:04:35.275309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:12.110981+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:12.110564+0000","last_became_peered":"2023-10-06T11:13:12.110564+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:30.193320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144182+0000","last_change":"2023-10-06T11:13:13.122172+0000","last_active":"2023-10-06T11:13:17.144182+0000","last_peered":"2023-10-06T11:13:17.144182+0000","last_clean":"2023-10-06T11:13:17.144182+0000","last_became_active":"2023-10-06T11:13:13.121871+0000","last_became_peered":"2023-10-06T11:13:13.121871+0000","last_unstale":"2023-10-06T11:13:17.144182+0000","last_undegraded":"2023-10-06T11:13:17.144182+0000","last_fullsized":"2023-10-06T11:13:17.144182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.169382+0000","last_change":"2023-10-06T11:13:17.164730+0000","last_active":"2023-10-06T11:13:17.169382+0000","last_peered":"2023-10-06T11:13:17.169382+0000","last_clean":"2023-10-06T11:13:17.169382+0000","last_became_active":"2023-10-06T11:13:17.163984+0000","last_became_peered":"2023-10-06T11:13:17.163984+0000","last_unstale":"2023-10-06T11:13:17.169382+0000","last_undegraded":"2023-10-06T11:13:17.169382+0000","last_fullsized":"2023-10-06T11:13:17.169382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:35.906494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143988+0000","last_change":"2023-10-06T11:13:12.114698+0000","last_active":"2023-10-06T11:13:17.143988+0000","last_peered":"2023-10-06T11:13:17.143988+0000","last_clean":"2023-10-06T11:13:17.143988+0000","last_became_active":"2023-10-06T11:13:12.114434+0000","last_became_peered":"2023-10-06T11:13:12.114434+0000","last_unstale":"2023-10-06T11:13:17.143988+0000","last_undegraded":"2023-10-06T11:13:17.143988+0000","last_fullsized":"2023-10-06T11:13:17.143988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151901+0000","last_change":"2023-10-06T11:13:13.134982+0000","last_active":"2023-10-06T11:13:17.151901+0000","last_peered":"2023-10-06T11:13:17.151901+0000","last_clean":"2023-10-06T11:13:17.151901+0000","last_became_active":"2023-10-06T11:13:13.134682+0000","last_became_peered":"2023-10-06T11:13:13.134682+0000","last_unstale":"2023-10-06T11:13:17.151901+0000","last_undegraded":"2023-10-06T11:13:17.151901+0000","last_fullsized":"2023-10-06T11:13:17.151901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:46.852448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.165861+0000","last_change":"2023-10-06T11:13:17.163360+0000","last_active":"2023-10-06T11:13:17.165861+0000","last_peered":"2023-10-06T11:13:17.165861+0000","last_clean":"2023-10-06T11:13:17.165861+0000","last_became_active":"2023-10-06T11:13:17.162962+0000","last_became_peered":"2023-10-06T11:13:17.162962+0000","last_unstale":"2023-10-06T11:13:17.165861+0000","last_undegraded":"2023-10-06T11:13:17.165861+0000","last_fullsized":"2023-10-06T11:13:17.165861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151036+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:13:17.151036+0000","last_peered":"2023-10-06T11:13:17.151036+0000","last_clean":"2023-10-06T11:13:17.151036+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:13:17.151036+0000","last_undegraded":"2023-10-06T11:13:17.151036+0000","last_fullsized":"2023-10-06T11:13:17.151036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152775+0000","last_change":"2023-10-06T11:13:12.104620+0000","last_active":"2023-10-06T11:13:17.152775+0000","last_peered":"2023-10-06T11:13:17.152775+0000","last_clean":"2023-10-06T11:13:17.152775+0000","last_became_active":"2023-10-06T11:13:12.104355+0000","last_became_peered":"2023-10-06T11:13:12.104355+0000","last_unstale":"2023-10-06T11:13:17.152775+0000","last_undegraded":"2023-10-06T11:13:17.152775+0000","last_fullsized":"2023-10-06T11:13:17.152775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:16.050738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150736+0000","last_change":"2023-10-06T11:13:13.130493+0000","last_active":"2023-10-06T11:13:17.150736+0000","last_peered":"2023-10-06T11:13:17.150736+0000","last_clean":"2023-10-06T11:13:17.150736+0000","last_became_active":"2023-10-06T11:13:13.129849+0000","last_became_peered":"2023-10-06T11:13:13.129849+0000","last_unstale":"2023-10-06T11:13:17.150736+0000","last_undegraded":"2023-10-06T11:13:17.150736+0000","last_fullsized":"2023-10-06T11:13:17.150736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:06.104311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.162543+0000","last_change":"2023-10-06T11:13:17.157136+0000","last_active":"2023-10-06T11:13:17.162543+0000","last_peered":"2023-10-06T11:13:17.162543+0000","last_clean":"2023-10-06T11:13:17.162543+0000","last_became_active":"2023-10-06T11:13:17.156751+0000","last_became_peered":"2023-10-06T11:13:17.156751+0000","last_unstale":"2023-10-06T11:13:17.162543+0000","last_undegraded":"2023-10-06T11:13:17.162543+0000","last_fullsized":"2023-10-06T11:13:17.162543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:06.723949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154906+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:13:17.154906+0000","last_peered":"2023-10-06T11:13:17.154906+0000","last_clean":"2023-10-06T11:13:17.154906+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:13:17.154906+0000","last_undegraded":"2023-10-06T11:13:17.154906+0000","last_fullsized":"2023-10-06T11:13:17.154906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143311+0000","last_change":"2023-10-06T11:13:12.106188+0000","last_active":"2023-10-06T11:13:17.143311+0000","last_peered":"2023-10-06T11:13:17.143311+0000","last_clean":"2023-10-06T11:13:17.143311+0000","last_became_active":"2023-10-06T11:13:12.104759+0000","last_became_peered":"2023-10-06T11:13:12.104759+0000","last_unstale":"2023-10-06T11:13:17.143311+0000","last_undegraded":"2023-10-06T11:13:17.143311+0000","last_fullsized":"2023-10-06T11:13:17.143311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150950+0000","last_change":"2023-10-06T11:13:13.129472+0000","last_active":"2023-10-06T11:13:17.150950+0000","last_peered":"2023-10-06T11:13:17.150950+0000","last_clean":"2023-10-06T11:13:17.150950+0000","last_became_active":"2023-10-06T11:13:13.129098+0000","last_became_peered":"2023-10-06T11:13:13.129098+0000","last_unstale":"2023-10-06T11:13:17.150950+0000","last_undegraded":"2023-10-06T11:13:17.150950+0000","last_fullsized":"2023-10-06T11:13:17.150950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:35:48.407971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.171118+0000","last_change":"2023-10-06T11:13:17.165728+0000","last_active":"2023-10-06T11:13:17.171118+0000","last_peered":"2023-10-06T11:13:17.171118+0000","last_clean":"2023-10-06T11:13:17.171118+0000","last_became_active":"2023-10-06T11:13:17.165346+0000","last_became_peered":"2023-10-06T11:13:17.165346+0000","last_unstale":"2023-10-06T11:13:17.171118+0000","last_undegraded":"2023-10-06T11:13:17.171118+0000","last_fullsized":"2023-10-06T11:13:17.171118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:50.894918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.136729+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:13:17.136729+0000","last_peered":"2023-10-06T11:13:17.136729+0000","last_clean":"2023-10-06T11:13:17.136729+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:13:17.136729+0000","last_undegraded":"2023-10-06T11:13:17.136729+0000","last_fullsized":"2023-10-06T11:13:17.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152088+0000","last_change":"2023-10-06T11:13:12.113344+0000","last_active":"2023-10-06T11:13:17.152088+0000","last_peered":"2023-10-06T11:13:17.152088+0000","last_clean":"2023-10-06T11:13:17.152088+0000","last_became_active":"2023-10-06T11:13:12.113058+0000","last_became_peered":"2023-10-06T11:13:12.113058+0000","last_unstale":"2023-10-06T11:13:17.152088+0000","last_undegraded":"2023-10-06T11:13:17.152088+0000","last_fullsized":"2023-10-06T11:13:17.152088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:25:25.552599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151812+0000","last_change":"2023-10-06T11:13:13.126878+0000","last_active":"2023-10-06T11:13:17.151812+0000","last_peered":"2023-10-06T11:13:17.151812+0000","last_clean":"2023-10-06T11:13:17.151812+0000","last_became_active":"2023-10-06T11:13:13.126442+0000","last_became_peered":"2023-10-06T11:13:13.126442+0000","last_unstale":"2023-10-06T11:13:17.151812+0000","last_undegraded":"2023-10-06T11:13:17.151812+0000","last_fullsized":"2023-10-06T11:13:17.151812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:18.891306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168046+0000","last_change":"2023-10-06T11:13:17.162293+0000","last_active":"2023-10-06T11:13:17.168046+0000","last_peered":"2023-10-06T11:13:17.168046+0000","last_clean":"2023-10-06T11:13:17.168046+0000","last_became_active":"2023-10-06T11:13:17.161704+0000","last_became_peered":"2023-10-06T11:13:17.161704+0000","last_unstale":"2023-10-06T11:13:17.168046+0000","last_undegraded":"2023-10-06T11:13:17.168046+0000","last_fullsized":"2023-10-06T11:13:17.168046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:33.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.154038+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:13:17.154038+0000","last_peered":"2023-10-06T11:13:17.154038+0000","last_clean":"2023-10-06T11:13:17.154038+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:13:17.154038+0000","last_undegraded":"2023-10-06T11:13:17.154038+0000","last_fullsized":"2023-10-06T11:13:17.154038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147427+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:13:17.147427+0000","last_peered":"2023-10-06T11:13:17.147427+0000","last_clean":"2023-10-06T11:13:17.147427+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:13:17.147427+0000","last_undegraded":"2023-10-06T11:13:17.147427+0000","last_fullsized":"2023-10-06T11:13:17.147427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143336+0000","last_change":"2023-10-06T11:13:12.105541+0000","last_active":"2023-10-06T11:13:17.143336+0000","last_peered":"2023-10-06T11:13:17.143336+0000","last_clean":"2023-10-06T11:13:17.143336+0000","last_became_active":"2023-10-06T11:13:12.105235+0000","last_became_peered":"2023-10-06T11:13:12.105235+0000","last_unstale":"2023-10-06T11:13:17.143336+0000","last_undegraded":"2023-10-06T11:13:17.143336+0000","last_fullsized":"2023-10-06T11:13:17.143336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140757+0000","last_change":"2023-10-06T11:13:13.123658+0000","last_active":"2023-10-06T11:13:17.140757+0000","last_peered":"2023-10-06T11:13:17.140757+0000","last_clean":"2023-10-06T11:13:17.140757+0000","last_became_active":"2023-10-06T11:13:13.123381+0000","last_became_peered":"2023-10-06T11:13:13.123381+0000","last_unstale":"2023-10-06T11:13:17.140757+0000","last_undegraded":"2023-10-06T11:13:17.140757+0000","last_fullsized":"2023-10-06T11:13:17.140757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:17.061401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.167581+0000","last_change":"2023-10-06T11:13:17.164198+0000","last_active":"2023-10-06T11:13:17.167581+0000","last_peered":"2023-10-06T11:13:17.167581+0000","last_clean":"2023-10-06T11:13:17.167581+0000","last_became_active":"2023-10-06T11:13:17.163841+0000","last_became_peered":"2023-10-06T11:13:17.163841+0000","last_unstale":"2023-10-06T11:13:17.167581+0000","last_undegraded":"2023-10-06T11:13:17.167581+0000","last_fullsized":"2023-10-06T11:13:17.167581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:25:37.062632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.147593+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:13:17.147593+0000","last_peered":"2023-10-06T11:13:17.147593+0000","last_clean":"2023-10-06T11:13:17.147593+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:13:17.147593+0000","last_undegraded":"2023-10-06T11:13:17.147593+0000","last_fullsized":"2023-10-06T11:13:17.147593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142083+0000","last_change":"2023-10-06T11:13:12.110086+0000","last_active":"2023-10-06T11:13:17.142083+0000","last_peered":"2023-10-06T11:13:17.142083+0000","last_clean":"2023-10-06T11:13:17.142083+0000","last_became_active":"2023-10-06T11:13:12.109735+0000","last_became_peered":"2023-10-06T11:13:12.109735+0000","last_unstale":"2023-10-06T11:13:17.142083+0000","last_undegraded":"2023-10-06T11:13:17.142083+0000","last_fullsized":"2023-10-06T11:13:17.142083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:29.494991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142662+0000","last_change":"2023-10-06T11:13:13.131401+0000","last_active":"2023-10-06T11:13:17.142662+0000","last_peered":"2023-10-06T11:13:17.142662+0000","last_clean":"2023-10-06T11:13:17.142662+0000","last_became_active":"2023-10-06T11:13:13.131126+0000","last_became_peered":"2023-10-06T11:13:13.131126+0000","last_unstale":"2023-10-06T11:13:17.142662+0000","last_undegraded":"2023-10-06T11:13:17.142662+0000","last_fullsized":"2023-10-06T11:13:17.142662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.164232+0000","last_change":"2023-10-06T11:13:17.161961+0000","last_active":"2023-10-06T11:13:17.164232+0000","last_peered":"2023-10-06T11:13:17.164232+0000","last_clean":"2023-10-06T11:13:17.164232+0000","last_became_active":"2023-10-06T11:13:17.161594+0000","last_became_peered":"2023-10-06T11:13:17.161594+0000","last_unstale":"2023-10-06T11:13:17.164232+0000","last_undegraded":"2023-10-06T11:13:17.164232+0000","last_fullsized":"2023-10-06T11:13:17.164232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:37.366244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.148583+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:13:17.148583+0000","last_peered":"2023-10-06T11:13:17.148583+0000","last_clean":"2023-10-06T11:13:17.148583+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:13:17.148583+0000","last_undegraded":"2023-10-06T11:13:17.148583+0000","last_fullsized":"2023-10-06T11:13:17.148583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151224+0000","last_change":"2023-10-06T11:13:12.113488+0000","last_active":"2023-10-06T11:13:17.151224+0000","last_peered":"2023-10-06T11:13:17.151224+0000","last_clean":"2023-10-06T11:13:17.151224+0000","last_became_active":"2023-10-06T11:13:12.113184+0000","last_became_peered":"2023-10-06T11:13:12.113184+0000","last_unstale":"2023-10-06T11:13:17.151224+0000","last_undegraded":"2023-10-06T11:13:17.151224+0000","last_fullsized":"2023-10-06T11:13:17.151224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142862+0000","last_change":"2023-10-06T11:13:13.122337+0000","last_active":"2023-10-06T11:13:17.142862+0000","last_peered":"2023-10-06T11:13:17.142862+0000","last_clean":"2023-10-06T11:13:17.142862+0000","last_became_active":"2023-10-06T11:13:13.122081+0000","last_became_peered":"2023-10-06T11:13:13.122081+0000","last_unstale":"2023-10-06T11:13:17.142862+0000","last_undegraded":"2023-10-06T11:13:17.142862+0000","last_fullsized":"2023-10-06T11:13:17.142862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:45.496026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166873+0000","last_change":"2023-10-06T11:13:17.157514+0000","last_active":"2023-10-06T11:13:17.166873+0000","last_peered":"2023-10-06T11:13:17.166873+0000","last_clean":"2023-10-06T11:13:17.166873+0000","last_became_active":"2023-10-06T11:13:17.157113+0000","last_became_peered":"2023-10-06T11:13:17.157113+0000","last_unstale":"2023-10-06T11:13:17.166873+0000","last_undegraded":"2023-10-06T11:13:17.166873+0000","last_fullsized":"2023-10-06T11:13:17.166873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:21:57.844604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144634+0000","last_change":"2023-10-06T11:13:12.117257+0000","last_active":"2023-10-06T11:13:17.144634+0000","last_peered":"2023-10-06T11:13:17.144634+0000","last_clean":"2023-10-06T11:13:17.144634+0000","last_became_active":"2023-10-06T11:13:12.116987+0000","last_became_peered":"2023-10-06T11:13:12.116987+0000","last_unstale":"2023-10-06T11:13:17.144634+0000","last_undegraded":"2023-10-06T11:13:17.144634+0000","last_fullsized":"2023-10-06T11:13:17.144634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152020+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:13:17.152020+0000","last_peered":"2023-10-06T11:13:17.152020+0000","last_clean":"2023-10-06T11:13:17.152020+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:13:17.152020+0000","last_undegraded":"2023-10-06T11:13:17.152020+0000","last_fullsized":"2023-10-06T11:13:17.152020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143909+0000","last_change":"2023-10-06T11:13:13.129882+0000","last_active":"2023-10-06T11:13:17.143909+0000","last_peered":"2023-10-06T11:13:17.143909+0000","last_clean":"2023-10-06T11:13:17.143909+0000","last_became_active":"2023-10-06T11:13:13.129592+0000","last_became_peered":"2023-10-06T11:13:13.129592+0000","last_unstale":"2023-10-06T11:13:17.143909+0000","last_undegraded":"2023-10-06T11:13:17.143909+0000","last_fullsized":"2023-10-06T11:13:17.143909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.158501+0000","last_change":"2023-10-06T11:13:17.156066+0000","last_active":"2023-10-06T11:13:17.158501+0000","last_peered":"2023-10-06T11:13:17.158501+0000","last_clean":"2023-10-06T11:13:17.158501+0000","last_became_active":"2023-10-06T11:13:17.155623+0000","last_became_peered":"2023-10-06T11:13:17.155623+0000","last_unstale":"2023-10-06T11:13:17.158501+0000","last_undegraded":"2023-10-06T11:13:17.158501+0000","last_fullsized":"2023-10-06T11:13:17.158501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:42.726790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144618+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:13:17.144618+0000","last_peered":"2023-10-06T11:13:17.144618+0000","last_clean":"2023-10-06T11:13:17.144618+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:13:17.144618+0000","last_undegraded":"2023-10-06T11:13:17.144618+0000","last_fullsized":"2023-10-06T11:13:17.144618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168135+0000","last_change":"2023-10-06T11:13:12.109073+0000","last_active":"2023-10-06T11:13:17.168135+0000","last_peered":"2023-10-06T11:13:17.168135+0000","last_clean":"2023-10-06T11:13:17.168135+0000","last_became_active":"2023-10-06T11:13:12.108687+0000","last_became_peered":"2023-10-06T11:13:12.108687+0000","last_unstale":"2023-10-06T11:13:17.168135+0000","last_undegraded":"2023-10-06T11:13:17.168135+0000","last_fullsized":"2023-10-06T11:13:17.168135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:53.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142725+0000","last_change":"2023-10-06T11:13:13.113909+0000","last_active":"2023-10-06T11:13:17.142725+0000","last_peered":"2023-10-06T11:13:17.142725+0000","last_clean":"2023-10-06T11:13:17.142725+0000","last_became_active":"2023-10-06T11:13:13.113579+0000","last_became_peered":"2023-10-06T11:13:13.113579+0000","last_unstale":"2023-10-06T11:13:17.142725+0000","last_undegraded":"2023-10-06T11:13:17.142725+0000","last_fullsized":"2023-10-06T11:13:17.142725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170450+0000","last_change":"2023-10-06T11:13:17.164311+0000","last_active":"2023-10-06T11:13:17.170450+0000","last_peered":"2023-10-06T11:13:17.170450+0000","last_clean":"2023-10-06T11:13:17.170450+0000","last_became_active":"2023-10-06T11:13:17.159765+0000","last_became_peered":"2023-10-06T11:13:17.159765+0000","last_unstale":"2023-10-06T11:13:17.170450+0000","last_undegraded":"2023-10-06T11:13:17.170450+0000","last_fullsized":"2023-10-06T11:13:17.170450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:56:58.648358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145036+0000","last_change":"2023-10-06T11:13:12.108063+0000","last_active":"2023-10-06T11:13:17.145036+0000","last_peered":"2023-10-06T11:13:17.145036+0000","last_clean":"2023-10-06T11:13:17.145036+0000","last_became_active":"2023-10-06T11:13:12.107787+0000","last_became_peered":"2023-10-06T11:13:12.107787+0000","last_unstale":"2023-10-06T11:13:17.145036+0000","last_undegraded":"2023-10-06T11:13:17.145036+0000","last_fullsized":"2023-10-06T11:13:17.145036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.137088+0000","last_change":"2023-10-06T11:13:13.128167+0000","last_active":"2023-10-06T11:13:17.137088+0000","last_peered":"2023-10-06T11:13:17.137088+0000","last_clean":"2023-10-06T11:13:17.137088+0000","last_became_active":"2023-10-06T11:13:13.127699+0000","last_became_peered":"2023-10-06T11:13:13.127699+0000","last_unstale":"2023-10-06T11:13:17.137088+0000","last_undegraded":"2023-10-06T11:13:17.137088+0000","last_fullsized":"2023-10-06T11:13:17.137088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:49.518740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.161638+0000","last_change":"2023-10-06T11:13:17.158623+0000","last_active":"2023-10-06T11:13:17.161638+0000","last_peered":"2023-10-06T11:13:17.161638+0000","last_clean":"2023-10-06T11:13:17.161638+0000","last_became_active":"2023-10-06T11:13:17.158283+0000","last_became_peered":"2023-10-06T11:13:17.158283+0000","last_unstale":"2023-10-06T11:13:17.161638+0000","last_undegraded":"2023-10-06T11:13:17.161638+0000","last_fullsized":"2023-10-06T11:13:17.161638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.150057+0000","last_change":"2023-10-06T11:13:12.105330+0000","last_active":"2023-10-06T11:13:17.150057+0000","last_peered":"2023-10-06T11:13:17.150057+0000","last_clean":"2023-10-06T11:13:17.150057+0000","last_became_active":"2023-10-06T11:13:12.104918+0000","last_became_peered":"2023-10-06T11:13:12.104918+0000","last_unstale":"2023-10-06T11:13:17.150057+0000","last_undegraded":"2023-10-06T11:13:17.150057+0000","last_fullsized":"2023-10-06T11:13:17.150057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:48.508077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143214+0000","last_change":"2023-10-06T11:13:13.113277+0000","last_active":"2023-10-06T11:13:17.143214+0000","last_peered":"2023-10-06T11:13:17.143214+0000","last_clean":"2023-10-06T11:13:17.143214+0000","last_became_active":"2023-10-06T11:13:13.112996+0000","last_became_peered":"2023-10-06T11:13:13.112996+0000","last_unstale":"2023-10-06T11:13:17.143214+0000","last_undegraded":"2023-10-06T11:13:17.143214+0000","last_fullsized":"2023-10-06T11:13:17.143214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:04.087561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.168692+0000","last_change":"2023-10-06T11:13:17.164841+0000","last_active":"2023-10-06T11:13:17.168692+0000","last_peered":"2023-10-06T11:13:17.168692+0000","last_clean":"2023-10-06T11:13:17.168692+0000","last_became_active":"2023-10-06T11:13:17.164169+0000","last_became_peered":"2023-10-06T11:13:17.164169+0000","last_unstale":"2023-10-06T11:13:17.168692+0000","last_undegraded":"2023-10-06T11:13:17.168692+0000","last_fullsized":"2023-10-06T11:13:17.168692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:43.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.152685+0000","last_change":"2023-10-06T11:13:12.106402+0000","last_active":"2023-10-06T11:13:17.152685+0000","last_peered":"2023-10-06T11:13:17.152685+0000","last_clean":"2023-10-06T11:13:17.152685+0000","last_became_active":"2023-10-06T11:13:12.106112+0000","last_became_peered":"2023-10-06T11:13:12.106112+0000","last_unstale":"2023-10-06T11:13:17.152685+0000","last_undegraded":"2023-10-06T11:13:17.152685+0000","last_fullsized":"2023-10-06T11:13:17.152685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:29.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142627+0000","last_change":"2023-10-06T11:13:13.112738+0000","last_active":"2023-10-06T11:13:17.142627+0000","last_peered":"2023-10-06T11:13:17.142627+0000","last_clean":"2023-10-06T11:13:17.142627+0000","last_became_active":"2023-10-06T11:13:13.112481+0000","last_became_peered":"2023-10-06T11:13:13.112481+0000","last_unstale":"2023-10-06T11:13:17.142627+0000","last_undegraded":"2023-10-06T11:13:17.142627+0000","last_fullsized":"2023-10-06T11:13:17.142627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:18.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.166864+0000","last_change":"2023-10-06T11:13:17.157509+0000","last_active":"2023-10-06T11:13:17.166864+0000","last_peered":"2023-10-06T11:13:17.166864+0000","last_clean":"2023-10-06T11:13:17.166864+0000","last_became_active":"2023-10-06T11:13:17.156662+0000","last_became_peered":"2023-10-06T11:13:17.156662+0000","last_unstale":"2023-10-06T11:13:17.166864+0000","last_undegraded":"2023-10-06T11:13:17.166864+0000","last_fullsized":"2023-10-06T11:13:17.166864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:05.195662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144326+0000","last_change":"2023-10-06T11:13:12.101845+0000","last_active":"2023-10-06T11:13:17.144326+0000","last_peered":"2023-10-06T11:13:17.144326+0000","last_clean":"2023-10-06T11:13:17.144326+0000","last_became_active":"2023-10-06T11:13:12.101436+0000","last_became_peered":"2023-10-06T11:13:12.101436+0000","last_unstale":"2023-10-06T11:13:17.144326+0000","last_undegraded":"2023-10-06T11:13:17.144326+0000","last_fullsized":"2023-10-06T11:13:17.144326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:09.983279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143534+0000","last_change":"2023-10-06T11:13:13.123861+0000","last_active":"2023-10-06T11:13:17.143534+0000","last_peered":"2023-10-06T11:13:17.143534+0000","last_clean":"2023-10-06T11:13:17.143534+0000","last_became_active":"2023-10-06T11:13:13.123660+0000","last_became_peered":"2023-10-06T11:13:13.123660+0000","last_unstale":"2023-10-06T11:13:17.143534+0000","last_undegraded":"2023-10-06T11:13:17.143534+0000","last_fullsized":"2023-10-06T11:13:17.143534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.323774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.170721+0000","last_change":"2023-10-06T11:13:17.165451+0000","last_active":"2023-10-06T11:13:17.170721+0000","last_peered":"2023-10-06T11:13:17.170721+0000","last_clean":"2023-10-06T11:13:17.170721+0000","last_became_active":"2023-10-06T11:13:17.165075+0000","last_became_peered":"2023-10-06T11:13:17.165075+0000","last_unstale":"2023-10-06T11:13:17.170721+0000","last_undegraded":"2023-10-06T11:13:17.170721+0000","last_fullsized":"2023-10-06T11:13:17.170721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:16.129270+0000","last_clean_scrub_stamp":"2023-10-06T11:13:16.129270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:25.391622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.145478+0000","last_change":"2023-10-06T11:13:12.107593+0000","last_active":"2023-10-06T11:13:17.145478+0000","last_peered":"2023-10-06T11:13:17.145478+0000","last_clean":"2023-10-06T11:13:17.145478+0000","last_became_active":"2023-10-06T11:13:12.107352+0000","last_became_peered":"2023-10-06T11:13:12.107352+0000","last_unstale":"2023-10-06T11:13:17.145478+0000","last_undegraded":"2023-10-06T11:13:17.145478+0000","last_fullsized":"2023-10-06T11:13:17.145478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:11.076137+0000","last_clean_scrub_stamp":"2023-10-06T11:13:11.076137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:38.933940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.142457+0000","last_change":"2023-10-06T11:13:13.125513+0000","last_active":"2023-10-06T11:13:17.142457+0000","last_peered":"2023-10-06T11:13:17.142457+0000","last_clean":"2023-10-06T11:13:17.142457+0000","last_became_active":"2023-10-06T11:13:13.125218+0000","last_became_peered":"2023-10-06T11:13:13.125218+0000","last_unstale":"2023-10-06T11:13:17.142457+0000","last_undegraded":"2023-10-06T11:13:17.142457+0000","last_fullsized":"2023-10-06T11:13:17.142457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:15:38.222422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.140901+0000","last_change":"2023-10-06T11:13:13.127823+0000","last_active":"2023-10-06T11:13:17.140901+0000","last_peered":"2023-10-06T11:13:17.140901+0000","last_clean":"2023-10-06T11:13:17.140901+0000","last_became_active":"2023-10-06T11:13:13.127598+0000","last_became_peered":"2023-10-06T11:13:13.127598+0000","last_unstale":"2023-10-06T11:13:17.140901+0000","last_undegraded":"2023-10-06T11:13:17.140901+0000","last_fullsized":"2023-10-06T11:13:17.140901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:14:05.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143675+0000","last_change":"2023-10-06T11:13:13.128681+0000","last_active":"2023-10-06T11:13:17.143675+0000","last_peered":"2023-10-06T11:13:17.143675+0000","last_clean":"2023-10-06T11:13:17.143675+0000","last_became_active":"2023-10-06T11:13:13.128410+0000","last_became_peered":"2023-10-06T11:13:13.128410+0000","last_unstale":"2023-10-06T11:13:17.143675+0000","last_undegraded":"2023-10-06T11:13:17.143675+0000","last_fullsized":"2023-10-06T11:13:17.143675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:41.375968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.144507+0000","last_change":"2023-10-06T11:13:13.122593+0000","last_active":"2023-10-06T11:13:17.144507+0000","last_peered":"2023-10-06T11:13:17.144507+0000","last_clean":"2023-10-06T11:13:17.144507+0000","last_became_active":"2023-10-06T11:13:13.122348+0000","last_became_peered":"2023-10-06T11:13:13.122348+0000","last_unstale":"2023-10-06T11:13:17.144507+0000","last_undegraded":"2023-10-06T11:13:17.144507+0000","last_fullsized":"2023-10-06T11:13:17.144507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:42.518365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.143721+0000","last_change":"2023-10-06T11:13:13.125197+0000","last_active":"2023-10-06T11:13:17.143721+0000","last_peered":"2023-10-06T11:13:17.143721+0000","last_clean":"2023-10-06T11:13:17.143721+0000","last_became_active":"2023-10-06T11:13:13.124919+0000","last_became_peered":"2023-10-06T11:13:13.124919+0000","last_unstale":"2023-10-06T11:13:17.143721+0000","last_undegraded":"2023-10-06T11:13:17.143721+0000","last_fullsized":"2023-10-06T11:13:17.143721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.635318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T11:13:17.151139+0000","last_change":"2023-10-06T11:13:13.127447+0000","last_active":"2023-10-06T11:13:17.151139+0000","last_peered":"2023-10-06T11:13:17.151139+0000","last_clean":"2023-10-06T11:13:17.151139+0000","last_became_active":"2023-10-06T11:13:13.127144+0000","last_became_peered":"2023-10-06T11:13:13.127144+0000","last_unstale":"2023-10-06T11:13:17.151139+0000","last_undegraded":"2023-10-06T11:13:17.151139+0000","last_fullsized":"2023-10-06T11:13:17.151139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:12.086800+0000","last_clean_scrub_stamp":"2023-10-06T11:13:12.086800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:51.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298192,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073648,"statfs":{"total":96636764160,"available":96331415552,"internally_reserved":0,"allocated":925696,"data_stored":718530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":901120,"data_stored":715154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":303104,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":307200,"data_stored":124322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":128002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":124856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:13:32.358 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T11:13:32.359 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T11:13:32.359 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T11:13:32.359 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T11:13:32.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.508+0000 7f080d4ec700 1 Processor -- start 2023-10-06T11:13:32.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.508+0000 7f080d4ec700 1 -- start start 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.508+0000 7f080d4ec700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0808159560 0x7f08080aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f080d4ec700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08080b49a0 0x7f08080aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f080d4ec700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b0760 0x7f08080b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f080d4ec700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080b0c60 con 0x7f08080b49a0 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f080d4ec700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080b0f40 con 0x7f0808159560 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f080d4ec700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08080b1220 con 0x7f08080b0760 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08080b49a0 0x7f08080aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08080b49a0 0x7f08080aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37568/0 (socket says 172.21.15.55:37568) 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 -- 172.21.15.55:0/4273350248 learned_addr learned my addr 172.21.15.55:0/4273350248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08077fe700 1 --2- 172.21.15.55:0/4273350248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b0760 0x7f08080b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f0806ffd700 1 --2- 172.21.15.55:0/4273350248 >> v2:172.21.15.142:3300/0 conn(0x7f0808159560 0x7f08080aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 -- 172.21.15.55:0/4273350248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b0760 msgr2=0x7f08080b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 --2- 172.21.15.55:0/4273350248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b0760 0x7f08080b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 -- 172.21.15.55:0/4273350248 >> v2:172.21.15.142:3300/0 conn(0x7f0808159560 msgr2=0x7f08080aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 --2- 172.21.15.55:0/4273350248 >> v2:172.21.15.142:3300/0 conn(0x7f0808159560 0x7f08080aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 -- 172.21.15.55:0/4273350248 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08080b1500 con 0x7f08080b49a0 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f0806ffd700 1 --2- 172.21.15.55:0/4273350248 >> v2:172.21.15.142:3300/0 conn(0x7f0808159560 0x7f08080aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f08067fc700 1 --2- 172.21.15.55:0/4273350248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08080b49a0 0x7f08080aaa70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07f00099b0 tx=0x7f07f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e044ef401a767a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f0805ffb700 1 -- 172.21.15.55:0/4273350248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0009ea0 con 0x7f08080b49a0 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.509+0000 7f0805ffb700 1 -- 172.21.15.55:0/4273350248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f000b820 con 0x7f08080b49a0 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f0805ffb700 1 -- 172.21.15.55:0/4273350248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000bbc0 con 0x7f08080b49a0 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 -- 172.21.15.55:0/4273350248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08080b49a0 msgr2=0x7f08080aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 --2- 172.21.15.55:0/4273350248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08080b49a0 0x7f08080aaa70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07f00099b0 tx=0x7f07f0009250 comp rx=0 tx=0).stop 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 -- 172.21.15.55:0/4273350248 shutdown_connections 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 --2- 172.21.15.55:0/4273350248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b0760 0x7f08080b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 --2- 172.21.15.55:0/4273350248 >> v2:172.21.15.142:3300/0 conn(0x7f0808159560 0x7f08080aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 --2- 172.21.15.55:0/4273350248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08080b49a0 0x7f08080aaa70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 -- 172.21.15.55:0/4273350248 >> 172.21.15.55:0/4273350248 conn(0x7f08080997f0 msgr2=0x7f080806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 -- 172.21.15.55:0/4273350248 shutdown_connections 2023-10-06T11:13:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.510+0000 7f080d4ec700 1 -- 172.21.15.55:0/4273350248 wait complete. 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.511+0000 7f080d4ec700 1 Processor -- start 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.511+0000 7f080d4ec700 1 -- start start 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f080d4ec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08080b0760 0x7f0808153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f080d4ec700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b49a0 0x7f080814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f080d4ec700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 0x7f0808157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f080d4ec700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080815afc0 con 0x7f0808159560 2023-10-06T11:13:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f080d4ec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808153210 con 0x7f08080b0760 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f080d4ec700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080815ab30 con 0x7f08080b49a0 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f08077fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 0x7f0808157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f08077fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 0x7f0808157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37580/0 (socket says 172.21.15.55:37580) 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f08077fe700 1 -- 172.21.15.55:0/560769416 learned_addr learned my addr 172.21.15.55:0/560769416 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f0806ffd700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08080b0760 0x7f0808153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.512+0000 7f08067fc700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b49a0 0x7f080814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f08077fe700 1 -- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b49a0 msgr2=0x7f080814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f08077fe700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b49a0 0x7f080814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f08077fe700 1 -- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08080b0760 msgr2=0x7f0808153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f08077fe700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08080b0760 0x7f0808153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f08077fe700 1 -- 172.21.15.55:0/560769416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00094f0 con 0x7f0808159560 2023-10-06T11:13:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f08077fe700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 0x7f0808157750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07f800ea50 tx=0x7f07f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800ee90 con 0x7f0808159560 2023-10-06T11:13:32.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f800c7f0 con 0x7f0808159560 2023-10-06T11:13:32.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080814e170 con 0x7f0808159560 2023-10-06T11:13:32.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800cbb0 con 0x7f0808159560 2023-10-06T11:13:32.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.513+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080815a200 con 0x7f0808159560 2023-10-06T11:13:32.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.514+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0808064a90 con 0x7f0808159560 2023-10-06T11:13:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.514+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07f8013470 con 0x7f0808159560 2023-10-06T11:13:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.515+0000 7f07feffd700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f07e8066f30 0x7f07e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.515+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f07f8084f80 con 0x7f0808159560 2023-10-06T11:13:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.515+0000 7f0806ffd700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f07e8066f30 0x7f07e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.516+0000 7f0806ffd700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f07e8066f30 0x7f07e80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0800007700 tx=0x7f0800009980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.519+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07f8051d00 con 0x7f0808159560 2023-10-06T11:13:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.755+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f08080b17e0 con 0x7f0808159560 2023-10-06T11:13:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.756+0000 7f07feffd700 1 -- 172.21.15.55:0/560769416 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f07f8017040 con 0x7f0808159560 2023-10-06T11:13:32.757 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:32.758 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T11:13:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f07e8066f30 msgr2=0x7f07e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f07e8066f30 0x7f07e80693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0800007700 tx=0x7f0800009980 comp rx=0 tx=0).stop 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 msgr2=0x7f0808157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 0x7f0808157750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07f800ea50 tx=0x7f07f80091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 shutdown_connections 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f07e8066f30 0x7f07e80693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0808159560 0x7f0808157750 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08080b0760 0x7f0808153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 --2- 172.21.15.55:0/560769416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08080b49a0 0x7f080814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 >> 172.21.15.55:0/560769416 conn(0x7f08080997f0 msgr2=0x7f0808158970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 shutdown_connections 2023-10-06T11:13:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.758+0000 7f080d4ec700 1 -- 172.21.15.55:0/560769416 wait complete. 2023-10-06T11:13:32.771 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T11:13:32.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.889+0000 7fdfc0d59700 1 Processor -- start 2023-10-06T11:13:32.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.889+0000 7fdfc0d59700 1 -- start start 2023-10-06T11:13:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfc0d59700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfbc0cbc30 0x7fdfbc0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfc0d59700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0cb7a0 con 0x7fdfbc159440 2023-10-06T11:13:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfc0d59700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0b0860 con 0x7fdfbc0b2100 2023-10-06T11:13:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfc0d59700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0cb150 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbaffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfbc0cbc30 0x7fdfbc0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbb7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdfbc159440 0x7fdfbc0b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53710/0 (socket says 172.21.15.55:53710) 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbb7fe700 1 -- 172.21.15.55:0/3380804885 learned_addr learned my addr 172.21.15.55:0/3380804885 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbaffd700 1 -- 172.21.15.55:0/3380804885 >> v1:172.21.15.142:6789/0 conn(0x7fdfbc0b2100 legacy=0x7fdfbc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbaffd700 1 -- 172.21.15.55:0/3380804885 >> v1:172.21.15.55:6789/0 conn(0x7fdfbc159440 legacy=0x7fdfbc0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbaffd700 1 -- 172.21.15.55:0/3380804885 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0cb430 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfba7fc700 1 -- 172.21.15.55:0/3380804885 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727109152 0 0) 0x7fdfbc0cb7a0 con 0x7fdfbc159440 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.890+0000 7fdfbaffd700 1 --2- 172.21.15.55:0/3380804885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc0cc080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0956995003b8cfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfba7fc700 1 -- 172.21.15.55:0/3380804885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0009e80 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfba7fc700 1 -- 172.21.15.55:0/3380804885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000b860 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfba7fc700 1 -- 172.21.15.55:0/3380804885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000bbe0 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 -- 172.21.15.55:0/3380804885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 msgr2=0x7fdfbc0cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/3380804885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc0cc080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb00091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 -- 172.21.15.55:0/3380804885 shutdown_connections 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/3380804885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc0cc080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 -- 172.21.15.55:0/3380804885 >> 172.21.15.55:0/3380804885 conn(0x7fdfbc06ece0 msgr2=0x7fdfbc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 -- 172.21.15.55:0/3380804885 shutdown_connections 2023-10-06T11:13:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.891+0000 7fdfc0d59700 1 -- 172.21.15.55:0/3380804885 wait complete. 2023-10-06T11:13:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.892+0000 7fdfc0d59700 1 Processor -- start 2023-10-06T11:13:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.892+0000 7fdfc0d59700 1 -- start start 2023-10-06T11:13:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfc0d59700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfbc0b2100 0x7fdfbc155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfc0d59700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfc0d59700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfbc159440 0x7fdfbc16cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfc0d59700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc15a2a0 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfc0d59700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc15a820 con 0x7fdfbc0b2100 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfc0d59700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc16d810 con 0x7fdfbc159440 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfbaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfbaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc15acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37610/0 (socket says 172.21.15.55:37610) 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfbaffd700 1 -- 172.21.15.55:0/1879768295 learned_addr learned my addr 172.21.15.55:0/1879768295 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfbb7fe700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfbc0b2100 0x7fdfbc155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.893+0000 7fdfbbfff700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfbc159440 0x7fdfbc16cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfbaffd700 1 -- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfbc159440 msgr2=0x7fdfbc16cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfbaffd700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfbc159440 0x7fdfbc16cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfbaffd700 1 -- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfbc0b2100 msgr2=0x7fdfbc155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfbaffd700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfbc0b2100 0x7fdfbc155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfbaffd700 1 -- 172.21.15.55:0/1879768295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009420 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfbaffd700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc15acb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000b3c0 tx=0x7fdfb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb001f070 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0000c90 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc16daf0 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0025420 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.894+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc155e90 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.895+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc05f230 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.895+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfb0023070 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.896+0000 7fdfa37fe700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.896+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdfb0085e80 con 0x7fdfbc0cbc30 2023-10-06T11:13:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.896+0000 7fdfbb7fe700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.897+0000 7fdfbb7fe700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa8066f30 0x7fdfa80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0b5010 tx=0x7fdfac007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:32.900+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfb0052ca0 con 0x7fdfbc0cbc30 2023-10-06T11:13:33.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.095+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfbc15a960 con 0x7fdfbc0cbc30 2023-10-06T11:13:33.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.095+0000 7fdfa37fe700 1 -- 172.21.15.55:0/1879768295 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fdfb002a020 con 0x7fdfbc0cbc30 2023-10-06T11:13:33.097 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:33.097 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:33.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa8066f30 msgr2=0x7fdfa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa8066f30 0x7fdfa80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0b5010 tx=0x7fdfac007f30 comp rx=0 tx=0).stop 2023-10-06T11:13:33.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 msgr2=0x7fdfbc15acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc15acb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000b3c0 tx=0x7fdfb0017000 comp rx=0 tx=0).stop 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 shutdown_connections 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa8066f30 0x7fdfa80693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfbc159440 0x7fdfbc16cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfbc0b2100 0x7fdfbc155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 --2- 172.21.15.55:0/1879768295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfbc0cbc30 0x7fdfbc15acb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 >> 172.21.15.55:0/1879768295 conn(0x7fdfbc06ece0 msgr2=0x7fdfbc0b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 shutdown_connections 2023-10-06T11:13:33.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.097+0000 7fdfc0d59700 1 -- 172.21.15.55:0/1879768295 wait complete. 2023-10-06T11:13:33.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:33.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.235+0000 7fa8eda9e700 1 Processor -- start 2023-10-06T11:13:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.235+0000 7fa8eda9e700 1 -- start start 2023-10-06T11:13:33.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8eda9e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 0x7fa8e80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8eda9e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8e80cd020 0x7fa8e80c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8eda9e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e80cbb80 con 0x7fa8e8159840 2023-10-06T11:13:33.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8eda9e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e80c6f00 con 0x7fa8e80cd020 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8eda9e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80cb530 con 0x7fa8e8159470 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e6ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8e8159840 0x7fa8e80c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53726/0 (socket says 172.21.15.55:53726) 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e6ffd700 1 -- 172.21.15.55:0/4208699788 learned_addr learned my addr 172.21.15.55:0/4208699788 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122033142 0 0) 0x7fa8e80cbb80 con 0x7fa8e8159840 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 0x7fa8e80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d0003570 con 0x7fa8e8159840 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e7fff700 1 --2- 172.21.15.55:0/4208699788 >> v2:172.21.15.142:3300/0 conn(0x7fa8e80cd020 0x7fa8e80c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 158359181 0 0) 0x7fa8d0003570 con 0x7fa8e8159840 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 msgr2=0x7fa8e80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 0x7fa8e80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 >> v2:172.21.15.142:3300/0 conn(0x7fa8e80cd020 msgr2=0x7fa8e80c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 --2- 172.21.15.55:0/4208699788 >> v2:172.21.15.142:3300/0 conn(0x7fa8e80cd020 0x7fa8e80c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80cb810 con 0x7fa8e8159840 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fa8dc001470 con 0x7fa8e8159840 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.236+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 >> v1:172.21.15.55:6789/0 conn(0x7fa8e8159840 legacy=0x7fa8e80c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d0003a60 0x7fa8d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 0x7fa8d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d0004d50 0x7fa8d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80c6f00 con 0x7fa8d0003a60 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80cb530 con 0x7fa8d0004d50 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d000ba60 con 0x7fa8e8159470 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d0003a60 0x7fa8d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e6ffd700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 0x7fa8d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e7fff700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d0004d50 0x7fa8d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 -- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 msgr2=0x7fa8d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8159470 0x7fa8d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 -- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d0004d50 msgr2=0x7fa8d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d0004d50 0x7fa8d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 -- 172.21.15.55:0/4208699788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0003570 con 0x7fa8d0003a60 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d0003a60 0x7fa8d0003e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009bf0 tx=0x7fa8d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be9d431b92e5155 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8005a00 con 0x7fa8d0003a60 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8005b60 con 0x7fa8d0003a60 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.237+0000 7fa8e67fc700 1 -- 172.21.15.55:0/4208699788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800e6b0 con 0x7fa8d0003a60 2023-10-06T11:13:33.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8eda9e700 1 -- 172.21.15.55:0/4208699788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d0003a60 msgr2=0x7fa8d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/4208699788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d0003a60 0x7fa8d0003e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009bf0 tx=0x7fa8d8009120 comp rx=0 tx=0).stop 2023-10-06T11:13:33.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8e7fff700 1 -- 172.21.15.55:0/4208699788 reap_dead start 2023-10-06T11:13:33.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8eda9e700 1 -- 172.21.15.55:0/4208699788 shutdown_connections 2023-10-06T11:13:33.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8eda9e700 1 -- 172.21.15.55:0/4208699788 >> 172.21.15.55:0/4208699788 conn(0x7fa8e80996e0 msgr2=0x7fa8e806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8eda9e700 1 -- 172.21.15.55:0/4208699788 shutdown_connections 2023-10-06T11:13:33.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.238+0000 7fa8eda9e700 1 -- 172.21.15.55:0/4208699788 wait complete. 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.239+0000 7fa8eda9e700 1 Processor -- start 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.239+0000 7fa8eda9e700 1 -- start start 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8eda9e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 0x7fa8e8156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8eda9e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e8147260 0x7fa8e8156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8eda9e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8157930 0x7fa8e8169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8eda9e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e816ac40 con 0x7fa8e8146e90 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8eda9e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e81560a0 con 0x7fa8e8147260 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8eda9e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8157dc0 con 0x7fa8e8157930 2023-10-06T11:13:33.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 0x7fa8e8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 0x7fa8e8156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37638/0 (socket says 172.21.15.55:37638) 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 -- 172.21.15.55:0/144079136 learned_addr learned my addr 172.21.15.55:0/144079136 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e6ffd700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e8147260 0x7fa8e8156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e7fff700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8157930 0x7fa8e8169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 -- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8157930 msgr2=0x7fa8e8169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8157930 0x7fa8e8169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 -- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e8147260 msgr2=0x7fa8e8156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e8147260 0x7fa8e8156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.240+0000 7fa8e77fe700 1 -- 172.21.15.55:0/144079136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8155a50 con 0x7fa8e8146e90 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.241+0000 7fa8e77fe700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 0x7fa8e8156530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0004730 tx=0x7fa8d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.241+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8022070 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.241+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8006240 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.241+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e8155d30 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.241+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800e6b0 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.241+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e816a220 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.242+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e81558a0 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.242+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8d8013470 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.242+0000 7fa8cf7fe700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa8d4066f30 0x7fa8d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.243+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa8d80861c0 con 0x7fa8e8146e90 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.243+0000 7fa8e6ffd700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa8d4066f30 0x7fa8d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.243+0000 7fa8e6ffd700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa8d4066f30 0x7fa8d40693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8e81583d0 tx=0x7fa8dc001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.247+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8d8052f40 con 0x7fa8e8146e90 2023-10-06T11:13:33.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.439+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8e81574d0 con 0x7fa8e8146e90 2023-10-06T11:13:33.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.440+0000 7fa8cf7fe700 1 -- 172.21.15.55:0/144079136 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8d8056560 con 0x7fa8e8146e90 2023-10-06T11:13:33.442 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:33.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa8d4066f30 msgr2=0x7fa8d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa8d4066f30 0x7fa8d40693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8e81583d0 tx=0x7fa8dc001e90 comp rx=0 tx=0).stop 2023-10-06T11:13:33.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 msgr2=0x7fa8e8156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 0x7fa8e8156530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0004730 tx=0x7fa8d8019000 comp rx=0 tx=0).stop 2023-10-06T11:13:33.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 shutdown_connections 2023-10-06T11:13:33.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa8d4066f30 0x7fa8d40693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e8146e90 0x7fa8e8156530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e8157930 0x7fa8e8169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 --2- 172.21.15.55:0/144079136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e8147260 0x7fa8e8156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 >> 172.21.15.55:0/144079136 conn(0x7fa8e80996e0 msgr2=0x7fa8e8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 shutdown_connections 2023-10-06T11:13:33.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.442+0000 7fa8eda9e700 1 -- 172.21.15.55:0/144079136 wait complete. 2023-10-06T11:13:33.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:33.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.576+0000 7fd53b450700 1 Processor -- start 2023-10-06T11:13:33.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.576+0000 7fd53b450700 1 -- start start 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.577+0000 7fd53b450700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 0x7fd534159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.577+0000 7fd53b450700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340b5ef0 con 0x7fd5340b4a20 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.577+0000 7fd53b450700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340b3600 con 0x7fd5340d09e0 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.577+0000 7fd53b450700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340b6380 con 0x7fd5340cd940 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.577+0000 7fd5389eb700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd5340b4a20 0x7fd5340d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53730/0 (socket says 172.21.15.55:53730) 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.577+0000 7fd5389eb700 1 -- 172.21.15.55:0/3027410795 learned_addr learned my addr 172.21.15.55:0/3027410795 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:33.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5391ec700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 0x7fd534159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693928584 0 0) 0x7fd5340b5ef0 con 0x7fd5340b4a20 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd51c003570 con 0x7fd5340b4a20 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962587873 0 0) 0x7fd5340b3600 con 0x7fd5340d09e0 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5340b5ef0 con 0x7fd5340d09e0 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 737409139 0 0) 0x7fd51c003570 con 0x7fd5340b4a20 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 msgr2=0x7fd534159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 0x7fd534159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 >> v1:172.21.15.142:6789/0 conn(0x7fd5340d09e0 legacy=0x7fd534163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340b52e0 con 0x7fd5340b4a20 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fd5280013f0 con 0x7fd5340b4a20 2023-10-06T11:13:33.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 >> v1:172.21.15.55:6789/0 conn(0x7fd5340b4a20 legacy=0x7fd5340d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 0x7fd51c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd51c0041d0 0x7fd51c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51c004d50 0x7fd51c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340b6380 con 0x7fd51c004d50 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c00bbf0 con 0x7fd51c0041d0 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c00bdb0 con 0x7fd5340cd940 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51c004d50 0x7fd51c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5391ec700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 0x7fd51c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5389eb700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd51c0041d0 0x7fd51c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5399ed700 1 -- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 msgr2=0x7fd51c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5340cd940 0x7fd51c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5399ed700 1 -- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd51c0041d0 msgr2=0x7fd51c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd51c0041d0 0x7fd51c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.578+0000 7fd5399ed700 1 -- 172.21.15.55:0/3027410795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c003570 con 0x7fd51c004d50 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51c004d50 0x7fd51c0051c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5240020f0 tx=0x7fd5240017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca917734fe454b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400c8b0 con 0x7fd51c004d50 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400ca10 con 0x7fd51c004d50 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd533fff700 1 -- 172.21.15.55:0/3027410795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400cdb0 con 0x7fd51c004d50 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd53b450700 1 -- 172.21.15.55:0/3027410795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51c004d50 msgr2=0x7fd51c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd53b450700 1 --2- 172.21.15.55:0/3027410795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51c004d50 0x7fd51c0051c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5240020f0 tx=0x7fd5240017a0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd5399ed700 1 -- 172.21.15.55:0/3027410795 reap_dead start 2023-10-06T11:13:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd53b450700 1 -- 172.21.15.55:0/3027410795 shutdown_connections 2023-10-06T11:13:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd53b450700 1 -- 172.21.15.55:0/3027410795 >> 172.21.15.55:0/3027410795 conn(0x7fd53406ece0 msgr2=0x7fd53406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd53b450700 1 -- 172.21.15.55:0/3027410795 shutdown_connections 2023-10-06T11:13:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.579+0000 7fd53b450700 1 -- 172.21.15.55:0/3027410795 wait complete. 2023-10-06T11:13:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.581+0000 7fd53b450700 1 Processor -- start 2023-10-06T11:13:33.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.581+0000 7fd53b450700 1 -- start start 2023-10-06T11:13:33.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.581+0000 7fd53b450700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53413adb0 0x7fd53414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.581+0000 7fd53b450700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd53413b180 0x7fd53414f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.581+0000 7fd53b450700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 0x7fd53415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.581+0000 7fd53b450700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53414c180 con 0x7fd53415e120 2023-10-06T11:13:33.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd53b450700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53414bb70 con 0x7fd53413b180 2023-10-06T11:13:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd53b450700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53415eef0 con 0x7fd53413adb0 2023-10-06T11:13:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 0x7fd53415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 0x7fd53415e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37646/0 (socket says 172.21.15.55:37646) 2023-10-06T11:13:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 -- 172.21.15.55:0/3519864768 learned_addr learned my addr 172.21.15.55:0/3519864768 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5391ec700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53413adb0 0x7fd53414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5389eb700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd53413b180 0x7fd53414f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 -- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53413adb0 msgr2=0x7fd53414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53413adb0 0x7fd53414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 -- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd53413b180 msgr2=0x7fd53414f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd53413b180 0x7fd53414f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 -- 172.21.15.55:0/3519864768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53414be10 con 0x7fd53415e120 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5399ed700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 0x7fd53415e590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0057f0 tx=0x7fd524016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400c6d0 con 0x7fd53415e120 2023-10-06T11:13:33.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524022070 con 0x7fd53415e120 2023-10-06T11:13:33.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53415f1d0 con 0x7fd53415e120 2023-10-06T11:13:33.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524006db0 con 0x7fd53415e120 2023-10-06T11:13:33.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.582+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd534150c00 con 0x7fd53415e120 2023-10-06T11:13:33.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.583+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534064a90 con 0x7fd53415e120 2023-10-06T11:13:33.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.584+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd524003030 con 0x7fd53415e120 2023-10-06T11:13:33.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.584+0000 7fd5317fa700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd520066f60 0x7fd520069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.584+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd5240862b0 con 0x7fd53415e120 2023-10-06T11:13:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.584+0000 7fd5391ec700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd520066f60 0x7fd520069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.585+0000 7fd5391ec700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd520066f60 0x7fd520069410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd52c006f00 tx=0x7fd52c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.588+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5240530d0 con 0x7fd53415e120 2023-10-06T11:13:33.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.781+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5340b55c0 con 0x7fd53415e120 2023-10-06T11:13:33.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.781+0000 7fd5317fa700 1 -- 172.21.15.55:0/3519864768 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5240566f0 con 0x7fd53415e120 2023-10-06T11:13:33.783 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:33.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.783+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd520066f60 msgr2=0x7fd520069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.783+0000 7fd53b450700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd520066f60 0x7fd520069410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd52c006f00 tx=0x7fd52c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.783+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 msgr2=0x7fd53415e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.783+0000 7fd53b450700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 0x7fd53415e590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0057f0 tx=0x7fd524016000 comp rx=0 tx=0).stop 2023-10-06T11:13:33.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 shutdown_connections 2023-10-06T11:13:33.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd520066f60 0x7fd520069410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e120 0x7fd53415e590 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53413adb0 0x7fd53414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 --2- 172.21.15.55:0/3519864768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd53413b180 0x7fd53414f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 >> 172.21.15.55:0/3519864768 conn(0x7fd53406ece0 msgr2=0x7fd5340cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 shutdown_connections 2023-10-06T11:13:33.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.784+0000 7fd53b450700 1 -- 172.21.15.55:0/3519864768 wait complete. 2023-10-06T11:13:33.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.919+0000 7f69e954a700 1 Processor -- start 2023-10-06T11:13:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.919+0000 7f69e954a700 1 -- start start 2023-10-06T11:13:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e954a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69e40b05d0 0x7f69e40cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e954a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 0x7f69e40c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e954a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e40cadd0 con 0x7f69e40ccc50 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e954a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e40cd0f0 con 0x7f69e40b05d0 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e954a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41577d0 con 0x7f69e40c9580 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69e40ccc50 0x7f69e40c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53740/0 (socket says 172.21.15.55:53740) 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e37fe700 1 -- 172.21.15.55:0/2861768326 learned_addr learned my addr 172.21.15.55:0/2861768326 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e3fff700 1 --2- 172.21.15.55:0/2861768326 >> v2:172.21.15.142:3300/0 conn(0x7f69e40b05d0 0x7f69e40cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.920+0000 7f69e8d49700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 0x7f69e40c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080196357 0 0) 0x7f69e40cadd0 con 0x7f69e40ccc50 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc003570 con 0x7f69e40ccc50 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 518976378 0 0) 0x7f69cc003570 con 0x7f69e40ccc50 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 msgr2=0x7f69e40c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 0x7f69e40c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 >> v2:172.21.15.142:3300/0 conn(0x7f69e40b05d0 msgr2=0x7f69e40cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/2861768326 >> v2:172.21.15.142:3300/0 conn(0x7f69e40b05d0 0x7f69e40cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40c9ae0 con 0x7f69e40ccc50 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f69d40015f0 con 0x7f69e40ccc50 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 >> v1:172.21.15.55:6789/0 conn(0x7f69e40ccc50 legacy=0x7f69e40c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 0x7f69cc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc003fe0 0x7f69cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc004d50 0x7f69cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40cd0f0 con 0x7f69cc004d50 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41577d0 con 0x7f69cc003fe0 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc00ba90 con 0x7f69e40c9580 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e8d49700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc004d50 0x7f69cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e3fff700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 0x7f69cc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e37fe700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc003fe0 0x7f69cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e8d49700 1 -- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 msgr2=0x7f69cc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e8d49700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c9580 0x7f69cc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e8d49700 1 -- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc003fe0 msgr2=0x7f69cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e8d49700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc003fe0 0x7f69cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.921+0000 7f69e8d49700 1 -- 172.21.15.55:0/2861768326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc003570 con 0x7f69cc004d50 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e8d49700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc004d50 0x7f69cc0051c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00e210 tx=0x7f69dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e64814057321108 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00ea60 con 0x7f69cc004d50 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc00f040 con 0x7f69cc004d50 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e2ffd700 1 -- 172.21.15.55:0/2861768326 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00ee10 con 0x7f69cc004d50 2023-10-06T11:13:33.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e954a700 1 -- 172.21.15.55:0/2861768326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc004d50 msgr2=0x7f69cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e954a700 1 --2- 172.21.15.55:0/2861768326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc004d50 0x7f69cc0051c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00e210 tx=0x7f69dc00b040 comp rx=0 tx=0).stop 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e8d49700 1 -- 172.21.15.55:0/2861768326 reap_dead start 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e954a700 1 -- 172.21.15.55:0/2861768326 shutdown_connections 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e954a700 1 -- 172.21.15.55:0/2861768326 >> 172.21.15.55:0/2861768326 conn(0x7f69e4096a30 msgr2=0x7f69e4096e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e954a700 1 -- 172.21.15.55:0/2861768326 shutdown_connections 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.922+0000 7f69e954a700 1 -- 172.21.15.55:0/2861768326 wait complete. 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.923+0000 7f69e954a700 1 Processor -- start 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.923+0000 7f69e954a700 1 -- start start 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e954a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e414edf0 0x7f69e40c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e954a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c5b80 0x7f69e415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e954a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 0x7f69e415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e954a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4068ca0 con 0x7f69e414f1c0 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e954a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40c6620 con 0x7f69e414edf0 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e954a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40c6060 con 0x7f69e40c5b80 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e8d49700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 0x7f69e415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e8d49700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 0x7f69e415c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37666/0 (socket says 172.21.15.55:37666) 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e8d49700 1 -- 172.21.15.55:0/1461772912 learned_addr learned my addr 172.21.15.55:0/1461772912 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e37fe700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c5b80 0x7f69e415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.924+0000 7f69e3fff700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e414edf0 0x7f69e40c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e8d49700 1 -- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c5b80 msgr2=0x7f69e415bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e8d49700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c5b80 0x7f69e415bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e8d49700 1 -- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e414edf0 msgr2=0x7f69e40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e8d49700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e414edf0 0x7f69e40c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e8d49700 1 -- 172.21.15.55:0/1461772912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40c6340 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e37fe700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c5b80 0x7f69e415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e3fff700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e414edf0 0x7f69e40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e8d49700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 0x7f69e415c260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69dc016000 tx=0x7f69dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00eee0 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc022070 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4068930 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0276a0 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.925+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e40b1ea0 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.926+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e4068770 con 0x7f69e414f1c0 2023-10-06T11:13:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.927+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69dc024030 con 0x7f69e414f1c0 2023-10-06T11:13:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.928+0000 7f69cbfff700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69d0066f30 0x7f69d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.928+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f69dc086e80 con 0x7f69e414f1c0 2023-10-06T11:13:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.928+0000 7f69e3fff700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69d0066f30 0x7f69d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.929+0000 7f69e3fff700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69d0066f30 0x7f69d00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69d8006f00 tx=0x7f69d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:33.931+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69dc053d20 con 0x7f69e414f1c0 2023-10-06T11:13:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.125+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69e405f230 con 0x7f69e414f1c0 2023-10-06T11:13:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.126+0000 7f69cbfff700 1 -- 172.21.15.55:0/1461772912 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69dc057340 con 0x7f69e414f1c0 2023-10-06T11:13:34.127 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69d0066f30 msgr2=0x7f69d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69d0066f30 0x7f69d00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69d8006f00 tx=0x7f69d8008040 comp rx=0 tx=0).stop 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 msgr2=0x7f69e415c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 0x7f69e415c260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69dc016000 tx=0x7f69dc01a000 comp rx=0 tx=0).stop 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 shutdown_connections 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69d0066f30 0x7f69d00693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e414f1c0 0x7f69e415c260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e414edf0 0x7f69e40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 --2- 172.21.15.55:0/1461772912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e40c5b80 0x7f69e415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 >> 172.21.15.55:0/1461772912 conn(0x7f69e4096a30 msgr2=0x7f69e4156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 shutdown_connections 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.128+0000 7f69e954a700 1 -- 172.21.15.55:0/1461772912 wait complete. 2023-10-06T11:13:34.142 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:34.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.262+0000 7f1a8b88b700 1 Processor -- start 2023-10-06T11:13:34.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.263+0000 7f1a8b88b700 1 -- start start 2023-10-06T11:13:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.263+0000 7f1a8b88b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841574f0 0x7f1a8406e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.263+0000 7f1a8b88b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a8406e9c0 0x7f1a840ab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.263+0000 7f1a8b88b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840c7cd0 con 0x7f1a841507e0 2023-10-06T11:13:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a8b88b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8406bb80 con 0x7f1a8406e9c0 2023-10-06T11:13:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a8b88b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8406ee40 con 0x7f1a841574f0 2023-10-06T11:13:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89e28700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a8406e9c0 0x7f1a840ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89627700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1a841507e0 0x7f1a8406b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53752/0 (socket says 172.21.15.55:53752) 2023-10-06T11:13:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89627700 1 -- 172.21.15.55:0/1040101114 learned_addr learned my addr 172.21.15.55:0/1040101114 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a88e26700 1 --2- 172.21.15.55:0/1040101114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841574f0 0x7f1a8406e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89e28700 1 -- 172.21.15.55:0/1040101114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841574f0 msgr2=0x7f1a8406e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89e28700 1 --2- 172.21.15.55:0/1040101114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841574f0 0x7f1a8406e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89e28700 1 -- 172.21.15.55:0/1040101114 >> v1:172.21.15.55:6789/0 conn(0x7f1a841507e0 legacy=0x7f1a8406b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a83fff700 1 -- 172.21.15.55:0/1040101114 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002560469 0 0) 0x7f1a840c7cd0 con 0x7f1a841507e0 2023-10-06T11:13:34.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89e28700 1 -- 172.21.15.55:0/1040101114 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840c9170 con 0x7f1a8406e9c0 2023-10-06T11:13:34.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a89e28700 1 --2- 172.21.15.55:0/1040101114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a8406e9c0 0x7f1a840ab120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a740098e0 tx=0x7f1a740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a559b57533cc099e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a83fff700 1 -- 172.21.15.55:0/1040101114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74009e80 con 0x7f1a8406e9c0 2023-10-06T11:13:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a83fff700 1 -- 172.21.15.55:0/1040101114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400b860 con 0x7f1a8406e9c0 2023-10-06T11:13:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.264+0000 7f1a83fff700 1 -- 172.21.15.55:0/1040101114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400bbe0 con 0x7f1a8406e9c0 2023-10-06T11:13:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 -- 172.21.15.55:0/1040101114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a8406e9c0 msgr2=0x7f1a840ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/1040101114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a8406e9c0 0x7f1a840ab120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a740098e0 tx=0x7f1a740091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 -- 172.21.15.55:0/1040101114 shutdown_connections 2023-10-06T11:13:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/1040101114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a8406e9c0 0x7f1a840ab120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/1040101114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841574f0 0x7f1a8406e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 -- 172.21.15.55:0/1040101114 >> 172.21.15.55:0/1040101114 conn(0x7f1a84069190 msgr2=0x7f1a840cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 -- 172.21.15.55:0/1040101114 shutdown_connections 2023-10-06T11:13:34.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.265+0000 7f1a8b88b700 1 -- 172.21.15.55:0/1040101114 wait complete. 2023-10-06T11:13:34.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.266+0000 7f1a8b88b700 1 Processor -- start 2023-10-06T11:13:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.266+0000 7f1a8b88b700 1 -- start start 2023-10-06T11:13:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a8b88b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a8406e9c0 0x7f1a840b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a8b88b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841507e0 0x7f1a840cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a8b88b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 0x7f1a840c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a8b88b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8414e320 con 0x7f1a841574f0 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a8b88b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8414e600 con 0x7f1a8406e9c0 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a8b88b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8414e8e0 con 0x7f1a841507e0 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 0x7f1a840c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 0x7f1a840c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37676/0 (socket says 172.21.15.55:37676) 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 -- 172.21.15.55:0/3872621180 learned_addr learned my addr 172.21.15.55:0/3872621180 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a88e26700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841507e0 0x7f1a840cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89627700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a8406e9c0 0x7f1a840b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 -- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841507e0 msgr2=0x7f1a840cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841507e0 0x7f1a840cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 -- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a8406e9c0 msgr2=0x7f1a840b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a8406e9c0 0x7f1a840b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89e28700 1 -- 172.21.15.55:0/3872621180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009420 con 0x7f1a841574f0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.267+0000 7f1a89627700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a8406e9c0 0x7f1a840b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.268+0000 7f1a89e28700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 0x7f1a840c5d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b3c0 tx=0x7f1a74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.268+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74011630 con 0x7f1a841574f0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.268+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74011790 con 0x7f1a841574f0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.268+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74011b50 con 0x7f1a841574f0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.268+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8414ebc0 con 0x7f1a841574f0 2023-10-06T11:13:34.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.268+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8414e020 con 0x7f1a841574f0 2023-10-06T11:13:34.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.269+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8414f060 con 0x7f1a841574f0 2023-10-06T11:13:34.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.269+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a740253f0 con 0x7f1a841574f0 2023-10-06T11:13:34.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.269+0000 7f1a817fa700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1a70066f30 0x7f1a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.270+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a740866d0 con 0x7f1a841574f0 2023-10-06T11:13:34.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.270+0000 7f1a89627700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1a70066f30 0x7f1a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.270+0000 7f1a89627700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1a70066f30 0x7f1a700693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c001560 tx=0x7f1a7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.280+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a740534f0 con 0x7f1a841574f0 2023-10-06T11:13:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.472+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a84064a90 con 0x7f1a841574f0 2023-10-06T11:13:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.472+0000 7f1a817fa700 1 -- 172.21.15.55:0/3872621180 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a74056b10 con 0x7f1a841574f0 2023-10-06T11:13:34.474 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1a70066f30 msgr2=0x7f1a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1a70066f30 0x7f1a700693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c001560 tx=0x7f1a7c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 msgr2=0x7f1a840c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 0x7f1a840c5d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b3c0 tx=0x7f1a74017000 comp rx=0 tx=0).stop 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 shutdown_connections 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1a70066f30 0x7f1a700693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a841574f0 0x7f1a840c5d90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a8406e9c0 0x7f1a840b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 --2- 172.21.15.55:0/3872621180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a841507e0 0x7f1a840cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 >> 172.21.15.55:0/3872621180 conn(0x7f1a84069190 msgr2=0x7f1a840abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 shutdown_connections 2023-10-06T11:13:34.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.474+0000 7f1a8b88b700 1 -- 172.21.15.55:0/3872621180 wait complete. 2023-10-06T11:13:34.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.607+0000 7f0c32c1b700 1 Processor -- start 2023-10-06T11:13:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.607+0000 7f0c32c1b700 1 -- start start 2023-10-06T11:13:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c32c1b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c2c159470 0x7f0c2c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c32c1b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c2c159840 0x7f0c2c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c32c1b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c32c1b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c0cbb80 con 0x7f0c2c159470 2023-10-06T11:13:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c32c1b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c0c6f00 con 0x7f0c2c159840 2023-10-06T11:13:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c32c1b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0cb530 con 0x7f0c2c0c6170 2023-10-06T11:13:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c309b7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c2c159470 0x7f0c2c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c309b7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c2c159470 0x7f0c2c0ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45690/0 (socket says 172.21.15.55:45690) 2023-10-06T11:13:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c309b7700 1 -- 172.21.15.55:0/182488499 learned_addr learned my addr 172.21.15.55:0/182488499 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.608+0000 7f0c2bfff700 1 --2- 172.21.15.55:0/182488499 >> v2:172.21.15.142:3300/0 conn(0x7f0c2c159840 0x7f0c2c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c311b8700 1 --2- 172.21.15.55:0/182488499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c309b7700 1 -- 172.21.15.55:0/182488499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 msgr2=0x7f0c2c0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c309b7700 1 --2- 172.21.15.55:0/182488499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c0c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c309b7700 1 -- 172.21.15.55:0/182488499 >> v2:172.21.15.142:3300/0 conn(0x7f0c2c159840 msgr2=0x7f0c2c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c309b7700 1 --2- 172.21.15.55:0/182488499 >> v2:172.21.15.142:3300/0 conn(0x7f0c2c159840 0x7f0c2c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c309b7700 1 -- 172.21.15.55:0/182488499 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c0cb810 con 0x7f0c2c159470 2023-10-06T11:13:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c2bfff700 1 --2- 172.21.15.55:0/182488499 >> v2:172.21.15.142:3300/0 conn(0x7f0c2c159840 0x7f0c2c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c309b7700 1 --2- 172.21.15.55:0/182488499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c0ce980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c089680 tx=0x7f0c24009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895d06864f3ccd2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c2b7fe700 1 -- 172.21.15.55:0/182488499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24005c10 con 0x7f0c2c159470 2023-10-06T11:13:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c2b7fe700 1 -- 172.21.15.55:0/182488499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24005d70 con 0x7f0c2c159470 2023-10-06T11:13:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c2b7fe700 1 -- 172.21.15.55:0/182488499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400b880 con 0x7f0c2c159470 2023-10-06T11:13:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c32c1b700 1 -- 172.21.15.55:0/182488499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 msgr2=0x7f0c2c0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.609+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/182488499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c0ce980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c089680 tx=0x7f0c24009220 comp rx=0 tx=0).stop 2023-10-06T11:13:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 -- 172.21.15.55:0/182488499 shutdown_connections 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/182488499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/182488499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c0ce980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/182488499 >> v2:172.21.15.142:3300/0 conn(0x7f0c2c159840 0x7f0c2c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 -- 172.21.15.55:0/182488499 >> 172.21.15.55:0/182488499 conn(0x7f0c2c0996e0 msgr2=0x7f0c2c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 -- 172.21.15.55:0/182488499 shutdown_connections 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.610+0000 7f0c32c1b700 1 -- 172.21.15.55:0/182488499 wait complete. 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.611+0000 7f0c32c1b700 1 Processor -- start 2023-10-06T11:13:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.611+0000 7f0c32c1b700 1 -- start start 2023-10-06T11:13:34.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c32c1b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c32c1b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c32c1b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c2c159840 0x7f0c2c15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c32c1b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c15cb50 con 0x7f0c2c159470 2023-10-06T11:13:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c32c1b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c15bf40 con 0x7f0c2c159840 2023-10-06T11:13:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c32c1b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c15c220 con 0x7f0c2c0c6170 2023-10-06T11:13:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45694/0 (socket says 172.21.15.55:45694) 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 -- 172.21.15.55:0/3280774723 learned_addr learned my addr 172.21.15.55:0/3280774723 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c309b7700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c311b8700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c2c159840 0x7f0c2c15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 -- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 msgr2=0x7f0c2c144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 -- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c2c159840 msgr2=0x7f0c2c15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c2c159840 0x7f0c2c15dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 -- 172.21.15.55:0/3280774723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c24009480 con 0x7f0c2c159470 2023-10-06T11:13:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c2bfff700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c15daa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00d180 tx=0x7f0c1c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.612+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00dcc0 con 0x7f0c2c159470 2023-10-06T11:13:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.613+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00f040 con 0x7f0c2c159470 2023-10-06T11:13:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.613+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c015670 con 0x7f0c2c159470 2023-10-06T11:13:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.613+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c15c500 con 0x7f0c2c159470 2023-10-06T11:13:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.613+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c1453b0 con 0x7f0c2c159470 2023-10-06T11:13:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.614+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c15ccc0 con 0x7f0c2c159470 2023-10-06T11:13:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.614+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c1c015a60 con 0x7f0c2c159470 2023-10-06T11:13:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.614+0000 7f0c28ff9700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c0c066f30 0x7f0c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.614+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c1c084c50 con 0x7f0c2c159470 2023-10-06T11:13:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.614+0000 7f0c309b7700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c0c066f30 0x7f0c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.615+0000 7f0c309b7700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c0c066f30 0x7f0c0c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c24007fd0 tx=0x7f0c24016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.619+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c1c04e5a0 con 0x7f0c2c159470 2023-10-06T11:13:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.808+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0c2c064a90 con 0x7f0c2c159470 2023-10-06T11:13:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.809+0000 7f0c28ff9700 1 -- 172.21.15.55:0/3280774723 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0c1c01a0a0 con 0x7f0c2c159470 2023-10-06T11:13:34.811 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c0c066f30 msgr2=0x7f0c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c0c066f30 0x7f0c0c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c24007fd0 tx=0x7f0c24016000 comp rx=0 tx=0).stop 2023-10-06T11:13:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 msgr2=0x7f0c2c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c15daa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00d180 tx=0x7f0c1c0099f0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 shutdown_connections 2023-10-06T11:13:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c0c066f30 0x7f0c0c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c2c159840 0x7f0c2c15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c2c0c6170 0x7f0c2c144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 --2- 172.21.15.55:0/3280774723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c2c159470 0x7f0c2c15daa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 >> 172.21.15.55:0/3280774723 conn(0x7f0c2c0996e0 msgr2=0x7f0c2c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 shutdown_connections 2023-10-06T11:13:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.811+0000 7f0c32c1b700 1 -- 172.21.15.55:0/3280774723 wait complete. 2023-10-06T11:13:34.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:34.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.942+0000 7f27123fe700 1 Processor -- start 2023-10-06T11:13:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.942+0000 7f27123fe700 1 -- start start 2023-10-06T11:13:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f27123fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f270c0b2810 0x7f270c0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f27123fe700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270c0cb7a0 con 0x7f270c159440 2023-10-06T11:13:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f27123fe700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270c0b0860 con 0x7f270c0cbc30 2023-10-06T11:13:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f27123fe700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270c0cb150 con 0x7f270c0b2810 2023-10-06T11:13:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f27113fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f270c159440 0x7f270c0b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45482/0 (socket says 172.21.15.55:45482) 2023-10-06T11:13:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f27113fc700 1 -- 172.21.15.55:0/4117650816 learned_addr learned my addr 172.21.15.55:0/4117650816 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f2711bfd700 1 --2- 172.21.15.55:0/4117650816 >> v2:172.21.15.142:3300/0 conn(0x7f270c0b2810 0x7f270c0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158126283 0 0) 0x7f270c0cb7a0 con 0x7f270c159440 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f4003570 con 0x7f270c159440 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267630727 0 0) 0x7f26f4003570 con 0x7f270c159440 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 >> v2:172.21.15.142:3300/0 conn(0x7f270c0b2810 msgr2=0x7f270c0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 --2- 172.21.15.55:0/4117650816 >> v2:172.21.15.142:3300/0 conn(0x7f270c0b2810 0x7f270c0cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 >> v1:172.21.15.142:6789/0 conn(0x7f270c0cbc30 legacy=0x7f270c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c0cb430 con 0x7f270c159440 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f2704001470 con 0x7f270c159440 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 >> v1:172.21.15.55:6789/0 conn(0x7f270c159440 legacy=0x7f270c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.943+0000 7f270bfff700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4003a60 0x7f26f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26f4004810 0x7f26f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26f40051c0 0x7f26f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0cb150 con 0x7f26f4004810 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f400c0d0 con 0x7f26f4003a60 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f400c290 con 0x7f26f40051c0 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26f4004810 0x7f26f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f27113fc700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4003a60 0x7f26f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2711bfd700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26f40051c0 0x7f26f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 -- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26f40051c0 msgr2=0x7f26f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26f40051c0 0x7f26f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 -- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4003a60 msgr2=0x7f26f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4003a60 0x7f26f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 -- 172.21.15.55:0/4117650816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4003570 con 0x7f26f4004810 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2711bfd700 1 -- 172.21.15.55:0/4117650816 reap_dead start 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f2710bfb700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26f4004810 0x7f26f4004c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f27000018e0 tx=0x7f2700007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3879cbaea80e93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700012420 con 0x7f26f4004810 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000125a0 con 0x7f26f4004810 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.944+0000 7f270bfff700 1 -- 172.21.15.55:0/4117650816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700012960 con 0x7f26f4004810 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 -- 172.21.15.55:0/4117650816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26f4004810 msgr2=0x7f26f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26f4004810 0x7f26f4004c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f27000018e0 tx=0x7f2700007d30 comp rx=0 tx=0).stop 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 -- 172.21.15.55:0/4117650816 shutdown_connections 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 --2- 172.21.15.55:0/4117650816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26f4004810 0x7f26f4004c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 -- 172.21.15.55:0/4117650816 >> 172.21.15.55:0/4117650816 conn(0x7f270c06ece0 msgr2=0x7f270c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 -- 172.21.15.55:0/4117650816 shutdown_connections 2023-10-06T11:13:34.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.945+0000 7f27123fe700 1 -- 172.21.15.55:0/4117650816 wait complete. 2023-10-06T11:13:34.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.946+0000 7f27123fe700 1 Processor -- start 2023-10-06T11:13:34.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.946+0000 7f27123fe700 1 -- start start 2023-10-06T11:13:34.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27123fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4004810 0x7f270c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27123fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270c0c9b20 0x7f270c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27123fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 0x7f270c169410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27123fe700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c16a100 con 0x7f270c0cee90 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27123fe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c16a6e0 con 0x7f26f4004810 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27123fe700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c16a9c0 con 0x7f270c0c9b20 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 0x7f270c169410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 0x7f270c169410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45714/0 (socket says 172.21.15.55:45714) 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 -- 172.21.15.55:0/426625406 learned_addr learned my addr 172.21.15.55:0/426625406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f27113fc700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4004810 0x7f270c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2710bfb700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270c0c9b20 0x7f270c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 -- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270c0c9b20 msgr2=0x7f270c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270c0c9b20 0x7f270c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 -- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4004810 msgr2=0x7f270c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4004810 0x7f270c0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 -- 172.21.15.55:0/426625406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c16aca0 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.947+0000 7f2711bfd700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 0x7f270c169410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f270c0b6030 tx=0x7f26fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.948+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00e040 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.948+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00f040 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.948+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c16a3e0 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.948+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00fd70 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.948+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c169950 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.949+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c0b1720 con 0x7f270c0cee90 2023-10-06T11:13:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.949+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26fc015640 con 0x7f270c0cee90 2023-10-06T11:13:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.949+0000 7f27097fa700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f26f8066f30 0x7f26f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.949+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f26fc085080 con 0x7f270c0cee90 2023-10-06T11:13:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.950+0000 7f27113fc700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f26f8066f30 0x7f26f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.950+0000 7f27113fc700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f26f8066f30 0x7f26f80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2704007f70 tx=0x7f2704001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:34.954+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26fc051ea0 con 0x7f270c0cee90 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.191+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f270c05f230 con 0x7f270c0cee90 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.192+0000 7f27097fa700 1 -- 172.21.15.55:0/426625406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f26fc0554c0 con 0x7f270c0cee90 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f26f8066f30 msgr2=0x7f26f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f26f8066f30 0x7f26f80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2704007f70 tx=0x7f2704001e50 comp rx=0 tx=0).stop 2023-10-06T11:13:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 msgr2=0x7f270c169410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 0x7f270c169410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f270c0b6030 tx=0x7f26fc00b040 comp rx=0 tx=0).stop 2023-10-06T11:13:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 shutdown_connections 2023-10-06T11:13:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f26f8066f30 0x7f26f80693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f270c0cee90 0x7f270c169410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4004810 0x7f270c0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 --2- 172.21.15.55:0/426625406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270c0c9b20 0x7f270c0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 >> 172.21.15.55:0/426625406 conn(0x7f270c06ece0 msgr2=0x7f270c158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 shutdown_connections 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.194+0000 7f27123fe700 1 -- 172.21.15.55:0/426625406 wait complete. 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:35.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:35.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.326+0000 7f8f5af81700 1 Processor -- start 2023-10-06T11:13:35.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.326+0000 7f8f5af81700 1 -- start start 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.326+0000 7f8f5af81700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f54159560 0x7f8f540aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5af81700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f540b0760 0x7f8f540b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5af81700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f540b0c60 con 0x7f8f540b49a0 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5af81700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f540b0f40 con 0x7f8f540b0760 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5af81700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540b1220 con 0x7f8f54159560 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5951e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f540b0760 0x7f8f540b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f53fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f540b49a0 0x7f8f540aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45484/0 (socket says 172.21.15.55:45484) 2023-10-06T11:13:35.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f53fff700 1 -- 172.21.15.55:0/3282374208 learned_addr learned my addr 172.21.15.55:0/3282374208 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f58d1d700 1 --2- 172.21.15.55:0/3282374208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f54159560 0x7f8f540aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5951e700 1 -- 172.21.15.55:0/3282374208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f54159560 msgr2=0x7f8f540aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5951e700 1 --2- 172.21.15.55:0/3282374208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f54159560 0x7f8f540aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5951e700 1 -- 172.21.15.55:0/3282374208 >> v1:172.21.15.55:6789/0 conn(0x7f8f540b49a0 legacy=0x7f8f540aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f537fe700 1 -- 172.21.15.55:0/3282374208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149691815 0 0) 0x7f8f540b0c60 con 0x7f8f540b49a0 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5951e700 1 -- 172.21.15.55:0/3282374208 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540b1500 con 0x7f8f540b0760 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f5951e700 1 --2- 172.21.15.55:0/3282374208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f540b0760 0x7f8f540b1bc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0098e0 tx=0x7f8f3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e363638f96ecf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f537fe700 1 -- 172.21.15.55:0/3282374208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00b640 con 0x7f8f540b0760 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f537fe700 1 -- 172.21.15.55:0/3282374208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00b7a0 con 0x7f8f540b0760 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.327+0000 7f8f537fe700 1 -- 172.21.15.55:0/3282374208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00bb40 con 0x7f8f540b0760 2023-10-06T11:13:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 -- 172.21.15.55:0/3282374208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f540b0760 msgr2=0x7f8f540b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 --2- 172.21.15.55:0/3282374208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f540b0760 0x7f8f540b1bc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0098e0 tx=0x7f8f3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 -- 172.21.15.55:0/3282374208 shutdown_connections 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 --2- 172.21.15.55:0/3282374208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f540b0760 0x7f8f540b1bc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 --2- 172.21.15.55:0/3282374208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f54159560 0x7f8f540aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 -- 172.21.15.55:0/3282374208 >> 172.21.15.55:0/3282374208 conn(0x7f8f540997f0 msgr2=0x7f8f5406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 -- 172.21.15.55:0/3282374208 shutdown_connections 2023-10-06T11:13:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.328+0000 7f8f5af81700 1 -- 172.21.15.55:0/3282374208 wait complete. 2023-10-06T11:13:35.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.329+0000 7f8f5af81700 1 Processor -- start 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.329+0000 7f8f5af81700 1 -- start start 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5af81700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f540b0760 0x7f8f5409a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5af81700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f540b49a0 0x7f8f5409a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5af81700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 0x7f8f54169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5af81700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f54157260 con 0x7f8f54159560 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5af81700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540ad210 con 0x7f8f540b49a0 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5af81700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5409aad0 con 0x7f8f540b0760 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 0x7f8f54169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 0x7f8f54169720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45736/0 (socket says 172.21.15.55:45736) 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 -- 172.21.15.55:0/1704240076 learned_addr learned my addr 172.21.15.55:0/1704240076 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:35.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f58d1d700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f540b0760 0x7f8f5409a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f53fff700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f540b49a0 0x7f8f5409a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 -- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f540b0760 msgr2=0x7f8f5409a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f540b0760 0x7f8f5409a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 -- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f540b49a0 msgr2=0x7f8f5409a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f540b49a0 0x7f8f5409a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.330+0000 7f8f5951e700 1 -- 172.21.15.55:0/1704240076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009420 con 0x7f8f54159560 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.331+0000 7f8f5951e700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 0x7f8f54169720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009f80 tx=0x7f8f3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.331+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c011420 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.331+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c011580 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.331+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5409ad40 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.331+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c011920 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.331+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5409b300 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.332+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f540ad3a0 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.332+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f3c011c90 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.332+0000 7f8f50ff9700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f34066f30 0x7f8f340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.333+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8f3c086430 con 0x7f8f54159560 2023-10-06T11:13:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.333+0000 7f8f58d1d700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f34066f30 0x7f8f340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.333+0000 7f8f58d1d700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f34066f30 0x7f8f340693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00f510 tx=0x7f8f4c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.337+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f3c053250 con 0x7f8f54159560 2023-10-06T11:13:35.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.530+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f540b17e0 con 0x7f8f54159560 2023-10-06T11:13:35.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.531+0000 7f8f50ff9700 1 -- 172.21.15.55:0/1704240076 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8f3c056870 con 0x7f8f54159560 2023-10-06T11:13:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:35.534 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f34066f30 msgr2=0x7f8f340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f34066f30 0x7f8f340693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00f510 tx=0x7f8f4c00b040 comp rx=0 tx=0).stop 2023-10-06T11:13:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 msgr2=0x7f8f54169720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 0x7f8f54169720 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009f80 tx=0x7f8f3c017000 comp rx=0 tx=0).stop 2023-10-06T11:13:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 shutdown_connections 2023-10-06T11:13:35.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f34066f30 0x7f8f340693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f54159560 0x7f8f54169720 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.533+0000 7f8f5af81700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f540b0760 0x7f8f5409a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.534+0000 7f8f5af81700 1 --2- 172.21.15.55:0/1704240076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f540b49a0 0x7f8f5409a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.534+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 >> 172.21.15.55:0/1704240076 conn(0x7f8f540997f0 msgr2=0x7f8f540cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.534+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 shutdown_connections 2023-10-06T11:13:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.534+0000 7f8f5af81700 1 -- 172.21.15.55:0/1704240076 wait complete. 2023-10-06T11:13:35.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:35.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.669+0000 7fcb70ac6700 1 Processor -- start 2023-10-06T11:13:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.669+0000 7fcb70ac6700 1 -- start start 2023-10-06T11:13:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb70ac6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb6c1574f0 0x7fcb6c06e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb70ac6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb6c06e9c0 0x7fcb6c0ab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb70ac6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0c7cd0 con 0x7fcb6c1507e0 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb70ac6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c06bb80 con 0x7fcb6c1574f0 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb70ac6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c06ee00 con 0x7fcb6c06e9c0 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb6a59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb6c1507e0 0x7fcb6c06b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45500/0 (socket says 172.21.15.55:45500) 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb69d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb6c1574f0 0x7fcb6c06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.670+0000 7fcb6a59c700 1 -- 172.21.15.55:0/3169761292 learned_addr learned my addr 172.21.15.55:0/3169761292 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb6ad9d700 1 --2- 172.21.15.55:0/3169761292 >> v2:172.21.15.142:3300/0 conn(0x7fcb6c06e9c0 0x7fcb6c0ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb69d9b700 1 -- 172.21.15.55:0/3169761292 >> v2:172.21.15.142:3300/0 conn(0x7fcb6c06e9c0 msgr2=0x7fcb6c0ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb69d9b700 1 --2- 172.21.15.55:0/3169761292 >> v2:172.21.15.142:3300/0 conn(0x7fcb6c06e9c0 0x7fcb6c0ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb69d9b700 1 -- 172.21.15.55:0/3169761292 >> v1:172.21.15.55:6789/0 conn(0x7fcb6c1507e0 legacy=0x7fcb6c06b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb69d9b700 1 -- 172.21.15.55:0/3169761292 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0c9170 con 0x7fcb6c1574f0 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb6959a700 1 -- 172.21.15.55:0/3169761292 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935140081 0 0) 0x7fcb6c0c7cd0 con 0x7fcb6c1507e0 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb69d9b700 1 --2- 172.21.15.55:0/3169761292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1574f0 0x7fcb6c06e480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0ac5d0 tx=0x7fcb540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e311952c226e5dc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb6959a700 1 -- 172.21.15.55:0/3169761292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400b6b0 con 0x7fcb6c1574f0 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb6959a700 1 -- 172.21.15.55:0/3169761292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5400b810 con 0x7fcb6c1574f0 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.671+0000 7fcb6959a700 1 -- 172.21.15.55:0/3169761292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400bbb0 con 0x7fcb6c1574f0 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 -- 172.21.15.55:0/3169761292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1574f0 msgr2=0x7fcb6c06e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/3169761292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1574f0 0x7fcb6c06e480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0ac5d0 tx=0x7fcb540091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 -- 172.21.15.55:0/3169761292 shutdown_connections 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/3169761292 >> v2:172.21.15.142:3300/0 conn(0x7fcb6c06e9c0 0x7fcb6c0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/3169761292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1574f0 0x7fcb6c06e480 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 -- 172.21.15.55:0/3169761292 >> 172.21.15.55:0/3169761292 conn(0x7fcb6c069190 msgr2=0x7fcb6c0cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 -- 172.21.15.55:0/3169761292 shutdown_connections 2023-10-06T11:13:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.672+0000 7fcb70ac6700 1 -- 172.21.15.55:0/3169761292 wait complete. 2023-10-06T11:13:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.673+0000 7fcb70ac6700 1 Processor -- start 2023-10-06T11:13:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.673+0000 7fcb70ac6700 1 -- start start 2023-10-06T11:13:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb6c06e9c0 0x7fcb6c0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 0x7fcb6c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb6c1574f0 0x7fcb6c067af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0adaf0 con 0x7fcb6c1507e0 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c068420 con 0x7fcb6c06e9c0 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0c4d90 con 0x7fcb6c1574f0 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 0x7fcb6c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 0x7fcb6c0675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45758/0 (socket says 172.21.15.55:45758) 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 -- 172.21.15.55:0/2696683122 learned_addr learned my addr 172.21.15.55:0/2696683122 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb6ad9d700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb6c1574f0 0x7fcb6c067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb6a59c700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb6c06e9c0 0x7fcb6c0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 -- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb6c1574f0 msgr2=0x7fcb6c067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb6c1574f0 0x7fcb6c067af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 -- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb6c06e9c0 msgr2=0x7fcb6c0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb6c06e9c0 0x7fcb6c0c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 -- 172.21.15.55:0/2696683122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009420 con 0x7fcb6c1507e0 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb6ad9d700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb6c1574f0 0x7fcb6c067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb69d9b700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 0x7fcb6c0675b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06dfb0 tx=0x7fcb54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400bb90 con 0x7fcb6c1507e0 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb54011420 con 0x7fcb6c1507e0 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540117e0 con 0x7fcb6c1507e0 2023-10-06T11:13:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c0c5070 con 0x7fcb6c1507e0 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.674+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c0c5630 con 0x7fcb6c1507e0 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.675+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c0c9410 con 0x7fcb6c1507e0 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.676+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb54011c10 con 0x7fcb6c1507e0 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.676+0000 7fcb627fc700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.676+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcb54086430 con 0x7fcb6c1507e0 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.676+0000 7fcb6a59c700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.677+0000 7fcb6a59c700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcb4c066f30 0x7fcb4c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb640011e0 tx=0x7fcb64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.680+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb540531b0 con 0x7fcb6c1507e0 2023-10-06T11:13:35.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.873+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb6c064a90 con 0x7fcb6c1507e0 2023-10-06T11:13:35.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.873+0000 7fcb627fc700 1 -- 172.21.15.55:0/2696683122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb540567d0 con 0x7fcb6c1507e0 2023-10-06T11:13:35.875 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:35.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcb4c066f30 msgr2=0x7fcb4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcb4c066f30 0x7fcb4c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb640011e0 tx=0x7fcb64009040 comp rx=0 tx=0).stop 2023-10-06T11:13:35.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 msgr2=0x7fcb6c0675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 0x7fcb6c0675b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06dfb0 tx=0x7fcb54017000 comp rx=0 tx=0).stop 2023-10-06T11:13:35.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 shutdown_connections 2023-10-06T11:13:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb6c1574f0 0x7fcb6c067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb6c06e9c0 0x7fcb6c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 --2- 172.21.15.55:0/2696683122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c1507e0 0x7fcb6c0675b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 >> 172.21.15.55:0/2696683122 conn(0x7fcb6c069190 msgr2=0x7fcb6c0abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 shutdown_connections 2023-10-06T11:13:35.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:35.875+0000 7fcb70ac6700 1 -- 172.21.15.55:0/2696683122 wait complete. 2023-10-06T11:13:35.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:36.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.010+0000 7fa1075e2700 1 Processor -- start 2023-10-06T11:13:36.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.010+0000 7fa1075e2700 1 -- start start 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa1075e2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 0x7fa10015d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa1075e2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa10015d650 0x7fa1000cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa1075e2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa100069c60 con 0x7fa1001539c0 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa1075e2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10015ab70 con 0x7fa10015d650 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa1075e2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10015db90 con 0x7fa100153d90 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 0x7fa10015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa105b7f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa10015d650 0x7fa1000cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa10537e700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa1001539c0 0x7fa100069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:52832/0 (socket says 172.21.15.55:52832) 2023-10-06T11:13:36.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa10537e700 1 -- 172.21.15.55:0/3423557094 learned_addr learned my addr 172.21.15.55:0/3423557094 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:36.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 --2- 172.21.15.55:0/3423557094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 0x7fa10015d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:51916/0 (socket says 172.21.15.55:51916) 2023-10-06T11:13:36.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 -- 172.21.15.55:0/3423557094 >> v2:172.21.15.142:3300/0 conn(0x7fa10015d650 msgr2=0x7fa1000cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa0fffff700 1 -- 172.21.15.55:0/3423557094 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047806814 0 0) 0x7fa100069c60 con 0x7fa1001539c0 2023-10-06T11:13:36.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 --2- 172.21.15.55:0/3423557094 >> v2:172.21.15.142:3300/0 conn(0x7fa10015d650 0x7fa1000cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 -- 172.21.15.55:0/3423557094 >> v1:172.21.15.142:6789/0 conn(0x7fa1001539c0 legacy=0x7fa100069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 -- 172.21.15.55:0/3423557094 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10015de70 con 0x7fa100153d90 2023-10-06T11:13:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.011+0000 7fa104b7d700 1 --2- 172.21.15.55:0/3423557094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 0x7fa10015d110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40098e0 tx=0x7fa0f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186293b2fe13a568 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa0fffff700 1 -- 172.21.15.55:0/3423557094 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400b640 con 0x7fa100153d90 2023-10-06T11:13:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa0fffff700 1 -- 172.21.15.55:0/3423557094 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f400b7a0 con 0x7fa100153d90 2023-10-06T11:13:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa0fffff700 1 -- 172.21.15.55:0/3423557094 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400bb40 con 0x7fa100153d90 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 -- 172.21.15.55:0/3423557094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 msgr2=0x7fa10015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 --2- 172.21.15.55:0/3423557094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 0x7fa10015d110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40098e0 tx=0x7fa0f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 -- 172.21.15.55:0/3423557094 shutdown_connections 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 --2- 172.21.15.55:0/3423557094 >> v2:172.21.15.142:3300/0 conn(0x7fa10015d650 0x7fa1000cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 --2- 172.21.15.55:0/3423557094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa100153d90 0x7fa10015d110 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 -- 172.21.15.55:0/3423557094 >> 172.21.15.55:0/3423557094 conn(0x7fa10006b610 msgr2=0x7fa10006ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 -- 172.21.15.55:0/3423557094 shutdown_connections 2023-10-06T11:13:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.012+0000 7fa1075e2700 1 -- 172.21.15.55:0/3423557094 wait complete. 2023-10-06T11:13:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.013+0000 7fa1075e2700 1 Processor -- start 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.013+0000 7fa1075e2700 1 -- start start 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa1075e2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1001539c0 0x7fa10013e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa1075e2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa100153d90 0x7fa100169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa1075e2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 0x7fa100155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa1075e2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100154550 con 0x7fa10015d650 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa1075e2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100154220 con 0x7fa100153d90 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa1075e2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10016a1e0 con 0x7fa1001539c0 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa105b7f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 0x7fa100155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa105b7f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 0x7fa100155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45762/0 (socket says 172.21.15.55:45762) 2023-10-06T11:13:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa105b7f700 1 -- 172.21.15.55:0/2142539704 learned_addr learned my addr 172.21.15.55:0/2142539704 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa10537e700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1001539c0 0x7fa10013e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.014+0000 7fa104b7d700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa100153d90 0x7fa100169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa105b7f700 1 -- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1001539c0 msgr2=0x7fa10013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa105b7f700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1001539c0 0x7fa10013e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa105b7f700 1 -- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa100153d90 msgr2=0x7fa100169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa105b7f700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa100153d90 0x7fa100169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa105b7f700 1 -- 172.21.15.55:0/2142539704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4009420 con 0x7fa10015d650 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa105b7f700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 0x7fa100155680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009e90 tx=0x7fa0f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000cb70 con 0x7fa10015d650 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000f040 con 0x7fa10015d650 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10016a4c0 con 0x7fa10015d650 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0014480 con 0x7fa10015d650 2023-10-06T11:13:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.015+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10013eb60 con 0x7fa10015d650 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.016+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa100064a90 con 0x7fa10015d650 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.016+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0f0014830 con 0x7fa10015d650 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.017+0000 7fa0fd7fa700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa0ec066f30 0x7fa0ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.017+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa0f00853b0 con 0x7fa10015d650 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.017+0000 7fa10537e700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa0ec066f30 0x7fa0ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.018+0000 7fa10537e700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa0ec066f30 0x7fa0ec0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8007160 tx=0x7fa0f8007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.021+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0f00521d0 con 0x7fa10015d650 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.213+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa100154690 con 0x7fa10015d650 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.213+0000 7fa0fd7fa700 1 -- 172.21.15.55:0/2142539704 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0f00557f0 con 0x7fa10015d650 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:36.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa0ec066f30 msgr2=0x7fa0ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa0ec066f30 0x7fa0ec0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8007160 tx=0x7fa0f8007f50 comp rx=0 tx=0).stop 2023-10-06T11:13:36.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 msgr2=0x7fa100155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 0x7fa100155680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009e90 tx=0x7fa0f000b040 comp rx=0 tx=0).stop 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 shutdown_connections 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa0ec066f30 0x7fa0ec0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa10015d650 0x7fa100155680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1001539c0 0x7fa10013e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 --2- 172.21.15.55:0/2142539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa100153d90 0x7fa100169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.215+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 >> 172.21.15.55:0/2142539704 conn(0x7fa10006b610 msgr2=0x7fa1000c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.216+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 shutdown_connections 2023-10-06T11:13:36.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.216+0000 7fa1075e2700 1 -- 172.21.15.55:0/2142539704 wait complete. 2023-10-06T11:13:36.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.350+0000 7f3ecd6ce700 1 Processor -- start 2023-10-06T11:13:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.350+0000 7f3ecd6ce700 1 -- start start 2023-10-06T11:13:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ecd6ce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ec81594d0 0x7f3ec80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ecd6ce700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ec81598a0 0x7f3ec80cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ecd6ce700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80cf330 con 0x7f3ec80ce7e0 2023-10-06T11:13:36.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ecd6ce700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80cf5d0 con 0x7f3ec81598a0 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ecd6ce700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80cf8b0 con 0x7f3ec81594d0 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ec67fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ec81598a0 0x7f3ec80cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ec67fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ec81598a0 0x7f3ec80cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45770/0 (socket says 172.21.15.55:45770) 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2265486831 learned_addr learned my addr 172.21.15.55:0/2265486831 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.351+0000 7f3ec6ffd700 1 --2- 172.21.15.55:0/2265486831 >> v2:172.21.15.142:3300/0 conn(0x7f3ec81594d0 0x7f3ec80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2265486831 >> v2:172.21.15.142:3300/0 conn(0x7f3ec81594d0 msgr2=0x7f3ec80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec67fc700 1 --2- 172.21.15.55:0/2265486831 >> v2:172.21.15.142:3300/0 conn(0x7f3ec81594d0 0x7f3ec80cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2265486831 >> v1:172.21.15.142:6789/0 conn(0x7f3ec80ce7e0 legacy=0x7f3ec80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2265486831 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80cfb90 con 0x7f3ec81598a0 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec67fc700 1 --2- 172.21.15.55:0/2265486831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81598a0 0x7f3ec80cbaa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8088f70 tx=0x7f3ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644645c6f206afa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec5ffb700 1 -- 172.21.15.55:0/2265486831 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc009e70 con 0x7f3ec81598a0 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec5ffb700 1 -- 172.21.15.55:0/2265486831 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00b860 con 0x7f3ec81598a0 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ec5ffb700 1 -- 172.21.15.55:0/2265486831 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00bc00 con 0x7f3ec81598a0 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2265486831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81598a0 msgr2=0x7f3ec80cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2265486831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81598a0 0x7f3ec80cbaa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8088f70 tx=0x7f3ebc009250 comp rx=0 tx=0).stop 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2265486831 shutdown_connections 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2265486831 >> v2:172.21.15.142:3300/0 conn(0x7f3ec81594d0 0x7f3ec80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2265486831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81598a0 0x7f3ec80cbaa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2265486831 >> 172.21.15.55:0/2265486831 conn(0x7f3ec8089e50 msgr2=0x7f3ec8099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.352+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2265486831 shutdown_connections 2023-10-06T11:13:36.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.353+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2265486831 wait complete. 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 Processor -- start 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 -- start start 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec80ce7e0 0x7f3ec8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 0x7f3ec816d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec816afe0 0x7f3ec815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec816d920 con 0x7f3ec81594d0 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec816e780 con 0x7f3ec816afe0 2023-10-06T11:13:36.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.354+0000 7f3ecd6ce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec816db00 con 0x7f3ec80ce7e0 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 0x7f3ec816d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 0x7f3ec816d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45772/0 (socket says 172.21.15.55:45772) 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2765712578 learned_addr learned my addr 172.21.15.55:0/2765712578 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec77fe700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec816afe0 0x7f3ec815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec6ffd700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec80ce7e0 0x7f3ec8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec80ce7e0 msgr2=0x7f3ec8152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec80ce7e0 0x7f3ec8152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec816afe0 msgr2=0x7f3ec815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec816afe0 0x7f3ec815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 -- 172.21.15.55:0/2765712578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0094f0 con 0x7f3ec81594d0 2023-10-06T11:13:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec77fe700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec816afe0 0x7f3ec815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:36.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ec67fc700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 0x7f3ec816d080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0094c0 tx=0x7f3ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00b9d0 con 0x7f3ec81594d0 2023-10-06T11:13:36.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00bb50 con 0x7f3ec81594d0 2023-10-06T11:13:36.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec816dde0 con 0x7f3ec81594d0 2023-10-06T11:13:36.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc025670 con 0x7f3ec81594d0 2023-10-06T11:13:36.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.355+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec816e3a0 con 0x7f3ec81594d0 2023-10-06T11:13:36.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.356+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec8064a90 con 0x7f3ec81594d0 2023-10-06T11:13:36.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.357+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ebc023070 con 0x7f3ec81594d0 2023-10-06T11:13:36.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.357+0000 7f3eaeffd700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.357+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3ebc085f80 con 0x7f3ec81594d0 2023-10-06T11:13:36.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.357+0000 7f3ec6ffd700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.358+0000 7f3ec6ffd700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb4066f30 0x7f3eb40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006f00 tx=0x7f3eb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.361+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ebc052da0 con 0x7f3ec81594d0 2023-10-06T11:13:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.555+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ec80cfe70 con 0x7f3ec81594d0 2023-10-06T11:13:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.556+0000 7f3eaeffd700 1 -- 172.21.15.55:0/2765712578 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ebc0563c0 con 0x7f3ec81594d0 2023-10-06T11:13:36.558 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:36.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb4066f30 msgr2=0x7f3eb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb4066f30 0x7f3eb40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006f00 tx=0x7f3eb8008040 comp rx=0 tx=0).stop 2023-10-06T11:13:36.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 msgr2=0x7f3ec816d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 0x7f3ec816d080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0094c0 tx=0x7f3ebc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 shutdown_connections 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec816afe0 0x7f3ec815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec80ce7e0 0x7f3ec8152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 --2- 172.21.15.55:0/2765712578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ec81594d0 0x7f3ec816d080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 >> 172.21.15.55:0/2765712578 conn(0x7f3ec8089e50 msgr2=0x7f3ec814c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 shutdown_connections 2023-10-06T11:13:36.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.558+0000 7f3ecd6ce700 1 -- 172.21.15.55:0/2765712578 wait complete. 2023-10-06T11:13:36.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:36.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.691+0000 7ff914ce7700 1 Processor -- start 2023-10-06T11:13:36.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.691+0000 7ff914ce7700 1 -- start start 2023-10-06T11:13:36.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff914ce7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff910067bd0 0x7ff9100cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff914ce7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91015d860 con 0x7ff91015dcf0 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff914ce7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91015a7f0 con 0x7ff91015a1f0 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff914ce7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91015aad0 con 0x7ff910067bd0 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff90e59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff910067bd0 0x7ff9100cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff90dd9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff91015dcf0 0x7ff910159ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45506/0 (socket says 172.21.15.55:45506) 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.692+0000 7ff90dd9b700 1 -- 172.21.15.55:0/331985363 learned_addr learned my addr 172.21.15.55:0/331985363 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90e59c700 1 -- 172.21.15.55:0/331985363 >> v1:172.21.15.142:6789/0 conn(0x7ff91015a1f0 legacy=0x7ff91006a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90e59c700 1 -- 172.21.15.55:0/331985363 >> v1:172.21.15.55:6789/0 conn(0x7ff91015dcf0 legacy=0x7ff910159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90e59c700 1 -- 172.21.15.55:0/331985363 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91015d210 con 0x7ff910067bd0 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90d59a700 1 -- 172.21.15.55:0/331985363 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335335070 0 0) 0x7ff91015d860 con 0x7ff91015dcf0 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90e59c700 1 --2- 172.21.15.55:0/331985363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100cad70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff900009e60 tx=0x7ff900009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50e9647cd210fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90d59a700 1 -- 172.21.15.55:0/331985363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000e070 con 0x7ff910067bd0 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90d59a700 1 -- 172.21.15.55:0/331985363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90000bc30 con 0x7ff910067bd0 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.693+0000 7ff90d59a700 1 -- 172.21.15.55:0/331985363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900012430 con 0x7ff910067bd0 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 -- 172.21.15.55:0/331985363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 msgr2=0x7ff9100cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 --2- 172.21.15.55:0/331985363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100cad70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff900009e60 tx=0x7ff900009780 comp rx=0 tx=0).stop 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 -- 172.21.15.55:0/331985363 shutdown_connections 2023-10-06T11:13:36.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 --2- 172.21.15.55:0/331985363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100cad70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 -- 172.21.15.55:0/331985363 >> 172.21.15.55:0/331985363 conn(0x7ff9100cd1a0 msgr2=0x7ff9100cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 -- 172.21.15.55:0/331985363 shutdown_connections 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.694+0000 7ff914ce7700 1 -- 172.21.15.55:0/331985363 wait complete. 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.695+0000 7ff914ce7700 1 Processor -- start 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.695+0000 7ff914ce7700 1 -- start start 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.695+0000 7ff914ce7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.695+0000 7ff914ce7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff91015a1f0 0x7ff910146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff914ce7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff91015dcf0 0x7ff9100b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff914ce7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff910147230 con 0x7ff910067bd0 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff914ce7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100b1780 con 0x7ff91015dcf0 2023-10-06T11:13:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff914ce7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91016a870 con 0x7ff91015a1f0 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45790/0 (socket says 172.21.15.55:45790) 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 -- 172.21.15.55:0/1278129772 learned_addr learned my addr 172.21.15.55:0/1278129772 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 -- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff91015a1f0 msgr2=0x7ff910146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90dd9b700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff91015a1f0 0x7ff910146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff91015a1f0 0x7ff910146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 -- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff91015dcf0 msgr2=0x7ff9100b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90ed9d700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff91015dcf0 0x7ff9100b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff91015dcf0 0x7ff9100b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 -- 172.21.15.55:0/1278129772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900009a20 con 0x7ff910067bd0 2023-10-06T11:13:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90dd9b700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff91015a1f0 0x7ff910146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff90e59c700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100c4ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9000099f0 tx=0x7ff900019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90001b420 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90001b5a0 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9100c54b0 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90001b960 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.696+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9100b1410 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.697+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff910064a90 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.698+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff90001bd10 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.698+0000 7ff9067fc700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff8f0066f30 0x7ff8f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.698+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff900086670 con 0x7ff910067bd0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.698+0000 7ff90dd9b700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff8f0066f30 0x7ff8f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.699+0000 7ff90dd9b700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff8f0066f30 0x7ff8f00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9100c3180 tx=0x7ff8f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.702+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff900053490 con 0x7ff910067bd0 2023-10-06T11:13:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.895+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9100cdd70 con 0x7ff910067bd0 2023-10-06T11:13:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.895+0000 7ff9067fc700 1 -- 172.21.15.55:0/1278129772 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff900056ab0 con 0x7ff910067bd0 2023-10-06T11:13:36.897 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:36.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff8f0066f30 msgr2=0x7ff8f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff8f0066f30 0x7ff8f00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9100c3180 tx=0x7ff8f8009040 comp rx=0 tx=0).stop 2023-10-06T11:13:36.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 msgr2=0x7ff9100c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100c4ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9000099f0 tx=0x7ff900019000 comp rx=0 tx=0).stop 2023-10-06T11:13:36.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 shutdown_connections 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff8f0066f30 0x7ff8f00693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff910067bd0 0x7ff9100c4ed0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff91015dcf0 0x7ff9100b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 --2- 172.21.15.55:0/1278129772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff91015a1f0 0x7ff910146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 >> 172.21.15.55:0/1278129772 conn(0x7ff9100cd1a0 msgr2=0x7ff9100cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 shutdown_connections 2023-10-06T11:13:36.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:36.897+0000 7ff914ce7700 1 -- 172.21.15.55:0/1278129772 wait complete. 2023-10-06T11:13:36.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.032+0000 7f4f865f7700 1 Processor -- start 2023-10-06T11:13:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.032+0000 7f4f865f7700 1 -- start start 2023-10-06T11:13:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f865f7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800cce50 0x7f4f800686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f865f7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800c9670 con 0x7f4f800b0820 2023-10-06T11:13:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f865f7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f80159c00 con 0x7f4f800c4450 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f865f7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c8a60 con 0x7f4f800cce50 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f7ffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4f800b0820 0x7f4f800cec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45508/0 (socket says 172.21.15.55:45508) 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f7ffff700 1 -- 172.21.15.55:0/1285817873 learned_addr learned my addr 172.21.15.55:0/1285817873 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.033+0000 7f4f84b94700 1 --2- 172.21.15.55:0/1285817873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800cce50 0x7f4f800686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f7effd700 1 -- 172.21.15.55:0/1285817873 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744719906 0 0) 0x7f4f800c9670 con 0x7f4f800b0820 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f7effd700 1 -- 172.21.15.55:0/1285817873 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f6c003570 con 0x7f4f800b0820 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f7effd700 1 -- 172.21.15.55:0/1285817873 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207163852 0 0) 0x7f4f80159c00 con 0x7f4f800c4450 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f84b94700 1 -- 172.21.15.55:0/1285817873 >> v1:172.21.15.142:6789/0 conn(0x7f4f800c4450 legacy=0x7f4f800cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f84b94700 1 -- 172.21.15.55:0/1285817873 >> v1:172.21.15.55:6789/0 conn(0x7f4f800b0820 legacy=0x7f4f800cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f84b94700 1 -- 172.21.15.55:0/1285817873 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800c8d40 con 0x7f4f800cce50 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f84b94700 1 --2- 172.21.15.55:0/1285817873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800cce50 0x7f4f800686c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009e90 tx=0x7f4f78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6baf100db60aa73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f7effd700 1 -- 172.21.15.55:0/1285817873 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800e070 con 0x7f4f800cce50 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f7effd700 1 -- 172.21.15.55:0/1285817873 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7800b920 con 0x7f4f800cce50 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.034+0000 7f4f7effd700 1 -- 172.21.15.55:0/1285817873 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700015f0 con 0x7f4f800cce50 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 -- 172.21.15.55:0/1285817873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800cce50 msgr2=0x7f4f800686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 --2- 172.21.15.55:0/1285817873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800cce50 0x7f4f800686c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009e90 tx=0x7f4f78009780 comp rx=0 tx=0).stop 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 -- 172.21.15.55:0/1285817873 shutdown_connections 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 --2- 172.21.15.55:0/1285817873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800cce50 0x7f4f800686c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 -- 172.21.15.55:0/1285817873 >> 172.21.15.55:0/1285817873 conn(0x7f4f80087fc0 msgr2=0x7f4f800ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 -- 172.21.15.55:0/1285817873 shutdown_connections 2023-10-06T11:13:37.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.035+0000 7f4f865f7700 1 -- 172.21.15.55:0/1285817873 wait complete. 2023-10-06T11:13:37.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.036+0000 7f4f865f7700 1 Processor -- start 2023-10-06T11:13:37.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.036+0000 7f4f865f7700 1 -- start start 2023-10-06T11:13:37.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 0x7f4f800c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800c4450 0x7f4f80157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f800cce50 0x7f4f8015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800b2270 con 0x7f4f800b0820 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80157d90 con 0x7f4f800cce50 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c7090 con 0x7f4f800c4450 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 0x7f4f800c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 0x7f4f800c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45806/0 (socket says 172.21.15.55:45806) 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 -- 172.21.15.55:0/3604906460 learned_addr learned my addr 172.21.15.55:0/3604906460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f84b94700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f800cce50 0x7f4f8015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7f7fe700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800c4450 0x7f4f80157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 -- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800c4450 msgr2=0x7f4f80157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800c4450 0x7f4f80157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 -- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f800cce50 msgr2=0x7f4f8015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f800cce50 0x7f4f8015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 -- 172.21.15.55:0/3604906460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78009a20 con 0x7f4f800b0820 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f84b94700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f800cce50 0x7f4f8015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7f7fe700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800c4450 0x7f4f80157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f7ffff700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 0x7f4f800c7d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000cb70 tx=0x7f4f70002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70007300 con 0x7f4f800b0820 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70007480 con 0x7f4f800b0820 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.037+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f800b1660 con 0x7f4f800b0820 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.038+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700057f0 con 0x7f4f800b0820 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.038+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f800b1c20 con 0x7f4f800b0820 2023-10-06T11:13:37.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.038+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f800c8270 con 0x7f4f800b0820 2023-10-06T11:13:37.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.039+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f70005bc0 con 0x7f4f800b0820 2023-10-06T11:13:37.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.039+0000 7f4f77fff700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f60066f30 0x7f4f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.039+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4f700848b0 con 0x7f4f800b0820 2023-10-06T11:13:37.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.040+0000 7f4f7f7fe700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f60066f30 0x7f4f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.040+0000 7f4f7f7fe700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f60066f30 0x7f4f600693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f680011e0 tx=0x7f4f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.044+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f800c8270 con 0x7f4f800b0820 2023-10-06T11:13:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.238+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4f800c8270 con 0x7f4f800b0820 2023-10-06T11:13:37.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.238+0000 7f4f77fff700 1 -- 172.21.15.55:0/3604906460 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4f800c8270 con 0x7f4f800b0820 2023-10-06T11:13:37.241 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.240+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f60066f30 msgr2=0x7f4f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.240+0000 7f4f865f7700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f60066f30 0x7f4f600693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f680011e0 tx=0x7f4f68009040 comp rx=0 tx=0).stop 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 msgr2=0x7f4f800c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 0x7f4f800c7d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000cb70 tx=0x7f4f70002c10 comp rx=0 tx=0).stop 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 shutdown_connections 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f60066f30 0x7f4f600693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f800b0820 0x7f4f800c7d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f800cce50 0x7f4f8015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 --2- 172.21.15.55:0/3604906460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f800c4450 0x7f4f80157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 >> 172.21.15.55:0/3604906460 conn(0x7f4f80087fc0 msgr2=0x7f4f800c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 shutdown_connections 2023-10-06T11:13:37.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.241+0000 7f4f865f7700 1 -- 172.21.15.55:0/3604906460 wait complete. 2023-10-06T11:13:37.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.373+0000 7fc08640b700 1 Processor -- start 2023-10-06T11:13:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 -- start start 2023-10-06T11:13:37.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc080156350 0x7fc0800cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0800cc710 0x7fc08006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc08006c160 0x7fc0800cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800ccb80 con 0x7fc08006c160 2023-10-06T11:13:37.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08006c9a0 con 0x7fc0800cc710 2023-10-06T11:13:37.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc08640b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080156b20 con 0x7fc080156350 2023-10-06T11:13:37.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.374+0000 7fc0849a8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc08006c160 0x7fc0800cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc08006c160 0x7fc0800cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45816/0 (socket says 172.21.15.55:45816) 2023-10-06T11:13:37.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 -- 172.21.15.55:0/4195854618 learned_addr learned my addr 172.21.15.55:0/4195854618 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:37.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc07f7fe700 1 --2- 172.21.15.55:0/4195854618 >> v2:172.21.15.142:3300/0 conn(0x7fc0800cc710 0x7fc08006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc07ffff700 1 --2- 172.21.15.55:0/4195854618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc080156350 0x7fc0800cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 -- 172.21.15.55:0/4195854618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc080156350 msgr2=0x7fc0800cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:37.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 --2- 172.21.15.55:0/4195854618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc080156350 0x7fc0800cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 -- 172.21.15.55:0/4195854618 >> v2:172.21.15.142:3300/0 conn(0x7fc0800cc710 msgr2=0x7fc08006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 --2- 172.21.15.55:0/4195854618 >> v2:172.21.15.142:3300/0 conn(0x7fc0800cc710 0x7fc08006bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 -- 172.21.15.55:0/4195854618 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080156e00 con 0x7fc08006c160 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc07f7fe700 1 --2- 172.21.15.55:0/4195854618 >> v2:172.21.15.142:3300/0 conn(0x7fc0800cc710 0x7fc08006bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc0849a8700 1 --2- 172.21.15.55:0/4195854618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc08006c160 0x7fc0800cafb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc08006e370 tx=0x7fc078009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4880f064f221d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc07effd700 1 -- 172.21.15.55:0/4195854618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800e070 con 0x7fc08006c160 2023-10-06T11:13:37.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc07effd700 1 -- 172.21.15.55:0/4195854618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800ba50 con 0x7fc08006c160 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.375+0000 7fc07effd700 1 -- 172.21.15.55:0/4195854618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780092e0 con 0x7fc08006c160 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 -- 172.21.15.55:0/4195854618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc08006c160 msgr2=0x7fc0800cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 --2- 172.21.15.55:0/4195854618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc08006c160 0x7fc0800cafb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc08006e370 tx=0x7fc078009840 comp rx=0 tx=0).stop 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 -- 172.21.15.55:0/4195854618 shutdown_connections 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 --2- 172.21.15.55:0/4195854618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc08006c160 0x7fc0800cafb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 --2- 172.21.15.55:0/4195854618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc080156350 0x7fc0800cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 --2- 172.21.15.55:0/4195854618 >> v2:172.21.15.142:3300/0 conn(0x7fc0800cc710 0x7fc08006bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 -- 172.21.15.55:0/4195854618 >> 172.21.15.55:0/4195854618 conn(0x7fc0800cdeb0 msgr2=0x7fc0800c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 -- 172.21.15.55:0/4195854618 shutdown_connections 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.376+0000 7fc08640b700 1 -- 172.21.15.55:0/4195854618 wait complete. 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.377+0000 7fc08640b700 1 Processor -- start 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.377+0000 7fc08640b700 1 -- start start 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc08640b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc08006c160 0x7fc08014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc08640b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0800cc710 0x7fc0800c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc08640b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 0x7fc0800b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc08640b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080168280 con 0x7fc080156350 2023-10-06T11:13:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc08640b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08014b490 con 0x7fc08006c160 2023-10-06T11:13:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc08640b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800c23e0 con 0x7fc0800cc710 2023-10-06T11:13:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 0x7fc0800b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 0x7fc0800b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45828/0 (socket says 172.21.15.55:45828) 2023-10-06T11:13:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 -- 172.21.15.55:0/2685626084 learned_addr learned my addr 172.21.15.55:0/2685626084 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:37.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc07ffff700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc08006c160 0x7fc08014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc07f7fe700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0800cc710 0x7fc0800c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 -- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0800cc710 msgr2=0x7fc0800c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0800cc710 0x7fc0800c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 -- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc08006c160 msgr2=0x7fc08014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc08006c160 0x7fc08014af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 -- 172.21.15.55:0/2685626084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc078009ae0 con 0x7fc080156350 2023-10-06T11:13:37.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.378+0000 7fc0849a8700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 0x7fc0800b2390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc078008950 tx=0x7fc078018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.379+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780032f0 con 0x7fc080156350 2023-10-06T11:13:37.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.379+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078008d40 con 0x7fc080156350 2023-10-06T11:13:37.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.379+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078026690 con 0x7fc080156350 2023-10-06T11:13:37.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.379+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc080167670 con 0x7fc080156350 2023-10-06T11:13:37.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.379+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc080167c30 con 0x7fc080156350 2023-10-06T11:13:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.379+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc080064a90 con 0x7fc080156350 2023-10-06T11:13:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.380+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc078003040 con 0x7fc080156350 2023-10-06T11:13:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.380+0000 7fc067fff700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.381+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc078086830 con 0x7fc080156350 2023-10-06T11:13:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.381+0000 7fc07ffff700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.381+0000 7fc07ffff700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc06c066f30 0x7fc06c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc074006fd0 tx=0x7fc074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.385+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0780535b0 con 0x7fc080156350 2023-10-06T11:13:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.622+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0801570e0 con 0x7fc080156350 2023-10-06T11:13:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.623+0000 7fc067fff700 1 -- 172.21.15.55:0/2685626084 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fc078056bd0 con 0x7fc080156350 2023-10-06T11:13:37.625 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:37.625 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc06c066f30 msgr2=0x7fc06c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc06c066f30 0x7fc06c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc074006fd0 tx=0x7fc074008040 comp rx=0 tx=0).stop 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 msgr2=0x7fc0800b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 0x7fc0800b2390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc078008950 tx=0x7fc078018000 comp rx=0 tx=0).stop 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 shutdown_connections 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc080156350 0x7fc0800b2390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc08006c160 0x7fc08014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 --2- 172.21.15.55:0/2685626084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0800cc710 0x7fc0800c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 >> 172.21.15.55:0/2685626084 conn(0x7fc0800cdeb0 msgr2=0x7fc0801553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 shutdown_connections 2023-10-06T11:13:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.625+0000 7fc08640b700 1 -- 172.21.15.55:0/2685626084 wait complete. 2023-10-06T11:13:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:37.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.756+0000 7f608070b700 1 Processor -- start 2023-10-06T11:13:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.756+0000 7f608070b700 1 -- start start 2023-10-06T11:13:37.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f608070b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60780b49a0 0x7f60780aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f608070b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780b0c60 con 0x7f6078159560 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f608070b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780b0f40 con 0x7f60780b0760 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f608070b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780b1220 con 0x7f60780b49a0 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f607dca6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60780b49a0 0x7f60780aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f607e4a7700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6078159560 0x7f60780aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45516/0 (socket says 172.21.15.55:45516) 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f607e4a7700 1 -- 172.21.15.55:0/1517443383 learned_addr learned my addr 172.21.15.55:0/1517443383 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f607dca6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60780b49a0 0x7f60780aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45832/0 (socket says 172.21.15.55:45832) 2023-10-06T11:13:37.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.757+0000 7f607dca6700 1 -- 172.21.15.55:0/1517443383 >> v1:172.21.15.142:6789/0 conn(0x7f60780b0760 legacy=0x7f60780b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607dca6700 1 -- 172.21.15.55:0/1517443383 >> v1:172.21.15.55:6789/0 conn(0x7f6078159560 legacy=0x7f60780aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607dca6700 1 -- 172.21.15.55:0/1517443383 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780b1500 con 0x7f60780b49a0 2023-10-06T11:13:37.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607d4a5700 1 -- 172.21.15.55:0/1517443383 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230838212 0 0) 0x7f60780b0c60 con 0x7f6078159560 2023-10-06T11:13:37.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607dca6700 1 --2- 172.21.15.55:0/1517443383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60780b49a0 0x7f60780aac40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6068009910 tx=0x7f60680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67987cc1f9ed0896 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607d4a5700 1 -- 172.21.15.55:0/1517443383 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800b820 con 0x7f60780b49a0 2023-10-06T11:13:37.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607d4a5700 1 -- 172.21.15.55:0/1517443383 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800b980 con 0x7f60780b49a0 2023-10-06T11:13:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f607d4a5700 1 -- 172.21.15.55:0/1517443383 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800bd20 con 0x7f60780b49a0 2023-10-06T11:13:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 -- 172.21.15.55:0/1517443383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60780b49a0 msgr2=0x7f60780aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 --2- 172.21.15.55:0/1517443383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60780b49a0 0x7f60780aac40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6068009910 tx=0x7f60680091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 -- 172.21.15.55:0/1517443383 shutdown_connections 2023-10-06T11:13:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 --2- 172.21.15.55:0/1517443383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60780b49a0 0x7f60780aac40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 -- 172.21.15.55:0/1517443383 >> 172.21.15.55:0/1517443383 conn(0x7f60780997f0 msgr2=0x7f607806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 -- 172.21.15.55:0/1517443383 shutdown_connections 2023-10-06T11:13:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.758+0000 7f608070b700 1 -- 172.21.15.55:0/1517443383 wait complete. 2023-10-06T11:13:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 Processor -- start 2023-10-06T11:13:37.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 -- start start 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780b0760 0x7f60780abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60780b49a0 0x7f607809a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 0x7f607809bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078157490 con 0x7f6078159560 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607809aea0 con 0x7f60780b0760 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f608070b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607809b0d0 con 0x7f60780b49a0 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f607eca8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 0x7f607809bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f607eca8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 0x7f607809bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45848/0 (socket says 172.21.15.55:45848) 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.760+0000 7f607eca8700 1 -- 172.21.15.55:0/3797573552 learned_addr learned my addr 172.21.15.55:0/3797573552 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:37.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607dca6700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60780b49a0 0x7f607809a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607e4a7700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780b0760 0x7f60780abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607eca8700 1 -- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60780b49a0 msgr2=0x7f607809a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607eca8700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60780b49a0 0x7f607809a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607eca8700 1 -- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780b0760 msgr2=0x7f60780abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607eca8700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780b0760 0x7f60780abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607eca8700 1 -- 172.21.15.55:0/3797573552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068009420 con 0x7f6078159560 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f607eca8700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 0x7f607809bc60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f607000c8e0 tx=0x7f6070001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000ce80 con 0x7f6078159560 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000a7e0 con 0x7f6078159560 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60780ae260 con 0x7f6078159560 2023-10-06T11:13:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000ab80 con 0x7f6078159560 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.761+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60780adc10 con 0x7f6078159560 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.762+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6078064a90 con 0x7f6078159560 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.762+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6070012420 con 0x7f6078159560 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.763+0000 7f606e7fc700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f605c066f30 0x7f605c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.763+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6070084c70 con 0x7f6078159560 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.763+0000 7f607e4a7700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f605c066f30 0x7f605c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.763+0000 7f607e4a7700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f605c066f30 0x7f605c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f607815d150 tx=0x7f6074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:37.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.767+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6070051a90 con 0x7f6078159560 2023-10-06T11:13:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.961+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60780b17e0 con 0x7f6078159560 2023-10-06T11:13:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.962+0000 7f606e7fc700 1 -- 172.21.15.55:0/3797573552 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f60700550b0 con 0x7f6078159560 2023-10-06T11:13:37.964 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:37.964 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f605c066f30 msgr2=0x7f605c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f605c066f30 0x7f605c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f607815d150 tx=0x7f6074009040 comp rx=0 tx=0).stop 2023-10-06T11:13:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 msgr2=0x7f607809bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 0x7f607809bc60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f607000c8e0 tx=0x7f6070001710 comp rx=0 tx=0).stop 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 shutdown_connections 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f605c066f30 0x7f605c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6078159560 0x7f607809bc60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60780b0760 0x7f60780abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 --2- 172.21.15.55:0/3797573552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60780b49a0 0x7f607809a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 >> 172.21.15.55:0/3797573552 conn(0x7f60780997f0 msgr2=0x7f60780afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 shutdown_connections 2023-10-06T11:13:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:37.964+0000 7f608070b700 1 -- 172.21.15.55:0/3797573552 wait complete. 2023-10-06T11:13:37.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:38.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.095+0000 7f32497c7700 1 Processor -- start 2023-10-06T11:13:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.095+0000 7f32497c7700 1 -- start start 2023-10-06T11:13:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32497c7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32440b49a0 0x7f32440aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32497c7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32440b0760 0x7f32440b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32497c7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32440b0c60 con 0x7f3244159560 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32497c7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32440b0f40 con 0x7f32440b49a0 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32497c7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32440b1220 con 0x7f32440b0760 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32427fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f32440b49a0 0x7f32440aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f3242ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3244159560 0x7f32440aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45532/0 (socket says 172.21.15.55:45532) 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f3242ffd700 1 -- 172.21.15.55:0/2036311036 learned_addr learned my addr 172.21.15.55:0/2036311036 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32437fe700 1 --2- 172.21.15.55:0/2036311036 >> v2:172.21.15.142:3300/0 conn(0x7f32440b0760 0x7f32440b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32427fc700 1 -- 172.21.15.55:0/2036311036 >> v2:172.21.15.142:3300/0 conn(0x7f32440b0760 msgr2=0x7f32440b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32427fc700 1 --2- 172.21.15.55:0/2036311036 >> v2:172.21.15.142:3300/0 conn(0x7f32440b0760 0x7f32440b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32427fc700 1 -- 172.21.15.55:0/2036311036 >> v1:172.21.15.55:6789/0 conn(0x7f3244159560 legacy=0x7f32440aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32427fc700 1 -- 172.21.15.55:0/2036311036 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32440b1500 con 0x7f32440b49a0 2023-10-06T11:13:38.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f3241ffb700 1 -- 172.21.15.55:0/2036311036 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770589108 0 0) 0x7f32440b0c60 con 0x7f3244159560 2023-10-06T11:13:38.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.096+0000 7f32427fc700 1 --2- 172.21.15.55:0/2036311036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b49a0 0x7f32440aac40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f322c0098e0 tx=0x7f322c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a156c8900f7d8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f3241ffb700 1 -- 172.21.15.55:0/2036311036 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011630 con 0x7f32440b49a0 2023-10-06T11:13:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f3241ffb700 1 -- 172.21.15.55:0/2036311036 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c011790 con 0x7f32440b49a0 2023-10-06T11:13:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f3241ffb700 1 -- 172.21.15.55:0/2036311036 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011b30 con 0x7f32440b49a0 2023-10-06T11:13:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 -- 172.21.15.55:0/2036311036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b49a0 msgr2=0x7f32440aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 --2- 172.21.15.55:0/2036311036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b49a0 0x7f32440aac40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f322c0098e0 tx=0x7f322c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 -- 172.21.15.55:0/2036311036 shutdown_connections 2023-10-06T11:13:38.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 --2- 172.21.15.55:0/2036311036 >> v2:172.21.15.142:3300/0 conn(0x7f32440b0760 0x7f32440b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 --2- 172.21.15.55:0/2036311036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b49a0 0x7f32440aac40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 -- 172.21.15.55:0/2036311036 >> 172.21.15.55:0/2036311036 conn(0x7f32440997f0 msgr2=0x7f324406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 -- 172.21.15.55:0/2036311036 shutdown_connections 2023-10-06T11:13:38.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.097+0000 7f32497c7700 1 -- 172.21.15.55:0/2036311036 wait complete. 2023-10-06T11:13:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.098+0000 7f32497c7700 1 Processor -- start 2023-10-06T11:13:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.098+0000 7f32497c7700 1 -- start start 2023-10-06T11:13:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32497c7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 0x7f32440b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32497c7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440b49a0 0x7f324409be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32497c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244159560 0x7f324409c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32497c7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3244157f50 con 0x7f32440b0760 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32497c7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324409ca10 con 0x7f32440b49a0 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32497c7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324416d940 con 0x7f3244159560 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f3242ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 0x7f32440b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f3242ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 0x7f32440b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45880/0 (socket says 172.21.15.55:45880) 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f3242ffd700 1 -- 172.21.15.55:0/4155104407 learned_addr learned my addr 172.21.15.55:0/4155104407 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32427fc700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440b49a0 0x7f324409be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f32437fe700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244159560 0x7f324409c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.099+0000 7f3242ffd700 1 -- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244159560 msgr2=0x7f324409c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f3242ffd700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244159560 0x7f324409c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f3242ffd700 1 -- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440b49a0 msgr2=0x7f324409be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f3242ffd700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440b49a0 0x7f324409be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f3242ffd700 1 -- 172.21.15.55:0/4155104407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009420 con 0x7f32440b0760 2023-10-06T11:13:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f32437fe700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244159560 0x7f324409c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f3242ffd700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 0x7f32440b3480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f323400c5e0 tx=0x7f3234007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340072e0 con 0x7f32440b0760 2023-10-06T11:13:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234007460 con 0x7f32440b0760 2023-10-06T11:13:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324416ddd0 con 0x7f32440b0760 2023-10-06T11:13:38.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340057f0 con 0x7f32440b0760 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.100+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324416d2f0 con 0x7f32440b0760 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.101+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324416dc20 con 0x7f32440b0760 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.101+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3234005c00 con 0x7f32440b0760 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.102+0000 7f323affd700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3224066f30 0x7f32240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.102+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3234083e60 con 0x7f32440b0760 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.102+0000 7f32427fc700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3224066f30 0x7f32240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.103+0000 7f32427fc700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3224066f30 0x7f32240693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f322c0098e0 tx=0x7f322c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.106+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3234050c80 con 0x7f32440b0760 2023-10-06T11:13:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.344+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3244064a90 con 0x7f32440b0760 2023-10-06T11:13:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.345+0000 7f323affd700 1 -- 172.21.15.55:0/4155104407 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f3234017020 con 0x7f32440b0760 2023-10-06T11:13:38.347 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:38.347 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3224066f30 msgr2=0x7f32240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3224066f30 0x7f32240693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f322c0098e0 tx=0x7f322c017000 comp rx=0 tx=0).stop 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 msgr2=0x7f32440b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 0x7f32440b3480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f323400c5e0 tx=0x7f3234007e80 comp rx=0 tx=0).stop 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 shutdown_connections 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3224066f30 0x7f32240693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32440b0760 0x7f32440b3480 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244159560 0x7f324409c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 --2- 172.21.15.55:0/4155104407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440b49a0 0x7f324409be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 >> 172.21.15.55:0/4155104407 conn(0x7f32440997f0 msgr2=0x7f3244069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 shutdown_connections 2023-10-06T11:13:38.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.347+0000 7f32497c7700 1 -- 172.21.15.55:0/4155104407 wait complete. 2023-10-06T11:13:38.350 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:38.376 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:38.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:38.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:13:12.502638+0000', 'modified': '2023-10-06T11:13:26.184677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6836/2998784723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2998784723}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2998784723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:13:38.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:13:38.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T11:13:38.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.886+0000 7fce8abbd700 1 Processor -- start 2023-10-06T11:13:38.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.886+0000 7fce8abbd700 1 -- start start 2023-10-06T11:13:38.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce8abbd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce84159600 0x7fce840abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce8abbd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce840ac1b0 0x7fce840675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce8abbd700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8406a4e0 con 0x7fce84159230 2023-10-06T11:13:38.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce8abbd700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840ac6a0 con 0x7fce84159600 2023-10-06T11:13:38.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce8abbd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8406b9b0 con 0x7fce840ac1b0 2023-10-06T11:13:38.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce89bbb700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce84159230 0x7fce8406b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45538/0 (socket says 172.21.15.55:45538) 2023-10-06T11:13:38.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce89bbb700 1 -- 172.21.15.55:0/2196770461 learned_addr learned my addr 172.21.15.55:0/2196770461 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:38.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce893ba700 1 --2- 172.21.15.55:0/2196770461 >> v2:172.21.15.55:3300/0 conn(0x7fce84159600 0x7fce840abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/2196770461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce840ac1b0 0x7fce840675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce88bb9700 1 -- 172.21.15.55:0/2196770461 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318688030 0 0) 0x7fce8406a4e0 con 0x7fce84159230 2023-10-06T11:13:38.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce88bb9700 1 -- 172.21.15.55:0/2196770461 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c003570 con 0x7fce84159230 2023-10-06T11:13:38.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.887+0000 7fce893ba700 1 -- 172.21.15.55:0/2196770461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce840ac1b0 msgr2=0x7fce840675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce893ba700 1 --2- 172.21.15.55:0/2196770461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce840ac1b0 0x7fce840675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce893ba700 1 -- 172.21.15.55:0/2196770461 >> v1:172.21.15.55:6789/0 conn(0x7fce84159230 legacy=0x7fce8406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce893ba700 1 -- 172.21.15.55:0/2196770461 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8406a7c0 con 0x7fce84159600 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce893ba700 1 --2- 172.21.15.55:0/2196770461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159600 0x7fce840abc70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce780098e0 tx=0x7fce780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282ebab4870d0231 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce88bb9700 1 -- 172.21.15.55:0/2196770461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78011630 con 0x7fce84159600 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce88bb9700 1 -- 172.21.15.55:0/2196770461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78011790 con 0x7fce84159600 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce88bb9700 1 -- 172.21.15.55:0/2196770461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78011b30 con 0x7fce84159600 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce8abbd700 1 -- 172.21.15.55:0/2196770461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159600 msgr2=0x7fce840abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2196770461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159600 0x7fce840abc70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce780098e0 tx=0x7fce780091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce8abbd700 1 -- 172.21.15.55:0/2196770461 shutdown_connections 2023-10-06T11:13:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2196770461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce840ac1b0 0x7fce840675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2196770461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159600 0x7fce840abc70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.888+0000 7fce8abbd700 1 -- 172.21.15.55:0/2196770461 >> 172.21.15.55:0/2196770461 conn(0x7fce84069130 msgr2=0x7fce840ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.889+0000 7fce8abbd700 1 -- 172.21.15.55:0/2196770461 shutdown_connections 2023-10-06T11:13:38.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.889+0000 7fce8abbd700 1 -- 172.21.15.55:0/2196770461 wait complete. 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 Processor -- start 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 -- start start 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce840ac1b0 0x7fce841563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 0x7fce840ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce84159600 0x7fce840aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8414cbe0 con 0x7fce84159230 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce841568e0 con 0x7fce840ac1b0 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce8abbd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce84154ed0 con 0x7fce84159600 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.890+0000 7fce893ba700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 0x7fce840ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 0x7fce840ae620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45908/0 (socket says 172.21.15.55:45908) 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 -- 172.21.15.55:0/2993510962 learned_addr learned my addr 172.21.15.55:0/2993510962 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce84159600 0x7fce840aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce89bbb700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce840ac1b0 0x7fce841563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 -- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce84159600 msgr2=0x7fce840aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce84159600 0x7fce840aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 -- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce840ac1b0 msgr2=0x7fce841563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce840ac1b0 0x7fce841563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 -- 172.21.15.55:0/2993510962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009420 con 0x7fce84159230 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce84159600 0x7fce840aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce893ba700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 0x7fce840ae620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce840696a0 tx=0x7fce78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce81ffb700 1 -- 172.21.15.55:0/2993510962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78011b10 con 0x7fce84159230 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce81ffb700 1 -- 172.21.15.55:0/2993510962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce780233f0 con 0x7fce84159230 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce841551b0 con 0x7fce84159230 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce81ffb700 1 -- 172.21.15.55:0/2993510962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78023770 con 0x7fce84159230 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.891+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce84155770 con 0x7fce84159230 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.893+0000 7fce81ffb700 1 -- 172.21.15.55:0/2993510962 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce7802c3b0 con 0x7fce84159230 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.893+0000 7fce81ffb700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce70066f30 0x7fce700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.894+0000 7fce81ffb700 1 -- 172.21.15.55:0/2993510962 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fce78085e60 con 0x7fce84159230 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.894+0000 7fce89bbb700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce70066f30 0x7fce700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.894+0000 7fce89bbb700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce70066f30 0x7fce700693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce8416c760 tx=0x7fce74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.895+0000 7fce95117b80 1 Processor -- start 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.895+0000 7fce95117b80 1 -- start start 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce95117b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2581bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be25844920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25817990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce95117b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2579bc80 con 0x55be2581b950 2023-10-06T11:13:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be25772a70 con 0x55be25865bc0 2023-10-06T11:13:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be25770270 con 0x55be25844e60 2023-10-06T11:13:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2581bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2581bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45924/0 (socket says 172.21.15.55:45924) 2023-10-06T11:13:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 -- 172.21.15.55:0/3932160224 learned_addr learned my addr 172.21.15.55:0/3932160224 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce893ba700 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be25844920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25817990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 -- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 msgr2=0x55be25817990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25817990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 -- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 msgr2=0x55be25844920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be25844920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.896+0000 7fce89bbb700 1 -- 172.21.15.55:0/3932160224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be25606270 con 0x55be2581b950 2023-10-06T11:13:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce89bbb700 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2581bd20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce74005b60 tx=0x7fce74013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76008df064f6656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce6affd700 1 -- 172.21.15.55:0/3932160224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005e70 con 0x55be2581b950 2023-10-06T11:13:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce6affd700 1 -- 172.21.15.55:0/3932160224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74007770 con 0x55be2581b950 2023-10-06T11:13:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce6affd700 1 -- 172.21.15.55:0/3932160224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400e840 con 0x55be2581b950 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 -- 172.21.15.55:0/3932160224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 msgr2=0x55be2581bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2581bd20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce74005b60 tx=0x7fce74013000 comp rx=0 tx=0).stop 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 -- 172.21.15.55:0/3932160224 shutdown_connections 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2581bd20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25817990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 --2- 172.21.15.55:0/3932160224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be25844920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 -- 172.21.15.55:0/3932160224 >> 172.21.15.55:0/3932160224 conn(0x55be2581d270 msgr2=0x55be2581d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 -- 172.21.15.55:0/3932160224 shutdown_connections 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.897+0000 7fce95117b80 1 -- 172.21.15.55:0/3932160224 wait complete. 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.898+0000 7fce95117b80 1 -- start start 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.898+0000 7fce95117b80 1 Processor -- start 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be25840c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be2585fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be2585b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2576c060 con 0x55be2581b950 2023-10-06T11:13:38.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be25717890 con 0x55be25865bc0 2023-10-06T11:13:38.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be25732ea0 con 0x55be25844e60 2023-10-06T11:13:38.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce95117b80 10 client.0 _ll_register_callbacks cb 0x55be25608f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:38.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be25840c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be25840c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45926/0 (socket says 172.21.15.55:45926) 2023-10-06T11:13:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 -- 172.21.15.55:0/3626620506 learned_addr learned my addr 172.21.15.55:0/3626620506 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce893ba700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be2585fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be2585b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 -- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 msgr2=0x55be2585fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be2585fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 -- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 msgr2=0x55be2585b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be2585b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.899+0000 7fce89bbb700 1 -- 172.21.15.55:0/3626620506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7400f040 con 0x55be2581b950 2023-10-06T11:13:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce89bbb700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be25840c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fce740058d0 tx=0x7fce74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1847d11344bfc4b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce63fff700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:13:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce63fff700 1 -- 172.21.15.55:0/3626620506 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400e840 con 0x55be2581b950 2023-10-06T11:13:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce63fff700 1 -- 172.21.15.55:0/3626620506 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fce7400ebb0 con 0x55be2581b950 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be25810690 con 0x55be2581b950 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce63fff700 1 -- 172.21.15.55:0/3626620506 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce74022420 con 0x55be2581b950 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 10 client.4761 fetch_fsmap learned FSMap version 9 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55be255a8fe0 con 0x55be2581b950 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce63fff700 1 -- 172.21.15.55:0/3626620506 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be25810690 con 0x55be2581b950 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce63fff700 1 -- 172.21.15.55:0/3626620506 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fce74022580 con 0x55be2581b950 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 10 client.4761 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 10 client.4761 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 20 client.4761 populate_metadata read hostname 'smithi055' 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be258121a0 0x55be25875790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 4 client.4761 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 --> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be257ed5c0 con 0x55be258121a0 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.900+0000 7fce893ba700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be258121a0 0x55be25875790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.901+0000 7fce63fff700 10 client.4761 ms_handle_connect on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.901+0000 7fce893ba700 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be258121a0 0x55be25875790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db0fa0b7d1c60e61 server_cookie=b5e35bebebc51dfb in_seq=0 out_seq=0 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.901+0000 7fce63fff700 1 -- 172.21.15.55:0/3626620506 <== mds.0 v2:172.21.15.142:6834/2998784723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55be257ed5c0 con 0x55be258121a0 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.901+0000 7fce63fff700 10 client.4761 handle_command_reply: tid=0 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.901+0000 7fce95117b80 1 client.4761 shutdown 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 msgr2=0x55be25840c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be25840c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fce740058d0 tx=0x7fce74014000 comp rx=0 tx=0).stop 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 shutdown_connections 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be258121a0 0x55be25875790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be25840c60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25865bc0 0x55be2585b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce63fff700 0 client.4761 ms_handle_reset on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 --2- 172.21.15.55:0/3626620506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be2585fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 >> 172.21.15.55:0/3626620506 conn(0x55be2581d270 msgr2=0x55be25841820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 shutdown_connections 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 1 -- 172.21.15.55:0/3626620506 wait complete. 2023-10-06T11:13:38.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.902+0000 7fce95117b80 20 client.4761 trim_cache size 0 max 16384 2023-10-06T11:13:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 Processor -- start 2023-10-06T11:13:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 -- start start 2023-10-06T11:13:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be258121a0 0x55be25819710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2585e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25844e60 0x55be25840e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be255eee30 con 0x55be2581b950 2023-10-06T11:13:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2581a980 con 0x55be25844e60 2023-10-06T11:13:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be2581d9a0 con 0x55be258121a0 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce893ba700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2585e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce893ba700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2585e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45932/0 (socket says 172.21.15.55:45932) 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.919+0000 7fce893ba700 1 -- 172.21.15.55:0/3491823839 learned_addr learned my addr 172.21.15.55:0/3491823839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce893ba700 1 -- 172.21.15.55:0/3491823839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be258121a0 msgr2=0x55be25819710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce893ba700 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be258121a0 0x55be25819710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce893ba700 1 -- 172.21.15.55:0/3491823839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25844e60 msgr2=0x55be25840e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce893ba700 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25844e60 0x55be25840e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce893ba700 1 -- 172.21.15.55:0/3491823839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be2573a780 con 0x55be2581b950 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce893ba700 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2585e570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce780566c0 tx=0x7fce78059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537babf76ac0b846 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce6b7fe700 1 -- 172.21.15.55:0/3491823839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7805d960 con 0x55be2581b950 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce6b7fe700 1 -- 172.21.15.55:0/3491823839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78084040 con 0x55be2581b950 2023-10-06T11:13:38.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce6b7fe700 1 -- 172.21.15.55:0/3491823839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78054d60 con 0x55be2581b950 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 -- 172.21.15.55:0/3491823839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 msgr2=0x55be2585e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2585e570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce780566c0 tx=0x7fce78059040 comp rx=0 tx=0).stop 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 -- 172.21.15.55:0/3491823839 shutdown_connections 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be25844e60 0x55be25840e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be258121a0 0x55be25819710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 --2- 172.21.15.55:0/3491823839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be2581b950 0x55be2585e570 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.920+0000 7fce95117b80 1 -- 172.21.15.55:0/3491823839 >> 172.21.15.55:0/3491823839 conn(0x55be2581d270 msgr2=0x55be25843830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.921+0000 7fce95117b80 1 -- 172.21.15.55:0/3491823839 shutdown_connections 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.921+0000 7fce95117b80 1 -- 172.21.15.55:0/3491823839 wait complete. 2023-10-06T11:13:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.921+0000 7fce95117b80 1 -- start start 2023-10-06T11:13:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.921+0000 7fce95117b80 1 Processor -- start 2023-10-06T11:13:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 0x55be258604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be2581b950 0x55be25843830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25843d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be258c8dc0 con 0x55be258121a0 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2585bf40 con 0x55be2581b950 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be2585c190 con 0x55be25844e60 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce95117b80 10 client.0 _ll_register_callbacks cb 0x55be25608f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 0x55be258604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 0x55be258604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45948/0 (socket says 172.21.15.55:45948) 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 -- 172.21.15.55:0/1249433902 learned_addr learned my addr 172.21.15.55:0/1249433902 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce893ba700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be2581b950 0x55be25843830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25843d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 -- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 msgr2=0x55be25843d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25843d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 -- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be2581b950 msgr2=0x55be25843830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:38.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be2581b950 0x55be25843830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 -- 172.21.15.55:0/1249433902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce84155770 con 0x55be258121a0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce893ba700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be2581b950 0x55be25843830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce8a3bc700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25843d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce89bbb700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 0x55be258604e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce74034040 tx=0x7fce7402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bef6238d2765041 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.922+0000 7fce63fff700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce63fff700 1 -- 172.21.15.55:0/1249433902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005e70 con 0x55be258121a0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce63fff700 1 -- 172.21.15.55:0/1249433902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fce74022a40 con 0x55be258121a0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce74007770 con 0x55be258121a0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce63fff700 1 -- 172.21.15.55:0/1249433902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce7400ebb0 con 0x55be258121a0 2023-10-06T11:13:38.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 10 client.4767 fetch_fsmap learned FSMap version 9 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55be25721470 con 0x55be258121a0 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce63fff700 1 -- 172.21.15.55:0/1249433902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74007770 con 0x55be258121a0 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce63fff700 1 -- 172.21.15.55:0/1249433902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fce74004a40 con 0x55be258121a0 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 10 client.4767 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 10 client.4767 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 20 client.4767 populate_metadata read hostname 'smithi055' 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be25865bc0 0x55be2585d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 4 client.4767 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-10-06T11:13:38.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 --> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be2570ee00 con 0x55be25865bc0 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.923+0000 7fce893ba700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be25865bc0 0x55be2585d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce63fff700 10 client.4767 ms_handle_connect on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce893ba700 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be25865bc0 0x55be2585d670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19cf75039ed93b49 server_cookie=f17db409217a6f72 in_seq=0 out_seq=0 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce63fff700 1 -- 172.21.15.55:0/1249433902 <== mds.0 v2:172.21.15.142:6834/2998784723 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55be2570ee00 con 0x55be25865bc0 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce63fff700 10 client.4767 handle_command_reply: tid=0 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 client.4767 shutdown 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 msgr2=0x55be258604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 0x55be258604e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce74034040 tx=0x7fce7402a000 comp rx=0 tx=0).stop 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 shutdown_connections 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:6834/2998784723,v1:172.21.15.142:6836/2998784723] conn(0x55be25865bc0 0x55be2585d670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be258121a0 0x55be258604e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce63fff700 0 client.4767 ms_handle_reset on v2:172.21.15.142:6834/2998784723 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55be25844e60 0x55be25843d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 --2- 172.21.15.55:0/1249433902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55be2581b950 0x55be25843830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 >> 172.21.15.55:0/1249433902 conn(0x55be2581d270 msgr2=0x55be2585e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 shutdown_connections 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 1 -- 172.21.15.55:0/1249433902 wait complete. 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.924+0000 7fce95117b80 20 client.4767 trim_cache size 0 max 16384 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:13:38.933 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4290, 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 25.805194671999999, 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 9, 2023-10-06T11:13:38.934 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 28, 2023-10-06T11:13:38.935 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 28, 2023-10-06T11:13:38.935 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 31.771207753999999 2023-10-06T11:13:38.935 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:13:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce70066f30 msgr2=0x7fce700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce70066f30 0x7fce700693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce8416c760 tx=0x7fce74009040 comp rx=0 tx=0).stop 2023-10-06T11:13:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 msgr2=0x7fce840ae620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 0x7fce840ae620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce840696a0 tx=0x7fce78017000 comp rx=0 tx=0).stop 2023-10-06T11:13:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 shutdown_connections 2023-10-06T11:13:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce70066f30 0x7fce700693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce84159600 0x7fce840aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce840ac1b0 0x7fce841563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 --2- 172.21.15.55:0/2993510962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce84159230 0x7fce840ae620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 >> 172.21.15.55:0/2993510962 conn(0x7fce84069130 msgr2=0x7fce8406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 shutdown_connections 2023-10-06T11:13:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:38.925+0000 7fce8abbd700 1 -- 172.21.15.55:0/2993510962 wait complete. 2023-10-06T11:13:38.939 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T11:13:38.953 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T11:13:38.953 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T11:13:38.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:38.954 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:13:38.970 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T11:13:38.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:38.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T11:13:39.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-10-06T11:13:39.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.150 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:13:39.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-10-06T11:13:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-10-06T11:13:39.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:13:39.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.237 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:13:39.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-10-06T11:13:39.327 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-10-06T11:13:39.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:13:39.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.329 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:13:39.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-10-06T11:13:39.454 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-10-06T11:13:39.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:13:39.456 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T11:13:39.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:13:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.574+0000 7f0ef5eb6700 1 Processor -- start 2023-10-06T11:13:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.574+0000 7f0ef5eb6700 1 -- start start 2023-10-06T11:13:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0ef5eb6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ef006eac0 0x7f0ef00ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0ef5eb6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00acd20 con 0x7f0ef0156500 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0ef5eb6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef01568d0 con 0x7f0ef006e650 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0ef5eb6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef006f430 con 0x7f0ef006eac0 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ef006eac0 0x7f0ef00ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ef006eac0 0x7f0ef00ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45952/0 (socket says 172.21.15.55:45952) 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 -- 172.21.15.55:0/3467593097 learned_addr learned my addr 172.21.15.55:0/3467593097 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eef7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0ef0156500 0x7f0ef00c7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45546/0 (socket says 172.21.15.55:45546) 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 -- 172.21.15.55:0/3467593097 >> v1:172.21.15.142:6789/0 conn(0x7f0ef006e650 legacy=0x7f0ef00ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 -- 172.21.15.55:0/3467593097 >> v1:172.21.15.55:6789/0 conn(0x7f0ef0156500 legacy=0x7f0ef00c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 -- 172.21.15.55:0/3467593097 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00c7b30 con 0x7f0ef006eac0 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eee7fc700 1 -- 172.21.15.55:0/3467593097 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789722912 0 0) 0x7f0ef00acd20 con 0x7f0ef0156500 2023-10-06T11:13:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.575+0000 7f0eeffff700 1 --2- 172.21.15.55:0/3467593097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef006eac0 0x7f0ef00ad8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009f20 tx=0x7f0ee8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989571321421b682 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0eee7fc700 1 -- 172.21.15.55:0/3467593097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800e070 con 0x7f0ef006eac0 2023-10-06T11:13:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0eee7fc700 1 -- 172.21.15.55:0/3467593097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800ba80 con 0x7f0ef006eac0 2023-10-06T11:13:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0eee7fc700 1 -- 172.21.15.55:0/3467593097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80092e0 con 0x7f0ef006eac0 2023-10-06T11:13:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/3467593097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef006eac0 msgr2=0x7f0ef00ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/3467593097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef006eac0 0x7f0ef00ad8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009f20 tx=0x7f0ee8009840 comp rx=0 tx=0).stop 2023-10-06T11:13:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/3467593097 shutdown_connections 2023-10-06T11:13:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/3467593097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef006eac0 0x7f0ef00ad8c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/3467593097 >> 172.21.15.55:0/3467593097 conn(0x7f0ef0068080 msgr2=0x7f0ef00cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/3467593097 shutdown_connections 2023-10-06T11:13:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.576+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/3467593097 wait complete. 2023-10-06T11:13:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.578+0000 7f0ef5eb6700 1 Processor -- start 2023-10-06T11:13:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.578+0000 7f0ef5eb6700 1 -- start start 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef006e650 0x7f0ef0069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef006eac0 0x7f0ef00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 0x7f0ef0153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00ccad0 con 0x7f0ef0156500 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0157730 con 0x7f0ef006eac0 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0157a10 con 0x7f0ef006e650 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 0x7f0ef0153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 0x7f0ef0153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45956/0 (socket says 172.21.15.55:45956) 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 -- 172.21.15.55:0/1549374230 learned_addr learned my addr 172.21.15.55:0/1549374230 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeeffd700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef006eac0 0x7f0ef00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eef7fe700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef006e650 0x7f0ef0069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 -- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef006e650 msgr2=0x7f0ef0069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef006e650 0x7f0ef0069670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 -- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef006eac0 msgr2=0x7f0ef00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef006eac0 0x7f0ef00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 -- 172.21.15.55:0/1549374230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009ae0 con 0x7f0ef0156500 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eef7fe700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef006e650 0x7f0ef0069670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0eeffff700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 0x7f0ef0153270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009880 tx=0x7f0ee8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8008d90 con 0x7f0ef0156500 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee8026460 con 0x7f0ef0156500 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0157cf0 con 0x7f0ef0156500 2023-10-06T11:13:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8026820 con 0x7f0ef0156500 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.579+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef01582b0 con 0x7f0ef0156500 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.580+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef0064a90 con 0x7f0ef0156500 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.581+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ee8003040 con 0x7f0ef0156500 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.581+0000 7f0ed77fe700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0edc066f30 0x7f0edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.581+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0ee8086b10 con 0x7f0ef0156500 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.581+0000 7f0eef7fe700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0edc066f30 0x7f0edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.582+0000 7f0eef7fe700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0edc066f30 0x7f0edc0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00011e0 tx=0x7f0ee0007c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.585+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ee8053930 con 0x7f0ef0156500 2023-10-06T11:13:39.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.823+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ef00c7e10 con 0x7f0ef0156500 2023-10-06T11:13:39.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.823+0000 7f0ed77fe700 1 -- 172.21.15.55:0/1549374230 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0ee8009940 con 0x7f0ef0156500 2023-10-06T11:13:39.825 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T11:13:39.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.825+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0edc066f30 msgr2=0x7f0edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.825+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0edc066f30 0x7f0edc0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00011e0 tx=0x7f0ee0007c70 comp rx=0 tx=0).stop 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 msgr2=0x7f0ef0153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 0x7f0ef0153270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009880 tx=0x7f0ee8018000 comp rx=0 tx=0).stop 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 shutdown_connections 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0edc066f30 0x7f0edc0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0156500 0x7f0ef0153270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef006e650 0x7f0ef0069670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 --2- 172.21.15.55:0/1549374230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef006eac0 0x7f0ef00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 >> 172.21.15.55:0/1549374230 conn(0x7f0ef0068080 msgr2=0x7f0ef00ae500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 shutdown_connections 2023-10-06T11:13:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:39.826+0000 7f0ef5eb6700 1 -- 172.21.15.55:0/1549374230 wait complete. 2023-10-06T11:13:39.839 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:13:39.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:13:39.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:13:39.839 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:13:39.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:39.840 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:13:39.840 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:13:39.840 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:13:39.840 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:13:39.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.840 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:13:39.855 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:13:39.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42473sec preferred_lft 42473sec 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:39.857 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:39.858 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:13:39.858 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T11:13:39.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.858 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:39.858 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:39.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2023-10-06T11:13:39.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2023-10-06T11:13:39.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2023-10-06T11:13:39.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T11:13:39.859 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:39.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.969 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:13:39.994 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:13:39.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:39.995 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:13:40.052 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:13:40.052 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:13:40.052 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:13:40.053 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:13:40.053 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:13:40.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.053 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:40.054 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:40.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:13:40.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:13:40.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:13:40.054 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:40.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.155 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:13:40.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.171 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-10-06T11:13:40.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.225 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:40.226 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:40.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:13:40.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T11:13:40.226 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:40.319 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T11:13:40.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.319 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:40.319 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:40.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T11:13:40.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T11:13:40.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T11:13:40.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T11:13:40.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T11:13:40.320 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:40.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.491 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:40.491 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:40.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:13:40.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T11:13:40.492 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:40.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:40.585 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:40.600 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:13:40.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:40.601 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:40.655 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:13:40.655 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:13:40.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:40.737 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:40.737 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:40.847 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:40.847 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:40.847 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:40.847 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:40.847 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:40.847 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:40.848 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:40.848 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:40.869 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:13:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:13:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:13:40.872 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:13:40.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:40.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:40.938 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T11:13:40.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:13:41.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.097+0000 7f28f60ea700 1 Processor -- start 2023-10-06T11:13:41.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.097+0000 7f28f60ea700 1 -- start start 2023-10-06T11:13:41.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.098+0000 7f28f60ea700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28f00ca370 0x7f28f0158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.098+0000 7f28f60ea700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 0x7f28f015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.098+0000 7f28f60ea700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f0157de0 con 0x7f28f00adb60 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.098+0000 7f28f60ea700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00cbb90 con 0x7f28f00ca370 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.098+0000 7f28f60ea700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f00cb5d0 con 0x7f28f00ce8a0 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28effff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 0x7f28f015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ef7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28f00ca370 0x7f28f0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28effff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 0x7f28f015aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:52066/0 (socket says 172.21.15.55:52066) 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28effff700 1 -- 172.21.15.55:0/3569166663 learned_addr learned my addr 172.21.15.55:0/3569166663 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28eeffd700 1 --1- 172.21.15.55:0/3569166663 >> v1:172.21.15.142:6789/0 conn(0x7f28f00adb60 0x7f28f00ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:52878/0 (socket says 172.21.15.55:52878) 2023-10-06T11:13:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ef7fe700 1 -- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 msgr2=0x7f28f015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ef7fe700 1 --2- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 0x7f28f015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ef7fe700 1 -- 172.21.15.55:0/3569166663 >> v1:172.21.15.142:6789/0 conn(0x7f28f00adb60 legacy=0x7f28f00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ef7fe700 1 -- 172.21.15.55:0/3569166663 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00cb8b0 con 0x7f28f00ca370 2023-10-06T11:13:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ee7fc700 1 -- 172.21.15.55:0/3569166663 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957625187 0 0) 0x7f28f0157de0 con 0x7f28f00adb60 2023-10-06T11:13:41.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28effff700 1 --2- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 0x7f28f015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.099+0000 7f28ef7fe700 1 --2- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ca370 0x7f28f0158270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28e00098e0 tx=0x7f28e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed67bc00b5345f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28ee7fc700 1 -- 172.21.15.55:0/3569166663 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000b640 con 0x7f28f00ca370 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28ee7fc700 1 -- 172.21.15.55:0/3569166663 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000b7a0 con 0x7f28f00ca370 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28ee7fc700 1 -- 172.21.15.55:0/3569166663 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000bb40 con 0x7f28f00ca370 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 -- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ca370 msgr2=0x7f28f0158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 --2- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ca370 0x7f28f0158270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28e00098e0 tx=0x7f28e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 -- 172.21.15.55:0/3569166663 shutdown_connections 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 --2- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00ce8a0 0x7f28f015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 --2- 172.21.15.55:0/3569166663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ca370 0x7f28f0158270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 -- 172.21.15.55:0/3569166663 >> 172.21.15.55:0/3569166663 conn(0x7f28f00707d0 msgr2=0x7f28f0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 -- 172.21.15.55:0/3569166663 shutdown_connections 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.100+0000 7f28f60ea700 1 -- 172.21.15.55:0/3569166663 wait complete. 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.101+0000 7f28f60ea700 1 Processor -- start 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.101+0000 7f28f60ea700 1 -- start start 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28f60ea700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00adb60 0x7f28f01681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28f60ea700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 0x7f28f00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28f60ea700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ce8a0 0x7f28f0146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28f60ea700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f00c5000 con 0x7f28f00ca370 2023-10-06T11:13:41.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28f60ea700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f01686e0 con 0x7f28f00ce8a0 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28f60ea700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f00c47c0 con 0x7f28f00adb60 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 0x7f28f00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 0x7f28f00b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45958/0 (socket says 172.21.15.55:45958) 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28eeffd700 1 -- 172.21.15.55:0/2259642501 learned_addr learned my addr 172.21.15.55:0/2259642501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28ef7fe700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00adb60 0x7f28f01681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.102+0000 7f28effff700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ce8a0 0x7f28f0146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28eeffd700 1 -- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00adb60 msgr2=0x7f28f01681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28eeffd700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00adb60 0x7f28f01681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28eeffd700 1 -- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ce8a0 msgr2=0x7f28f0146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28eeffd700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ce8a0 0x7f28f0146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28eeffd700 1 -- 172.21.15.55:0/2259642501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8009ae0 con 0x7f28f00ca370 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28eeffd700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 0x7f28f00b1a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28e400c540 tx=0x7f28e400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4005a70 con 0x7f28f00ca370 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e0009420 con 0x7f28f00ca370 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4005bf0 con 0x7f28f00ca370 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40070d0 con 0x7f28f00ca370 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.103+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f00c4da0 con 0x7f28f00ca370 2023-10-06T11:13:41.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.104+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f0064a90 con 0x7f28f00ca370 2023-10-06T11:13:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.104+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28e4007480 con 0x7f28f00ca370 2023-10-06T11:13:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.105+0000 7f28d77fe700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28dc066f30 0x7f28dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.105+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f28e4083e20 con 0x7f28f00ca370 2023-10-06T11:13:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.105+0000 7f28ef7fe700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28dc066f30 0x7f28dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.106+0000 7f28ef7fe700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28dc066f30 0x7f28dc0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28f0158370 tx=0x7f28e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:41.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.109+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28e4050c40 con 0x7f28f00ca370 2023-10-06T11:13:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.351+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28f0157b00 con 0x7f28f00ca370 2023-10-06T11:13:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.351+0000 7f28d77fe700 1 -- 172.21.15.55:0/2259642501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f28e4017070 con 0x7f28f00ca370 2023-10-06T11:13:41.353 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T11:13:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28dc066f30 msgr2=0x7f28dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28dc066f30 0x7f28dc0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28f0158370 tx=0x7f28e0017000 comp rx=0 tx=0).stop 2023-10-06T11:13:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 msgr2=0x7f28f00b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 0x7f28f00b1a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28e400c540 tx=0x7f28e400c850 comp rx=0 tx=0).stop 2023-10-06T11:13:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 shutdown_connections 2023-10-06T11:13:41.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28dc066f30 0x7f28dc0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f00ce8a0 0x7f28f0146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28f00adb60 0x7f28f01681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 --2- 172.21.15.55:0/2259642501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f00ca370 0x7f28f00b1a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 >> 172.21.15.55:0/2259642501 conn(0x7f28f00707d0 msgr2=0x7f28f01533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 shutdown_connections 2023-10-06T11:13:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:41.353+0000 7f28f60ea700 1 -- 172.21.15.55:0/2259642501 wait complete. 2023-10-06T11:13:41.367 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:13:41.367 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:13:41.367 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:13:41.368 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T11:13:41.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T11:13:41.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:13:41.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:13:41.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:13:41.368 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T11:13:41.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.368 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:13:41.383 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:41.383 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:13:41.384 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42471sec preferred_lft 42471sec 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:13:41.385 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link tentative 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link tentative 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.386 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:13:41.447 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:13:41.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.449 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:13:41.504 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:13:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:13:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:13:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:13:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:13:41.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.548 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:41.548 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:41.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:13:41.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:13:41.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:13:41.548 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:41.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.651 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:13:41.666 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:13:41.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.666 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-10-06T11:13:41.721 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T11:13:41.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.722 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:41.722 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:41.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:13:41.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T11:13:41.722 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:41.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T11:13:41.849 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:41.849 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 92:4e:0a:a4:a7:b4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::904e:aff:fea4:a7b4/64 scope link tentative 2023-10-06T11:13:41.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T11:13:41.935 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:41.935 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:41.935 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:41.935 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 92:4e:0a:a4:a7:b4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::904e:aff:fea4:a7b4/64 scope link tentative 2023-10-06T11:13:41.936 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:41.955 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T11:13:41.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:41.955 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:41.955 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:41.955 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T11:13:41.955 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T11:13:41.955 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T11:13:41.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T11:13:41.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T11:13:41.956 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:42.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:42.180 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:13:42.180 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:13:42.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2023-10-06T11:13:42.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T11:13:42.180 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:13:42.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:42.262 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T11:13:42.277 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T11:13:42.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:42.277 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T11:13:42.332 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T11:13:42.333 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:13:42.333 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:42.413 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:42.413 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:42.432 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:42.432 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:42.432 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:42.432 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 2@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:42.432 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:42.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:42.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:42.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:42.454 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:42.455 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:42.455 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:42.455 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 2@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:42.455 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:42.456 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:42.456 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:42.456 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:42.456 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:13:42.457 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:13:42.457 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:13:42.458 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:13:42.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:42.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T11:13:42.523 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T11:13:42.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:13:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.682+0000 7fb65553b700 1 Processor -- start 2023-10-06T11:13:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.682+0000 7fb65553b700 1 -- start start 2023-10-06T11:13:42.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb65553b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb650159440 0x7fb6500b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb65553b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6500b35d0 0x7fb6500cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb65553b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb6500b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb65553b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500cb7a0 con 0x7fb650159440 2023-10-06T11:13:42.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb65553b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500b0860 con 0x7fb6500b35d0 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb65553b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500cb150 con 0x7fb6500cc170 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb650159440 0x7fb6500b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb650159440 0x7fb6500b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45960/0 (socket says 172.21.15.55:45960) 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 -- 172.21.15.55:0/1568858454 learned_addr learned my addr 172.21.15.55:0/1568858454 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64f7fe700 1 --2- 172.21.15.55:0/1568858454 >> v2:172.21.15.142:3300/0 conn(0x7fb6500b35d0 0x7fb6500cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb654d3a700 1 --2- 172.21.15.55:0/1568858454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb6500b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 -- 172.21.15.55:0/1568858454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 msgr2=0x7fb6500b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 --2- 172.21.15.55:0/1568858454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb6500b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 -- 172.21.15.55:0/1568858454 >> v2:172.21.15.142:3300/0 conn(0x7fb6500b35d0 msgr2=0x7fb6500cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 --2- 172.21.15.55:0/1568858454 >> v2:172.21.15.142:3300/0 conn(0x7fb6500b35d0 0x7fb6500cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.683+0000 7fb64ffff700 1 -- 172.21.15.55:0/1568858454 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500cb430 con 0x7fb650159440 2023-10-06T11:13:42.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb64ffff700 1 --2- 172.21.15.55:0/1568858454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb6500b3090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6500d0220 tx=0x7fb640009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92101150f183d5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb64effd700 1 -- 172.21.15.55:0/1568858454 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000b860 con 0x7fb650159440 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb64effd700 1 -- 172.21.15.55:0/1568858454 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000b9c0 con 0x7fb650159440 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb64effd700 1 -- 172.21.15.55:0/1568858454 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000bd60 con 0x7fb650159440 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 -- 172.21.15.55:0/1568858454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 msgr2=0x7fb6500b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 --2- 172.21.15.55:0/1568858454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb6500b3090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6500d0220 tx=0x7fb640009250 comp rx=0 tx=0).stop 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 -- 172.21.15.55:0/1568858454 shutdown_connections 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 --2- 172.21.15.55:0/1568858454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb6500b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 --2- 172.21.15.55:0/1568858454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb6500b3090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 --2- 172.21.15.55:0/1568858454 >> v2:172.21.15.142:3300/0 conn(0x7fb6500b35d0 0x7fb6500cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 -- 172.21.15.55:0/1568858454 >> 172.21.15.55:0/1568858454 conn(0x7fb65006ece0 msgr2=0x7fb65006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:42.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 -- 172.21.15.55:0/1568858454 shutdown_connections 2023-10-06T11:13:42.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.684+0000 7fb65553b700 1 -- 172.21.15.55:0/1568858454 wait complete. 2023-10-06T11:13:42.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.685+0000 7fb65553b700 1 Processor -- start 2023-10-06T11:13:42.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 -- start start 2023-10-06T11:13:42.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6500b35d0 0x7fb6500c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb650154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb65016ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500c3f50 con 0x7fb650159440 2023-10-06T11:13:42.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65016d5f0 con 0x7fb6500b35d0 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb65553b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65016d8d0 con 0x7fb6500cc170 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb654d3a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb65016ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb654d3a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb65016ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45962/0 (socket says 172.21.15.55:45962) 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.686+0000 7fb654d3a700 1 -- 172.21.15.55:0/1219485427 learned_addr learned my addr 172.21.15.55:0/1219485427 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb64ffff700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6500b35d0 0x7fb6500c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb64f7fe700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb650154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb654d3a700 1 -- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 msgr2=0x7fb650154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb654d3a700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb650154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb654d3a700 1 -- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6500b35d0 msgr2=0x7fb6500c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb654d3a700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6500b35d0 0x7fb6500c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb654d3a700 1 -- 172.21.15.55:0/1219485427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400094f0 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb654d3a700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb65016ca10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb648009fa0 tx=0x7fb648009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64800ebc0 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64800ed20 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65015b1e0 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648014670 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.687+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65015b7a0 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.688+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65015b040 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.689+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6480149e0 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.689+0000 7fb637fff700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb63c066f30 0x7fb63c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.689+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb648084fc0 con 0x7fb650159440 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.689+0000 7fb64ffff700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb63c066f30 0x7fb63c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:42.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.690+0000 7fb64ffff700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb63c066f30 0x7fb63c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb6500d0220 tx=0x7fb640017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:42.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.694+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb65015b040 con 0x7fb650159440 2023-10-06T11:13:42.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.933+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb65015b040 con 0x7fb650159440 2023-10-06T11:13:42.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.934+0000 7fb637fff700 1 -- 172.21.15.55:0/1219485427 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb65015b040 con 0x7fb650159440 2023-10-06T11:13:42.936 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb63c066f30 msgr2=0x7fb63c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb63c066f30 0x7fb63c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb6500d0220 tx=0x7fb640017000 comp rx=0 tx=0).stop 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 msgr2=0x7fb65016ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb65016ca10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb648009fa0 tx=0x7fb648009900 comp rx=0 tx=0).stop 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 shutdown_connections 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb63c066f30 0x7fb63c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb650159440 0x7fb65016ca10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6500b35d0 0x7fb6500c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 --2- 172.21.15.55:0/1219485427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6500cc170 0x7fb650154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:42.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 >> 172.21.15.55:0/1219485427 conn(0x7fb65006ece0 msgr2=0x7fb650156900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:42.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 shutdown_connections 2023-10-06T11:13:42.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:42.936+0000 7fb65553b700 1 -- 172.21.15.55:0/1219485427 wait complete. 2023-10-06T11:13:42.949 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:13:42.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:13:42.950 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:13:42.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:42.950 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:42.971 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:13:42.972 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42473sec preferred_lft 42473sec 2023-10-06T11:13:42.972 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:13:42.972 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:42.972 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T11:13:42.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:42.972 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:42.972 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:42.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-10-06T11:13:42.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-10-06T11:13:42.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-10-06T11:13:42.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T11:13:42.973 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:43.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.155 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:13:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:13:43.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.201 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:13:43.236 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:13:43.236 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:13:43.236 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:13:43.236 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:13:43.236 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:13:43.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.237 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:43.237 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:43.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:13:43.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:13:43.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:13:43.237 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:43.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.509 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:13:43.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.524 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-10-06T11:13:43.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.579 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:43.579 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:43.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:13:43.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T11:13:43.579 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:43.667 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T11:13:43.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T11:13:43.668 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:43.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:43.867 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:43.867 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:43.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:13:43.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T11:13:43.868 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:43.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:43.959 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:13:43.973 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:13:43.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:43.974 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:13:44.028 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:13:44.028 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:13:44.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:44.121 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:44.122 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:44.213 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:44.234 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:44.234 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:13:44.236 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:13:44.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.236 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:13:44.260 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T11:13:44.261 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:13:44.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.393+0000 7f27d143f700 1 Processor -- start 2023-10-06T11:13:44.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.393+0000 7f27d143f700 1 -- start start 2023-10-06T11:13:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27d143f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27d143f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f27cc0b49a0 0x7f27cc0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27d143f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27cc0b0760 0x7f27cc0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27d143f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc0b0c60 con 0x7f27cc0b49a0 2023-10-06T11:13:44.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27d143f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc0b0f40 con 0x7f27cc0b0760 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27d143f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0b1220 con 0x7f27cc159560 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f27cc0b49a0 0x7f27cc0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f27cc0b49a0 0x7f27cc0aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50476/0 (socket says 172.21.15.55:50476) 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 -- 172.21.15.55:0/2284749935 learned_addr learned my addr 172.21.15.55:0/2284749935 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27caffd700 1 --2- 172.21.15.55:0/2284749935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27cb7fe700 1 --2- 172.21.15.55:0/2284749935 >> v2:172.21.15.142:3300/0 conn(0x7f27cc0b0760 0x7f27cc0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 -- 172.21.15.55:0/2284749935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 msgr2=0x7f27cc0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:44.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/2284749935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 -- 172.21.15.55:0/2284749935 >> v2:172.21.15.142:3300/0 conn(0x7f27cc0b0760 msgr2=0x7f27cc0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:44.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/2284749935 >> v2:172.21.15.142:3300/0 conn(0x7f27cc0b0760 0x7f27cc0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 -- 172.21.15.55:0/2284749935 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0b1500 con 0x7f27cc0b49a0 2023-10-06T11:13:44.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.394+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/2284749935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b49a0 0x7f27cc0aaa70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b2f10 tx=0x7f27c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f14880dbdb6bff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:44.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27c9ffb700 1 -- 172.21.15.55:0/2284749935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000b640 con 0x7f27cc0b49a0 2023-10-06T11:13:44.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27c9ffb700 1 -- 172.21.15.55:0/2284749935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000b7a0 con 0x7f27cc0b49a0 2023-10-06T11:13:44.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27c9ffb700 1 -- 172.21.15.55:0/2284749935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000bb60 con 0x7f27cc0b49a0 2023-10-06T11:13:44.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 -- 172.21.15.55:0/2284749935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b49a0 msgr2=0x7f27cc0aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 --2- 172.21.15.55:0/2284749935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b49a0 0x7f27cc0aaa70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b2f10 tx=0x7f27c0009250 comp rx=0 tx=0).stop 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 -- 172.21.15.55:0/2284749935 shutdown_connections 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 --2- 172.21.15.55:0/2284749935 >> v2:172.21.15.142:3300/0 conn(0x7f27cc0b0760 0x7f27cc0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 --2- 172.21.15.55:0/2284749935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 --2- 172.21.15.55:0/2284749935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b49a0 0x7f27cc0aaa70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 -- 172.21.15.55:0/2284749935 >> 172.21.15.55:0/2284749935 conn(0x7f27cc0997f0 msgr2=0x7f27cc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 -- 172.21.15.55:0/2284749935 shutdown_connections 2023-10-06T11:13:44.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.395+0000 7f27d143f700 1 -- 172.21.15.55:0/2284749935 wait complete. 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.396+0000 7f27d143f700 1 Processor -- start 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 -- start start 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 0x7f27cc09d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc0b49a0 0x7f27cc09af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc09d750 con 0x7f27cc0b0760 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc09b440 con 0x7f27cc0b49a0 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27d143f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc09c260 con 0x7f27cc159560 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27caffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 0x7f27cc09d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27caffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 0x7f27cc09d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50490/0 (socket says 172.21.15.55:50490) 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.397+0000 7f27caffd700 1 -- 172.21.15.55:0/461071189 learned_addr learned my addr 172.21.15.55:0/461071189 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27cb7fe700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27caffd700 1 -- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 msgr2=0x7f27cc0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27caffd700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27caffd700 1 -- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc0b49a0 msgr2=0x7f27cc09af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc0b49a0 0x7f27cc09af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27caffd700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc0b49a0 0x7f27cc09af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27caffd700 1 -- 172.21.15.55:0/461071189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00094f0 con 0x7f27cc0b0760 2023-10-06T11:13:44.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27cb7fe700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:44.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc0b49a0 0x7f27cc09af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:44.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27caffd700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 0x7f27cc09d210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00ea00 tx=0x7f27bc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:44.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00c850 con 0x7f27cc0b0760 2023-10-06T11:13:44.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00c9b0 con 0x7f27cc0b0760 2023-10-06T11:13:44.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00cd30 con 0x7f27cc0b0760 2023-10-06T11:13:44.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc09b650 con 0x7f27cc0b0760 2023-10-06T11:13:44.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.398+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc09bc10 con 0x7f27cc0b0760 2023-10-06T11:13:44.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.399+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc064a90 con 0x7f27cc0b0760 2023-10-06T11:13:44.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.399+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27bc013680 con 0x7f27cc0b0760 2023-10-06T11:13:44.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.400+0000 7f27b2ffd700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f27b8066f30 0x7f27b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:44.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.400+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f27bc084fa0 con 0x7f27cc0b0760 2023-10-06T11:13:44.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.400+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f27b8066f30 0x7f27b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:44.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.400+0000 7f27ca7fc700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f27b8066f30 0x7f27b80693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b2f10 tx=0x7f27c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:44.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.404+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27bc051dc0 con 0x7f27cc0b0760 2023-10-06T11:13:44.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.641+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27cc0b17e0 con 0x7f27cc0b0760 2023-10-06T11:13:44.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.641+0000 7f27b2ffd700 1 -- 172.21.15.55:0/461071189 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f27bc021070 con 0x7f27cc0b0760 2023-10-06T11:13:44.643 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T11:13:44.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f27b8066f30 msgr2=0x7f27b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:44.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f27b8066f30 0x7f27b80693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b2f10 tx=0x7f27c0017000 comp rx=0 tx=0).stop 2023-10-06T11:13:44.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 msgr2=0x7f27cc09d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:44.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 0x7f27cc09d210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00ea00 tx=0x7f27bc009120 comp rx=0 tx=0).stop 2023-10-06T11:13:44.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 shutdown_connections 2023-10-06T11:13:44.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f27b8066f30 0x7f27b80693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27cc0b0760 0x7f27cc09d210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27cc159560 0x7f27cc0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 --2- 172.21.15.55:0/461071189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27cc0b49a0 0x7f27cc09af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:44.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 >> 172.21.15.55:0/461071189 conn(0x7f27cc0997f0 msgr2=0x7f27cc069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:44.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 shutdown_connections 2023-10-06T11:13:44.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:44.643+0000 7f27d143f700 1 -- 172.21.15.55:0/461071189 wait complete. 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:13:44.657 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T11:13:44.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.658 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:13:44.673 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:13:44.674 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42471sec preferred_lft 42471sec 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:44.675 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link tentative 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link tentative 2023-10-06T11:13:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:44.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.677 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:13:44.737 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:13:44.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.739 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:13:44.795 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:13:44.795 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:13:44.795 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:13:44.795 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:13:44.795 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:13:44.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.796 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:44.796 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:44.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:13:44.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:13:44.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:13:44.796 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:44.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.895 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:13:44.909 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:13:44.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.910 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-10-06T11:13:44.964 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T11:13:44.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:44.964 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:44.964 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:44.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:13:44.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T11:13:44.965 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:45.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:45.053 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T11:13:45.086 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 36:37:46:a0:72:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.087 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::3437:46ff:fea0:7260/64 scope link tentative 2023-10-06T11:13:45.088 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:45.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 36:37:46:a0:72:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:13:45.177 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:13:45.178 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.178 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::3437:46ff:fea0:7260/64 scope link tentative 2023-10-06T11:13:45.178 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:45.189 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T11:13:45.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:45.189 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:45.189 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:45.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T11:13:45.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T11:13:45.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T11:13:45.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T11:13:45.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T11:13:45.190 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:45.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:45.415 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:13:45.415 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:13:45.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2023-10-06T11:13:45.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T11:13:45.415 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:13:45.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:45.494 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T11:13:45.508 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T11:13:45.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:45.509 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T11:13:45.563 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T11:13:45.563 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:13:45.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:45.647 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:45.648 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 3@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 3@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:13:45.685 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:13:45.685 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:13:45.686 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:13:45.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:45.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T11:13:45.751 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T11:13:45.786 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.915+0000 7fe9d1071700 1 Processor -- start 2023-10-06T11:13:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.915+0000 7fe9d1071700 1 -- start start 2023-10-06T11:13:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.916+0000 7fe9d1071700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9cc0b29b0 0x7fe9cc159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.916+0000 7fe9d1071700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 0x7fe9cc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.916+0000 7fe9d1071700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0b0da0 con 0x7fe9cc0b25e0 2023-10-06T11:13:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.916+0000 7fe9d1071700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0cbfa0 con 0x7fe9cc0b29b0 2023-10-06T11:13:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.916+0000 7fe9d1071700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0cb390 con 0x7fe9cc159660 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.916+0000 7fe9cb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 0x7fe9cc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 0x7fe9cc0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:38126/0 (socket says 172.21.15.55:38126) 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 -- 172.21.15.55:0/2607880621 learned_addr learned my addr 172.21.15.55:0/2607880621 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cad9d700 1 --1- 172.21.15.55:0/2607880621 >> v1:172.21.15.142:6789/0 conn(0x7fe9cc0b25e0 0x7fe9cc0b0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:41276/0 (socket says 172.21.15.55:41276) 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9ca59c700 1 --2- 172.21.15.55:0/2607880621 >> v2:172.21.15.142:3300/0 conn(0x7fe9cc0b29b0 0x7fe9cc159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 -- 172.21.15.55:0/2607880621 >> v2:172.21.15.142:3300/0 conn(0x7fe9cc0b29b0 msgr2=0x7fe9cc159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 --2- 172.21.15.55:0/2607880621 >> v2:172.21.15.142:3300/0 conn(0x7fe9cc0b29b0 0x7fe9cc159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9c9d9b700 1 -- 172.21.15.55:0/2607880621 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671120387 0 0) 0x7fe9c40014e0 con 0x7fe9cc0b25e0 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 -- 172.21.15.55:0/2607880621 >> v1:172.21.15.142:6789/0 conn(0x7fe9cc0b25e0 legacy=0x7fe9cc0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 -- 172.21.15.55:0/2607880621 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0cb670 con 0x7fe9cc159660 2023-10-06T11:13:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9cb59e700 1 --2- 172.21.15.55:0/2607880621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 0x7fe9cc0cc430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0099b0 tx=0x7fe9bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa012683bb13915 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9c9d9b700 1 -- 172.21.15.55:0/2607880621 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc009ea0 con 0x7fe9cc159660 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9c9d9b700 1 -- 172.21.15.55:0/2607880621 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc00b860 con 0x7fe9cc159660 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.917+0000 7fe9c9d9b700 1 -- 172.21.15.55:0/2607880621 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00bc00 con 0x7fe9cc159660 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 -- 172.21.15.55:0/2607880621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 msgr2=0x7fe9cc0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 --2- 172.21.15.55:0/2607880621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 0x7fe9cc0cc430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0099b0 tx=0x7fe9bc009250 comp rx=0 tx=0).stop 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 -- 172.21.15.55:0/2607880621 shutdown_connections 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 --2- 172.21.15.55:0/2607880621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc159660 0x7fe9cc0cc430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 --2- 172.21.15.55:0/2607880621 >> v2:172.21.15.142:3300/0 conn(0x7fe9cc0b29b0 0x7fe9cc159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 -- 172.21.15.55:0/2607880621 >> 172.21.15.55:0/2607880621 conn(0x7fe9cc06ece0 msgr2=0x7fe9cc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 -- 172.21.15.55:0/2607880621 shutdown_connections 2023-10-06T11:13:45.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.918+0000 7fe9d1071700 1 -- 172.21.15.55:0/2607880621 wait complete. 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.919+0000 7fe9d1071700 1 Processor -- start 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.919+0000 7fe9d1071700 1 -- start start 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9d1071700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 0x7fe9cc155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9d1071700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc0b29b0 0x7fe9cc0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9d1071700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9cc159660 0x7fe9cc0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9d1071700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0c8690 con 0x7fe9cc0b25e0 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9d1071700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc15b410 con 0x7fe9cc159660 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9d1071700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0c9210 con 0x7fe9cc0b29b0 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 0x7fe9cc155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 0x7fe9cc155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50498/0 (socket says 172.21.15.55:50498) 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cad9d700 1 -- 172.21.15.55:0/737137522 learned_addr learned my addr 172.21.15.55:0/737137522 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9ca59c700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc0b29b0 0x7fe9cc0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cb59e700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9cc159660 0x7fe9cc0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cb59e700 1 -- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc0b29b0 msgr2=0x7fe9cc0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cb59e700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc0b29b0 0x7fe9cc0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cb59e700 1 -- 172.21.15.55:0/737137522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 msgr2=0x7fe9cc155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cb59e700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 0x7fe9cc155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cb59e700 1 -- 172.21.15.55:0/737137522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc0094f0 con 0x7fe9cc159660 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.920+0000 7fe9cad9d700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 0x7fe9cc155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.921+0000 7fe9cb59e700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9cc159660 0x7fe9cc0cf0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0d0420 tx=0x7fe9bc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.921+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc01a450 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.921+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc01a5d0 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.921+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc0c88e0 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.921+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc01a990 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.921+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc0c8ea0 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.922+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc15b8b0 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.922+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9bc02e440 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.923+0000 7fe9c2ffd700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe9ac066f30 0x7fe9ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.923+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe9bc086750 con 0x7fe9cc159660 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.923+0000 7fe9cad9d700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe9ac066f30 0x7fe9ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:45.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.923+0000 7fe9cad9d700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe9ac066f30 0x7fe9ac0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4002280 tx=0x7fe9c4001b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:45.927+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9cc15b8b0 con 0x7fe9cc159660 2023-10-06T11:13:46.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.121+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9cc15b8b0 con 0x7fe9cc159660 2023-10-06T11:13:46.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.122+0000 7fe9c2ffd700 1 -- 172.21.15.55:0/737137522 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fe9cc15b8b0 con 0x7fe9cc159660 2023-10-06T11:13:46.124 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:46.124 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe9ac066f30 msgr2=0x7fe9ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe9ac066f30 0x7fe9ac0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4002280 tx=0x7fe9c4001b80 comp rx=0 tx=0).stop 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9cc159660 msgr2=0x7fe9cc0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9cc159660 0x7fe9cc0cf0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0d0420 tx=0x7fe9bc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 shutdown_connections 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe9ac066f30 0x7fe9ac0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9cc0b25e0 0x7fe9cc155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9cc159660 0x7fe9cc0cf0e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 --2- 172.21.15.55:0/737137522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9cc0b29b0 0x7fe9cc0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 >> 172.21.15.55:0/737137522 conn(0x7fe9cc06ece0 msgr2=0x7fe9cc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:46.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 shutdown_connections 2023-10-06T11:13:46.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.124+0000 7fe9d1071700 1 -- 172.21.15.55:0/737137522 wait complete. 2023-10-06T11:13:46.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:46.138 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 Processor -- start 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 -- start start 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbac4159840 0x7fbac40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbac40cf090 0x7fbac40c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac40cbb80 con 0x7fbac4159470 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40c6f00 con 0x7fbac4159840 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.259+0000 7fbaca9db700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40cb530 con 0x7fbac40cf090 2023-10-06T11:13:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac3fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbac4159470 0x7fbac40ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47920/0 (socket says 172.21.15.55:47920) 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac3fff700 1 -- 172.21.15.55:0/172709608 learned_addr learned my addr 172.21.15.55:0/172709608 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac37fe700 1 --2- 172.21.15.55:0/172709608 >> v2:172.21.15.55:3300/0 conn(0x7fbac4159840 0x7fbac40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac8f78700 1 --2- 172.21.15.55:0/172709608 >> v2:172.21.15.142:3300/0 conn(0x7fbac40cf090 0x7fbac40c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac37fe700 1 -- 172.21.15.55:0/172709608 >> v2:172.21.15.142:3300/0 conn(0x7fbac40cf090 msgr2=0x7fbac40c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac37fe700 1 --2- 172.21.15.55:0/172709608 >> v2:172.21.15.142:3300/0 conn(0x7fbac40cf090 0x7fbac40c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac37fe700 1 -- 172.21.15.55:0/172709608 >> v1:172.21.15.55:6789/0 conn(0x7fbac4159470 legacy=0x7fbac40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac37fe700 1 -- 172.21.15.55:0/172709608 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40cb810 con 0x7fbac4159840 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac2ffd700 1 -- 172.21.15.55:0/172709608 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785771929 0 0) 0x7fbac40cbb80 con 0x7fbac4159470 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac8f78700 1 --2- 172.21.15.55:0/172709608 >> v2:172.21.15.142:3300/0 conn(0x7fbac40cf090 0x7fbac40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac37fe700 1 --2- 172.21.15.55:0/172709608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c6170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbac415d0c0 tx=0x7fbaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d7fbf06e8733b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac2ffd700 1 -- 172.21.15.55:0/172709608 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00b6b0 con 0x7fbac4159840 2023-10-06T11:13:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac2ffd700 1 -- 172.21.15.55:0/172709608 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac00b810 con 0x7fbac4159840 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.260+0000 7fbac2ffd700 1 -- 172.21.15.55:0/172709608 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00bbb0 con 0x7fbac4159840 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 -- 172.21.15.55:0/172709608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 msgr2=0x7fbac40c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 --2- 172.21.15.55:0/172709608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c6170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbac415d0c0 tx=0x7fbaac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 -- 172.21.15.55:0/172709608 shutdown_connections 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 --2- 172.21.15.55:0/172709608 >> v2:172.21.15.142:3300/0 conn(0x7fbac40cf090 0x7fbac40c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 --2- 172.21.15.55:0/172709608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c6170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 -- 172.21.15.55:0/172709608 >> 172.21.15.55:0/172709608 conn(0x7fbac40996e0 msgr2=0x7fbac406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 -- 172.21.15.55:0/172709608 shutdown_connections 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.261+0000 7fbaca9db700 1 -- 172.21.15.55:0/172709608 wait complete. 2023-10-06T11:13:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.262+0000 7fbaca9db700 1 Processor -- start 2023-10-06T11:13:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.262+0000 7fbaca9db700 1 -- start start 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbaca9db700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbac40cf090 0x7fbac413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbaca9db700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbac4159470 0x7fbac40c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbaca9db700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbaca9db700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40ca4c0 con 0x7fbac4159840 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbaca9db700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac416b180 con 0x7fbac40cf090 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbaca9db700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40c9f00 con 0x7fbac4159470 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50524/0 (socket says 172.21.15.55:50524) 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 -- 172.21.15.55:0/2573909453 learned_addr learned my addr 172.21.15.55:0/2573909453 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac37fe700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbac4159470 0x7fbac40c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac3fff700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbac40cf090 0x7fbac413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 -- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbac4159470 msgr2=0x7fbac40c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbac4159470 0x7fbac40c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 -- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbac40cf090 msgr2=0x7fbac413f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbac40cf090 0x7fbac413f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac8f78700 1 -- 172.21.15.55:0/2573909453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac009420 con 0x7fbac4159840 2023-10-06T11:13:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.263+0000 7fbac3fff700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbac40cf090 0x7fbac413f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.264+0000 7fbac8f78700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c7550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00d150 tx=0x7fbabc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.264+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00dd90 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.264+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00f040 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.264+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac40ca1e0 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.264+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc015650 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.264+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac40b3c10 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.265+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40b3e30 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.265+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbabc015a40 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.265+0000 7fbabbfff700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.266+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbabc085300 con 0x7fbac4159840 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.266+0000 7fbac3fff700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.266+0000 7fbac3fff700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbaa4066f30 0x7fbaa40693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbac40b5dc0 tx=0x7fbab4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.270+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbabc052080 con 0x7fbac4159840 2023-10-06T11:13:46.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.461+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbac4064a90 con 0x7fbac4159840 2023-10-06T11:13:46.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.461+0000 7fbabbfff700 1 -- 172.21.15.55:0/2573909453 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbabc0556a0 con 0x7fbac4159840 2023-10-06T11:13:46.463 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:46.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbaa4066f30 msgr2=0x7fbaa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbaa4066f30 0x7fbaa40693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbac40b5dc0 tx=0x7fbab4009040 comp rx=0 tx=0).stop 2023-10-06T11:13:46.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 msgr2=0x7fbac40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c7550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00d150 tx=0x7fbabc009a50 comp rx=0 tx=0).stop 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 shutdown_connections 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbac4159840 0x7fbac40c7550 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbac40cf090 0x7fbac413f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 --2- 172.21.15.55:0/2573909453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbac4159470 0x7fbac40c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.463+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 >> 172.21.15.55:0/2573909453 conn(0x7fbac40996e0 msgr2=0x7fbac40d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.464+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 shutdown_connections 2023-10-06T11:13:46.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.464+0000 7fbaca9db700 1 -- 172.21.15.55:0/2573909453 wait complete. 2023-10-06T11:13:46.477 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.597+0000 7fc97c221700 1 Processor -- start 2023-10-06T11:13:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 -- start start 2023-10-06T11:13:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9740cc820 0x7fc9740ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740c9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9740675b0 0x7fc974067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc974159bc0 con 0x7fc9740cc820 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97406f420 con 0x7fc9740675b0 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.598+0000 7fc97c221700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97415ab70 con 0x7fc97406efb0 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9740cc820 0x7fc9740ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9740cc820 0x7fc9740ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50532/0 (socket says 172.21.15.55:50532) 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 -- 172.21.15.55:0/378972013 learned_addr learned my addr 172.21.15.55:0/378972013 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc9797bc700 1 --2- 172.21.15.55:0/378972013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc97a7be700 1 --2- 172.21.15.55:0/378972013 >> v2:172.21.15.142:3300/0 conn(0x7fc9740675b0 0x7fc974067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 -- 172.21.15.55:0/378972013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 msgr2=0x7fc9740c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 --2- 172.21.15.55:0/378972013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 -- 172.21.15.55:0/378972013 >> v2:172.21.15.142:3300/0 conn(0x7fc9740675b0 msgr2=0x7fc974067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 --2- 172.21.15.55:0/378972013 >> v2:172.21.15.142:3300/0 conn(0x7fc9740675b0 0x7fc974067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 -- 172.21.15.55:0/378972013 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740cbf70 con 0x7fc9740cc820 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc979fbd700 1 --2- 172.21.15.55:0/378972013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740ccbf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9740cdb40 tx=0x7fc96c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ae936ec7ebe20b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc978fbb700 1 -- 172.21.15.55:0/378972013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00b820 con 0x7fc9740cc820 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc978fbb700 1 -- 172.21.15.55:0/378972013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00b980 con 0x7fc9740cc820 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.599+0000 7fc978fbb700 1 -- 172.21.15.55:0/378972013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00bd20 con 0x7fc9740cc820 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 -- 172.21.15.55:0/378972013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 msgr2=0x7fc9740ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 --2- 172.21.15.55:0/378972013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740ccbf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9740cdb40 tx=0x7fc96c009250 comp rx=0 tx=0).stop 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 -- 172.21.15.55:0/378972013 shutdown_connections 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 --2- 172.21.15.55:0/378972013 >> v2:172.21.15.142:3300/0 conn(0x7fc9740675b0 0x7fc974067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 --2- 172.21.15.55:0/378972013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740ccbf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 --2- 172.21.15.55:0/378972013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 -- 172.21.15.55:0/378972013 >> 172.21.15.55:0/378972013 conn(0x7fc974069190 msgr2=0x7fc9740cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 -- 172.21.15.55:0/378972013 shutdown_connections 2023-10-06T11:13:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.600+0000 7fc97c221700 1 -- 172.21.15.55:0/378972013 wait complete. 2023-10-06T11:13:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.601+0000 7fc97c221700 1 Processor -- start 2023-10-06T11:13:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.601+0000 7fc97c221700 1 -- start start 2023-10-06T11:13:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97c221700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9740675b0 0x7fc974155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97c221700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97c221700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97c221700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b0710 con 0x7fc9740cc820 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97c221700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97416a810 con 0x7fc9740675b0 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97c221700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b00c0 con 0x7fc97406efb0 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50540/0 (socket says 172.21.15.55:50540) 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 -- 172.21.15.55:0/3166582061 learned_addr learned my addr 172.21.15.55:0/3166582061 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc979fbd700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9740675b0 0x7fc974155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc9797bc700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 -- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 msgr2=0x7fc9740ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 -- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9740675b0 msgr2=0x7fc974155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9740675b0 0x7fc974155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 -- 172.21.15.55:0/3166582061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0094f0 con 0x7fc9740cc820 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc979fbd700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9740675b0 0x7fc974155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc97a7be700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740b0ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc964009fa0 tx=0x7fc964009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.602+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400ebc0 con 0x7fc9740cc820 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.603+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400ed20 con 0x7fc9740cc820 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.603+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9740b03a0 con 0x7fc9740cc820 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.603+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964014670 con 0x7fc9740cc820 2023-10-06T11:13:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.603+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740accb0 con 0x7fc9740cc820 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.604+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9740aff20 con 0x7fc9740cc820 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.604+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9640149e0 con 0x7fc9740cc820 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.604+0000 7fc971ffb700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc960066f30 0x7fc9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.604+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc964084fd0 con 0x7fc9740cc820 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.604+0000 7fc979fbd700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc960066f30 0x7fc9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.605+0000 7fc979fbd700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc960066f30 0x7fc9600693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9740cdb40 tx=0x7fc96c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.609+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9740aff20 con 0x7fc9740cc820 2023-10-06T11:13:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.801+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9740aff20 con 0x7fc9740cc820 2023-10-06T11:13:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.801+0000 7fc971ffb700 1 -- 172.21.15.55:0/3166582061 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9740aff20 con 0x7fc9740cc820 2023-10-06T11:13:46.803 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc960066f30 msgr2=0x7fc9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc960066f30 0x7fc9600693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9740cdb40 tx=0x7fc96c017000 comp rx=0 tx=0).stop 2023-10-06T11:13:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 msgr2=0x7fc9740b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740b0ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc964009fa0 tx=0x7fc964009900 comp rx=0 tx=0).stop 2023-10-06T11:13:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 shutdown_connections 2023-10-06T11:13:46.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc960066f30 0x7fc9600693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9740cc820 0x7fc9740b0ba0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9740675b0 0x7fc974155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 --2- 172.21.15.55:0/3166582061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc97406efb0 0x7fc9740ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 >> 172.21.15.55:0/3166582061 conn(0x7fc974069190 msgr2=0x7fc9740c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 shutdown_connections 2023-10-06T11:13:46.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.803+0000 7fc97c221700 1 -- 172.21.15.55:0/3166582061 wait complete. 2023-10-06T11:13:46.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:46.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.937+0000 7fef3a43c700 1 Processor -- start 2023-10-06T11:13:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.937+0000 7fef3a43c700 1 -- start start 2023-10-06T11:13:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3a43c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef34153970 0x7fef340b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3a43c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3a43c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fef340af180 0x7fef3406a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3a43c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3415a600 con 0x7fef34153970 2023-10-06T11:13:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3a43c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef340b0cd0 con 0x7fef340af180 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3a43c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef34159cd0 con 0x7fef340b07c0 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef34153970 0x7fef340b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef34153970 0x7fef340b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50542/0 (socket says 172.21.15.55:50542) 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 -- 172.21.15.55:0/2209444460 learned_addr learned my addr 172.21.15.55:0/2209444460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef39c3b700 1 --2- 172.21.15.55:0/2209444460 >> v2:172.21.15.142:3300/0 conn(0x7fef340af180 0x7fef3406a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef38c39700 1 --2- 172.21.15.55:0/2209444460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 -- 172.21.15.55:0/2209444460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 msgr2=0x7fef340b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 --2- 172.21.15.55:0/2209444460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 -- 172.21.15.55:0/2209444460 >> v2:172.21.15.142:3300/0 conn(0x7fef340af180 msgr2=0x7fef3406a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 --2- 172.21.15.55:0/2209444460 >> v2:172.21.15.142:3300/0 conn(0x7fef340af180 0x7fef3406a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.938+0000 7fef3943a700 1 -- 172.21.15.55:0/2209444460 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef34159fb0 con 0x7fef34153970 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3943a700 1 --2- 172.21.15.55:0/2209444460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34153970 0x7fef340b1120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef3406b750 tx=0x7fef2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975c3ebdf4c7c3b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef2bfff700 1 -- 172.21.15.55:0/2209444460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00e070 con 0x7fef34153970 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef2bfff700 1 -- 172.21.15.55:0/2209444460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00ba50 con 0x7fef34153970 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef2bfff700 1 -- 172.21.15.55:0/2209444460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0092e0 con 0x7fef34153970 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 -- 172.21.15.55:0/2209444460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34153970 msgr2=0x7fef340b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 --2- 172.21.15.55:0/2209444460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34153970 0x7fef340b1120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef3406b750 tx=0x7fef2c009840 comp rx=0 tx=0).stop 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 -- 172.21.15.55:0/2209444460 shutdown_connections 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 --2- 172.21.15.55:0/2209444460 >> v2:172.21.15.142:3300/0 conn(0x7fef340af180 0x7fef3406a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 --2- 172.21.15.55:0/2209444460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34153970 0x7fef340b1120 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 --2- 172.21.15.55:0/2209444460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 -- 172.21.15.55:0/2209444460 >> 172.21.15.55:0/2209444460 conn(0x7fef34069140 msgr2=0x7fef340aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 -- 172.21.15.55:0/2209444460 shutdown_connections 2023-10-06T11:13:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.939+0000 7fef3a43c700 1 -- 172.21.15.55:0/2209444460 wait complete. 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.940+0000 7fef3a43c700 1 Processor -- start 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.940+0000 7fef3a43c700 1 -- start start 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.941+0000 7fef3a43c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 0x7fef340b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.941+0000 7fef3a43c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3a43c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef34153970 0x7fef3415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3a43c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3413b2f0 con 0x7fef340af180 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3a43c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3415fbe0 con 0x7fef34153970 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3a43c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3415feb0 con 0x7fef340b07c0 2023-10-06T11:13:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 0x7fef340b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 0x7fef340b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50554/0 (socket says 172.21.15.55:50554) 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 -- 172.21.15.55:0/3093345750 learned_addr learned my addr 172.21.15.55:0/3093345750 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef39c3b700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef34153970 0x7fef3415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef38c39700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 -- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 msgr2=0x7fef340b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 -- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef34153970 msgr2=0x7fef3415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef34153970 0x7fef3415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 -- 172.21.15.55:0/3093345750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009ae0 con 0x7fef340af180 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3943a700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 0x7fef340b0ed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef340ce0b0 tx=0x7fef2c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c008980 con 0x7fef340af180 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c008b20 con 0x7fef340af180 2023-10-06T11:13:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef34160190 con 0x7fef340af180 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c01c410 con 0x7fef340af180 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.942+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef34160750 con 0x7fef340af180 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.943+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3405f230 con 0x7fef340af180 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.944+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef2c003040 con 0x7fef340af180 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.944+0000 7fef297fa700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.944+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fef2c085f10 con 0x7fef340af180 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.944+0000 7fef38c39700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.945+0000 7fef38c39700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fef18066f30 0x7fef180693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef340b2890 tx=0x7fef24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:46.948+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef2c052d30 con 0x7fef340af180 2023-10-06T11:13:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.141+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef3415b080 con 0x7fef340af180 2023-10-06T11:13:47.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.142+0000 7fef297fa700 1 -- 172.21.15.55:0/3093345750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef2c009940 con 0x7fef340af180 2023-10-06T11:13:47.144 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fef18066f30 msgr2=0x7fef180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fef18066f30 0x7fef180693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fef340b2890 tx=0x7fef24008040 comp rx=0 tx=0).stop 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 msgr2=0x7fef340b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 0x7fef340b0ed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef340ce0b0 tx=0x7fef2c018000 comp rx=0 tx=0).stop 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 shutdown_connections 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fef18066f30 0x7fef180693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef340af180 0x7fef340b0ed0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef34153970 0x7fef3415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 --2- 172.21.15.55:0/3093345750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef340b07c0 0x7fef340b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 >> 172.21.15.55:0/3093345750 conn(0x7fef34069140 msgr2=0x7fef341501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 shutdown_connections 2023-10-06T11:13:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.144+0000 7fef3a43c700 1 -- 172.21.15.55:0/3093345750 wait complete. 2023-10-06T11:13:47.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.278+0000 7f6a3f59e700 1 Processor -- start 2023-10-06T11:13:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.278+0000 7f6a3f59e700 1 -- start start 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a400cd3c0 0x7f6a400ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3f59e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a400b29f0 0x7f6a400cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a400cc970 con 0x7f6a400b2620 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3f59e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a400cf520 con 0x7f6a400b29f0 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a400cbd60 con 0x7f6a400cd3c0 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a400b29f0 0x7f6a400cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a400b29f0 0x7f6a400cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50564/0 (socket says 172.21.15.55:50564) 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 -- 172.21.15.55:0/2198074145 learned_addr learned my addr 172.21.15.55:0/2198074145 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3dd9b700 1 --2- 172.21.15.55:0/2198074145 >> v2:172.21.15.142:3300/0 conn(0x7f6a400cd3c0 0x7f6a400ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 -- 172.21.15.55:0/2198074145 >> v2:172.21.15.142:3300/0 conn(0x7f6a400cd3c0 msgr2=0x7f6a400ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 --2- 172.21.15.55:0/2198074145 >> v2:172.21.15.142:3300/0 conn(0x7f6a400cd3c0 0x7f6a400ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 -- 172.21.15.55:0/2198074145 >> v1:172.21.15.142:6789/0 conn(0x7f6a400b2620 legacy=0x7f6a400cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 -- 172.21.15.55:0/2198074145 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400cc040 con 0x7f6a400b29f0 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.279+0000 7f6a3ed9d700 1 --2- 172.21.15.55:0/2198074145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a400cefe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a400b62d0 tx=0x7f6a38009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfaded3368e783e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3d59a700 1 -- 172.21.15.55:0/2198074145 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800e070 con 0x7f6a400b29f0 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3d59a700 1 -- 172.21.15.55:0/2198074145 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3800ba50 con 0x7f6a400b29f0 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3d59a700 1 -- 172.21.15.55:0/2198074145 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380092e0 con 0x7f6a400b29f0 2023-10-06T11:13:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2198074145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 msgr2=0x7f6a400cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2198074145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a400cefe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a400b62d0 tx=0x7f6a38009840 comp rx=0 tx=0).stop 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2198074145 shutdown_connections 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2198074145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a400cefe0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2198074145 >> v2:172.21.15.142:3300/0 conn(0x7f6a400cd3c0 0x7f6a400ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2198074145 >> 172.21.15.55:0/2198074145 conn(0x7f6a40099520 msgr2=0x7f6a4006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2198074145 shutdown_connections 2023-10-06T11:13:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.280+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2198074145 wait complete. 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.281+0000 7f6a3f59e700 1 Processor -- start 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.281+0000 7f6a3f59e700 1 -- start start 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a400b2620 0x7f6a400b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3f59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a40152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a400cd3c0 0x7f6a40068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3f59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a40155b10 con 0x7f6a400b29f0 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a400c8430 con 0x7f6a400b2620 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a400c8cb0 con 0x7f6a400cd3c0 2023-10-06T11:13:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a40152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a40152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50580/0 (socket says 172.21.15.55:50580) 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3dd9b700 1 -- 172.21.15.55:0/2592479530 learned_addr learned my addr 172.21.15.55:0/2592479530 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3ed9d700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a400cd3c0 0x7f6a40068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.282+0000 7f6a3e59c700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a400b2620 0x7f6a400b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3dd9b700 1 -- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a400cd3c0 msgr2=0x7f6a40068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3dd9b700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a400cd3c0 0x7f6a40068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3dd9b700 1 -- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a400b2620 msgr2=0x7f6a400b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3dd9b700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a400b2620 0x7f6a400b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3dd9b700 1 -- 172.21.15.55:0/2592479530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38009ae0 con 0x7f6a400b29f0 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3dd9b700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a40152e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400d860 tx=0x7f6a34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340125f0 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34012750 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a40155830 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34012af0 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.283+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a400c8940 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.284+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a400c8e60 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.284+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a34013480 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.285+0000 7f6a2e7fc700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a20066f30 0x7f6a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.285+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6a34084d80 con 0x7f6a400b29f0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.285+0000 7f6a3e59c700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a20066f30 0x7f6a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.285+0000 7f6a3e59c700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a20066f30 0x7f6a200693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6a30003a20 tx=0x7f6a30007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.289+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a400c8e60 con 0x7f6a400b29f0 2023-10-06T11:13:47.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.481+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a400c8e20 con 0x7f6a400b29f0 2023-10-06T11:13:47.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.481+0000 7f6a2e7fc700 1 -- 172.21.15.55:0/2592479530 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a34055590 con 0x7f6a400b29f0 2023-10-06T11:13:47.483 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a20066f30 msgr2=0x7f6a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a20066f30 0x7f6a200693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6a30003a20 tx=0x7f6a30007f10 comp rx=0 tx=0).stop 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 msgr2=0x7f6a40152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a40152e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400d860 tx=0x7f6a34008040 comp rx=0 tx=0).stop 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 shutdown_connections 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a20066f30 0x7f6a200693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a400cd3c0 0x7f6a40068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a400b2620 0x7f6a400b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 --2- 172.21.15.55:0/2592479530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a400b29f0 0x7f6a40152e60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 >> 172.21.15.55:0/2592479530 conn(0x7f6a40099520 msgr2=0x7f6a40156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:47.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 shutdown_connections 2023-10-06T11:13:47.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.483+0000 7f6a3f59e700 1 -- 172.21.15.55:0/2592479530 wait complete. 2023-10-06T11:13:47.496 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:47.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.616+0000 7f9588b02700 1 Processor -- start 2023-10-06T11:13:47.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.616+0000 7f9588b02700 1 -- start start 2023-10-06T11:13:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9588b02700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9584156370 0x7f958406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9588b02700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 0x7f95840adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9588b02700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95840c84a0 con 0x7f9584156740 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9588b02700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95840c7890 con 0x7f9584156370 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9588b02700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c7b70 con 0x7f958406eaa0 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9581d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9584156740 0x7f958406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47936/0 (socket says 172.21.15.55:47936) 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.617+0000 7f9581d9b700 1 -- 172.21.15.55:0/563240163 learned_addr learned my addr 172.21.15.55:0/563240163 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958259c700 1 --2- 172.21.15.55:0/563240163 >> v2:172.21.15.142:3300/0 conn(0x7f9584156370 0x7f958406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9582d9d700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 0x7f95840adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760287492 0 0) 0x7f95840c84a0 con 0x7f9584156740 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9570003570 con 0x7f9584156740 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039576799 0 0) 0x7f9570003570 con 0x7f9584156740 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 msgr2=0x7f95840adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 0x7f95840adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 >> v2:172.21.15.142:3300/0 conn(0x7f9584156370 msgr2=0x7f958406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 --2- 172.21.15.55:0/563240163 >> v2:172.21.15.142:3300/0 conn(0x7f9584156370 0x7f958406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840c7e50 con 0x7f9584156740 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f956c001470 con 0x7f9584156740 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 >> v1:172.21.15.55:6789/0 conn(0x7f9584156740 legacy=0x7f958406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 0x7f9570003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570003fe0 0x7f9570004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9570004d50 0x7f95700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c7890 con 0x7f9570003fe0 2023-10-06T11:13:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c7b70 con 0x7f9570004d50 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957000ba90 con 0x7f958406eaa0 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9581d9b700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570003fe0 0x7f9570004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f958259c700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 0x7f9570003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9582d9d700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9570004d50 0x7f95700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9581d9b700 1 -- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 msgr2=0x7f9570003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9581d9b700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f958406eaa0 0x7f9570003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9581d9b700 1 -- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9570004d50 msgr2=0x7f95700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9581d9b700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9570004d50 0x7f95700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.618+0000 7f9581d9b700 1 -- 172.21.15.55:0/563240163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570003570 con 0x7f9570003fe0 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9581d9b700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570003fe0 0x7f9570004810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95840c4130 tx=0x7f956c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779480be8ed07578 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c00cbd0 con 0x7f9570003fe0 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c00cd50 con 0x7f9570003fe0 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f958159a700 1 -- 172.21.15.55:0/563240163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c005b70 con 0x7f9570003fe0 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9588b02700 1 -- 172.21.15.55:0/563240163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570003fe0 msgr2=0x7f9570004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9588b02700 1 --2- 172.21.15.55:0/563240163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570003fe0 0x7f9570004810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95840c4130 tx=0x7f956c001e90 comp rx=0 tx=0).stop 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9582d9d700 1 -- 172.21.15.55:0/563240163 reap_dead start 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9588b02700 1 -- 172.21.15.55:0/563240163 shutdown_connections 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9588b02700 1 -- 172.21.15.55:0/563240163 >> 172.21.15.55:0/563240163 conn(0x7f9584069150 msgr2=0x7f95840cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9588b02700 1 -- 172.21.15.55:0/563240163 shutdown_connections 2023-10-06T11:13:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.619+0000 7f9588b02700 1 -- 172.21.15.55:0/563240163 wait complete. 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.620+0000 7f9588b02700 1 Processor -- start 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 -- start start 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570003fe0 0x7f958414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 0x7f95840b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9584158670 0x7f9584158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c4180 con 0x7f95840b2170 2023-10-06T11:13:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840b2b20 con 0x7f9584158670 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9588b02700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958414ec60 con 0x7f9570003fe0 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9581d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 0x7f95840b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9581d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 0x7f95840b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50598/0 (socket says 172.21.15.55:50598) 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f9581d9b700 1 -- 172.21.15.55:0/1127728474 learned_addr learned my addr 172.21.15.55:0/1127728474 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.621+0000 7f958259c700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570003fe0 0x7f958414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9582d9d700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9584158670 0x7f9584158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9581d9b700 1 -- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570003fe0 msgr2=0x7f958414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570003fe0 0x7f958414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9581d9b700 1 -- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9584158670 msgr2=0x7f9584158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9584158670 0x7f9584158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9581d9b700 1 -- 172.21.15.55:0/1127728474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95841593f0 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f958259c700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570003fe0 0x7f958414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9582d9d700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9584158670 0x7f9584158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 0x7f95840b25e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f956c001ed0 tx=0x7f956c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c001430 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0072e0 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95841596d0 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c0076a0 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.622+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9584159c90 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.623+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95840c4330 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.623+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f956c019030 con 0x7f95840b2170 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.624+0000 7f957a7fc700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.624+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f956c085c50 con 0x7f95840b2170 2023-10-06T11:13:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.624+0000 7f958259c700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.625+0000 7f958259c700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9564066f30 0x7f95640693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f957c009fd0 tx=0x7f957c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.628+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95840c4330 con 0x7f95840b2170 2023-10-06T11:13:47.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.822+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f95840c4330 con 0x7f95840b2170 2023-10-06T11:13:47.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.822+0000 7f957a7fc700 1 -- 172.21.15.55:0/1127728474 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f95840c4330 con 0x7f95840b2170 2023-10-06T11:13:47.825 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:47.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9564066f30 msgr2=0x7f95640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9564066f30 0x7f95640693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f957c009fd0 tx=0x7f957c00b040 comp rx=0 tx=0).stop 2023-10-06T11:13:47.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 msgr2=0x7f95840b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 0x7f95840b25e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f956c001ed0 tx=0x7f956c015000 comp rx=0 tx=0).stop 2023-10-06T11:13:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 shutdown_connections 2023-10-06T11:13:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9584158670 0x7f9584158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570003fe0 0x7f958414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 --2- 172.21.15.55:0/1127728474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95840b2170 0x7f95840b25e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.824+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 >> 172.21.15.55:0/1127728474 conn(0x7f9584069150 msgr2=0x7f95840cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:47.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.825+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 shutdown_connections 2023-10-06T11:13:47.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.825+0000 7f9588b02700 1 -- 172.21.15.55:0/1127728474 wait complete. 2023-10-06T11:13:47.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.955+0000 7fd717335700 1 Processor -- start 2023-10-06T11:13:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.955+0000 7fd717335700 1 -- start start 2023-10-06T11:13:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd717335700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd710159560 0x7fd7100aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd717335700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 0x7fd7100aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd717335700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100b0c60 con 0x7fd7100b0760 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd717335700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7100b0f40 con 0x7fd710159560 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd717335700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100b1220 con 0x7fd7100b49a0 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd7158d2700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd7100b0760 0x7fd7100b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47942/0 (socket says 172.21.15.55:47942) 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd7158d2700 1 -- 172.21.15.55:0/468413312 learned_addr learned my addr 172.21.15.55:0/468413312 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd7148d0700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 0x7fd7100aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.956+0000 7fd7150d1700 1 --2- 172.21.15.55:0/468413312 >> v2:172.21.15.142:3300/0 conn(0x7fd710159560 0x7fd7100aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307063826 0 0) 0x7fd7100b0c60 con 0x7fd7100b0760 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f8003570 con 0x7fd7100b0760 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207812979 0 0) 0x7fd6f8003570 con 0x7fd7100b0760 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 msgr2=0x7fd7100aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 0x7fd7100aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 >> v2:172.21.15.142:3300/0 conn(0x7fd710159560 msgr2=0x7fd7100aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 --2- 172.21.15.55:0/468413312 >> v2:172.21.15.142:3300/0 conn(0x7fd710159560 0x7fd7100aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100b1500 con 0x7fd7100b0760 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd7150d1700 1 --2- 172.21.15.55:0/468413312 >> v2:172.21.15.142:3300/0 conn(0x7fd710159560 0x7fd7100aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fd7000017f0 con 0x7fd7100b0760 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 >> v1:172.21.15.55:6789/0 conn(0x7fd7100b0760 legacy=0x7fd7100b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f8003a60 0x7fd6f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6f8004810 0x7fd6f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 0x7fd6f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100b0f40 con 0x7fd6f8004810 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100b1220 con 0x7fd6f8003a60 2023-10-06T11:13:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f800ba60 con 0x7fd7100b49a0 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd7148d0700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6f8004810 0x7fd6f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd7150d1700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f8003a60 0x7fd6f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.957+0000 7fd7158d2700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 0x7fd6f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7148d0700 1 -- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 msgr2=0x7fd6f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7148d0700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7100b49a0 0x7fd6f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7148d0700 1 -- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f8003a60 msgr2=0x7fd6f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7148d0700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f8003a60 0x7fd6f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7148d0700 1 -- 172.21.15.55:0/468413312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8003570 con 0x7fd6f8004810 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7148d0700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6f8004810 0x7fd6f8004c80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd704009c30 tx=0x7fd7040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cbebd83ea2ac76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400e710 con 0x7fd6f8004810 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400e870 con 0x7fd6f8004810 2023-10-06T11:13:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd70ffff700 1 -- 172.21.15.55:0/468413312 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400ec30 con 0x7fd6f8004810 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd717335700 1 -- 172.21.15.55:0/468413312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6f8004810 msgr2=0x7fd6f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd717335700 1 --2- 172.21.15.55:0/468413312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6f8004810 0x7fd6f8004c80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd704009c30 tx=0x7fd7040091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd7158d2700 1 -- 172.21.15.55:0/468413312 reap_dead start 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd717335700 1 -- 172.21.15.55:0/468413312 shutdown_connections 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.958+0000 7fd717335700 1 -- 172.21.15.55:0/468413312 >> 172.21.15.55:0/468413312 conn(0x7fd7100997f0 msgr2=0x7fd71006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.959+0000 7fd717335700 1 -- 172.21.15.55:0/468413312 shutdown_connections 2023-10-06T11:13:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.959+0000 7fd717335700 1 -- 172.21.15.55:0/468413312 wait complete. 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 Processor -- start 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 -- start start 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f8004810 0x7fd71009a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71009ab80 0x7fd710169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 0x7fd71016a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015a1b0 con 0x7fd71016a460 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016ae20 con 0x7fd71009ab80 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.960+0000 7fd717335700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71009b3b0 con 0x7fd6f8004810 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 0x7fd71016a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 0x7fd71016a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50616/0 (socket says 172.21.15.55:50616) 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 -- 172.21.15.55:0/2052410501 learned_addr learned my addr 172.21.15.55:0/2052410501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7150d1700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f8004810 0x7fd71009a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7148d0700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71009ab80 0x7fd710169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 -- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f8004810 msgr2=0x7fd71009a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f8004810 0x7fd71009a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 -- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71009ab80 msgr2=0x7fd710169f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71009ab80 0x7fd710169f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 -- 172.21.15.55:0/2052410501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71009b690 con 0x7fd71016a460 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7148d0700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71009ab80 0x7fd710169f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd7158d2700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 0x7fd71016a8e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b6490 tx=0x7fd700002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700007b60 con 0x7fd71016a460 2023-10-06T11:13:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000ad40 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71009b970 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700013640 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.961+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71009aff0 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.962+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710064a90 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.963+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7000139f0 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.963+0000 7fd70d7fa700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd6fc066f30 0x7fd6fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.963+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd7000850a0 con 0x7fd71016a460 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.963+0000 7fd7150d1700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd6fc066f30 0x7fd6fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.964+0000 7fd7150d1700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd6fc066f30 0x7fd6fc0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd708006ea0 tx=0x7fd708009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:47.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:47.967+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd700051ec0 con 0x7fd71016a460 2023-10-06T11:13:48.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.162+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7100b17e0 con 0x7fd71016a460 2023-10-06T11:13:48.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.163+0000 7fd70d7fa700 1 -- 172.21.15.55:0/2052410501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fd7000554e0 con 0x7fd71016a460 2023-10-06T11:13:48.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:48.166 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.165+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd6fc066f30 msgr2=0x7fd6fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.165+0000 7fd717335700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd6fc066f30 0x7fd6fc0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd708006ea0 tx=0x7fd708009120 comp rx=0 tx=0).stop 2023-10-06T11:13:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.165+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 msgr2=0x7fd71016a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.165+0000 7fd717335700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 0x7fd71016a8e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd7100b6490 tx=0x7fd700002180 comp rx=0 tx=0).stop 2023-10-06T11:13:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 shutdown_connections 2023-10-06T11:13:48.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd6fc066f30 0x7fd6fc0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd71016a460 0x7fd71016a8e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f8004810 0x7fd71009a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 --2- 172.21.15.55:0/2052410501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd71009ab80 0x7fd710169f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 >> 172.21.15.55:0/2052410501 conn(0x7fd7100997f0 msgr2=0x7fd7101576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 shutdown_connections 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.166+0000 7fd717335700 1 -- 172.21.15.55:0/2052410501 wait complete. 2023-10-06T11:13:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:48.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.302+0000 7f3b9b28a700 1 Processor -- start 2023-10-06T11:13:48.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.303+0000 7f3b9b28a700 1 -- start start 2023-10-06T11:13:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.303+0000 7f3b9b28a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b94159470 0x7f3b940ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.303+0000 7f3b9b28a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940cd020 0x7f3b940c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.303+0000 7f3b9b28a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940cbb80 con 0x7f3b94159840 2023-10-06T11:13:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.303+0000 7f3b9b28a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940c6f00 con 0x7f3b94159470 2023-10-06T11:13:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.303+0000 7f3b9b28a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940cb530 con 0x7f3b940cd020 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99026700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b94159470 0x7f3b940ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b98825700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b94159840 0x7f3b940c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47946/0 (socket says 172.21.15.55:47946) 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b98825700 1 -- 172.21.15.55:0/674991488 learned_addr learned my addr 172.21.15.55:0/674991488 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99827700 1 --2- 172.21.15.55:0/674991488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940cd020 0x7f3b940c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99026700 1 -- 172.21.15.55:0/674991488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940cd020 msgr2=0x7f3b940c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99026700 1 --2- 172.21.15.55:0/674991488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940cd020 0x7f3b940c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99026700 1 -- 172.21.15.55:0/674991488 >> v1:172.21.15.55:6789/0 conn(0x7f3b94159840 legacy=0x7f3b940c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99026700 1 -- 172.21.15.55:0/674991488 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940cb810 con 0x7f3b94159470 2023-10-06T11:13:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b93fff700 1 -- 172.21.15.55:0/674991488 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594559702 0 0) 0x7f3b940cbb80 con 0x7f3b94159840 2023-10-06T11:13:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b99026700 1 --2- 172.21.15.55:0/674991488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b94159470 0x7f3b940ce980 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0098d0 tx=0x7f3b8c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d9cb65a60d8714 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b93fff700 1 -- 172.21.15.55:0/674991488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c009e70 con 0x7f3b94159470 2023-10-06T11:13:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b93fff700 1 -- 172.21.15.55:0/674991488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c005c10 con 0x7f3b94159470 2023-10-06T11:13:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.304+0000 7f3b93fff700 1 -- 172.21.15.55:0/674991488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00b650 con 0x7f3b94159470 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 -- 172.21.15.55:0/674991488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b94159470 msgr2=0x7f3b940ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/674991488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b94159470 0x7f3b940ce980 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0098d0 tx=0x7f3b8c009120 comp rx=0 tx=0).stop 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 -- 172.21.15.55:0/674991488 shutdown_connections 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/674991488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940cd020 0x7f3b940c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/674991488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b94159470 0x7f3b940ce980 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 -- 172.21.15.55:0/674991488 >> 172.21.15.55:0/674991488 conn(0x7f3b940996e0 msgr2=0x7f3b9406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 -- 172.21.15.55:0/674991488 shutdown_connections 2023-10-06T11:13:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.305+0000 7f3b9b28a700 1 -- 172.21.15.55:0/674991488 wait complete. 2023-10-06T11:13:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.306+0000 7f3b9b28a700 1 Processor -- start 2023-10-06T11:13:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.306+0000 7f3b9b28a700 1 -- start start 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b9b28a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 0x7f3b9415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b9b28a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b94159840 0x7f3b9415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b9b28a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940c9130 0x7f3b940b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b9b28a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940c8ca0 con 0x7f3b940cd020 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b9b28a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940c8690 con 0x7f3b94159840 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b9b28a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9415e990 con 0x7f3b940c9130 2023-10-06T11:13:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 0x7f3b9415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 0x7f3b9415d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50634/0 (socket says 172.21.15.55:50634) 2023-10-06T11:13:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 -- 172.21.15.55:0/2556945202 learned_addr learned my addr 172.21.15.55:0/2556945202 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 -- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940c9130 msgr2=0x7f3b940b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940c9130 0x7f3b940b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 -- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b94159840 msgr2=0x7f3b9415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b94159840 0x7f3b9415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 -- 172.21.15.55:0/2556945202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c0093c0 con 0x7f3b940cd020 2023-10-06T11:13:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b99026700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 0x7f3b9415d7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b94067c70 tx=0x7f3b8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.307+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c006310 con 0x7f3b940cd020 2023-10-06T11:13:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.308+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c006490 con 0x7f3b940cd020 2023-10-06T11:13:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.308+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b940c8930 con 0x7f3b940cd020 2023-10-06T11:13:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.308+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c006850 con 0x7f3b940cd020 2023-10-06T11:13:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.308+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9415ec70 con 0x7f3b940cd020 2023-10-06T11:13:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.309+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b940c84f0 con 0x7f3b940cd020 2023-10-06T11:13:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.309+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b8c01a630 con 0x7f3b940cd020 2023-10-06T11:13:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.309+0000 7f3b917fa700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b80066f30 0x7f3b800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.309+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3b8c086040 con 0x7f3b940cd020 2023-10-06T11:13:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.310+0000 7f3b98825700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b80066f30 0x7f3b800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.310+0000 7f3b98825700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b80066f30 0x7f3b800693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3b9415dce0 tx=0x7f3b88007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.314+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b940c84f0 con 0x7f3b940cd020 2023-10-06T11:13:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.505+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b940c84f0 con 0x7f3b940cd020 2023-10-06T11:13:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.506+0000 7f3b917fa700 1 -- 172.21.15.55:0/2556945202 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b940c84f0 con 0x7f3b940cd020 2023-10-06T11:13:48.507 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b80066f30 msgr2=0x7f3b800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b80066f30 0x7f3b800693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3b9415dce0 tx=0x7f3b88007bd0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 msgr2=0x7f3b9415d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 0x7f3b9415d7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b94067c70 tx=0x7f3b8c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 shutdown_connections 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b80066f30 0x7f3b800693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b940cd020 0x7f3b9415d7a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b940c9130 0x7f3b940b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 --2- 172.21.15.55:0/2556945202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b94159840 0x7f3b9415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 >> 172.21.15.55:0/2556945202 conn(0x7f3b940996e0 msgr2=0x7f3b941584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 shutdown_connections 2023-10-06T11:13:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.508+0000 7f3b9b28a700 1 -- 172.21.15.55:0/2556945202 wait complete. 2023-10-06T11:13:48.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.643+0000 7fd4bd8e7700 1 Processor -- start 2023-10-06T11:13:48.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.643+0000 7fd4bd8e7700 1 -- start start 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4bd8e7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4b8159830 0x7fd4b80ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4bd8e7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4b80ca7b0 0x7fd4b80675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4bd8e7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b80ca320 con 0x7fd4b80acf20 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4bd8e7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b8159c00 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4bd8e7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80ad480 con 0x7fd4b8159830 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4b67fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4b80ca7b0 0x7fd4b80675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4b77fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd4b80acf20 0x7fd4b806e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47958/0 (socket says 172.21.15.55:47958) 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4b77fe700 1 -- 172.21.15.55:0/2385080384 learned_addr learned my addr 172.21.15.55:0/2385080384 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.644+0000 7fd4b6ffd700 1 --2- 172.21.15.55:0/2385080384 >> v2:172.21.15.142:3300/0 conn(0x7fd4b8159830 0x7fd4b80ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b67fc700 1 -- 172.21.15.55:0/2385080384 >> v2:172.21.15.142:3300/0 conn(0x7fd4b8159830 msgr2=0x7fd4b80ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b67fc700 1 --2- 172.21.15.55:0/2385080384 >> v2:172.21.15.142:3300/0 conn(0x7fd4b8159830 0x7fd4b80ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b67fc700 1 -- 172.21.15.55:0/2385080384 >> v1:172.21.15.55:6789/0 conn(0x7fd4b80acf20 legacy=0x7fd4b806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b67fc700 1 -- 172.21.15.55:0/2385080384 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80c99f0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b5ffb700 1 -- 172.21.15.55:0/2385080384 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644294652 0 0) 0x7fd4b80ca320 con 0x7fd4b80acf20 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b6ffd700 1 --2- 172.21.15.55:0/2385080384 >> v2:172.21.15.142:3300/0 conn(0x7fd4b8159830 0x7fd4b80ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b67fc700 1 --2- 172.21.15.55:0/2385080384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b80675b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8068690 tx=0x7fd4a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187a340c9bf5cbdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b5ffb700 1 -- 172.21.15.55:0/2385080384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000b6b0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b5ffb700 1 -- 172.21.15.55:0/2385080384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a000b810 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4b5ffb700 1 -- 172.21.15.55:0/2385080384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000bbb0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/2385080384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 msgr2=0x7fd4b80675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/2385080384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b80675b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8068690 tx=0x7fd4a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/2385080384 shutdown_connections 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/2385080384 >> v2:172.21.15.142:3300/0 conn(0x7fd4b8159830 0x7fd4b80ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/2385080384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b80675b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/2385080384 >> 172.21.15.55:0/2385080384 conn(0x7fd4b8069150 msgr2=0x7fd4b806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.645+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/2385080384 shutdown_connections 2023-10-06T11:13:48.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.646+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/2385080384 wait complete. 2023-10-06T11:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.647+0000 7fd4bd8e7700 1 Processor -- start 2023-10-06T11:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.647+0000 7fd4bd8e7700 1 -- start start 2023-10-06T11:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.647+0000 7fd4bd8e7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4b80acf20 0x7fd4b81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.647+0000 7fd4bd8e7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b8169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.647+0000 7fd4bd8e7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4b8159830 0x7fd4b816a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4bd8e7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81501a0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4bd8e7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b8150480 con 0x7fd4b8159830 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4bd8e7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b8150760 con 0x7fd4b80acf20 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b8169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b8169b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50664/0 (socket says 172.21.15.55:50664) 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 -- 172.21.15.55:0/982087975 learned_addr learned my addr 172.21.15.55:0/982087975 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b6ffd700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4b80acf20 0x7fd4b81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b77fe700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4b8159830 0x7fd4b816a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 -- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4b80acf20 msgr2=0x7fd4b81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4b80acf20 0x7fd4b81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 -- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4b8159830 msgr2=0x7fd4b816a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4b8159830 0x7fd4b816a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 -- 172.21.15.55:0/982087975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0009420 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4b67fc700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b8169b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0013000 tx=0x7fd4a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000bb90 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0011420 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00117a0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b8150a40 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.648+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b81415e0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.649+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b805f230 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.650+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4a0011b90 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.650+0000 7fd4aeffd700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.650+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd4a00862b0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.650+0000 7fd4b6ffd700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.651+0000 7fd4b6ffd700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0006f00 tx=0x7fd4b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.655+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4a00530d0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.845+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4b806b1d0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.845+0000 7fd4aeffd700 1 -- 172.21.15.55:0/982087975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4a00566f0 con 0x7fd4b80ca7b0 2023-10-06T11:13:48.847 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd498066f30 msgr2=0x7fd4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0006f00 tx=0x7fd4b0008040 comp rx=0 tx=0).stop 2023-10-06T11:13:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 msgr2=0x7fd4b8169b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b8169b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0013000 tx=0x7fd4a0017000 comp rx=0 tx=0).stop 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 shutdown_connections 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4b8159830 0x7fd4b816a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4b80acf20 0x7fd4b81522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 --2- 172.21.15.55:0/982087975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b80ca7b0 0x7fd4b8169b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 >> 172.21.15.55:0/982087975 conn(0x7fd4b8069150 msgr2=0x7fd4b81419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 shutdown_connections 2023-10-06T11:13:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.847+0000 7fd4bd8e7700 1 -- 172.21.15.55:0/982087975 wait complete. 2023-10-06T11:13:48.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.982+0000 7f599df9d700 1 Processor -- start 2023-10-06T11:13:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.982+0000 7f599df9d700 1 -- start start 2023-10-06T11:13:48.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599df9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5998153970 0x7f59980b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599df9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59980af180 0x7f59980b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599df9d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599815a600 con 0x7f59980b07c0 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599df9d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998157600 con 0x7f5998153970 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599df9d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59980b0cd0 con 0x7f59980af180 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599cf9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5998153970 0x7f59980b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599cf9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5998153970 0x7f59980b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50680/0 (socket says 172.21.15.55:50680) 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.983+0000 7f599cf9b700 1 -- 172.21.15.55:0/308988470 learned_addr learned my addr 172.21.15.55:0/308988470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599d79c700 1 --2- 172.21.15.55:0/308988470 >> v2:172.21.15.142:3300/0 conn(0x7f59980af180 0x7f59980b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599cf9b700 1 -- 172.21.15.55:0/308988470 >> v2:172.21.15.142:3300/0 conn(0x7f59980af180 msgr2=0x7f59980b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599cf9b700 1 --2- 172.21.15.55:0/308988470 >> v2:172.21.15.142:3300/0 conn(0x7f59980af180 0x7f59980b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599cf9b700 1 -- 172.21.15.55:0/308988470 >> v1:172.21.15.142:6789/0 conn(0x7f59980b07c0 legacy=0x7f599806a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599cf9b700 1 -- 172.21.15.55:0/308988470 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5998159cd0 con 0x7f5998153970 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599d79c700 1 --2- 172.21.15.55:0/308988470 >> v2:172.21.15.142:3300/0 conn(0x7f59980af180 0x7f59980b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599cf9b700 1 --2- 172.21.15.55:0/308988470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5998153970 0x7f59980b1120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f599806dd30 tx=0x7f5990009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524d53015bd51df4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f59977fe700 1 -- 172.21.15.55:0/308988470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000b820 con 0x7f5998153970 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f59977fe700 1 -- 172.21.15.55:0/308988470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000b980 con 0x7f5998153970 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f59977fe700 1 -- 172.21.15.55:0/308988470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000bd20 con 0x7f5998153970 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599df9d700 1 -- 172.21.15.55:0/308988470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5998153970 msgr2=0x7f59980b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.984+0000 7f599df9d700 1 --2- 172.21.15.55:0/308988470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5998153970 0x7f59980b1120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f599806dd30 tx=0x7f5990009250 comp rx=0 tx=0).stop 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.985+0000 7f599df9d700 1 -- 172.21.15.55:0/308988470 shutdown_connections 2023-10-06T11:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.985+0000 7f599df9d700 1 --2- 172.21.15.55:0/308988470 >> v2:172.21.15.142:3300/0 conn(0x7f59980af180 0x7f59980b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.985+0000 7f599df9d700 1 --2- 172.21.15.55:0/308988470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5998153970 0x7f59980b1120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.985+0000 7f599df9d700 1 -- 172.21.15.55:0/308988470 >> 172.21.15.55:0/308988470 conn(0x7f5998069140 msgr2=0x7f59980aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.985+0000 7f599df9d700 1 -- 172.21.15.55:0/308988470 shutdown_connections 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.985+0000 7f599df9d700 1 -- 172.21.15.55:0/308988470 wait complete. 2023-10-06T11:13:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.986+0000 7f599df9d700 1 Processor -- start 2023-10-06T11:13:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.986+0000 7f599df9d700 1 -- start start 2023-10-06T11:13:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.986+0000 7f599df9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59980af180 0x7f5998153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.986+0000 7f599df9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 0x7f5998151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599df9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5998153970 0x7f59981666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599df9d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59981676e0 con 0x7f59980b07c0 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599df9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998167120 con 0x7f59980af180 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599df9d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5998167400 con 0x7f5998153970 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 0x7f5998151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 0x7f5998151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50684/0 (socket says 172.21.15.55:50684) 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 -- 172.21.15.55:0/1445890081 learned_addr learned my addr 172.21.15.55:0/1445890081 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599d79c700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5998153970 0x7f59981666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599cf9b700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59980af180 0x7f5998153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 -- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5998153970 msgr2=0x7f59981666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5998153970 0x7f59981666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 -- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59980af180 msgr2=0x7f5998153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59980af180 0x7f5998153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 -- 172.21.15.55:0/1445890081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900094f0 con 0x7f59980b07c0 2023-10-06T11:13:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599cf9b700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59980af180 0x7f5998153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599d79c700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5998153970 0x7f59981666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5997fff700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 0x7f5998151d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f598800c950 tx=0x7f5988002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800a7e0 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800a940 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59980a5630 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800ad00 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.987+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998152250 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.988+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599805f230 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.989+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5988012630 con 0x7f59980b07c0 2023-10-06T11:13:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.989+0000 7f5994ff9700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:48.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.989+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5988084ee0 con 0x7f59980b07c0 2023-10-06T11:13:48.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.989+0000 7f599cf9b700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:48.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.990+0000 7f599cf9b700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f599806dd30 tx=0x7f5990016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:48.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:48.994+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5988051db0 con 0x7f59980b07c0 2023-10-06T11:13:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.189+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5998159fb0 con 0x7f59980b07c0 2023-10-06T11:13:49.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.189+0000 7f5994ff9700 1 -- 172.21.15.55:0/1445890081 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f598800ae60 con 0x7f59980b07c0 2023-10-06T11:13:49.191 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5978066f30 msgr2=0x7f59780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f599806dd30 tx=0x7f5990016000 comp rx=0 tx=0).stop 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 msgr2=0x7f5998151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 0x7f5998151d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f598800c950 tx=0x7f5988002760 comp rx=0 tx=0).stop 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 shutdown_connections 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5998153970 0x7f59981666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59980af180 0x7f5998153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 --2- 172.21.15.55:0/1445890081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59980b07c0 0x7f5998151d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 >> 172.21.15.55:0/1445890081 conn(0x7f5998069140 msgr2=0x7f599806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 shutdown_connections 2023-10-06T11:13:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.191+0000 7f599df9d700 1 -- 172.21.15.55:0/1445890081 wait complete. 2023-10-06T11:13:49.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.326+0000 7f44bc98a700 1 Processor -- start 2023-10-06T11:13:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.326+0000 7f44bc98a700 1 -- start start 2023-10-06T11:13:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44bc98a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44b8159470 0x7f44b80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44bc98a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80cbb80 con 0x7f44b80cd020 2023-10-06T11:13:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44bc98a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80c6f00 con 0x7f44b8159840 2023-10-06T11:13:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44bc98a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80cb530 con 0x7f44b8159470 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b6d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44b80cd020 0x7f44b8163190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47962/0 (socket says 172.21.15.55:47962) 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b6d9d700 1 -- 172.21.15.55:0/1750279391 learned_addr learned my addr 172.21.15.55:0/1750279391 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b659c700 1 --2- 172.21.15.55:0/1750279391 >> v2:172.21.15.142:3300/0 conn(0x7f44b8159470 0x7f44b80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b559a700 1 -- 172.21.15.55:0/1750279391 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171464836 0 0) 0x7f44b80cbb80 con 0x7f44b80cd020 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b559a700 1 -- 172.21.15.55:0/1750279391 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a0003570 con 0x7f44b80cd020 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b659c700 1 -- 172.21.15.55:0/1750279391 >> v1:172.21.15.142:6789/0 conn(0x7f44b8159840 legacy=0x7f44b80c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b659c700 1 -- 172.21.15.55:0/1750279391 >> v1:172.21.15.55:6789/0 conn(0x7f44b80cd020 legacy=0x7f44b8163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.327+0000 7f44b659c700 1 -- 172.21.15.55:0/1750279391 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80cb810 con 0x7f44b8159470 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44b659c700 1 --2- 172.21.15.55:0/1750279391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b80ce980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44a80098d0 tx=0x7f44a8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f7aa9575e424ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44b559a700 1 -- 172.21.15.55:0/1750279391 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8005c10 con 0x7f44b8159470 2023-10-06T11:13:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44b559a700 1 -- 172.21.15.55:0/1750279391 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8005d70 con 0x7f44b8159470 2023-10-06T11:13:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44b559a700 1 -- 172.21.15.55:0/1750279391 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8006280 con 0x7f44b8159470 2023-10-06T11:13:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 -- 172.21.15.55:0/1750279391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 msgr2=0x7f44b80ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 --2- 172.21.15.55:0/1750279391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b80ce980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44a80098d0 tx=0x7f44a8009120 comp rx=0 tx=0).stop 2023-10-06T11:13:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 -- 172.21.15.55:0/1750279391 shutdown_connections 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 --2- 172.21.15.55:0/1750279391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b80ce980 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 -- 172.21.15.55:0/1750279391 >> 172.21.15.55:0/1750279391 conn(0x7f44b80996e0 msgr2=0x7f44b806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 -- 172.21.15.55:0/1750279391 shutdown_connections 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.328+0000 7f44bc98a700 1 -- 172.21.15.55:0/1750279391 wait complete. 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.329+0000 7f44bc98a700 1 Processor -- start 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 -- start start 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80cd020 0x7f44b815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 0x7f44b816a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81548c0 con 0x7f44b8159840 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815b570 con 0x7f44b8159470 2023-10-06T11:13:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44bc98a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b3890 con 0x7f44b80cd020 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44b6d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 0x7f44b816a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44b6d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 0x7f44b816a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50700/0 (socket says 172.21.15.55:50700) 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.330+0000 7f44b6d9d700 1 -- 172.21.15.55:0/3938059180 learned_addr learned my addr 172.21.15.55:0/3938059180 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b659c700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80cd020 0x7f44b815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b5d9b700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b6d9d700 1 -- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80cd020 msgr2=0x7f44b815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b6d9d700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80cd020 0x7f44b815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b6d9d700 1 -- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 msgr2=0x7f44b816a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b6d9d700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b816a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b6d9d700 1 -- 172.21.15.55:0/3938059180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80093c0 con 0x7f44b8159840 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b5d9b700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b816a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44b6d9d700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 0x7f44b816a930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f44b0001460 tx=0x7f44b0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000ce80 con 0x7f44b8159840 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000ab70 con 0x7f44b8159840 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b00070f0 con 0x7f44b8159840 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b815aa30 con 0x7f44b8159840 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.331+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b815afb0 con 0x7f44b8159840 2023-10-06T11:13:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.332+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b80b3a40 con 0x7f44b8159840 2023-10-06T11:13:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.332+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44b0007520 con 0x7f44b8159840 2023-10-06T11:13:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.333+0000 7f44a67fc700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4498066f30 0x7f44980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.333+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44b0084e80 con 0x7f44b8159840 2023-10-06T11:13:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.333+0000 7f44b659c700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4498066f30 0x7f44980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.334+0000 7f44b659c700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4498066f30 0x7f44980693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44b816b570 tx=0x7f44a8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.337+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44b80b3a40 con 0x7f44b8159840 2023-10-06T11:13:49.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.530+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44b80b3a00 con 0x7f44b8159840 2023-10-06T11:13:49.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.531+0000 7f44a67fc700 1 -- 172.21.15.55:0/3938059180 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44b0051ca0 con 0x7f44b8159840 2023-10-06T11:13:49.533 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4498066f30 msgr2=0x7f44980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4498066f30 0x7f44980693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44b816b570 tx=0x7f44a8016000 comp rx=0 tx=0).stop 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 msgr2=0x7f44b816a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 0x7f44b816a930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f44b0001460 tx=0x7f44b0001ae0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 shutdown_connections 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4498066f30 0x7f44980693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b8159840 0x7f44b816a930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44b80cd020 0x7f44b815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 --2- 172.21.15.55:0/3938059180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44b8159470 0x7f44b816a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 >> 172.21.15.55:0/3938059180 conn(0x7f44b80996e0 msgr2=0x7f44b8158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 shutdown_connections 2023-10-06T11:13:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.533+0000 7f44bc98a700 1 -- 172.21.15.55:0/3938059180 wait complete. 2023-10-06T11:13:49.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:49.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.667+0000 7fc3957c9700 1 Processor -- start 2023-10-06T11:13:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.667+0000 7fc3957c9700 1 -- start start 2023-10-06T11:13:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc3957c9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc390140cc0 0x7fc3900c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc3957c9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc390141090 con 0x7fc39006dab0 2023-10-06T11:13:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc3957c9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3900c7e60 con 0x7fc3900c6c20 2023-10-06T11:13:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc3957c9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39006f6e0 con 0x7fc390140cc0 2023-10-06T11:13:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc390140cc0 0x7fc3900c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc39006dab0 0x7fc3900695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47972/0 (socket says 172.21.15.55:47972) 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38f7fe700 1 -- 172.21.15.55:0/4235106574 learned_addr learned my addr 172.21.15.55:0/4235106574 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38effd700 1 -- 172.21.15.55:0/4235106574 >> v1:172.21.15.142:6789/0 conn(0x7fc3900c6c20 legacy=0x7fc39006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38effd700 1 -- 172.21.15.55:0/4235106574 >> v1:172.21.15.55:6789/0 conn(0x7fc39006dab0 legacy=0x7fc3900695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38effd700 1 -- 172.21.15.55:0/4235106574 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900c7250 con 0x7fc390140cc0 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38dffb700 1 -- 172.21.15.55:0/4235106574 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232069862 0 0) 0x7fc390141090 con 0x7fc39006dab0 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38effd700 1 --2- 172.21.15.55:0/4235106574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc390140cc0 0x7fc3900c66e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3800098e0 tx=0x7fc3800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ea002715bb58b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38dffb700 1 -- 172.21.15.55:0/4235106574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380009e80 con 0x7fc390140cc0 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38dffb700 1 -- 172.21.15.55:0/4235106574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38000b860 con 0x7fc390140cc0 2023-10-06T11:13:49.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.668+0000 7fc38dffb700 1 -- 172.21.15.55:0/4235106574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38000bbe0 con 0x7fc390140cc0 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 -- 172.21.15.55:0/4235106574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc390140cc0 msgr2=0x7fc3900c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 --2- 172.21.15.55:0/4235106574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc390140cc0 0x7fc3900c66e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3800098e0 tx=0x7fc3800091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 -- 172.21.15.55:0/4235106574 shutdown_connections 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 --2- 172.21.15.55:0/4235106574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc390140cc0 0x7fc3900c66e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 -- 172.21.15.55:0/4235106574 >> 172.21.15.55:0/4235106574 conn(0x7fc3900cc0a0 msgr2=0x7fc3900cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 -- 172.21.15.55:0/4235106574 shutdown_connections 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.669+0000 7fc3957c9700 1 -- 172.21.15.55:0/4235106574 wait complete. 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.670+0000 7fc3957c9700 1 Processor -- start 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.670+0000 7fc3957c9700 1 -- start start 2023-10-06T11:13:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc3957c9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39006dab0 0x7fc390168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc3957c9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 0x7fc390156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc3957c9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc390140cc0 0x7fc3900c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc3957c9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900b0500 con 0x7fc3900c6c20 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc3957c9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900c60f0 con 0x7fc390140cc0 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc3957c9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900c63d0 con 0x7fc39006dab0 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 0x7fc390156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 0x7fc390156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50714/0 (socket says 172.21.15.55:50714) 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 -- 172.21.15.55:0/189700284 learned_addr learned my addr 172.21.15.55:0/189700284 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38effd700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39006dab0 0x7fc390168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38f7fe700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc390140cc0 0x7fc3900c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 -- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39006dab0 msgr2=0x7fc390168d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39006dab0 0x7fc390168d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 -- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc390140cc0 msgr2=0x7fc3900c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.671+0000 7fc38e7fc700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc390140cc0 0x7fc3900c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc38e7fc700 1 -- 172.21.15.55:0/189700284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc380009420 con 0x7fc3900c6c20 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc38f7fe700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc390140cc0 0x7fc3900c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc38e7fc700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 0x7fc390156810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc38400c4e0 tx=0x7fc38400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384011590 con 0x7fc3900c6c20 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc384011710 con 0x7fc3900c6c20 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3900afeb0 con 0x7fc3900c6c20 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384011ad0 con 0x7fc3900c6c20 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.672+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc390156d50 con 0x7fc3900c6c20 2023-10-06T11:13:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.673+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3900b06b0 con 0x7fc3900c6c20 2023-10-06T11:13:49.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.673+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc38401b3b0 con 0x7fc3900c6c20 2023-10-06T11:13:49.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.674+0000 7fc376ffd700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc37c066f30 0x7fc37c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:49.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.674+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc384083db0 con 0x7fc3900c6c20 2023-10-06T11:13:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.674+0000 7fc38effd700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc37c066f30 0x7fc37c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.674+0000 7fc38effd700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc37c066f30 0x7fc37c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3800093f0 tx=0x7fc380017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.678+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3900b06b0 con 0x7fc3900c6c20 2023-10-06T11:13:49.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.870+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc390064a90 con 0x7fc3900c6c20 2023-10-06T11:13:49.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.870+0000 7fc376ffd700 1 -- 172.21.15.55:0/189700284 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc384017070 con 0x7fc3900c6c20 2023-10-06T11:13:49.872 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:49.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc37c066f30 msgr2=0x7fc37c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc37c066f30 0x7fc37c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3800093f0 tx=0x7fc380017000 comp rx=0 tx=0).stop 2023-10-06T11:13:49.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 msgr2=0x7fc390156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:49.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 0x7fc390156810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc38400c4e0 tx=0x7fc38400c7f0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 shutdown_connections 2023-10-06T11:13:49.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc37c066f30 0x7fc37c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc390140cc0 0x7fc3900c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39006dab0 0x7fc390168d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 --2- 172.21.15.55:0/189700284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3900c6c20 0x7fc390156810 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 >> 172.21.15.55:0/189700284 conn(0x7fc3900cc0a0 msgr2=0x7fc39013c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 shutdown_connections 2023-10-06T11:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:49.872+0000 7fc3957c9700 1 -- 172.21.15.55:0/189700284 wait complete. 2023-10-06T11:13:49.886 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:50.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.003+0000 7fbd5188b700 1 Processor -- start 2023-10-06T11:13:50.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.003+0000 7fbd5188b700 1 -- start start 2023-10-06T11:13:50.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd5188b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd4c0b49a0 0x7fbd4c0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd5188b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd4c0b0760 0x7fbd4c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd5188b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0b0c60 con 0x7fbd4c159560 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd5188b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b0f40 con 0x7fbd4c0b0760 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd5188b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b1220 con 0x7fbd4c0b49a0 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd4b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd4c0b0760 0x7fbd4c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd4affd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbd4c159560 0x7fbd4c0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47980/0 (socket says 172.21.15.55:47980) 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd4affd700 1 -- 172.21.15.55:0/3369814002 learned_addr learned my addr 172.21.15.55:0/3369814002 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd4a7fc700 1 --2- 172.21.15.55:0/3369814002 >> v2:172.21.15.142:3300/0 conn(0x7fbd4c0b49a0 0x7fbd4c0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd4b7fe700 1 -- 172.21.15.55:0/3369814002 >> v2:172.21.15.142:3300/0 conn(0x7fbd4c0b49a0 msgr2=0x7fbd4c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.004+0000 7fbd4b7fe700 1 --2- 172.21.15.55:0/3369814002 >> v2:172.21.15.142:3300/0 conn(0x7fbd4c0b49a0 0x7fbd4c0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd4b7fe700 1 -- 172.21.15.55:0/3369814002 >> v1:172.21.15.55:6789/0 conn(0x7fbd4c159560 legacy=0x7fbd4c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd4b7fe700 1 -- 172.21.15.55:0/3369814002 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0b1500 con 0x7fbd4c0b0760 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd4a7fc700 1 --2- 172.21.15.55:0/3369814002 >> v2:172.21.15.142:3300/0 conn(0x7fbd4c0b49a0 0x7fbd4c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd4b7fe700 1 --2- 172.21.15.55:0/3369814002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c0b1bc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0098e0 tx=0x7fbd3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedb56f048e7fa2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd49ffb700 1 -- 172.21.15.55:0/3369814002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c009e80 con 0x7fbd4c0b0760 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd49ffb700 1 -- 172.21.15.55:0/3369814002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00b820 con 0x7fbd4c0b0760 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd49ffb700 1 -- 172.21.15.55:0/3369814002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00bba0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 -- 172.21.15.55:0/3369814002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 msgr2=0x7fbd4c0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 --2- 172.21.15.55:0/3369814002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c0b1bc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0098e0 tx=0x7fbd3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 -- 172.21.15.55:0/3369814002 shutdown_connections 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 --2- 172.21.15.55:0/3369814002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c0b1bc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 --2- 172.21.15.55:0/3369814002 >> v2:172.21.15.142:3300/0 conn(0x7fbd4c0b49a0 0x7fbd4c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 -- 172.21.15.55:0/3369814002 >> 172.21.15.55:0/3369814002 conn(0x7fbd4c0997f0 msgr2=0x7fbd4c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:50.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.005+0000 7fbd5188b700 1 -- 172.21.15.55:0/3369814002 shutdown_connections 2023-10-06T11:13:50.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.006+0000 7fbd5188b700 1 -- 172.21.15.55:0/3369814002 wait complete. 2023-10-06T11:13:50.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 Processor -- start 2023-10-06T11:13:50.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 -- start start 2023-10-06T11:13:50.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4c0b49a0 0x7fbd4c09d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4c159560 0x7fbd4c09b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15c3f0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15cd20 con 0x7fbd4c0b49a0 2023-10-06T11:13:50.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.007+0000 7fbd5188b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15a120 con 0x7fbd4c159560 2023-10-06T11:13:50.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c169e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50732/0 (socket says 172.21.15.55:50732) 2023-10-06T11:13:50.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 -- 172.21.15.55:0/1963036901 learned_addr learned my addr 172.21.15.55:0/1963036901 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:50.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4b7fe700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4c159560 0x7fbd4c09b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 -- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4c159560 msgr2=0x7fbd4c09b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4c159560 0x7fbd4c09b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4a7fc700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4c0b49a0 0x7fbd4c09d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 -- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4c0b49a0 msgr2=0x7fbd4c09d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4c0b49a0 0x7fbd4c09d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 -- 172.21.15.55:0/1963036901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c009420 con 0x7fbd4c0b0760 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd4affd700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c169e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c910 tx=0x7fbd440016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44005d80 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4400a590 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c16a3a0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400a950 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.008+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c159ad0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.009+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c064a90 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.010+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd440070f0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.010+0000 7fbd42ffd700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd2c066f30 0x7fbd2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.010+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbd44084650 con 0x7fbd4c0b0760 2023-10-06T11:13:50.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.010+0000 7fbd4a7fc700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd2c066f30 0x7fbd2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.011+0000 7fbd4a7fc700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd2c066f30 0x7fbd2c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0b4140 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.014+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd440514f0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.213+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd4c0b17e0 con 0x7fbd4c0b0760 2023-10-06T11:13:50.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.214+0000 7fbd42ffd700 1 -- 172.21.15.55:0/1963036901 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fbd44054b10 con 0x7fbd4c0b0760 2023-10-06T11:13:50.216 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:50.216 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd2c066f30 msgr2=0x7fbd2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd2c066f30 0x7fbd2c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0b4140 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2023-10-06T11:13:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 msgr2=0x7fbd4c169e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c169e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c910 tx=0x7fbd440016e0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 shutdown_connections 2023-10-06T11:13:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd2c066f30 0x7fbd2c0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd4c0b0760 0x7fbd4c169e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd4c159560 0x7fbd4c09b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 --2- 172.21.15.55:0/1963036901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd4c0b49a0 0x7fbd4c09d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 >> 172.21.15.55:0/1963036901 conn(0x7fbd4c0997f0 msgr2=0x7fbd4c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 shutdown_connections 2023-10-06T11:13:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.216+0000 7fbd5188b700 1 -- 172.21.15.55:0/1963036901 wait complete. 2023-10-06T11:13:50.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:50.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:50.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.353+0000 7f99d79a4700 1 Processor -- start 2023-10-06T11:13:50.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.353+0000 7f99d79a4700 1 -- start start 2023-10-06T11:13:50.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d79a4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99d01594d0 0x7f99d00cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d79a4700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d00cbee0 con 0x7f99d01598a0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d79a4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d00cf5d0 con 0x7f99d00cbaa0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d79a4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d00cf8b0 con 0x7f99d01594d0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d4f3f700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99d01598a0 0x7f99d00ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47990/0 (socket says 172.21.15.55:47990) 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d4f3f700 1 -- 172.21.15.55:0/4243064547 learned_addr learned my addr 172.21.15.55:0/4243064547 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99d5740700 1 --2- 172.21.15.55:0/4243064547 >> v2:172.21.15.142:3300/0 conn(0x7f99d01594d0 0x7f99d00cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.354+0000 7f99cffff700 1 -- 172.21.15.55:0/4243064547 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972218595 0 0) 0x7f99d00cbee0 con 0x7f99d01598a0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99cffff700 1 -- 172.21.15.55:0/4243064547 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b8003570 con 0x7f99d01598a0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99d5740700 1 -- 172.21.15.55:0/4243064547 >> v1:172.21.15.142:6789/0 conn(0x7f99d00cbaa0 legacy=0x7f99d00c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99cffff700 1 -- 172.21.15.55:0/4243064547 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978169747 0 0) 0x7f99d00cf5d0 con 0x7f99d00cbaa0 2023-10-06T11:13:50.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99d5740700 1 -- 172.21.15.55:0/4243064547 >> v1:172.21.15.55:6789/0 conn(0x7f99d01598a0 legacy=0x7f99d00ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99d5740700 1 -- 172.21.15.55:0/4243064547 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00cfb90 con 0x7f99d01594d0 2023-10-06T11:13:50.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99d5740700 1 --2- 172.21.15.55:0/4243064547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d00cb560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99c80098e0 tx=0x7f99c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e978e8815bf13b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99cffff700 1 -- 172.21.15.55:0/4243064547 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800b640 con 0x7f99d01594d0 2023-10-06T11:13:50.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99cffff700 1 -- 172.21.15.55:0/4243064547 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c800b7a0 con 0x7f99d01594d0 2023-10-06T11:13:50.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.355+0000 7f99cffff700 1 -- 172.21.15.55:0/4243064547 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800bb40 con 0x7f99d01594d0 2023-10-06T11:13:50.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 -- 172.21.15.55:0/4243064547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 msgr2=0x7f99d00cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 --2- 172.21.15.55:0/4243064547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d00cb560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99c80098e0 tx=0x7f99c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 -- 172.21.15.55:0/4243064547 shutdown_connections 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 --2- 172.21.15.55:0/4243064547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d00cb560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 -- 172.21.15.55:0/4243064547 >> 172.21.15.55:0/4243064547 conn(0x7f99d0089e50 msgr2=0x7f99d0099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 -- 172.21.15.55:0/4243064547 shutdown_connections 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.356+0000 7f99d79a4700 1 -- 172.21.15.55:0/4243064547 wait complete. 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.357+0000 7f99d79a4700 1 Processor -- start 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.357+0000 7f99d79a4700 1 -- start start 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d79a4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99d00cbaa0 0x7f99d00b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d79a4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d0158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d79a4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 0x7f99d014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d79a4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00b4430 con 0x7f99d01598a0 2023-10-06T11:13:50.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d79a4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00b5400 con 0x7f99d01594d0 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d79a4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00b4f70 con 0x7f99d00cbaa0 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 0x7f99d014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 0x7f99d014cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50740/0 (socket says 172.21.15.55:50740) 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 -- 172.21.15.55:0/2282761901 learned_addr learned my addr 172.21.15.55:0/2282761901 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5740700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99d00cbaa0 0x7f99d00b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d4f3f700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d0158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 -- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99d00cbaa0 msgr2=0x7f99d00b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99d00cbaa0 0x7f99d00b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 -- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 msgr2=0x7f99d0158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d0158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 -- 172.21.15.55:0/2282761901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8009420 con 0x7f99d01598a0 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d4f3f700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d0158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.358+0000 7f99d5f41700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 0x7f99d014cfd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c890 tx=0x7f99c0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.359+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0017070 con 0x7f99d01598a0 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.359+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0006ba0 con 0x7f99d01598a0 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.359+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d01588d0 con 0x7f99d01598a0 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.359+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0012630 con 0x7f99d01598a0 2023-10-06T11:13:50.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.359+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d00b4920 con 0x7f99d01598a0 2023-10-06T11:13:50.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.359+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d0064a90 con 0x7f99d01598a0 2023-10-06T11:13:50.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.360+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99c0012a60 con 0x7f99d01598a0 2023-10-06T11:13:50.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.360+0000 7f99cd7fa700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99bc066f30 0x7f99bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.360+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f99c00846d0 con 0x7f99d01598a0 2023-10-06T11:13:50.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.361+0000 7f99d5740700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99bc066f30 0x7f99bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.361+0000 7f99d5740700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99bc066f30 0x7f99bc0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99c80093f0 tx=0x7f99c8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.365+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99c00514f0 con 0x7f99d01598a0 2023-10-06T11:13:50.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.559+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99d00b50b0 con 0x7f99d01598a0 2023-10-06T11:13:50.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.559+0000 7f99cd7fa700 1 -- 172.21.15.55:0/2282761901 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99c0054b10 con 0x7f99d01598a0 2023-10-06T11:13:50.561 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:50.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99bc066f30 msgr2=0x7f99bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99bc066f30 0x7f99bc0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99c80093f0 tx=0x7f99c8017000 comp rx=0 tx=0).stop 2023-10-06T11:13:50.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 msgr2=0x7f99d014cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 0x7f99d014cfd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c890 tx=0x7f99c0001670 comp rx=0 tx=0).stop 2023-10-06T11:13:50.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 shutdown_connections 2023-10-06T11:13:50.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99bc066f30 0x7f99bc0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01598a0 0x7f99d014cfd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99d00cbaa0 0x7f99d00b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 --2- 172.21.15.55:0/2282761901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99d01594d0 0x7f99d0158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 >> 172.21.15.55:0/2282761901 conn(0x7f99d0089e50 msgr2=0x7f99d00c6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:50.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 shutdown_connections 2023-10-06T11:13:50.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.561+0000 7f99d79a4700 1 -- 172.21.15.55:0/2282761901 wait complete. 2023-10-06T11:13:50.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:50.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.695+0000 7fa9648f8700 1 Processor -- start 2023-10-06T11:13:50.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.695+0000 7fa9648f8700 1 -- start start 2023-10-06T11:13:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.696+0000 7fa9648f8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9600b0640 0x7fa9600cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.696+0000 7fa9648f8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600cca70 con 0x7fa9600cc5f0 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.696+0000 7fa9648f8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600c53c0 con 0x7fa9600b0a10 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.696+0000 7fa9648f8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600ca790 con 0x7fa9600b0640 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95ed9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9600cc5f0 0x7fa9600c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48006/0 (socket says 172.21.15.55:48006) 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95ed9d700 1 -- 172.21.15.55:0/3494157603 learned_addr learned my addr 172.21.15.55:0/3494157603 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95e59c700 1 --2- 172.21.15.55:0/3494157603 >> v2:172.21.15.142:3300/0 conn(0x7fa9600b0640 0x7fa9600cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702085556 0 0) 0x7fa9600cca70 con 0x7fa9600cc5f0 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c003570 con 0x7fa9600cc5f0 2023-10-06T11:13:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623606911 0 0) 0x7fa94c003570 con 0x7fa9600cc5f0 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 >> v2:172.21.15.142:3300/0 conn(0x7fa9600b0640 msgr2=0x7fa9600cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 --2- 172.21.15.55:0/3494157603 >> v2:172.21.15.142:3300/0 conn(0x7fa9600b0640 0x7fa9600cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 >> v1:172.21.15.142:6789/0 conn(0x7fa9600b0a10 legacy=0x7fa9600cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600ccd00 con 0x7fa9600cc5f0 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fa9500017f0 con 0x7fa9600cc5f0 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 >> v1:172.21.15.55:6789/0 conn(0x7fa9600cc5f0 legacy=0x7fa9600c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c003a60 0x7fa94c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa94c004810 0x7fa94c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa94c0051c0 0x7fa94c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600ca790 con 0x7fa94c0051c0 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c00c160 con 0x7fa94c004810 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c00c320 con 0x7fa94c003a60 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95ed9d700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa94c0051c0 0x7fa94c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.697+0000 7fa95dd9b700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa94c004810 0x7fa94c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95e59c700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c003a60 0x7fa94c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 -- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c003a60 msgr2=0x7fa94c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c003a60 0x7fa94c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 -- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa94c004810 msgr2=0x7fa94c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa94c004810 0x7fa94c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 -- 172.21.15.55:0/3494157603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c003570 con 0x7fa94c0051c0 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 -- 172.21.15.55:0/3494157603 reap_dead start 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95ed9d700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa94c0051c0 0x7fa94c00ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa95000a930 tx=0x7fa9500021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72a9f8e01fb363e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500070d0 con 0x7fa94c0051c0 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa950007250 con 0x7fa94c0051c0 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa95d59a700 1 -- 172.21.15.55:0/3494157603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950007610 con 0x7fa94c0051c0 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa9648f8700 1 -- 172.21.15.55:0/3494157603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa94c0051c0 msgr2=0x7fa94c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.698+0000 7fa9648f8700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa94c0051c0 0x7fa94c00ba60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa95000a930 tx=0x7fa9500021d0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.699+0000 7fa9648f8700 1 -- 172.21.15.55:0/3494157603 shutdown_connections 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.699+0000 7fa9648f8700 1 --2- 172.21.15.55:0/3494157603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa94c0051c0 0x7fa94c00ba60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.699+0000 7fa9648f8700 1 -- 172.21.15.55:0/3494157603 >> 172.21.15.55:0/3494157603 conn(0x7fa960087fc0 msgr2=0x7fa9600ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.699+0000 7fa9648f8700 1 -- 172.21.15.55:0/3494157603 shutdown_connections 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.699+0000 7fa9648f8700 1 -- 172.21.15.55:0/3494157603 wait complete. 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 Processor -- start 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 -- start start 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c0051c0 0x7fa96006a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 0x7fa9600c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa96014cbe0 0x7fa9600af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c6760 con 0x7fa9600c7230 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c64b0 con 0x7fa96014cbe0 2023-10-06T11:13:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.700+0000 7fa9648f8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600695a0 con 0x7fa94c0051c0 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 0x7fa9600c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 0x7fa9600c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50758/0 (socket says 172.21.15.55:50758) 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 -- 172.21.15.55:0/1081615499 learned_addr learned my addr 172.21.15.55:0/1081615499 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95e59c700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c0051c0 0x7fa96006a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95ed9d700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa96014cbe0 0x7fa9600af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 -- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c0051c0 msgr2=0x7fa96006a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c0051c0 0x7fa96006a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 -- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa96014cbe0 msgr2=0x7fa9600af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa96014cbe0 0x7fa9600af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 -- 172.21.15.55:0/1081615499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960069880 con 0x7fa9600c7230 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa95dd9b700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 0x7fa9600c5f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa948002950 tx=0x7fa948007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948003390 con 0x7fa9600c7230 2023-10-06T11:13:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948006820 con 0x7fa9600c7230 2023-10-06T11:13:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa960069b60 con 0x7fa9600c7230 2023-10-06T11:13:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948006bc0 con 0x7fa9600c7230 2023-10-06T11:13:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.701+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600c76a0 con 0x7fa9600c7230 2023-10-06T11:13:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.702+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa960064a90 con 0x7fa9600c7230 2023-10-06T11:13:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.703+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa948007030 con 0x7fa9600c7230 2023-10-06T11:13:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.703+0000 7fa9567fc700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa940066f30 0x7fa9400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.703+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa9480849f0 con 0x7fa9600c7230 2023-10-06T11:13:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.703+0000 7fa95e59c700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa940066f30 0x7fa9400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.704+0000 7fa95e59c700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa940066f30 0x7fa9400693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa9580090f0 tx=0x7fa958009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.707+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa948055320 con 0x7fa9600c7230 2023-10-06T11:13:50.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.899+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9600ccfe0 con 0x7fa9600c7230 2023-10-06T11:13:50.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.900+0000 7fa9567fc700 1 -- 172.21.15.55:0/1081615499 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa948054eb0 con 0x7fa9600c7230 2023-10-06T11:13:50.901 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:50.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa940066f30 msgr2=0x7fa9400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa940066f30 0x7fa9400693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa9580090f0 tx=0x7fa958009120 comp rx=0 tx=0).stop 2023-10-06T11:13:50.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 msgr2=0x7fa9600c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:50.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 0x7fa9600c5f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa948002950 tx=0x7fa948007d30 comp rx=0 tx=0).stop 2023-10-06T11:13:50.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 shutdown_connections 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa940066f30 0x7fa9400693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa96014cbe0 0x7fa9600af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94c0051c0 0x7fa96006a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 --2- 172.21.15.55:0/1081615499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9600c7230 0x7fa9600c5f70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.901+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 >> 172.21.15.55:0/1081615499 conn(0x7fa960087fc0 msgr2=0x7fa9600cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.902+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 shutdown_connections 2023-10-06T11:13:50.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:50.902+0000 7fa9648f8700 1 -- 172.21.15.55:0/1081615499 wait complete. 2023-10-06T11:13:50.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.037+0000 7f86de6c8700 1 Processor -- start 2023-10-06T11:13:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.037+0000 7f86de6c8700 1 -- start start 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86de6c8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86de6c8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86d8159840 0x7f86d80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86de6c8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d80cbb80 con 0x7f86d80c6170 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86de6c8700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80c6d00 con 0x7f86d8159840 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86de6c8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80c6f00 con 0x7f86d8159470 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d77fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86d8159840 0x7f86d80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86dcc65700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86d80c6170 0x7f86d80c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48016/0 (socket says 172.21.15.55:48016) 2023-10-06T11:13:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86dcc65700 1 -- 172.21.15.55:0/2705258418 learned_addr learned my addr 172.21.15.55:0/2705258418 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d7fff700 1 --2- 172.21.15.55:0/2705258418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d77fe700 1 -- 172.21.15.55:0/2705258418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 msgr2=0x7f86d80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d77fe700 1 --2- 172.21.15.55:0/2705258418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d77fe700 1 -- 172.21.15.55:0/2705258418 >> v1:172.21.15.55:6789/0 conn(0x7f86d80c6170 legacy=0x7f86d80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d77fe700 1 -- 172.21.15.55:0/2705258418 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80cb530 con 0x7f86d8159840 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d6ffd700 1 -- 172.21.15.55:0/2705258418 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505519140 0 0) 0x7f86d80cbb80 con 0x7f86d80c6170 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d77fe700 1 --2- 172.21.15.55:0/2705258418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d8159840 0x7f86d80ceec0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0098e0 tx=0x7f86cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e41e8b79923de4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d6ffd700 1 -- 172.21.15.55:0/2705258418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc009e80 con 0x7f86d8159840 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d6ffd700 1 -- 172.21.15.55:0/2705258418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc00b860 con 0x7f86d8159840 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.038+0000 7f86d6ffd700 1 -- 172.21.15.55:0/2705258418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc00bbe0 con 0x7f86d8159840 2023-10-06T11:13:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 -- 172.21.15.55:0/2705258418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d8159840 msgr2=0x7f86d80ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2705258418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d8159840 0x7f86d80ceec0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0098e0 tx=0x7f86cc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 -- 172.21.15.55:0/2705258418 shutdown_connections 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2705258418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2705258418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d8159840 0x7f86d80ceec0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 -- 172.21.15.55:0/2705258418 >> 172.21.15.55:0/2705258418 conn(0x7f86d80996e0 msgr2=0x7f86d806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 -- 172.21.15.55:0/2705258418 shutdown_connections 2023-10-06T11:13:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.039+0000 7f86de6c8700 1 -- 172.21.15.55:0/2705258418 wait complete. 2023-10-06T11:13:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.040+0000 7f86de6c8700 1 Processor -- start 2023-10-06T11:13:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.040+0000 7f86de6c8700 1 -- start start 2023-10-06T11:13:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86de6c8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 0x7f86d8153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86de6c8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86de6c8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8159840 0x7f86d8152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86de6c8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8152e90 con 0x7f86d80c6170 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86de6c8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d816aad0 con 0x7f86d8159840 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86de6c8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80c7710 con 0x7f86d8159470 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 0x7f86d8153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86d7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 0x7f86d8153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50768/0 (socket says 172.21.15.55:50768) 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86d7fff700 1 -- 172.21.15.55:0/2094314890 learned_addr learned my addr 172.21.15.55:0/2094314890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86d77fe700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86dcc65700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8159840 0x7f86d8152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.041+0000 7f86d7fff700 1 -- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 msgr2=0x7f86d8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86d7fff700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86d7fff700 1 -- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8159840 msgr2=0x7f86d8152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86d7fff700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8159840 0x7f86d8152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86d7fff700 1 -- 172.21.15.55:0/2094314890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc009420 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86dcc65700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8159840 0x7f86d8152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86d7fff700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 0x7f86d8153020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f86c800d810 tx=0x7f86c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80125f0 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8012750 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8012af0 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8169be0 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.042+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d816a1a0 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.043+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d8064a90 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.043+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86c801e460 con 0x7f86d80c6170 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.044+0000 7f86bffff700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f86c4066f30 0x7f86c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.044+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f86c8084fe0 con 0x7f86d80c6170 2023-10-06T11:13:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.044+0000 7f86d77fe700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f86c4066f30 0x7f86c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.045+0000 7f86d77fe700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f86c4066f30 0x7f86c40693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0091e0 tx=0x7f86cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.048+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86c8051e00 con 0x7f86d80c6170 2023-10-06T11:13:51.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.243+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86d816d2d0 con 0x7f86d80c6170 2023-10-06T11:13:51.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.243+0000 7f86bffff700 1 -- 172.21.15.55:0/2094314890 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86c8055420 con 0x7f86d80c6170 2023-10-06T11:13:51.245 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.245+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f86c4066f30 msgr2=0x7f86c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.245+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f86c4066f30 0x7f86c40693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0091e0 tx=0x7f86cc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 msgr2=0x7f86d8153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 0x7f86d8153020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f86c800d810 tx=0x7f86c8008040 comp rx=0 tx=0).stop 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 shutdown_connections 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f86c4066f30 0x7f86c40693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86d80c6170 0x7f86d8153020 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86d8159840 0x7f86d8152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 --2- 172.21.15.55:0/2094314890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86d8159470 0x7f86d8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 >> 172.21.15.55:0/2094314890 conn(0x7f86d80996e0 msgr2=0x7f86d815e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 shutdown_connections 2023-10-06T11:13:51.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.246+0000 7f86de6c8700 1 -- 172.21.15.55:0/2094314890 wait complete. 2023-10-06T11:13:51.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:51.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.381+0000 7fcd38fa2700 1 Processor -- start 2023-10-06T11:13:51.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.381+0000 7fcd38fa2700 1 -- start start 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd38fa2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd34067bd0 0x7fcd340cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd38fa2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd3415a1f0 0x7fcd340cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd38fa2700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3415d860 con 0x7fcd3415dcf0 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd38fa2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3415aad0 con 0x7fcd3415a1f0 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd38fa2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3415a5f0 con 0x7fcd34067bd0 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd31d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd3415dcf0 0x7fcd34159ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48024/0 (socket says 172.21.15.55:48024) 2023-10-06T11:13:51.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd32d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd3415a1f0 0x7fcd340cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd31d9b700 1 -- 172.21.15.55:0/642969907 learned_addr learned my addr 172.21.15.55:0/642969907 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd3259c700 1 --2- 172.21.15.55:0/642969907 >> v2:172.21.15.142:3300/0 conn(0x7fcd34067bd0 0x7fcd340cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd32d9d700 1 -- 172.21.15.55:0/642969907 >> v2:172.21.15.142:3300/0 conn(0x7fcd34067bd0 msgr2=0x7fcd340cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd32d9d700 1 --2- 172.21.15.55:0/642969907 >> v2:172.21.15.142:3300/0 conn(0x7fcd34067bd0 0x7fcd340cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd32d9d700 1 -- 172.21.15.55:0/642969907 >> v1:172.21.15.55:6789/0 conn(0x7fcd3415dcf0 legacy=0x7fcd34159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd32d9d700 1 -- 172.21.15.55:0/642969907 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3415a7f0 con 0x7fcd3415a1f0 2023-10-06T11:13:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd3159a700 1 -- 172.21.15.55:0/642969907 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050887026 0 0) 0x7fcd3415d860 con 0x7fcd3415dcf0 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.382+0000 7fcd32d9d700 1 --2- 172.21.15.55:0/642969907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415a1f0 0x7fcd340cb2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406dbe0 tx=0x7fcd2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6925a94f2a8811ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd3159a700 1 -- 172.21.15.55:0/642969907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00e070 con 0x7fcd3415a1f0 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd3159a700 1 -- 172.21.15.55:0/642969907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c00bb20 con 0x7fcd3415a1f0 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd3159a700 1 -- 172.21.15.55:0/642969907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c012430 con 0x7fcd3415a1f0 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 -- 172.21.15.55:0/642969907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415a1f0 msgr2=0x7fcd340cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/642969907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415a1f0 0x7fcd340cb2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406dbe0 tx=0x7fcd2c009780 comp rx=0 tx=0).stop 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 -- 172.21.15.55:0/642969907 shutdown_connections 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/642969907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415a1f0 0x7fcd340cb2b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/642969907 >> v2:172.21.15.142:3300/0 conn(0x7fcd34067bd0 0x7fcd340cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 -- 172.21.15.55:0/642969907 >> 172.21.15.55:0/642969907 conn(0x7fcd340cd1a0 msgr2=0x7fcd340cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 -- 172.21.15.55:0/642969907 shutdown_connections 2023-10-06T11:13:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.383+0000 7fcd38fa2700 1 -- 172.21.15.55:0/642969907 wait complete. 2023-10-06T11:13:51.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.384+0000 7fcd38fa2700 1 Processor -- start 2023-10-06T11:13:51.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.384+0000 7fcd38fa2700 1 -- start start 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd38fa2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd34067bd0 0x7fcd3416c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd38fa2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3415a1f0 0x7fcd340c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd38fa2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 0x7fcd341586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd38fa2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3416ce90 con 0x7fcd3415dcf0 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd38fa2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34169c10 con 0x7fcd34067bd0 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd38fa2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34169ef0 con 0x7fcd3415a1f0 2023-10-06T11:13:51.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd32d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 0x7fcd341586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd32d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 0x7fcd341586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50774/0 (socket says 172.21.15.55:50774) 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd32d9d700 1 -- 172.21.15.55:0/2237318634 learned_addr learned my addr 172.21.15.55:0/2237318634 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd3259c700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd34067bd0 0x7fcd3416c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.385+0000 7fcd31d9b700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3415a1f0 0x7fcd340c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd32d9d700 1 -- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3415a1f0 msgr2=0x7fcd340c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd32d9d700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3415a1f0 0x7fcd340c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd32d9d700 1 -- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd34067bd0 msgr2=0x7fcd3416c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd32d9d700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd34067bd0 0x7fcd3416c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd32d9d700 1 -- 172.21.15.55:0/2237318634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c009a20 con 0x7fcd3415dcf0 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd32d9d700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 0x7fcd341586b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00b6c0 tx=0x7fcd2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c027470 con 0x7fcd3415dcf0 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0275d0 con 0x7fcd3415dcf0 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3416a1d0 con 0x7fcd3415dcf0 2023-10-06T11:13:51.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c027990 con 0x7fcd3415dcf0 2023-10-06T11:13:51.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.386+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3416a790 con 0x7fcd3415dcf0 2023-10-06T11:13:51.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.387+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd34064a90 con 0x7fcd3415dcf0 2023-10-06T11:13:51.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.387+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd2c024070 con 0x7fcd3415dcf0 2023-10-06T11:13:51.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.388+0000 7fcd227fc700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd14066f30 0x7fcd140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.388+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcd2c087170 con 0x7fcd3415dcf0 2023-10-06T11:13:51.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.388+0000 7fcd3259c700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd14066f30 0x7fcd140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.388+0000 7fcd3259c700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd14066f30 0x7fcd140693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd340cbd90 tx=0x7fcd240091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.392+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd2c054040 con 0x7fcd3415dcf0 2023-10-06T11:13:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.587+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd3416a980 con 0x7fcd3415dcf0 2023-10-06T11:13:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.587+0000 7fcd227fc700 1 -- 172.21.15.55:0/2237318634 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd2c057660 con 0x7fcd3415dcf0 2023-10-06T11:13:51.589 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd14066f30 msgr2=0x7fcd140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd14066f30 0x7fcd140693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd340cbd90 tx=0x7fcd240091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 msgr2=0x7fcd341586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 0x7fcd341586b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00b6c0 tx=0x7fcd2c019000 comp rx=0 tx=0).stop 2023-10-06T11:13:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 shutdown_connections 2023-10-06T11:13:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd14066f30 0x7fcd140693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd3415dcf0 0x7fcd341586b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd34067bd0 0x7fcd3416c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 --2- 172.21.15.55:0/2237318634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd3415a1f0 0x7fcd340c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 >> 172.21.15.55:0/2237318634 conn(0x7fcd340cd1a0 msgr2=0x7fcd3406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 shutdown_connections 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.589+0000 7fcd38fa2700 1 -- 172.21.15.55:0/2237318634 wait complete. 2023-10-06T11:13:51.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:51.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 Processor -- start 2023-10-06T11:13:51.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 -- start start 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6240b0820 0x7fa6240686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240c9670 con 0x7fa6240c4450 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa624159c00 con 0x7fa6240b0820 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.724+0000 7fa62ab2f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c8a60 con 0x7fa6240cc740 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6240b0820 0x7fa6240686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6240b0820 0x7fa6240686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50776/0 (socket says 172.21.15.55:50776) 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 -- 172.21.15.55:0/1392725347 learned_addr learned my addr 172.21.15.55:0/1392725347 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:51.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6290cc700 1 --2- 172.21.15.55:0/1392725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 -- 172.21.15.55:0/1392725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 msgr2=0x7fa6240ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 --2- 172.21.15.55:0/1392725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 -- 172.21.15.55:0/1392725347 >> v1:172.21.15.142:6789/0 conn(0x7fa6240c4450 legacy=0x7fa6240cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 -- 172.21.15.55:0/1392725347 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240c8d40 con 0x7fa6240b0820 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6288cb700 1 --2- 172.21.15.55:0/1392725347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240686c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009f70 tx=0x7fa61c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6eec36a4f18147 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6237fe700 1 -- 172.21.15.55:0/1392725347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00e070 con 0x7fa6240b0820 2023-10-06T11:13:51.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6237fe700 1 -- 172.21.15.55:0/1392725347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00bad0 con 0x7fa6240b0820 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.725+0000 7fa6237fe700 1 -- 172.21.15.55:0/1392725347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0092e0 con 0x7fa6240b0820 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 -- 172.21.15.55:0/1392725347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 msgr2=0x7fa6240686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/1392725347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240686c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009f70 tx=0x7fa61c009840 comp rx=0 tx=0).stop 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 -- 172.21.15.55:0/1392725347 shutdown_connections 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/1392725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/1392725347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240686c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 -- 172.21.15.55:0/1392725347 >> 172.21.15.55:0/1392725347 conn(0x7fa624087fc0 msgr2=0x7fa6240ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 -- 172.21.15.55:0/1392725347 shutdown_connections 2023-10-06T11:13:51.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.726+0000 7fa62ab2f700 1 -- 172.21.15.55:0/1392725347 wait complete. 2023-10-06T11:13:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.727+0000 7fa62ab2f700 1 Processor -- start 2023-10-06T11:13:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.727+0000 7fa62ab2f700 1 -- start start 2023-10-06T11:13:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa62ab2f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa62ab2f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6240c4450 0x7fa624157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa62ab2f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa62ab2f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240b4050 con 0x7fa6240b0820 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa62ab2f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624157590 con 0x7fa6240c4450 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa62ab2f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62415a5c0 con 0x7fa6240cc740 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50782/0 (socket says 172.21.15.55:50782) 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 -- 172.21.15.55:0/509954158 learned_addr learned my addr 172.21.15.55:0/509954158 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa623fff700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6240c4450 0x7fa624157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6290cc700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 -- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 msgr2=0x7fa6240c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 -- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6240c4450 msgr2=0x7fa624157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6240c4450 0x7fa624157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 -- 172.21.15.55:0/509954158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009ae0 con 0x7fa6240b0820 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.728+0000 7fa6288cb700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240b3b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00b770 tx=0x7fa61c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.729+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c008a00 con 0x7fa6240b0820 2023-10-06T11:13:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.729+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c008b60 con 0x7fa6240b0820 2023-10-06T11:13:51.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.729+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6240b38e0 con 0x7fa6240b0820 2023-10-06T11:13:51.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.729+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c026460 con 0x7fa6240b0820 2023-10-06T11:13:51.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.729+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6240b22a0 con 0x7fa6240b0820 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.730+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62415a700 con 0x7fa6240b0820 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.730+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa61c003040 con 0x7fa6240b0820 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.730+0000 7fa620ff9700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa604066f30 0x7fa6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.730+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa61c0868b0 con 0x7fa6240b0820 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.731+0000 7fa623fff700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa604066f30 0x7fa6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.731+0000 7fa623fff700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa604066f30 0x7fa6040693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa62406cef0 tx=0x7fa60c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:51.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.735+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa61c053780 con 0x7fa6240b0820 2023-10-06T11:13:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.930+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa624064a90 con 0x7fa6240b0820 2023-10-06T11:13:51.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.930+0000 7fa620ff9700 1 -- 172.21.15.55:0/509954158 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa61c0210a0 con 0x7fa6240b0820 2023-10-06T11:13:51.932 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:51.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa604066f30 msgr2=0x7fa6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa604066f30 0x7fa6040693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa62406cef0 tx=0x7fa60c007ec0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 msgr2=0x7fa6240b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240b3b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00b770 tx=0x7fa61c018000 comp rx=0 tx=0).stop 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 shutdown_connections 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa604066f30 0x7fa6040693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b0820 0x7fa6240b3b10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6240cc740 0x7fa6240c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 --2- 172.21.15.55:0/509954158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6240c4450 0x7fa624157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.932+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 >> 172.21.15.55:0/509954158 conn(0x7fa624087fc0 msgr2=0x7fa6240697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.933+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 shutdown_connections 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:51.933+0000 7fa62ab2f700 1 -- 172.21.15.55:0/509954158 wait complete. 2023-10-06T11:13:51.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:52.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.064+0000 7ff04c2e1700 1 Processor -- start 2023-10-06T11:13:52.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.064+0000 7ff04c2e1700 1 -- start start 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04c2e1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0440adb60 0x7ff0440ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04c2e1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff044157de0 con 0x7ff0440ce6d0 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04c2e1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440ceb10 con 0x7ff0440ca370 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04c2e1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440cbb90 con 0x7ff0440adb60 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04a87e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff0440ce6d0 0x7ff04415aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48030/0 (socket says 172.21.15.55:48030) 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04a87e700 1 -- 172.21.15.55:0/1777898529 learned_addr learned my addr 172.21.15.55:0/1777898529 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04987c700 1 --2- 172.21.15.55:0/1777898529 >> v2:172.21.15.142:3300/0 conn(0x7ff0440adb60 0x7ff0440ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747071115 0 0) 0x7ff044157de0 con 0x7ff0440ce6d0 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.065+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff030003570 con 0x7ff0440ce6d0 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938089829 0 0) 0x7ff0440ceb10 con 0x7ff0440ca370 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff044157de0 con 0x7ff0440ca370 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04987c700 1 -- 172.21.15.55:0/1777898529 >> v1:172.21.15.142:6789/0 conn(0x7ff0440ca370 legacy=0x7ff044158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04987c700 1 -- 172.21.15.55:0/1777898529 >> v1:172.21.15.55:6789/0 conn(0x7ff0440ce6d0 legacy=0x7ff04415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04987c700 1 -- 172.21.15.55:0/1777898529 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440cb5d0 con 0x7ff0440adb60 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04987c700 1 --2- 172.21.15.55:0/1777898529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440adb60 0x7ff0440ce190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff0340098e0 tx=0x7ff0340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=764743b0a83ee5bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034011630 con 0x7ff0440adb60 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034011790 con 0x7ff0440adb60 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04907b700 1 -- 172.21.15.55:0/1777898529 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034011b30 con 0x7ff0440adb60 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04c2e1700 1 -- 172.21.15.55:0/1777898529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440adb60 msgr2=0x7ff0440ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.066+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/1777898529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440adb60 0x7ff0440ce190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff0340098e0 tx=0x7ff0340091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.067+0000 7ff04c2e1700 1 -- 172.21.15.55:0/1777898529 shutdown_connections 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.067+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/1777898529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440adb60 0x7ff0440ce190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.067+0000 7ff04c2e1700 1 -- 172.21.15.55:0/1777898529 >> 172.21.15.55:0/1777898529 conn(0x7ff0440707d0 msgr2=0x7ff044070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.067+0000 7ff04c2e1700 1 -- 172.21.15.55:0/1777898529 shutdown_connections 2023-10-06T11:13:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.067+0000 7ff04c2e1700 1 -- 172.21.15.55:0/1777898529 wait complete. 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 Processor -- start 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 -- start start 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0440adb60 0x7ff044152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 0x7ff0440c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440ce6d0 0x7ff0440c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440b2d20 con 0x7ff0440ca370 2023-10-06T11:13:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0441533d0 con 0x7ff0440ce6d0 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.068+0000 7ff04c2e1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440b2110 con 0x7ff0440adb60 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 0x7ff0440c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 0x7ff0440c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50798/0 (socket says 172.21.15.55:50798) 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 -- 172.21.15.55:0/26309767 learned_addr learned my addr 172.21.15.55:0/26309767 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04a87e700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440ce6d0 0x7ff0440c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04a07d700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0440adb60 0x7ff044152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 -- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0440adb60 msgr2=0x7ff044152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0440adb60 0x7ff044152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 -- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440ce6d0 msgr2=0x7ff0440c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440ce6d0 0x7ff0440c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 -- 172.21.15.55:0/26309767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034009420 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04a07d700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0440adb60 0x7ff044152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04987c700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 0x7ff0440c52e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff034013000 tx=0x7ff034017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03401f070 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034000c90 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0440b23f0 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034025420 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.069+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0440b29b0 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.070+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff044064a90 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.071+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff034023070 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.071+0000 7ff03a7fc700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff028066f30 0x7ff0280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.071+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff034086190 con 0x7ff0440ca370 2023-10-06T11:13:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.072+0000 7ff04a07d700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff028066f30 0x7ff0280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.072+0000 7ff04a07d700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff028066f30 0x7ff0280693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff040007fd0 tx=0x7ff040009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.075+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff034052fb0 con 0x7ff0440ca370 2023-10-06T11:13:52.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.270+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0440b2e60 con 0x7ff0440ca370 2023-10-06T11:13:52.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.271+0000 7ff03a7fc700 1 -- 172.21.15.55:0/26309767 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18707 (secure 0 0 0) 0x7ff03405de60 con 0x7ff0440ca370 2023-10-06T11:13:52.272 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:52.273 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:17.560225+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:52.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff028066f30 msgr2=0x7ff0280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff028066f30 0x7ff0280693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff040007fd0 tx=0x7ff040009040 comp rx=0 tx=0).stop 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 msgr2=0x7ff0440c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 0x7ff0440c52e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff034013000 tx=0x7ff034017000 comp rx=0 tx=0).stop 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 shutdown_connections 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff028066f30 0x7ff0280693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0440ce6d0 0x7ff0440c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0440adb60 0x7ff044152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 --2- 172.21.15.55:0/26309767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0440ca370 0x7ff0440c52e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 >> 172.21.15.55:0/26309767 conn(0x7ff0440707d0 msgr2=0x7ff0440cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 shutdown_connections 2023-10-06T11:13:52.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.273+0000 7ff04c2e1700 1 -- 172.21.15.55:0/26309767 wait complete. 2023-10-06T11:13:52.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:52.287 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:52.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.407+0000 7f7382f54700 1 Processor -- start 2023-10-06T11:13:52.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.407+0000 7f7382f54700 1 -- start start 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7382f54700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f737c159470 0x7f737c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7382f54700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c159840 0x7f737c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7382f54700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0cbb80 con 0x7f737c0c6170 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7382f54700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0c6d00 con 0x7f737c159470 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7382f54700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0c6f00 con 0x7f737c159840 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7380cf0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f737c159470 0x7f737c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f73814f1700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f737c0c6170 0x7f737c0c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48032/0 (socket says 172.21.15.55:48032) 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f73814f1700 1 -- 172.21.15.55:0/1864735719 learned_addr learned my addr 172.21.15.55:0/1864735719 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f737bfff700 1 --2- 172.21.15.55:0/1864735719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c159840 0x7f737c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7380cf0700 1 -- 172.21.15.55:0/1864735719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c159840 msgr2=0x7f737c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7380cf0700 1 --2- 172.21.15.55:0/1864735719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c159840 0x7f737c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7380cf0700 1 -- 172.21.15.55:0/1864735719 >> v1:172.21.15.55:6789/0 conn(0x7f737c0c6170 legacy=0x7f737c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f737b7fe700 1 -- 172.21.15.55:0/1864735719 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502500810 0 0) 0x7f737c0cbb80 con 0x7f737c0c6170 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7380cf0700 1 -- 172.21.15.55:0/1864735719 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0cb530 con 0x7f737c159470 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.408+0000 7f7380cf0700 1 --2- 172.21.15.55:0/1864735719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c0ce980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73700098d0 tx=0x7f7370009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6dbb142a739c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f737b7fe700 1 -- 172.21.15.55:0/1864735719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370009e70 con 0x7f737c159470 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f737b7fe700 1 -- 172.21.15.55:0/1864735719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370005c10 con 0x7f737c159470 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f737b7fe700 1 -- 172.21.15.55:0/1864735719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000b650 con 0x7f737c159470 2023-10-06T11:13:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 -- 172.21.15.55:0/1864735719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 msgr2=0x7f737c0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 --2- 172.21.15.55:0/1864735719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c0ce980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73700098d0 tx=0x7f7370009120 comp rx=0 tx=0).stop 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 -- 172.21.15.55:0/1864735719 shutdown_connections 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 --2- 172.21.15.55:0/1864735719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c0ce980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 --2- 172.21.15.55:0/1864735719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c159840 0x7f737c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 -- 172.21.15.55:0/1864735719 >> 172.21.15.55:0/1864735719 conn(0x7f737c0996e0 msgr2=0x7f737c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 -- 172.21.15.55:0/1864735719 shutdown_connections 2023-10-06T11:13:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.409+0000 7f7382f54700 1 -- 172.21.15.55:0/1864735719 wait complete. 2023-10-06T11:13:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.410+0000 7f7382f54700 1 Processor -- start 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 -- start start 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c0c6170 0x7f737c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f737c159840 0x7f737c15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c169d80 con 0x7f737c159470 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0c7a70 con 0x7f737c159840 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f7382f54700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c1533f0 con 0x7f737c0c6170 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f737bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f737bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c15b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50814/0 (socket says 172.21.15.55:50814) 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.411+0000 7f737bfff700 1 -- 172.21.15.55:0/1066796824 learned_addr learned my addr 172.21.15.55:0/1066796824 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f7380cf0700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c0c6170 0x7f737c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f737bfff700 1 -- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c0c6170 msgr2=0x7f737c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f737bfff700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c0c6170 0x7f737c152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f737bfff700 1 -- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f737c159840 msgr2=0x7f737c15be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f73814f1700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f737c159840 0x7f737c15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f737bfff700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f737c159840 0x7f737c15be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f737bfff700 1 -- 172.21.15.55:0/1066796824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700093c0 con 0x7f737c159470 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f73814f1700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f737c159840 0x7f737c15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f737bfff700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c15b8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f736800d860 tx=0x7f7368008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368009610 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368009770 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c1536d0 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368009b30 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.412+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c153c90 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.413+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c064a90 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.413+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f736801e460 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.414+0000 7f7378ff9700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7360066f30 0x7f73600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.414+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7368084fa0 con 0x7f737c159470 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.414+0000 7f7380cf0700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7360066f30 0x7f73600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.414+0000 7f7380cf0700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7360066f30 0x7f73600693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f737c154420 tx=0x7f7370016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.418+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7368051dc0 con 0x7f737c159470 2023-10-06T11:13:52.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.612+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f737c0c7bb0 con 0x7f737c159470 2023-10-06T11:13:52.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.612+0000 7f7378ff9700 1 -- 172.21.15.55:0/1066796824 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73680553e0 con 0x7f737c159470 2023-10-06T11:13:52.614 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:52.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7360066f30 msgr2=0x7f73600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7360066f30 0x7f73600693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f737c154420 tx=0x7f7370016000 comp rx=0 tx=0).stop 2023-10-06T11:13:52.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 msgr2=0x7f737c15b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c15b8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f736800d860 tx=0x7f7368008040 comp rx=0 tx=0).stop 2023-10-06T11:13:52.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 shutdown_connections 2023-10-06T11:13:52.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7360066f30 0x7f73600693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f737c159840 0x7f737c15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f737c0c6170 0x7f737c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 --2- 172.21.15.55:0/1066796824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f737c159470 0x7f737c15b8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 >> 172.21.15.55:0/1066796824 conn(0x7f737c0996e0 msgr2=0x7f737c154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 shutdown_connections 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.614+0000 7f7382f54700 1 -- 172.21.15.55:0/1066796824 wait complete. 2023-10-06T11:13:52.628 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.748+0000 7f35bdbe5700 1 Processor -- start 2023-10-06T11:13:52.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.748+0000 7f35bdbe5700 1 -- start start 2023-10-06T11:13:52.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35bdbe5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35b81598a0 0x7f35b80ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35bdbe5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b80cf5d0 con 0x7f35b80cbc70 2023-10-06T11:13:52.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35bdbe5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b80cf8b0 con 0x7f35b81594d0 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35bdbe5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b80cfb90 con 0x7f35b81598a0 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35b6ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35b81598a0 0x7f35b80ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35b7fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35b80cbc70 0x7f35b80ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48034/0 (socket says 172.21.15.55:48034) 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.749+0000 7f35b7fff700 1 -- 172.21.15.55:0/3522848222 learned_addr learned my addr 172.21.15.55:0/3522848222 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b67fc700 1 -- 172.21.15.55:0/3522848222 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726320952 0 0) 0x7f35b80cf5d0 con 0x7f35b80cbc70 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b67fc700 1 -- 172.21.15.55:0/3522848222 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a0003570 con 0x7f35b80cbc70 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b6ffd700 1 -- 172.21.15.55:0/3522848222 >> v1:172.21.15.142:6789/0 conn(0x7f35b81594d0 legacy=0x7f35b80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b6ffd700 1 -- 172.21.15.55:0/3522848222 >> v1:172.21.15.55:6789/0 conn(0x7f35b80cbc70 legacy=0x7f35b80ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b6ffd700 1 -- 172.21.15.55:0/3522848222 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80cfe70 con 0x7f35b81598a0 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b6ffd700 1 --2- 172.21.15.55:0/3522848222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81598a0 0x7f35b80ce7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0098e0 tx=0x7f35ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1805cea9ee6f8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b67fc700 1 -- 172.21.15.55:0/3522848222 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00b640 con 0x7f35b81598a0 2023-10-06T11:13:52.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b67fc700 1 -- 172.21.15.55:0/3522848222 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac00b7a0 con 0x7f35b81598a0 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.750+0000 7f35b67fc700 1 -- 172.21.15.55:0/3522848222 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00bb40 con 0x7f35b81598a0 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 -- 172.21.15.55:0/3522848222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81598a0 msgr2=0x7f35b80ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/3522848222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81598a0 0x7f35b80ce7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0098e0 tx=0x7f35ac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 -- 172.21.15.55:0/3522848222 shutdown_connections 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/3522848222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81598a0 0x7f35b80ce7e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 -- 172.21.15.55:0/3522848222 >> 172.21.15.55:0/3522848222 conn(0x7f35b8089e50 msgr2=0x7f35b8099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 -- 172.21.15.55:0/3522848222 shutdown_connections 2023-10-06T11:13:52.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.751+0000 7f35bdbe5700 1 -- 172.21.15.55:0/3522848222 wait complete. 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.752+0000 7f35bdbe5700 1 Processor -- start 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.752+0000 7f35bdbe5700 1 -- start start 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35b80cbc70 0x7f35b8149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 0x7f35b8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35b81598a0 0x7f35b8154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b32b0 con 0x7f35b81594d0 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b815cb20 con 0x7f35b81598a0 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b8150250 con 0x7f35b80cbc70 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 0x7f35b8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 0x7f35b8155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50822/0 (socket says 172.21.15.55:50822) 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 -- 172.21.15.55:0/2570264368 learned_addr learned my addr 172.21.15.55:0/2570264368 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b77fe700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35b80cbc70 0x7f35b8149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b7fff700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35b81598a0 0x7f35b8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 -- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35b80cbc70 msgr2=0x7f35b8149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35b80cbc70 0x7f35b8149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 -- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35b81598a0 msgr2=0x7f35b8154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35b81598a0 0x7f35b8154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 -- 172.21.15.55:0/2570264368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac009420 con 0x7f35b81594d0 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b7fff700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35b81598a0 0x7f35b8154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:52.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35b6ffd700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 0x7f35b8155260 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35ac013000 tx=0x7f35ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac000d10 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac00bb20 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac011630 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b8152c40 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.753+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b815c4d0 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.754+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b8064a90 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.755+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35ac0119e0 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.755+0000 7f359f7fe700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35a4066f30 0x7f35a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.755+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f35ac085f40 con 0x7f35b81594d0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.755+0000 7f35b77fe700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35a4066f30 0x7f35a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:52.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.756+0000 7f35b77fe700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35a4066f30 0x7f35a40693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35a8003a80 tx=0x7f35a8007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:52.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.759+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35ac052d60 con 0x7f35b81594d0 2023-10-06T11:13:52.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.954+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35b804bb40 con 0x7f35b81594d0 2023-10-06T11:13:52.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.954+0000 7f359f7fe700 1 -- 172.21.15.55:0/2570264368 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35ac056380 con 0x7f35b81594d0 2023-10-06T11:13:52.956 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:52.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35a4066f30 msgr2=0x7f35a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35a4066f30 0x7f35a40693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35a8003a80 tx=0x7f35a8007ec0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 msgr2=0x7f35b8155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 0x7f35b8155260 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35ac013000 tx=0x7f35ac017000 comp rx=0 tx=0).stop 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 shutdown_connections 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35a4066f30 0x7f35a40693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35b81598a0 0x7f35b8154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35b80cbc70 0x7f35b8149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 --2- 172.21.15.55:0/2570264368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b81594d0 0x7f35b8155260 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 >> 172.21.15.55:0/2570264368 conn(0x7f35b8089e50 msgr2=0x7f35b80ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 shutdown_connections 2023-10-06T11:13:52.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:52.956+0000 7f35bdbe5700 1 -- 172.21.15.55:0/2570264368 wait complete. 2023-10-06T11:13:52.970 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:53.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.091+0000 7f3f74612700 1 Processor -- start 2023-10-06T11:13:53.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.091+0000 7f3f74612700 1 -- start start 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f74612700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c159840 0x7f3f6c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f74612700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f6c0cf090 0x7f3f6c0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f74612700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c0cbb80 con 0x7f3f6c159470 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f74612700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c0c6f00 con 0x7f3f6c0cf090 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f74612700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c0cb530 con 0x7f3f6c159840 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f6c0cf090 0x7f3f6c0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f6c0cf090 0x7f3f6c0c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50828/0 (socket says 172.21.15.55:50828) 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 -- 172.21.15.55:0/1714832281 learned_addr learned my addr 172.21.15.55:0/1714832281 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f71bad700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c159840 0x7f3f6c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 -- 172.21.15.55:0/1714832281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c159840 msgr2=0x7f3f6c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c159840 0x7f3f6c0c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 -- 172.21.15.55:0/1714832281 >> v1:172.21.15.142:6789/0 conn(0x7f3f6c159470 legacy=0x7f3f6c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f72baf700 1 -- 172.21.15.55:0/1714832281 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c0cb810 con 0x7f3f6c0cf090 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.092+0000 7f3f71bad700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c159840 0x7f3f6c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f72baf700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0cf090 0x7f3f6c0c66b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009f20 tx=0x7f3f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7d64273a81fa81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f713ac700 1 -- 172.21.15.55:0/1714832281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400e070 con 0x7f3f6c0cf090 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f713ac700 1 -- 172.21.15.55:0/1714832281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6400ba80 con 0x7f3f6c0cf090 2023-10-06T11:13:53.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f713ac700 1 -- 172.21.15.55:0/1714832281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640092e0 con 0x7f3f6c0cf090 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 -- 172.21.15.55:0/1714832281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0cf090 msgr2=0x7f3f6c0c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0cf090 0x7f3f6c0c66b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009f20 tx=0x7f3f64009840 comp rx=0 tx=0).stop 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 -- 172.21.15.55:0/1714832281 shutdown_connections 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c0cf090 0x7f3f6c0c66b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 --2- 172.21.15.55:0/1714832281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c159840 0x7f3f6c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 -- 172.21.15.55:0/1714832281 >> 172.21.15.55:0/1714832281 conn(0x7f3f6c0996e0 msgr2=0x7f3f6c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 -- 172.21.15.55:0/1714832281 shutdown_connections 2023-10-06T11:13:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.093+0000 7f3f74612700 1 -- 172.21.15.55:0/1714832281 wait complete. 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.094+0000 7f3f74612700 1 Processor -- start 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 -- start start 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c0cf090 0x7f3f6c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 0x7f3f6c0c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c159840 0x7f3f6c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c15a620 con 0x7f3f6c159470 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c15aff0 con 0x7f3f6c159840 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f74612700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c16e040 con 0x7f3f6c0cf090 2023-10-06T11:13:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f71bad700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 0x7f3f6c0c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f71bad700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 0x7f3f6c0c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50842/0 (socket says 172.21.15.55:50842) 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f71bad700 1 -- 172.21.15.55:0/4093558032 learned_addr learned my addr 172.21.15.55:0/4093558032 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.095+0000 7f3f723ae700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c0cf090 0x7f3f6c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f71bad700 1 -- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c0cf090 msgr2=0x7f3f6c15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f72baf700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c159840 0x7f3f6c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f71bad700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c0cf090 0x7f3f6c15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f71bad700 1 -- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c159840 msgr2=0x7f3f6c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f71bad700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c159840 0x7f3f6c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f71bad700 1 -- 172.21.15.55:0/4093558032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f64009ae0 con 0x7f3f6c159470 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f723ae700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c0cf090 0x7f3f6c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f71bad700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 0x7f3f6c0c88e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00e8d0 tx=0x7f3f5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00ee70 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00c5e0 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00c980 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c159cf0 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.096+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c15a2b0 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.097+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6c15a790 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.097+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f5c013410 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.098+0000 7f3f627fc700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f50066f30 0x7f3f500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.098+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3f5c084860 con 0x7f3f6c159470 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.098+0000 7f3f723ae700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f50066f30 0x7f3f500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.098+0000 7f3f723ae700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f50066f30 0x7f3f500693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f68001870 tx=0x7f3f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.102+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f5c0515e0 con 0x7f3f6c159470 2023-10-06T11:13:53.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.299+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f6c064a90 con 0x7f3f6c159470 2023-10-06T11:13:53.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.299+0000 7f3f627fc700 1 -- 172.21.15.55:0/4093558032 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f5c054c00 con 0x7f3f6c159470 2023-10-06T11:13:53.301 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f50066f30 msgr2=0x7f3f500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f50066f30 0x7f3f500693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f68001870 tx=0x7f3f68009040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 msgr2=0x7f3f6c0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 0x7f3f6c0c88e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00e8d0 tx=0x7f3f5c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 shutdown_connections 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3f50066f30 0x7f3f500693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f6c159840 0x7f3f6c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f6c0cf090 0x7f3f6c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 --2- 172.21.15.55:0/4093558032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f6c159470 0x7f3f6c0c88e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 >> 172.21.15.55:0/4093558032 conn(0x7f3f6c0996e0 msgr2=0x7f3f6c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 shutdown_connections 2023-10-06T11:13:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.301+0000 7f3f74612700 1 -- 172.21.15.55:0/4093558032 wait complete. 2023-10-06T11:13:53.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:53.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.435+0000 7fc54f498700 1 Processor -- start 2023-10-06T11:13:53.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.436+0000 7fc54f498700 1 -- start start 2023-10-06T11:13:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.436+0000 7fc54f498700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5480b0a10 0x7fc5480cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.436+0000 7fc54f498700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 0x7fc5480c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.436+0000 7fc54f498700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5480c53c0 con 0x7fc5480b0640 2023-10-06T11:13:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.436+0000 7fc54f498700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5480ca790 con 0x7fc5480b0a10 2023-10-06T11:13:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.436+0000 7fc54f498700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480ccd00 con 0x7fc5480cc420 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54d234700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc5480b0640 0x7fc5480cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48042/0 (socket says 172.21.15.55:48042) 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54d234700 1 -- 172.21.15.55:0/2657689922 learned_addr learned my addr 172.21.15.55:0/2657689922 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54da35700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 0x7fc5480c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54ca33700 1 --2- 172.21.15.55:0/2657689922 >> v2:172.21.15.142:3300/0 conn(0x7fc5480b0a10 0x7fc5480cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412794268 0 0) 0x7fc5480c53c0 con 0x7fc5480b0640 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc530003570 con 0x7fc5480b0640 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064723004 0 0) 0x7fc530003570 con 0x7fc5480b0640 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 msgr2=0x7fc5480c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 0x7fc5480c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 >> v2:172.21.15.142:3300/0 conn(0x7fc5480b0a10 msgr2=0x7fc5480cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 --2- 172.21.15.55:0/2657689922 >> v2:172.21.15.142:3300/0 conn(0x7fc5480b0a10 0x7fc5480cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480ccfe0 con 0x7fc5480b0640 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fc540001970 con 0x7fc5480b0640 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 >> v1:172.21.15.55:6789/0 conn(0x7fc5480b0640 legacy=0x7fc5480cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 0x7fc530003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530003fe0 0x7fc530004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc530004d50 0x7fc5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480ca790 con 0x7fc530004d50 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480ccd00 con 0x7fc530003fe0 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53000ba90 con 0x7fc5480cc420 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54da35700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc530004d50 0x7fc5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54d234700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 0x7fc530003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.437+0000 7fc54ca33700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530003fe0 0x7fc530004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 -- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 msgr2=0x7fc530003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5480cc420 0x7fc530003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 -- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530003fe0 msgr2=0x7fc530004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530003fe0 0x7fc530004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 -- 172.21.15.55:0/2657689922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530003570 con 0x7fc530004d50 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54ca33700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530003fe0 0x7fc530004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc530004d50 0x7fc5300051c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc538009c00 tx=0x7fc5380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9b9ac445306b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53800e6b0 con 0x7fc530004d50 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53800e810 con 0x7fc530004d50 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc547fff700 1 -- 172.21.15.55:0/2657689922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53800ebd0 con 0x7fc530004d50 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54f498700 1 -- 172.21.15.55:0/2657689922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc530004d50 msgr2=0x7fc5300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54f498700 1 --2- 172.21.15.55:0/2657689922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc530004d50 0x7fc5300051c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc538009c00 tx=0x7fc5380091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.438+0000 7fc54da35700 1 -- 172.21.15.55:0/2657689922 reap_dead start 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.439+0000 7fc54f498700 1 -- 172.21.15.55:0/2657689922 shutdown_connections 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.439+0000 7fc54f498700 1 -- 172.21.15.55:0/2657689922 >> 172.21.15.55:0/2657689922 conn(0x7fc548087fc0 msgr2=0x7fc5480ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.439+0000 7fc54f498700 1 -- 172.21.15.55:0/2657689922 shutdown_connections 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.439+0000 7fc54f498700 1 -- 172.21.15.55:0/2657689922 wait complete. 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.440+0000 7fc54f498700 1 Processor -- start 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.440+0000 7fc54f498700 1 -- start start 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530004d50 0x7fc5480686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc548154e30 0x7fc54814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 0x7fc5480c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480b2230 con 0x7fc5480c9050 2023-10-06T11:13:53.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54816a380 con 0x7fc530004d50 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480c9a00 con 0x7fc548154e30 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 0x7fc5480c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 0x7fc5480c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50848/0 (socket says 172.21.15.55:50848) 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 -- 172.21.15.55:0/1397142002 learned_addr learned my addr 172.21.15.55:0/1397142002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54ca33700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc548154e30 0x7fc54814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54d234700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530004d50 0x7fc5480686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 -- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc548154e30 msgr2=0x7fc54814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc548154e30 0x7fc54814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 -- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530004d50 msgr2=0x7fc5480686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530004d50 0x7fc5480686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 -- 172.21.15.55:0/1397142002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54814b330 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54d234700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530004d50 0x7fc5480686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54ca33700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc548154e30 0x7fc54814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54da35700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 0x7fc5480c94c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc530004730 tx=0x7fc53801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538022070 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53800eb90 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54806a630 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.441+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53800e6b0 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.442+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc548169d30 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.442+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc548064a90 con 0x7fc5480c9050 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.443+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc538027960 con 0x7fc5480c9050 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.443+0000 7fc5457fa700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc534066f30 0x7fc5340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.443+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc538000e40 con 0x7fc5480c9050 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.443+0000 7fc54d234700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc534066f30 0x7fc5340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.444+0000 7fc54d234700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc534066f30 0x7fc5340693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc540001ae0 tx=0x7fc540009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.447+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc538052bf0 con 0x7fc5480c9050 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.639+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc54816a4c0 con 0x7fc5480c9050 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.639+0000 7fc5457fa700 1 -- 172.21.15.55:0/1397142002 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc538017020 con 0x7fc5480c9050 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc534066f30 msgr2=0x7fc5340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc534066f30 0x7fc5340693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc540001ae0 tx=0x7fc540009040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 msgr2=0x7fc5480c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 0x7fc5480c94c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc530004730 tx=0x7fc53801a000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 shutdown_connections 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc534066f30 0x7fc5340693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5480c9050 0x7fc5480c94c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc530004d50 0x7fc5480686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 --2- 172.21.15.55:0/1397142002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc548154e30 0x7fc54814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 >> 172.21.15.55:0/1397142002 conn(0x7fc548087fc0 msgr2=0x7fc548156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.641+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 shutdown_connections 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.642+0000 7fc54f498700 1 -- 172.21.15.55:0/1397142002 wait complete. 2023-10-06T11:13:53.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:53.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 Processor -- start 2023-10-06T11:13:53.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 -- start start 2023-10-06T11:13:53.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7518159840 0x7f75180c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75180cf090 0x7f75180c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180cbb80 con 0x7f7518159470 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180c6f00 con 0x7f7518159840 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.777+0000 7f751f0f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cb530 con 0x7f75180cf090 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7518159840 0x7f75180c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7518159840 0x7f75180c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50850/0 (socket says 172.21.15.55:50850) 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 -- 172.21.15.55:0/1484222359 learned_addr learned my addr 172.21.15.55:0/1484222359 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f751d692700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75180cf090 0x7f75180c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 -- 172.21.15.55:0/1484222359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75180cf090 msgr2=0x7f75180c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75180cf090 0x7f75180c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 -- 172.21.15.55:0/1484222359 >> v1:172.21.15.142:6789/0 conn(0x7f7518159470 legacy=0x7f75180ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 -- 172.21.15.55:0/1484222359 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180cb810 con 0x7f7518159840 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f751d692700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75180cf090 0x7f75180c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f7517fff700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7518159840 0x7f75180c6170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75000099b0 tx=0x7f7500009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8519f8e6c40c489 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f75177fe700 1 -- 172.21.15.55:0/1484222359 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000b860 con 0x7f7518159840 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f75177fe700 1 -- 172.21.15.55:0/1484222359 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000b9c0 con 0x7f7518159840 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.778+0000 7f75177fe700 1 -- 172.21.15.55:0/1484222359 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000bd60 con 0x7f7518159840 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 -- 172.21.15.55:0/1484222359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7518159840 msgr2=0x7f75180c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7518159840 0x7f75180c6170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75000099b0 tx=0x7f7500009250 comp rx=0 tx=0).stop 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 -- 172.21.15.55:0/1484222359 shutdown_connections 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75180cf090 0x7f75180c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1484222359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7518159840 0x7f75180c6170 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 -- 172.21.15.55:0/1484222359 >> 172.21.15.55:0/1484222359 conn(0x7f75180996e0 msgr2=0x7f751806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 -- 172.21.15.55:0/1484222359 shutdown_connections 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.779+0000 7f751f0f5700 1 -- 172.21.15.55:0/1484222359 wait complete. 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.780+0000 7f751f0f5700 1 Processor -- start 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.780+0000 7f751f0f5700 1 -- start start 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751f0f5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 0x7f75181699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751f0f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7518159470 0x7f75180c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751f0f5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7518159840 0x7f751815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751f0f5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815a150 con 0x7f75180cf090 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751f0f5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815a430 con 0x7f7518159840 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751f0f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751815a710 con 0x7f7518159470 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 0x7f75181699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 0x7f75181699f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50866/0 (socket says 172.21.15.55:50866) 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 -- 172.21.15.55:0/1056626427 learned_addr learned my addr 172.21.15.55:0/1056626427 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f7517fff700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7518159470 0x7f75180c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751d692700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7518159840 0x7f751815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 -- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7518159470 msgr2=0x7f75180c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7518159470 0x7f75180c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 -- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7518159840 msgr2=0x7f751815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7518159840 0x7f751815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.781+0000 7f751ce91700 1 -- 172.21.15.55:0/1056626427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000094f0 con 0x7f75180cf090 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.782+0000 7f751ce91700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 0x7f75181699f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f750800cdb0 tx=0x7f7508001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.782+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800aac0 con 0x7f75180cf090 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.782+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800ac20 con 0x7f75180cf090 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.782+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508012420 con 0x7f75180cf090 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.782+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751815a9f0 con 0x7f75180cf090 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.782+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751814b4e0 con 0x7f75180cf090 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.783+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7518064a90 con 0x7f75180cf090 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.783+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7508012810 con 0x7f75180cf090 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.784+0000 7f7514ff9700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74f8066f30 0x7f74f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.784+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7508085090 con 0x7f75180cf090 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.784+0000 7f7517fff700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74f8066f30 0x7f74f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.784+0000 7f7517fff700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74f8066f30 0x7f74f80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f75000099b0 tx=0x7f7500017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.788+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7508051e70 con 0x7f75180cf090 2023-10-06T11:13:53.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.979+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f75180c6bf0 con 0x7f75180cf090 2023-10-06T11:13:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.979+0000 7f7514ff9700 1 -- 172.21.15.55:0/1056626427 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7508055490 con 0x7f75180cf090 2023-10-06T11:13:53.981 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74f8066f30 msgr2=0x7f74f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74f8066f30 0x7f74f80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f75000099b0 tx=0x7f7500017000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 msgr2=0x7f75181699f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 0x7f75181699f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f750800cdb0 tx=0x7f7508001be0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 shutdown_connections 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74f8066f30 0x7f74f80693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180cf090 0x7f75181699f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7518159840 0x7f751815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 --2- 172.21.15.55:0/1056626427 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7518159470 0x7f75180c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 >> 172.21.15.55:0/1056626427 conn(0x7f75180996e0 msgr2=0x7f75180ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 shutdown_connections 2023-10-06T11:13:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:53.981+0000 7f751f0f5700 1 -- 172.21.15.55:0/1056626427 wait complete. 2023-10-06T11:13:54.013 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2023-10-06T11:13:54.013 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T11:13:54.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2023-10-06T11:13:54.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.131+0000 7fca23752700 1 Processor -- start 2023-10-06T11:13:54.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.131+0000 7fca23752700 1 -- start start 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca23752700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca1c0b0760 0x7fca1c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca23752700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c0b0c60 con 0x7fca1c159560 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca23752700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c0b0f40 con 0x7fca1c0b49a0 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca23752700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c0ab350 con 0x7fca1c0b0760 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca214ee700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca1c159560 0x7fca1c0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48052/0 (socket says 172.21.15.55:48052) 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca214ee700 1 -- 172.21.15.55:0/518969792 learned_addr learned my addr 172.21.15.55:0/518969792 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca21cef700 1 --2- 172.21.15.55:0/518969792 >> v2:172.21.15.55:3300/0 conn(0x7fca1c0b0760 0x7fca1c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca1bfff700 1 -- 172.21.15.55:0/518969792 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478411543 0 0) 0x7fca1c0b0c60 con 0x7fca1c159560 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca1bfff700 1 -- 172.21.15.55:0/518969792 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca04003570 con 0x7fca1c159560 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca21cef700 1 -- 172.21.15.55:0/518969792 >> v1:172.21.15.142:6789/0 conn(0x7fca1c0b49a0 legacy=0x7fca1c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca21cef700 1 -- 172.21.15.55:0/518969792 >> v1:172.21.15.55:6789/0 conn(0x7fca1c159560 legacy=0x7fca1c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.132+0000 7fca21cef700 1 -- 172.21.15.55:0/518969792 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c0b1220 con 0x7fca1c0b0760 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca21cef700 1 --2- 172.21.15.55:0/518969792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b0760 0x7fca1c0ccf90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009e90 tx=0x7fca0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738b3ea4274fc62b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca1bfff700 1 -- 172.21.15.55:0/518969792 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00e070 con 0x7fca1c0b0760 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca1bfff700 1 -- 172.21.15.55:0/518969792 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c00bc40 con 0x7fca1c0b0760 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca1bfff700 1 -- 172.21.15.55:0/518969792 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c012430 con 0x7fca1c0b0760 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 -- 172.21.15.55:0/518969792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b0760 msgr2=0x7fca1c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 --2- 172.21.15.55:0/518969792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b0760 0x7fca1c0ccf90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009e90 tx=0x7fca0c009780 comp rx=0 tx=0).stop 2023-10-06T11:13:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 -- 172.21.15.55:0/518969792 shutdown_connections 2023-10-06T11:13:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 --2- 172.21.15.55:0/518969792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b0760 0x7fca1c0ccf90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 -- 172.21.15.55:0/518969792 >> 172.21.15.55:0/518969792 conn(0x7fca1c0997f0 msgr2=0x7fca1c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 -- 172.21.15.55:0/518969792 shutdown_connections 2023-10-06T11:13:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.133+0000 7fca23752700 1 -- 172.21.15.55:0/518969792 wait complete. 2023-10-06T11:13:54.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.134+0000 7fca23752700 1 Processor -- start 2023-10-06T11:13:54.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.134+0000 7fca23752700 1 -- start start 2023-10-06T11:13:54.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca23752700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca1c0b0760 0x7fca1c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca23752700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 0x7fca1c09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca23752700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1c159560 0x7fca1c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca23752700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c09e0f0 con 0x7fca1c0b49a0 2023-10-06T11:13:54.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca23752700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c16de10 con 0x7fca1c159560 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca23752700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c16d290 con 0x7fca1c0b0760 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.135+0000 7fca20ced700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 0x7fca1c09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 0x7fca1c09dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50894/0 (socket says 172.21.15.55:50894) 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 -- 172.21.15.55:0/2443931001 learned_addr learned my addr 172.21.15.55:0/2443931001 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca21cef700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1c159560 0x7fca1c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca214ee700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca1c0b0760 0x7fca1c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 -- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca1c0b0760 msgr2=0x7fca1c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca1c0b0760 0x7fca1c15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 -- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1c159560 msgr2=0x7fca1c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1c159560 0x7fca1c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 -- 172.21.15.55:0/2443931001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c009a20 con 0x7fca1c0b49a0 2023-10-06T11:13:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca214ee700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca1c0b0760 0x7fca1c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca20ced700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 0x7fca1c09dbb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c790 tx=0x7fca10007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10011590 con 0x7fca1c0b49a0 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10011710 con 0x7fca1c0b49a0 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c16d570 con 0x7fca1c0b49a0 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10011ad0 con 0x7fca1c0b49a0 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.136+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c16db30 con 0x7fca1c0b49a0 2023-10-06T11:13:54.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.137+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c15a990 con 0x7fca1c0b49a0 2023-10-06T11:13:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.138+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca1001b3b0 con 0x7fca1c0b49a0 2023-10-06T11:13:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.138+0000 7fca197fa700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca08066f30 0x7fca080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.138+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fca10083db0 con 0x7fca1c0b49a0 2023-10-06T11:13:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.138+0000 7fca214ee700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca08066f30 0x7fca080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.139+0000 7fca214ee700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca08066f30 0x7fca080693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fca14001360 tx=0x7fca14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.142+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca1c15a990 con 0x7fca1c0b49a0 2023-10-06T11:13:54.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.418+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7fca1c15a990 con 0x7fca1c0b49a0 2023-10-06T11:13:54.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.762+0000 7fca197fa700 1 -- 172.21.15.55:0/2443931001 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v64) v1 ==== 147+0+0 (secure 0 0 0) 0x7fca1c15a990 con 0x7fca1c0b49a0 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca08066f30 msgr2=0x7fca080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca08066f30 0x7fca080693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fca14001360 tx=0x7fca14009040 comp rx=0 tx=0).stop 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 msgr2=0x7fca1c09dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 0x7fca1c09dbb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c790 tx=0x7fca10007f20 comp rx=0 tx=0).stop 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 shutdown_connections 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca08066f30 0x7fca080693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1c159560 0x7fca1c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca1c0b0760 0x7fca1c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 --2- 172.21.15.55:0/2443931001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca1c0b49a0 0x7fca1c09dbb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 >> 172.21.15.55:0/2443931001 conn(0x7fca1c0997f0 msgr2=0x7fca1c158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:54.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 shutdown_connections 2023-10-06T11:13:54.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.765+0000 7fca23752700 1 -- 172.21.15.55:0/2443931001 wait complete. 2023-10-06T11:13:54.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:13:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.902+0000 7f4b99871700 1 Processor -- start 2023-10-06T11:13:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.902+0000 7f4b99871700 1 -- start start 2023-10-06T11:13:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99871700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b940b1830 0x7f4b941565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99871700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 0x7f4b94156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99871700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9415a600 con 0x7f4b94153970 2023-10-06T11:13:54.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99871700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b940b0cd0 con 0x7f4b940b1830 2023-10-06T11:13:54.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99871700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94159cd0 con 0x7f4b940b07c0 2023-10-06T11:13:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99070700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 0x7f4b94156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b9886f700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4b94153970 0x7f4b940b1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:44154/0 (socket says 172.21.15.55:44154) 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b93fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b940b1830 0x7f4b941565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b99070700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 0x7f4b94156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:47770/0 (socket says 172.21.15.55:47770) 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.903+0000 7f4b9886f700 1 -- 172.21.15.55:0/3552183456 learned_addr learned my addr 172.21.15.55:0/3552183456 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b937fe700 1 -- 172.21.15.55:0/3552183456 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085411678 0 0) 0x7f4b9415a600 con 0x7f4b94153970 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b99070700 1 -- 172.21.15.55:0/3552183456 >> v2:172.21.15.142:3300/0 conn(0x7f4b940b1830 msgr2=0x7f4b941565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b99070700 1 --2- 172.21.15.55:0/3552183456 >> v2:172.21.15.142:3300/0 conn(0x7f4b940b1830 0x7f4b941565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b99070700 1 -- 172.21.15.55:0/3552183456 >> v1:172.21.15.142:6789/0 conn(0x7f4b94153970 legacy=0x7f4b940b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b99070700 1 -- 172.21.15.55:0/3552183456 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b94159fb0 con 0x7f4b940b07c0 2023-10-06T11:13:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b99070700 1 --2- 172.21.15.55:0/3552183456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 0x7f4b94156b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b840098e0 tx=0x7f4b840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=610cc5ae16dada17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b937fe700 1 -- 172.21.15.55:0/3552183456 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400b640 con 0x7f4b940b07c0 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b937fe700 1 -- 172.21.15.55:0/3552183456 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8400b7a0 con 0x7f4b940b07c0 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.904+0000 7f4b937fe700 1 -- 172.21.15.55:0/3552183456 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8400bb40 con 0x7f4b940b07c0 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 -- 172.21.15.55:0/3552183456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 msgr2=0x7f4b94156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 --2- 172.21.15.55:0/3552183456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 0x7f4b94156b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b840098e0 tx=0x7f4b840091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 -- 172.21.15.55:0/3552183456 shutdown_connections 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 --2- 172.21.15.55:0/3552183456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940b07c0 0x7f4b94156b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 --2- 172.21.15.55:0/3552183456 >> v2:172.21.15.142:3300/0 conn(0x7f4b940b1830 0x7f4b941565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 -- 172.21.15.55:0/3552183456 >> 172.21.15.55:0/3552183456 conn(0x7f4b94069140 msgr2=0x7f4b940aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 -- 172.21.15.55:0/3552183456 shutdown_connections 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.905+0000 7f4b99871700 1 -- 172.21.15.55:0/3552183456 wait complete. 2023-10-06T11:13:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.906+0000 7f4b99871700 1 Processor -- start 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.906+0000 7f4b99871700 1 -- start start 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99871700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940b07c0 0x7f4b9413a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99871700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 0x7f4b940cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99871700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b94153970 0x7f4b94154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99871700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9414cf40 con 0x7f4b940b1830 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99871700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94155050 con 0x7f4b940b07c0 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99871700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940cc960 con 0x7f4b94153970 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 0x7f4b940cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 0x7f4b940cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50452/0 (socket says 172.21.15.55:50452) 2023-10-06T11:13:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 -- 172.21.15.55:0/929144888 learned_addr learned my addr 172.21.15.55:0/929144888 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b9886f700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940b07c0 0x7f4b9413a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b99070700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b94153970 0x7f4b94154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 -- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b94153970 msgr2=0x7f4b94154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b94153970 0x7f4b94154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 -- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940b07c0 msgr2=0x7f4b9413a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940b07c0 0x7f4b9413a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 -- 172.21.15.55:0/929144888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84009420 con 0x7f4b940b1830 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.907+0000 7f4b93fff700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 0x7f4b940cd720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800ec80 tx=0x7f4b880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.908+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800c9d0 con 0x7f4b940b1830 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.908+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8800cb30 con 0x7f4b940b1830 2023-10-06T11:13:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.908+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88013470 con 0x7f4b940b1830 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.908+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b940ccc40 con 0x7f4b940b1830 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.908+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b940cd200 con 0x7f4b940b1830 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.908+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9405f230 con 0x7f4b940b1830 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.909+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b88013820 con 0x7f4b940b1830 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.909+0000 7f4b90ff9700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b80066f30 0x7f4b800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.909+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4b88084dd0 con 0x7f4b940b1830 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.910+0000 7f4b9886f700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b80066f30 0x7f4b800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.910+0000 7f4b9886f700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b80066f30 0x7f4b800693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c002230 tx=0x7f4b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:54.914+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b88051b10 con 0x7f4b940b1830 2023-10-06T11:13:55.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.107+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4b9415a290 con 0x7f4b940b1830 2023-10-06T11:13:55.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.110+0000 7f4b90ff9700 1 -- 172.21.15.55:0/929144888 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b88055130 con 0x7f4b940b1830 2023-10-06T11:13:55.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b80066f30 msgr2=0x7f4b800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b80066f30 0x7f4b800693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c002230 tx=0x7f4b8c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 msgr2=0x7f4b940cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 0x7f4b940cd720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800ec80 tx=0x7f4b880091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 shutdown_connections 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b80066f30 0x7f4b800693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b94153970 0x7f4b94154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940b07c0 0x7f4b9413a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 --2- 172.21.15.55:0/929144888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b940b1830 0x7f4b940cd720 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 >> 172.21.15.55:0/929144888 conn(0x7f4b94069140 msgr2=0x7f4b9414fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 shutdown_connections 2023-10-06T11:13:55.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.112+0000 7f4b99871700 1 -- 172.21.15.55:0/929144888 wait complete. 2023-10-06T11:13:55.127 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:13:55.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:13:55.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:13:55.215 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:13:55.216 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:13:55.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:55.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T11:13:55.258 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:13:55.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:55.258 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:13:55.314 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:13:55.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:55.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T11:13:55.350 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:13:55.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:55.350 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:13:55.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T11:13:55.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:55.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T11:13:55.446 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:13:55.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:55.446 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:13:55.503 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T11:13:55.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:55.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T11:13:55.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:13:55.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:55.547 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:13:55.602 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:13:55.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.722+0000 7f79ed6af700 1 Processor -- start 2023-10-06T11:13:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.722+0000 7f79ed6af700 1 -- start start 2023-10-06T11:13:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79ed6af700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79e80b2810 0x7f79e80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79ed6af700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80cb7a0 con 0x7f79e80cbc30 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79ed6af700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b0860 con 0x7f79e8159440 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79ed6af700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80cb150 con 0x7f79e80b2810 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79e77fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79e80cbc30 0x7f79e80b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41750/0 (socket says 172.21.15.55:41750) 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79e77fe700 1 -- 172.21.15.55:0/797767869 learned_addr learned my addr 172.21.15.55:0/797767869 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79eceae700 1 --2- 172.21.15.55:0/797767869 >> v2:172.21.15.142:3300/0 conn(0x7f79e80b2810 0x7f79e80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239705552 0 0) 0x7f79e80cb7a0 con 0x7f79e80cbc30 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.723+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d4003570 con 0x7f79e80cbc30 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058799966 0 0) 0x7f79e80b0860 con 0x7f79e8159440 2023-10-06T11:13:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e80cb7a0 con 0x7f79e8159440 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79eceae700 1 -- 172.21.15.55:0/797767869 >> v1:172.21.15.142:6789/0 conn(0x7f79e8159440 legacy=0x7f79e80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79eceae700 1 -- 172.21.15.55:0/797767869 >> v1:172.21.15.55:6789/0 conn(0x7f79e80cbc30 legacy=0x7f79e80b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79eceae700 1 -- 172.21.15.55:0/797767869 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80cb430 con 0x7f79e80b2810 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79eceae700 1 --2- 172.21.15.55:0/797767869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e80cc080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009e60 tx=0x7f79e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e5bbe02d8c8989 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000e070 con 0x7f79e80b2810 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000bab0 con 0x7f79e80b2810 2023-10-06T11:13:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79e6ffd700 1 -- 172.21.15.55:0/797767869 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000be70 con 0x7f79e80b2810 2023-10-06T11:13:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79ed6af700 1 -- 172.21.15.55:0/797767869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 msgr2=0x7f79e80cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79ed6af700 1 --2- 172.21.15.55:0/797767869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e80cc080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009e60 tx=0x7f79e0009780 comp rx=0 tx=0).stop 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.724+0000 7f79ed6af700 1 -- 172.21.15.55:0/797767869 shutdown_connections 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.725+0000 7f79ed6af700 1 --2- 172.21.15.55:0/797767869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e80cc080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.725+0000 7f79ed6af700 1 -- 172.21.15.55:0/797767869 >> 172.21.15.55:0/797767869 conn(0x7f79e806ece0 msgr2=0x7f79e806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.725+0000 7f79ed6af700 1 -- 172.21.15.55:0/797767869 shutdown_connections 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.725+0000 7f79ed6af700 1 -- 172.21.15.55:0/797767869 wait complete. 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.726+0000 7f79ed6af700 1 Processor -- start 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.726+0000 7f79ed6af700 1 -- start start 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80cbc30 0x7f79e80c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 0x7f79e80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c9e20 con 0x7f79e8159440 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8169890 con 0x7f79e80b2810 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8169b70 con 0x7f79e80cbc30 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 0x7f79e80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 0x7f79e80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50468/0 (socket says 172.21.15.55:50468) 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 -- 172.21.15.55:0/389509339 learned_addr learned my addr 172.21.15.55:0/389509339 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79e7fff700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79e77fe700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80cbc30 0x7f79e80c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 -- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80cbc30 msgr2=0x7f79e80c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80cbc30 0x7f79e80c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 -- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 msgr2=0x7f79e8154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e8154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 -- 172.21.15.55:0/389509339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0009a20 con 0x7f79e8159440 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79e7fff700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e8154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79eceae700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 0x7f79e80b5080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f79e8069150 tx=0x7f79e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0026480 con 0x7f79e8159440 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e8169e50 con 0x7f79e8159440 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0026600 con 0x7f79e8159440 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00269c0 con 0x7f79e8159440 2023-10-06T11:13:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.727+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80c65d0 con 0x7f79e8159440 2023-10-06T11:13:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.728+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e805f230 con 0x7f79e8159440 2023-10-06T11:13:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.729+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79e001c400 con 0x7f79e8159440 2023-10-06T11:13:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.729+0000 7f79dffff700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f79c8066f30 0x7f79c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.729+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f79e0086d20 con 0x7f79e8159440 2023-10-06T11:13:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.730+0000 7f79e7fff700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f79c8066f30 0x7f79c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.730+0000 7f79e7fff700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f79c8066f30 0x7f79c80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c8da0 tx=0x7f79d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:55.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.734+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79e0053b00 con 0x7f79e8159440 2023-10-06T11:13:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.974+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79e8159810 con 0x7f79e8159440 2023-10-06T11:13:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.974+0000 7f79dffff700 1 -- 172.21.15.55:0/389509339 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f79e002b090 con 0x7f79e8159440 2023-10-06T11:13:55.976 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:55.976 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f79c8066f30 msgr2=0x7f79c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f79c8066f30 0x7f79c80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c8da0 tx=0x7f79d8009040 comp rx=0 tx=0).stop 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 msgr2=0x7f79e80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 0x7f79e80b5080 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f79e8069150 tx=0x7f79e0019000 comp rx=0 tx=0).stop 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 shutdown_connections 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f79c8066f30 0x7f79c80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79e8159440 0x7f79e80b5080 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b2810 0x7f79e8154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 --2- 172.21.15.55:0/389509339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80cbc30 0x7f79e80c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.976+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 >> 172.21.15.55:0/389509339 conn(0x7f79e806ece0 msgr2=0x7f79e81559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.977+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 shutdown_connections 2023-10-06T11:13:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:55.977+0000 7f79ed6af700 1 -- 172.21.15.55:0/389509339 wait complete. 2023-10-06T11:13:55.980 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:55.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:56.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.107+0000 7f0c4bd11700 1 Processor -- start 2023-10-06T11:13:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.107+0000 7f0c4bd11700 1 -- start start 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4bd11700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44159560 0x7f0c440aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4bd11700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c440b49a0 0x7f0c440aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4bd11700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c440b0760 0x7f0c440b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4bd11700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440b0c60 con 0x7f0c440b49a0 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4bd11700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440b0f40 con 0x7f0c440b0760 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4bd11700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440b1220 con 0x7f0c44159560 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c440b49a0 0x7f0c440aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c440b49a0 0x7f0c440aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50478/0 (socket says 172.21.15.55:50478) 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 -- 172.21.15.55:0/1782563237 learned_addr learned my addr 172.21.15.55:0/1782563237 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c49aad700 1 --2- 172.21.15.55:0/1782563237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44159560 0x7f0c440aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 -- 172.21.15.55:0/1782563237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44159560 msgr2=0x7f0c440aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c4a2ae700 1 --2- 172.21.15.55:0/1782563237 >> v2:172.21.15.142:3300/0 conn(0x7f0c440b0760 0x7f0c440b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 --2- 172.21.15.55:0/1782563237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44159560 0x7f0c440aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 -- 172.21.15.55:0/1782563237 >> v2:172.21.15.142:3300/0 conn(0x7f0c440b0760 msgr2=0x7f0c440b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 --2- 172.21.15.55:0/1782563237 >> v2:172.21.15.142:3300/0 conn(0x7f0c440b0760 0x7f0c440b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.108+0000 7f0c492ac700 1 -- 172.21.15.55:0/1782563237 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440b1500 con 0x7f0c440b49a0 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c492ac700 1 --2- 172.21.15.55:0/1782563237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c440aaa70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c440b2f10 tx=0x7f0c38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bab1c008eff8b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c48aab700 1 -- 172.21.15.55:0/1782563237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800b860 con 0x7f0c440b49a0 2023-10-06T11:13:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c48aab700 1 -- 172.21.15.55:0/1782563237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3800b9c0 con 0x7f0c440b49a0 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c48aab700 1 -- 172.21.15.55:0/1782563237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800bd60 con 0x7f0c440b49a0 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 -- 172.21.15.55:0/1782563237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 msgr2=0x7f0c440aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/1782563237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c440aaa70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c440b2f10 tx=0x7f0c38009250 comp rx=0 tx=0).stop 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 -- 172.21.15.55:0/1782563237 shutdown_connections 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/1782563237 >> v2:172.21.15.142:3300/0 conn(0x7f0c440b0760 0x7f0c440b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/1782563237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44159560 0x7f0c440aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/1782563237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c440aaa70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 -- 172.21.15.55:0/1782563237 >> 172.21.15.55:0/1782563237 conn(0x7f0c440997f0 msgr2=0x7f0c4406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 -- 172.21.15.55:0/1782563237 shutdown_connections 2023-10-06T11:13:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.109+0000 7f0c4bd11700 1 -- 172.21.15.55:0/1782563237 wait complete. 2023-10-06T11:13:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.110+0000 7f0c4bd11700 1 Processor -- start 2023-10-06T11:13:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.110+0000 7f0c4bd11700 1 -- start start 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4bd11700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440b0760 0x7f0c44156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4bd11700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c44169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4bd11700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44159560 0x7f0c4409c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4bd11700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4415d2d0 con 0x7f0c440b49a0 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4bd11700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4409ac40 con 0x7f0c44159560 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4bd11700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4409a050 con 0x7f0c440b0760 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c492ac700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c44169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c492ac700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c44169670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50492/0 (socket says 172.21.15.55:50492) 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c492ac700 1 -- 172.21.15.55:0/3778691630 learned_addr learned my addr 172.21.15.55:0/3778691630 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c49aad700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440b0760 0x7f0c44156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.111+0000 7f0c4a2ae700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44159560 0x7f0c4409c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c492ac700 1 -- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440b0760 msgr2=0x7f0c44156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c492ac700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440b0760 0x7f0c44156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c492ac700 1 -- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44159560 msgr2=0x7f0c4409c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c492ac700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44159560 0x7f0c4409c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c492ac700 1 -- 172.21.15.55:0/3778691630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380094f0 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c492ac700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c44169670 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c44067c20 tx=0x7f0c38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38011dc0 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38024440 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38024800 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4409a310 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.112+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4409a8d0 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.113+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4409add0 con 0x7f0c440b49a0 2023-10-06T11:13:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.114+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c3801a420 con 0x7f0c440b49a0 2023-10-06T11:13:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.114+0000 7f0c41ffb700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c30066f30 0x7f0c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.114+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0c380867e0 con 0x7f0c440b49a0 2023-10-06T11:13:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.114+0000 7f0c49aad700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c30066f30 0x7f0c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.115+0000 7f0c49aad700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c30066f30 0x7f0c300693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400ac00 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.118+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c380535c0 con 0x7f0c440b49a0 2023-10-06T11:13:56.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.312+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c44064a90 con 0x7f0c440b49a0 2023-10-06T11:13:56.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.312+0000 7f0c41ffb700 1 -- 172.21.15.55:0/3778691630 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f0c38056be0 con 0x7f0c440b49a0 2023-10-06T11:13:56.314 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:56.314 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:54.753042+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:56.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c30066f30 msgr2=0x7f0c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c30066f30 0x7f0c300693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400ac00 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 msgr2=0x7f0c44169670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c44169670 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c44067c20 tx=0x7f0c38017000 comp rx=0 tx=0).stop 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 shutdown_connections 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c30066f30 0x7f0c300693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44159560 0x7f0c4409c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440b0760 0x7f0c44156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 --2- 172.21.15.55:0/3778691630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c440b49a0 0x7f0c44169670 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.314+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 >> 172.21.15.55:0/3778691630 conn(0x7f0c440997f0 msgr2=0x7f0c441588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.315+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 shutdown_connections 2023-10-06T11:13:56.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.315+0000 7f0c4bd11700 1 -- 172.21.15.55:0/3778691630 wait complete. 2023-10-06T11:13:56.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:10.219143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:11.479173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T11:13:15.162401+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:56.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:56.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.450+0000 7fcd6d944700 1 Processor -- start 2023-10-06T11:13:56.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.450+0000 7fcd6d944700 1 -- start start 2023-10-06T11:13:56.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.451+0000 7fcd6d944700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.451+0000 7fcd6d944700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd681598a0 0x7fcd680cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.451+0000 7fcd6d944700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd680cf310 con 0x7fcd680ce7e0 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.451+0000 7fcd6d944700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd680cf5d0 con 0x7fcd681598a0 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.451+0000 7fcd6d944700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680cf8b0 con 0x7fcd681594d0 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd667fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd681598a0 0x7fcd680cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:47820/0 (socket says 172.21.15.55:47820) 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 -- 172.21.15.55:0/3186234620 learned_addr learned my addr 172.21.15.55:0/3186234620 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd677fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcd680ce7e0 0x7fcd680cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:44170/0 (socket says 172.21.15.55:44170) 2023-10-06T11:13:56.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 -- 172.21.15.55:0/3186234620 >> v2:172.21.15.142:3300/0 conn(0x7fcd681598a0 msgr2=0x7fcd680cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 --2- 172.21.15.55:0/3186234620 >> v2:172.21.15.142:3300/0 conn(0x7fcd681598a0 0x7fcd680cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 -- 172.21.15.55:0/3186234620 >> v1:172.21.15.142:6789/0 conn(0x7fcd680ce7e0 legacy=0x7fcd680cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 -- 172.21.15.55:0/3186234620 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680cfb90 con 0x7fcd681594d0 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd66ffd700 1 --2- 172.21.15.55:0/3186234620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680cb560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd600099b0 tx=0x7fcd60009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c305312a87ac4e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.452+0000 7fcd65ffb700 1 -- 172.21.15.55:0/3186234620 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60009ea0 con 0x7fcd681594d0 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd65ffb700 1 -- 172.21.15.55:0/3186234620 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6000b860 con 0x7fcd681594d0 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd65ffb700 1 -- 172.21.15.55:0/3186234620 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000bc00 con 0x7fcd681594d0 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 -- 172.21.15.55:0/3186234620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 msgr2=0x7fcd680cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 --2- 172.21.15.55:0/3186234620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680cb560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd600099b0 tx=0x7fcd60009250 comp rx=0 tx=0).stop 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 -- 172.21.15.55:0/3186234620 shutdown_connections 2023-10-06T11:13:56.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 --2- 172.21.15.55:0/3186234620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680cb560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 --2- 172.21.15.55:0/3186234620 >> v2:172.21.15.142:3300/0 conn(0x7fcd681598a0 0x7fcd680cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 -- 172.21.15.55:0/3186234620 >> 172.21.15.55:0/3186234620 conn(0x7fcd68089e50 msgr2=0x7fcd68099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 -- 172.21.15.55:0/3186234620 shutdown_connections 2023-10-06T11:13:56.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.453+0000 7fcd6d944700 1 -- 172.21.15.55:0/3186234620 wait complete. 2023-10-06T11:13:56.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.454+0000 7fcd6d944700 1 Processor -- start 2023-10-06T11:13:56.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.454+0000 7fcd6d944700 1 -- start start 2023-10-06T11:13:56.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd6d944700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680ce7e0 0x7fcd6814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd6d944700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd6d944700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 0x7fcd68069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd6d944700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6816a020 con 0x7fcd681598a0 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd6d944700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680c8a20 con 0x7fcd680ce7e0 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd6d944700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680c8d00 con 0x7fcd681594d0 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd677fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 0x7fcd68069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd677fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 0x7fcd68069500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50502/0 (socket says 172.21.15.55:50502) 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd677fe700 1 -- 172.21.15.55:0/215687528 learned_addr learned my addr 172.21.15.55:0/215687528 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd667fc700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.455+0000 7fcd66ffd700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680ce7e0 0x7fcd6814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd677fe700 1 -- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 msgr2=0x7fcd680c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd677fe700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd677fe700 1 -- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680ce7e0 msgr2=0x7fcd6814c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd677fe700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680ce7e0 0x7fcd6814c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd677fe700 1 -- 172.21.15.55:0/215687528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600094f0 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd66ffd700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680ce7e0 0x7fcd6814c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd677fe700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 0x7fcd68069500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800cd00 tx=0x7fcd58001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800ce60 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58005df0 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd680c8fe0 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800abb0 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.456+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd680b5130 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.457+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd68169dc0 con 0x7fcd681598a0 2023-10-06T11:13:56.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.457+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd580070f0 con 0x7fcd681598a0 2023-10-06T11:13:56.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.458+0000 7fcd5effd700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.458+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fcd58084a40 con 0x7fcd681598a0 2023-10-06T11:13:56.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.458+0000 7fcd66ffd700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.459+0000 7fcd66ffd700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd48066f30 0x7fcd480693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd600099b0 tx=0x7fcd60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.462+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd58086e60 con 0x7fcd681598a0 2023-10-06T11:13:56.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.656+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd68064a90 con 0x7fcd681598a0 2023-10-06T11:13:56.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.656+0000 7fcd5effd700 1 -- 172.21.15.55:0/215687528 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd580518a0 con 0x7fcd681598a0 2023-10-06T11:13:56.658 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:13:56.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd48066f30 msgr2=0x7fcd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd48066f30 0x7fcd480693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd600099b0 tx=0x7fcd60017000 comp rx=0 tx=0).stop 2023-10-06T11:13:56.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 msgr2=0x7fcd68069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 0x7fcd68069500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800cd00 tx=0x7fcd58001b10 comp rx=0 tx=0).stop 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 shutdown_connections 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd681598a0 0x7fcd68069500 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd680ce7e0 0x7fcd6814c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 --2- 172.21.15.55:0/215687528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd681594d0 0x7fcd680c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 >> 172.21.15.55:0/215687528 conn(0x7fcd68089e50 msgr2=0x7fcd6815cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 shutdown_connections 2023-10-06T11:13:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.658+0000 7fcd6d944700 1 -- 172.21.15.55:0/215687528 wait complete. 2023-10-06T11:13:56.672 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.792+0000 7f0ee3a85700 1 Processor -- start 2023-10-06T11:13:56.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.792+0000 7f0ee3a85700 1 -- start start 2023-10-06T11:13:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee3a85700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0edc1594d0 0x7f0edc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee3a85700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc0cbee0 con 0x7f0edc1598a0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee3a85700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc0cf5d0 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee3a85700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc0cf8b0 con 0x7f0edc1594d0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee1821700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0edc1594d0 0x7f0edc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee1020700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0edc1598a0 0x7f0edc0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41752/0 (socket says 172.21.15.55:41752) 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.793+0000 7f0ee1020700 1 -- 172.21.15.55:0/4127396878 learned_addr learned my addr 172.21.15.55:0/4127396878 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee1821700 1 -- 172.21.15.55:0/4127396878 >> v1:172.21.15.142:6789/0 conn(0x7f0edc0cbaa0 legacy=0x7f0edc0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee1821700 1 -- 172.21.15.55:0/4127396878 >> v1:172.21.15.55:6789/0 conn(0x7f0edc1598a0 legacy=0x7f0edc0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee1821700 1 -- 172.21.15.55:0/4127396878 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0cfb90 con 0x7f0edc1594d0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee081f700 1 -- 172.21.15.55:0/4127396878 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063075045 0 0) 0x7f0edc0cbee0 con 0x7f0edc1598a0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee1821700 1 --2- 172.21.15.55:0/4127396878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc1594d0 0x7f0edc0cb560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80098e0 tx=0x7f0ed80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6252df2054238c59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee081f700 1 -- 172.21.15.55:0/4127396878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8009e80 con 0x7f0edc1594d0 2023-10-06T11:13:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee081f700 1 -- 172.21.15.55:0/4127396878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800b860 con 0x7f0edc1594d0 2023-10-06T11:13:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee081f700 1 -- 172.21.15.55:0/4127396878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800bbe0 con 0x7f0edc1594d0 2023-10-06T11:13:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee3a85700 1 -- 172.21.15.55:0/4127396878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc1594d0 msgr2=0x7f0edc0cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/4127396878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc1594d0 0x7f0edc0cb560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80098e0 tx=0x7f0ed80091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee3a85700 1 -- 172.21.15.55:0/4127396878 shutdown_connections 2023-10-06T11:13:56.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/4127396878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc1594d0 0x7f0edc0cb560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.794+0000 7f0ee3a85700 1 -- 172.21.15.55:0/4127396878 >> 172.21.15.55:0/4127396878 conn(0x7f0edc089e50 msgr2=0x7f0edc099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.795+0000 7f0ee3a85700 1 -- 172.21.15.55:0/4127396878 shutdown_connections 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.795+0000 7f0ee3a85700 1 -- 172.21.15.55:0/4127396878 wait complete. 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 Processor -- start 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 -- start start 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 0x7f0edc158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc1594d0 0x7f0edc0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1598a0 0x7f0edc0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b4d90 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b37b0 con 0x7f0edc1594d0 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.796+0000 7f0ee3a85700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b3a90 con 0x7f0edc1598a0 2023-10-06T11:13:56.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 0x7f0edc158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 0x7f0edc158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50514/0 (socket says 172.21.15.55:50514) 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 -- 172.21.15.55:0/2434246038 learned_addr learned my addr 172.21.15.55:0/2434246038 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1020700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc1594d0 0x7f0edc0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 -- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1598a0 msgr2=0x7f0edc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee2022700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1598a0 0x7f0edc0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1598a0 0x7f0edc0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 -- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc1594d0 msgr2=0x7f0edc0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc1594d0 0x7f0edc0b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 -- 172.21.15.55:0/2434246038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009420 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1020700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc1594d0 0x7f0edc0b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee2022700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1598a0 0x7f0edc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee1821700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 0x7f0edc158440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80093f0 tx=0x7f0ed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed801f070 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800b9d0 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8025650 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc0b3d70 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.797+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc0b4330 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.798+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc158980 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.799+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ed8023070 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.799+0000 7f0ed1ffb700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ec0066f30 0x7f0ec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.799+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0ed8085f80 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.799+0000 7f0ee1020700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ec0066f30 0x7f0ec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.800+0000 7f0ee1020700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ec0066f30 0x7f0ec00693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.803+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ed80b75a0 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.993+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0edc064a90 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.993+0000 7f0ed1ffb700 1 -- 172.21.15.55:0/2434246038 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ed80150a0 con 0x7f0edc0cbaa0 2023-10-06T11:13:56.995 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ec0066f30 msgr2=0x7f0ec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ec0066f30 0x7f0ec00693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc009040 comp rx=0 tx=0).stop 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 msgr2=0x7f0edc158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 0x7f0edc158440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80093f0 tx=0x7f0ed8017000 comp rx=0 tx=0).stop 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 shutdown_connections 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ec0066f30 0x7f0ec00693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0edc0cbaa0 0x7f0edc158440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1598a0 0x7f0edc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 --2- 172.21.15.55:0/2434246038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc1594d0 0x7f0edc0b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 >> 172.21.15.55:0/2434246038 conn(0x7f0edc089e50 msgr2=0x7f0edc0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 shutdown_connections 2023-10-06T11:13:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:56.995+0000 7f0ee3a85700 1 -- 172.21.15.55:0/2434246038 wait complete. 2023-10-06T11:13:57.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:57.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.129+0000 7f6f59da9700 1 Processor -- start 2023-10-06T11:13:57.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.129+0000 7f6f59da9700 1 -- start start 2023-10-06T11:13:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f59da9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f540b0640 0x7f6f540cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f59da9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0a10 0x7f6f540cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f59da9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f540cc420 0x7f6f540c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f59da9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540ca790 con 0x7f6f540b0640 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f59da9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540c53c0 con 0x7f6f540cc420 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f59da9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540ccd00 con 0x7f6f540b0a10 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f537fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f540b0640 0x7f6f540cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f537fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f540b0640 0x7f6f540cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50528/0 (socket says 172.21.15.55:50528) 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.130+0000 7f6f537fe700 1 -- 172.21.15.55:0/4011148777 learned_addr learned my addr 172.21.15.55:0/4011148777 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f53fff700 1 --2- 172.21.15.55:0/4011148777 >> v2:172.21.15.142:3300/0 conn(0x7f6f540cc420 0x7f6f540c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f52ffd700 1 --2- 172.21.15.55:0/4011148777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0a10 0x7f6f540cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f537fe700 1 -- 172.21.15.55:0/4011148777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0a10 msgr2=0x7f6f540cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f537fe700 1 --2- 172.21.15.55:0/4011148777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0a10 0x7f6f540cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f537fe700 1 -- 172.21.15.55:0/4011148777 >> v2:172.21.15.142:3300/0 conn(0x7f6f540cc420 msgr2=0x7f6f540c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f537fe700 1 --2- 172.21.15.55:0/4011148777 >> v2:172.21.15.142:3300/0 conn(0x7f6f540cc420 0x7f6f540c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f537fe700 1 -- 172.21.15.55:0/4011148777 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540ccfe0 con 0x7f6f540b0640 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f53fff700 1 --2- 172.21.15.55:0/4011148777 >> v2:172.21.15.142:3300/0 conn(0x7f6f540cc420 0x7f6f540c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f537fe700 1 --2- 172.21.15.55:0/4011148777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540b0640 0x7f6f540cecd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f540c3a70 tx=0x7f6f44009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff144e9d20bdb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f527fc700 1 -- 172.21.15.55:0/4011148777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44005c10 con 0x7f6f540b0640 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f527fc700 1 -- 172.21.15.55:0/4011148777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44005d70 con 0x7f6f540b0640 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f527fc700 1 -- 172.21.15.55:0/4011148777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400b880 con 0x7f6f540b0640 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f59da9700 1 -- 172.21.15.55:0/4011148777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540b0640 msgr2=0x7f6f540cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.131+0000 7f6f59da9700 1 --2- 172.21.15.55:0/4011148777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540b0640 0x7f6f540cecd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f540c3a70 tx=0x7f6f44009220 comp rx=0 tx=0).stop 2023-10-06T11:13:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 -- 172.21.15.55:0/4011148777 shutdown_connections 2023-10-06T11:13:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 --2- 172.21.15.55:0/4011148777 >> v2:172.21.15.142:3300/0 conn(0x7f6f540cc420 0x7f6f540c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 --2- 172.21.15.55:0/4011148777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540b0640 0x7f6f540cecd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 --2- 172.21.15.55:0/4011148777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0a10 0x7f6f540cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 -- 172.21.15.55:0/4011148777 >> 172.21.15.55:0/4011148777 conn(0x7f6f54087fc0 msgr2=0x7f6f540ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 -- 172.21.15.55:0/4011148777 shutdown_connections 2023-10-06T11:13:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.132+0000 7f6f59da9700 1 -- 172.21.15.55:0/4011148777 wait complete. 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.133+0000 7f6f59da9700 1 Processor -- start 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.133+0000 7f6f59da9700 1 -- start start 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0640 0x7f6f5415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f540b0a10 0x7f6f5406a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 0x7f6f540687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54069070 con 0x7f6f540cc420 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54069350 con 0x7f6f540b0a10 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54069630 con 0x7f6f540b0640 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 0x7f6f540687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 0x7f6f540687e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50544/0 (socket says 172.21.15.55:50544) 2023-10-06T11:13:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 -- 172.21.15.55:0/1992034470 learned_addr learned my addr 172.21.15.55:0/1992034470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f52ffd700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f540b0a10 0x7f6f5406a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f537fe700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0640 0x7f6f5415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 -- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0640 msgr2=0x7f6f5415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0640 0x7f6f5415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 -- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f540b0a10 msgr2=0x7f6f5406a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f540b0a10 0x7f6f5406a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 -- 172.21.15.55:0/1992034470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009480 con 0x7f6f540cc420 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f53fff700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 0x7f6f540687e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00a380 tx=0x7f6f4c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c015440 con 0x7f6f540cc420 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0155a0 con 0x7f6f540cc420 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f54069910 con 0x7f6f540cc420 2023-10-06T11:13:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.134+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c015960 con 0x7f6f540cc420 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.135+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5406a650 con 0x7f6f540cc420 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.136+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5415d390 con 0x7f6f540cc420 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.136+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f4c00d440 con 0x7f6f540cc420 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.136+0000 7f6f3b7fe700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6f40066f30 0x7f6f400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.136+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6f4c0854c0 con 0x7f6f540cc420 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.136+0000 7f6f537fe700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6f40066f30 0x7f6f400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.137+0000 7f6f537fe700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6f40066f30 0x7f6f400693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009260 tx=0x7f6f44016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.141+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f4c0522a0 con 0x7f6f540cc420 2023-10-06T11:13:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.337+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f54064a90 con 0x7f6f540cc420 2023-10-06T11:13:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.337+0000 7f6f3b7fe700 1 -- 172.21.15.55:0/1992034470 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f4c0558c0 con 0x7f6f540cc420 2023-10-06T11:13:57.339 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6f40066f30 msgr2=0x7f6f400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6f40066f30 0x7f6f400693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009260 tx=0x7f6f44016000 comp rx=0 tx=0).stop 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 msgr2=0x7f6f540687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 0x7f6f540687e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00a380 tx=0x7f6f4c007900 comp rx=0 tx=0).stop 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 shutdown_connections 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6f40066f30 0x7f6f400693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f540cc420 0x7f6f540687e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f540b0640 0x7f6f5415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 --2- 172.21.15.55:0/1992034470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f540b0a10 0x7f6f5406a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 >> 172.21.15.55:0/1992034470 conn(0x7f6f54087fc0 msgr2=0x7f6f5415dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 shutdown_connections 2023-10-06T11:13:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.339+0000 7f6f59da9700 1 -- 172.21.15.55:0/1992034470 wait complete. 2023-10-06T11:13:57.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:57.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.473+0000 7ff349536700 1 Processor -- start 2023-10-06T11:13:57.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.473+0000 7ff349536700 1 -- start start 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff349536700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff34415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff349536700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff34415d650 0x7ff3440cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff349536700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff344069c60 con 0x7ff3441539c0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff349536700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34415ab70 con 0x7ff34415d650 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff349536700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34415db90 con 0x7ff344153d90 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff342ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff3441539c0 0x7ff344069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41768/0 (socket says 172.21.15.55:41768) 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff342ffd700 1 -- 172.21.15.55:0/498621841 learned_addr learned my addr 172.21.15.55:0/498621841 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff3427fc700 1 --2- 172.21.15.55:0/498621841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff34415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff3437fe700 1 --2- 172.21.15.55:0/498621841 >> v2:172.21.15.142:3300/0 conn(0x7ff34415d650 0x7ff3440cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff341ffb700 1 -- 172.21.15.55:0/498621841 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555374870 0 0) 0x7ff344069c60 con 0x7ff3441539c0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.474+0000 7ff341ffb700 1 -- 172.21.15.55:0/498621841 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330003570 con 0x7ff3441539c0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff3427fc700 1 -- 172.21.15.55:0/498621841 >> v2:172.21.15.142:3300/0 conn(0x7ff34415d650 msgr2=0x7ff3440cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff3427fc700 1 --2- 172.21.15.55:0/498621841 >> v2:172.21.15.142:3300/0 conn(0x7ff34415d650 0x7ff3440cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff341ffb700 1 -- 172.21.15.55:0/498621841 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091623394 0 0) 0x7ff330003570 con 0x7ff3441539c0 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff3427fc700 1 -- 172.21.15.55:0/498621841 >> v1:172.21.15.55:6789/0 conn(0x7ff3441539c0 legacy=0x7ff344069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff3427fc700 1 -- 172.21.15.55:0/498621841 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34415de70 con 0x7ff344153d90 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff3437fe700 1 --2- 172.21.15.55:0/498621841 >> v2:172.21.15.142:3300/0 conn(0x7ff34415d650 0x7ff3440cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff3427fc700 1 --2- 172.21.15.55:0/498621841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff34415d110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0098e0 tx=0x7ff32c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=835277d9292d01f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff341ffb700 1 -- 172.21.15.55:0/498621841 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0017f0 con 0x7ff344153d90 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff341ffb700 1 -- 172.21.15.55:0/498621841 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c011420 con 0x7ff344153d90 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff341ffb700 1 -- 172.21.15.55:0/498621841 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0117a0 con 0x7ff344153d90 2023-10-06T11:13:57.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff349536700 1 -- 172.21.15.55:0/498621841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 msgr2=0x7ff34415d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff349536700 1 --2- 172.21.15.55:0/498621841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff34415d110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0098e0 tx=0x7ff32c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff349536700 1 -- 172.21.15.55:0/498621841 shutdown_connections 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff349536700 1 --2- 172.21.15.55:0/498621841 >> v2:172.21.15.142:3300/0 conn(0x7ff34415d650 0x7ff3440cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff349536700 1 --2- 172.21.15.55:0/498621841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff34415d110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.475+0000 7ff349536700 1 -- 172.21.15.55:0/498621841 >> 172.21.15.55:0/498621841 conn(0x7ff34406b610 msgr2=0x7ff34406ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.476+0000 7ff349536700 1 -- 172.21.15.55:0/498621841 shutdown_connections 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.476+0000 7ff349536700 1 -- 172.21.15.55:0/498621841 wait complete. 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 Processor -- start 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 -- start start 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 0x7ff344158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff344155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34415d650 0x7ff3440cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344158790 con 0x7ff3441539c0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3441506b0 con 0x7ff34415d650 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.477+0000 7ff349536700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff344155f90 con 0x7ff344153d90 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 0x7ff344158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 0x7ff344158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50546/0 (socket says 172.21.15.55:50546) 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 -- 172.21.15.55:0/3292196322 learned_addr learned my addr 172.21.15.55:0/3292196322 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff3437fe700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34415d650 0x7ff3440cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff3427fc700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff344155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 -- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 msgr2=0x7ff344155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff344155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 -- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34415d650 msgr2=0x7ff3440cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34415d650 0x7ff3440cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 -- 172.21.15.55:0/3292196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334009420 con 0x7ff3441539c0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff3427fc700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff344155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff3437fe700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34415d650 0x7ff3440cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff342ffd700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 0x7ff344158250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00cc10 tx=0x7ff33c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c004dc0 con 0x7ff3441539c0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c00a720 con 0x7ff3441539c0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c009420 con 0x7ff3441539c0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00aae0 con 0x7ff3441539c0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.478+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff344156520 con 0x7ff3441539c0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.479+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3440c4e90 con 0x7ff3441539c0 2023-10-06T11:13:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.480+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff33c007150 con 0x7ff3441539c0 2023-10-06T11:13:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.480+0000 7ff33affd700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff324066f30 0x7ff3240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.480+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff33c0845b0 con 0x7ff3441539c0 2023-10-06T11:13:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.480+0000 7ff3427fc700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff324066f30 0x7ff3240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.481+0000 7ff3427fc700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff324066f30 0x7ff3240693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff344159340 tx=0x7ff32c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.484+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff33c051410 con 0x7ff3441539c0 2023-10-06T11:13:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.676+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff34416a060 con 0x7ff3441539c0 2023-10-06T11:13:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.676+0000 7ff33affd700 1 -- 172.21.15.55:0/3292196322 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff33c0180a0 con 0x7ff3441539c0 2023-10-06T11:13:57.678 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:13:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.678+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff324066f30 msgr2=0x7ff3240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.678+0000 7ff349536700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff324066f30 0x7ff3240693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff344159340 tx=0x7ff32c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.678+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 msgr2=0x7ff344158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.678+0000 7ff349536700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 0x7ff344158250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00cc10 tx=0x7ff33c001670 comp rx=0 tx=0).stop 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 shutdown_connections 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff324066f30 0x7ff3240693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3441539c0 0x7ff344158250 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34415d650 0x7ff3440cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 --2- 172.21.15.55:0/3292196322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff344153d90 0x7ff344155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 >> 172.21.15.55:0/3292196322 conn(0x7ff34406b610 msgr2=0x7ff344069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 shutdown_connections 2023-10-06T11:13:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.679+0000 7ff349536700 1 -- 172.21.15.55:0/3292196322 wait complete. 2023-10-06T11:13:57.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T11:13:57.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.813+0000 7f364dee7700 1 Processor -- start 2023-10-06T11:13:57.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.813+0000 7f364dee7700 1 -- start start 2023-10-06T11:13:57.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364dee7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36480b2620 0x7f36480cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364dee7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cf1b0 0x7f36480cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364dee7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480cc970 con 0x7f36480b29f0 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364dee7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36480cbd60 con 0x7f36480b2620 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364dee7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480cc040 con 0x7f36480cf1b0 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364cee5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36480b2620 0x7f36480cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364cee5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36480b2620 0x7f36480cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50548/0 (socket says 172.21.15.55:50548) 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.814+0000 7f364cee5700 1 -- 172.21.15.55:0/1124327171 learned_addr learned my addr 172.21.15.55:0/1124327171 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f364d6e6700 1 --2- 172.21.15.55:0/1124327171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cf1b0 0x7f36480cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f364cee5700 1 -- 172.21.15.55:0/1124327171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cf1b0 msgr2=0x7f36480cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f364cee5700 1 --2- 172.21.15.55:0/1124327171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cf1b0 0x7f36480cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f364cee5700 1 -- 172.21.15.55:0/1124327171 >> v1:172.21.15.142:6789/0 conn(0x7f36480b29f0 legacy=0x7f36480ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f364cee5700 1 -- 172.21.15.55:0/1124327171 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480cc320 con 0x7f36480b2620 2023-10-06T11:13:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f364cee5700 1 --2- 172.21.15.55:0/1124327171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480b2620 0x7f36480cccb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3640009990 tx=0x7f3640009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862aa9b91d310fa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f36477fe700 1 -- 172.21.15.55:0/1124327171 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640005c10 con 0x7f36480b2620 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f36477fe700 1 -- 172.21.15.55:0/1124327171 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640005d70 con 0x7f36480b2620 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.815+0000 7f36477fe700 1 -- 172.21.15.55:0/1124327171 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000b880 con 0x7f36480b2620 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 -- 172.21.15.55:0/1124327171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480b2620 msgr2=0x7f36480cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 --2- 172.21.15.55:0/1124327171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480b2620 0x7f36480cccb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3640009990 tx=0x7f3640009220 comp rx=0 tx=0).stop 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 -- 172.21.15.55:0/1124327171 shutdown_connections 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 --2- 172.21.15.55:0/1124327171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480cf1b0 0x7f36480cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 --2- 172.21.15.55:0/1124327171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480b2620 0x7f36480cccb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 -- 172.21.15.55:0/1124327171 >> 172.21.15.55:0/1124327171 conn(0x7f3648099520 msgr2=0x7f364806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 -- 172.21.15.55:0/1124327171 shutdown_connections 2023-10-06T11:13:57.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.816+0000 7f364dee7700 1 -- 172.21.15.55:0/1124327171 wait complete. 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.817+0000 7f364dee7700 1 Processor -- start 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.817+0000 7f364dee7700 1 -- start start 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36480b2620 0x7f364816a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480b29f0 0x7f3648156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 0x7f364815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364816ae10 con 0x7f36480cf1b0 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364816a440 con 0x7f36480b2620 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3648169b80 con 0x7f36480b29f0 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 0x7f364815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 0x7f364815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50562/0 (socket says 172.21.15.55:50562) 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 -- 172.21.15.55:0/1685505319 learned_addr learned my addr 172.21.15.55:0/1685505319 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364cee5700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36480b2620 0x7f364816a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f3647fff700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480b29f0 0x7f3648156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 -- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480b29f0 msgr2=0x7f3648156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480b29f0 0x7f3648156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 -- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36480b2620 msgr2=0x7f364816a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36480b2620 0x7f364816a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 -- 172.21.15.55:0/1685505319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009480 con 0x7f36480cf1b0 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f3647fff700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480b29f0 0x7f3648156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364cee5700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36480b2620 0x7f364816a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364d6e6700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 0x7f364815aed0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f363000d8c0 tx=0x7f3630008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363000b5d0 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363000b750 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.818+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364815b7b0 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.819+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363000bb10 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.819+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364816a0d0 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.819+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364816a5f0 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.820+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f363001e460 con 0x7f36480cf1b0 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.820+0000 7f3644ff9700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3628066f30 0x7f36280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.820+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3630084fe0 con 0x7f36480cf1b0 2023-10-06T11:13:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.821+0000 7f364cee5700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3628066f30 0x7f36280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.821+0000 7f364cee5700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3628066f30 0x7f36280693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3640009260 tx=0x7f3640016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:57.825+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3630051dc0 con 0x7f36480cf1b0 2023-10-06T11:13:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.017+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f364805f230 con 0x7f36480cf1b0 2023-10-06T11:13:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.017+0000 7f3644ff9700 1 -- 172.21.15.55:0/1685505319 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f36300553e0 con 0x7f36480cf1b0 2023-10-06T11:13:58.019 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:13:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3628066f30 msgr2=0x7f36280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3628066f30 0x7f36280693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3640009260 tx=0x7f3640016000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 msgr2=0x7f364815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 0x7f364815aed0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f363000d8c0 tx=0x7f3630008040 comp rx=0 tx=0).stop 2023-10-06T11:13:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 shutdown_connections 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3628066f30 0x7f36280693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36480cf1b0 0x7f364815aed0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36480b2620 0x7f364816a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 --2- 172.21.15.55:0/1685505319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36480b29f0 0x7f3648156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 >> 172.21.15.55:0/1685505319 conn(0x7f3648099520 msgr2=0x7f36480c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 shutdown_connections 2023-10-06T11:13:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.019+0000 7f364dee7700 1 -- 172.21.15.55:0/1685505319 wait complete. 2023-10-06T11:13:58.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:58.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.150+0000 7f60ea24d700 1 Processor -- start 2023-10-06T11:13:58.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.150+0000 7f60ea24d700 1 -- start start 2023-10-06T11:13:58.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60ea24d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60e4159440 0x7f60e40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60ea24d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60e40b35d0 0x7f60e40cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60ea24d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40cb7a0 con 0x7f60e40cc170 2023-10-06T11:13:58.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60ea24d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40b0860 con 0x7f60e4159440 2023-10-06T11:13:58.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60ea24d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40cb150 con 0x7f60e40b35d0 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60e924b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60e4159440 0x7f60e40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60e924b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60e4159440 0x7f60e40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50576/0 (socket says 172.21.15.55:50576) 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60e924b700 1 -- 172.21.15.55:0/2315024088 learned_addr learned my addr 172.21.15.55:0/2315024088 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.151+0000 7f60e8a4a700 1 --2- 172.21.15.55:0/2315024088 >> v2:172.21.15.142:3300/0 conn(0x7f60e40b35d0 0x7f60e40cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e924b700 1 -- 172.21.15.55:0/2315024088 >> v2:172.21.15.142:3300/0 conn(0x7f60e40b35d0 msgr2=0x7f60e40cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e924b700 1 --2- 172.21.15.55:0/2315024088 >> v2:172.21.15.142:3300/0 conn(0x7f60e40b35d0 0x7f60e40cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e924b700 1 -- 172.21.15.55:0/2315024088 >> v1:172.21.15.142:6789/0 conn(0x7f60e40cc170 legacy=0x7f60e40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e924b700 1 -- 172.21.15.55:0/2315024088 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e40cb430 con 0x7f60e4159440 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e924b700 1 --2- 172.21.15.55:0/2315024088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e4159440 0x7f60e40b3090 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f60e40d0220 tx=0x7f60dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae8f0f57aa5b1e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e3fff700 1 -- 172.21.15.55:0/2315024088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc009e70 con 0x7f60e4159440 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e3fff700 1 -- 172.21.15.55:0/2315024088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00b860 con 0x7f60e4159440 2023-10-06T11:13:58.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60e3fff700 1 -- 172.21.15.55:0/2315024088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00bc00 con 0x7f60e4159440 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60ea24d700 1 -- 172.21.15.55:0/2315024088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e4159440 msgr2=0x7f60e40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60ea24d700 1 --2- 172.21.15.55:0/2315024088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e4159440 0x7f60e40b3090 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f60e40d0220 tx=0x7f60dc009250 comp rx=0 tx=0).stop 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60ea24d700 1 -- 172.21.15.55:0/2315024088 shutdown_connections 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60ea24d700 1 --2- 172.21.15.55:0/2315024088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e4159440 0x7f60e40b3090 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60ea24d700 1 --2- 172.21.15.55:0/2315024088 >> v2:172.21.15.142:3300/0 conn(0x7f60e40b35d0 0x7f60e40cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.152+0000 7f60ea24d700 1 -- 172.21.15.55:0/2315024088 >> 172.21.15.55:0/2315024088 conn(0x7f60e406ece0 msgr2=0x7f60e406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.153+0000 7f60ea24d700 1 -- 172.21.15.55:0/2315024088 shutdown_connections 2023-10-06T11:13:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.153+0000 7f60ea24d700 1 -- 172.21.15.55:0/2315024088 wait complete. 2023-10-06T11:13:58.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.154+0000 7f60ea24d700 1 Processor -- start 2023-10-06T11:13:58.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.154+0000 7f60ea24d700 1 -- start start 2023-10-06T11:13:58.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.154+0000 7f60ea24d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 0x7f60e4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.154+0000 7f60ea24d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e40cc170 0x7f60e40c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60ea24d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e4159440 0x7f60e40c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60ea24d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40c4200 con 0x7f60e40b35d0 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60ea24d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40c3bf0 con 0x7f60e40cc170 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60ea24d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4154210 con 0x7f60e4159440 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 0x7f60e4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 0x7f60e4153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50588/0 (socket says 172.21.15.55:50588) 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 -- 172.21.15.55:0/3416312373 learned_addr learned my addr 172.21.15.55:0/3416312373 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e9a4c700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e4159440 0x7f60e40c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e8a4a700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e40cc170 0x7f60e40c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 -- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e4159440 msgr2=0x7f60e40c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e4159440 0x7f60e40c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 -- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e40cc170 msgr2=0x7f60e40c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e40cc170 0x7f60e40c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 -- 172.21.15.55:0/3416312373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0094f0 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e924b700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 0x7f60e4153cd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60e4069150 tx=0x7f60dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc011420 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc011580 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc011940 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e40c9840 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.155+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e40c9b20 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.156+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e405f230 con 0x7f60e40b35d0 2023-10-06T11:13:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.157+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60dc02c3b0 con 0x7f60e40b35d0 2023-10-06T11:13:58.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.157+0000 7f60e17fa700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f60d0066f60 0x7f60d0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.157+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f60dc085eb0 con 0x7f60e40b35d0 2023-10-06T11:13:58.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.158+0000 7f60e8a4a700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f60d0066f60 0x7f60d0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.158+0000 7f60e8a4a700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f60d0066f60 0x7f60d0069410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f60d80093f0 tx=0x7f60d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.162+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60dc052c90 con 0x7f60e40b35d0 2023-10-06T11:13:58.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.399+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e4159810 con 0x7f60e40b35d0 2023-10-06T11:13:58.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.399+0000 7f60e17fa700 1 -- 172.21.15.55:0/3416312373 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f60dc015090 con 0x7f60e40b35d0 2023-10-06T11:13:58.401 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:58.401 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f60d0066f60 msgr2=0x7f60d0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f60d0066f60 0x7f60d0069410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f60d80093f0 tx=0x7f60d8008040 comp rx=0 tx=0).stop 2023-10-06T11:13:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 msgr2=0x7f60e4153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 0x7f60e4153cd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60e4069150 tx=0x7f60dc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 shutdown_connections 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f60d0066f60 0x7f60d0069410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b35d0 0x7f60e4153cd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e4159440 0x7f60e40c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 --2- 172.21.15.55:0/3416312373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e40cc170 0x7f60e40c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.401+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 >> 172.21.15.55:0/3416312373 conn(0x7f60e406ece0 msgr2=0x7f60e40cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.402+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 shutdown_connections 2023-10-06T11:13:58.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.402+0000 7f60ea24d700 1 -- 172.21.15.55:0/3416312373 wait complete. 2023-10-06T11:13:58.405 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:58.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:58.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 Processor -- start 2023-10-06T11:13:58.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 -- start start 2023-10-06T11:13:58.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47480b25e0 0x7f47480b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47480b29b0 0x7f4748159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47480cbfa0 con 0x7f4748159660 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47480cb390 con 0x7f47480b25e0 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.533+0000 7f474e4fa700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47480cb670 con 0x7f47480b29b0 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4747fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47480b25e0 0x7f47480b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f474ca97700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4748159660 0x7f4748068540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41772/0 (socket says 172.21.15.55:41772) 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f474ca97700 1 -- 172.21.15.55:0/2135266485 learned_addr learned my addr 172.21.15.55:0/2135266485 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f47477fe700 1 --2- 172.21.15.55:0/2135266485 >> v2:172.21.15.142:3300/0 conn(0x7f47480b29b0 0x7f4748159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4747fff700 1 -- 172.21.15.55:0/2135266485 >> v2:172.21.15.142:3300/0 conn(0x7f47480b29b0 msgr2=0x7f4748159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4747fff700 1 --2- 172.21.15.55:0/2135266485 >> v2:172.21.15.142:3300/0 conn(0x7f47480b29b0 0x7f4748159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4747fff700 1 -- 172.21.15.55:0/2135266485 >> v1:172.21.15.55:6789/0 conn(0x7f4748159660 legacy=0x7f4748068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4746ffd700 1 -- 172.21.15.55:0/2135266485 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416047236 0 0) 0x7f47480cbfa0 con 0x7f4748159660 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4747fff700 1 -- 172.21.15.55:0/2135266485 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47480cb950 con 0x7f47480b25e0 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4747fff700 1 --2- 172.21.15.55:0/2135266485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b25e0 0x7f47480b0690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f47480cab10 tx=0x7f4738009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538eb7542f125696 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4746ffd700 1 -- 172.21.15.55:0/2135266485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738005c10 con 0x7f47480b25e0 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4746ffd700 1 -- 172.21.15.55:0/2135266485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4738005d70 con 0x7f47480b25e0 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.534+0000 7f4746ffd700 1 -- 172.21.15.55:0/2135266485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738006260 con 0x7f47480b25e0 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 -- 172.21.15.55:0/2135266485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b25e0 msgr2=0x7f47480b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2135266485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b25e0 0x7f47480b0690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f47480cab10 tx=0x7f4738009120 comp rx=0 tx=0).stop 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 -- 172.21.15.55:0/2135266485 shutdown_connections 2023-10-06T11:13:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2135266485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b25e0 0x7f47480b0690 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2135266485 >> v2:172.21.15.142:3300/0 conn(0x7f47480b29b0 0x7f4748159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 -- 172.21.15.55:0/2135266485 >> 172.21.15.55:0/2135266485 conn(0x7f474806ece0 msgr2=0x7f474806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 -- 172.21.15.55:0/2135266485 shutdown_connections 2023-10-06T11:13:58.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.535+0000 7f474e4fa700 1 -- 172.21.15.55:0/2135266485 wait complete. 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.536+0000 7f474e4fa700 1 Processor -- start 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.536+0000 7f474e4fa700 1 -- start start 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474e4fa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480b25e0 0x7f47480c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474e4fa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 0x7f474816b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474e4fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4748159660 0x7f47480c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474e4fa700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47480c99a0 con 0x7f47480b29b0 2023-10-06T11:13:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474e4fa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47480c96c0 con 0x7f47480b25e0 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474e4fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47480c7570 con 0x7f4748159660 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 0x7f474816b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 0x7f474816b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50594/0 (socket says 172.21.15.55:50594) 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 -- 172.21.15.55:0/2274233595 learned_addr learned my addr 172.21.15.55:0/2274233595 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f474ca97700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4748159660 0x7f47480c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f4747fff700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480b25e0 0x7f47480c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 -- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4748159660 msgr2=0x7f47480c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4748159660 0x7f47480c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 -- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480b25e0 msgr2=0x7f47480c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480b25e0 0x7f47480c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 -- 172.21.15.55:0/2274233595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380093c0 con 0x7f47480b29b0 2023-10-06T11:13:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.537+0000 7f47477fe700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 0x7f474816b230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ec80 tx=0x7f473c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.538+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00c9d0 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.538+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c00cb30 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.538+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47480c7850 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.538+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c013470 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.538+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47480c93b0 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.539+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4748064a90 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.539+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f473c013820 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.539+0000 7f472ffff700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4734066f30 0x7f47340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.540+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f473c084d50 con 0x7f47480b29b0 2023-10-06T11:13:58.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.540+0000 7f4747fff700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4734066f30 0x7f47340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.540+0000 7f4747fff700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4734066f30 0x7f47340693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47480b5ab0 tx=0x7f4738016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.544+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f473c088030 con 0x7f47480b29b0 2023-10-06T11:13:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.738+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47480cbc30 con 0x7f47480b29b0 2023-10-06T11:13:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.739+0000 7f472ffff700 1 -- 172.21.15.55:0/2274233595 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f473c051b30 con 0x7f47480b29b0 2023-10-06T11:13:58.741 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:58.741 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:54.753042+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4734066f30 msgr2=0x7f47340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4734066f30 0x7f47340693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47480b5ab0 tx=0x7f4738016000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 msgr2=0x7f474816b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 0x7f474816b230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ec80 tx=0x7f473c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 shutdown_connections 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4734066f30 0x7f47340693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4748159660 0x7f47480c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480b25e0 0x7f47480c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 --2- 172.21.15.55:0/2274233595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480b29b0 0x7f474816b230 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 >> 172.21.15.55:0/2274233595 conn(0x7f474806ece0 msgr2=0x7f4748153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 shutdown_connections 2023-10-06T11:13:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.741+0000 7f474e4fa700 1 -- 172.21.15.55:0/2274233595 wait complete. 2023-10-06T11:13:58.755 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:13:58.755 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:58.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.873+0000 7f4346827700 1 Processor -- start 2023-10-06T11:13:58.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.873+0000 7f4346827700 1 -- start start 2023-10-06T11:13:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4346827700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43400cbc30 0x7f43400cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4346827700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43400b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4346827700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400cb7a0 con 0x7f4340159440 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4346827700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43400b0860 con 0x7f43400cbc30 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4346827700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400cb150 con 0x7f43400b2100 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43400cbc30 0x7f43400cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43400cbc30 0x7f43400cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50602/0 (socket says 172.21.15.55:50602) 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 -- 172.21.15.55:0/2121461071 learned_addr learned my addr 172.21.15.55:0/2121461071 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4346026700 1 --2- 172.21.15.55:0/2121461071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43400b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 -- 172.21.15.55:0/2121461071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 msgr2=0x7f43400b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 --2- 172.21.15.55:0/2121461071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43400b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 -- 172.21.15.55:0/2121461071 >> v1:172.21.15.142:6789/0 conn(0x7f4340159440 legacy=0x7f43400b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.874+0000 7f4345024700 1 -- 172.21.15.55:0/2121461071 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400cb430 con 0x7f43400cbc30 2023-10-06T11:13:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4345024700 1 --2- 172.21.15.55:0/2121461071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43400cbc30 0x7f43400cc080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43340099b0 tx=0x7f4334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d658fa337f5905 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4344823700 1 -- 172.21.15.55:0/2121461071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334009ea0 con 0x7f43400cbc30 2023-10-06T11:13:58.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4344823700 1 -- 172.21.15.55:0/2121461071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433400b860 con 0x7f43400cbc30 2023-10-06T11:13:58.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4344823700 1 -- 172.21.15.55:0/2121461071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400bc00 con 0x7f43400cbc30 2023-10-06T11:13:58.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 -- 172.21.15.55:0/2121461071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43400cbc30 msgr2=0x7f43400cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 --2- 172.21.15.55:0/2121461071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43400cbc30 0x7f43400cc080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43340099b0 tx=0x7f4334009250 comp rx=0 tx=0).stop 2023-10-06T11:13:58.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 -- 172.21.15.55:0/2121461071 shutdown_connections 2023-10-06T11:13:58.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 --2- 172.21.15.55:0/2121461071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43400b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 --2- 172.21.15.55:0/2121461071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43400cbc30 0x7f43400cc080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 -- 172.21.15.55:0/2121461071 >> 172.21.15.55:0/2121461071 conn(0x7f434006ece0 msgr2=0x7f434006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 -- 172.21.15.55:0/2121461071 shutdown_connections 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.875+0000 7f4346827700 1 -- 172.21.15.55:0/2121461071 wait complete. 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 Processor -- start 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 -- start start 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43401532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43400cbc30 0x7f43400c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 0x7f4340158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400b05a0 con 0x7f4340159440 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400ce440 con 0x7f43400cbc30 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346827700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400c5d10 con 0x7f43400b2100 2023-10-06T11:13:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346026700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 0x7f4340158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346026700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 0x7f4340158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50604/0 (socket says 172.21.15.55:50604) 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.877+0000 7f4346026700 1 -- 172.21.15.55:0/3839567641 learned_addr learned my addr 172.21.15.55:0/3839567641 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4345825700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43401532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4345024700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43400cbc30 0x7f43400c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346026700 1 -- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 msgr2=0x7f43401532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346026700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43401532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346026700 1 -- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43400cbc30 msgr2=0x7f43400c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346026700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43400cbc30 0x7f43400c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346026700 1 -- 172.21.15.55:0/3839567641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43340094f0 con 0x7f4340159440 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4345024700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43400cbc30 0x7f43400c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346026700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 0x7f4340158010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f433000ea80 tx=0x7f43300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000c920 con 0x7f4340159440 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433000ca80 con 0x7f4340159440 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43400c5ff0 con 0x7f4340159440 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000ce40 con 0x7f4340159440 2023-10-06T11:13:58.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.878+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400ce0d0 con 0x7f4340159440 2023-10-06T11:13:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.879+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43400ce5d0 con 0x7f4340159440 2023-10-06T11:13:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.880+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4330013680 con 0x7f4340159440 2023-10-06T11:13:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.880+0000 7f433dffb700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f432c066f30 0x7f432c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.880+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4330084d30 con 0x7f4340159440 2023-10-06T11:13:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.880+0000 7f4345825700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f432c066f30 0x7f432c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.881+0000 7f4345825700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f432c066f30 0x7f432c0693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4338007fd0 tx=0x7f4338009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:58.885+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4330051b10 con 0x7f4340159440 2023-10-06T11:13:59.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.124+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f434005f230 con 0x7f4340159440 2023-10-06T11:13:59.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.125+0000 7f433dffb700 1 -- 172.21.15.55:0/3839567641 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f4330055130 con 0x7f4340159440 2023-10-06T11:13:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:59.127 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f432c066f30 msgr2=0x7f432c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f432c066f30 0x7f432c0693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4338007fd0 tx=0x7f4338009040 comp rx=0 tx=0).stop 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 msgr2=0x7f4340158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 0x7f4340158010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f433000ea80 tx=0x7f43300091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 shutdown_connections 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f432c066f30 0x7f432c0693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4340159440 0x7f4340158010 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43400b2100 0x7f43401532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 --2- 172.21.15.55:0/3839567641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43400cbc30 0x7f43400c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 >> 172.21.15.55:0/3839567641 conn(0x7f434006ece0 msgr2=0x7f43401549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 shutdown_connections 2023-10-06T11:13:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.127+0000 7f4346827700 1 -- 172.21.15.55:0/3839567641 wait complete. 2023-10-06T11:13:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:59.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.259+0000 7f85915bc700 1 Processor -- start 2023-10-06T11:13:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.259+0000 7f85915bc700 1 -- start start 2023-10-06T11:13:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f85915bc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f85915bc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f858c0b35d0 0x7f858c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f85915bc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c0cb7a0 con 0x7f858c0cc170 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f85915bc700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c0b0860 con 0x7f858c0b35d0 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f85915bc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0cb150 con 0x7f858c159440 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f858affd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f858a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f858c0b35d0 0x7f858c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f858b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f858c0cc170 0x7f858c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:44228/0 (socket says 172.21.15.55:44228) 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f858b7fe700 1 -- 172.21.15.55:0/2693359800 learned_addr learned my addr 172.21.15.55:0/2693359800 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.260+0000 7f858affd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:47946/0 (socket says 172.21.15.55:47946) 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f858affd700 1 -- 172.21.15.55:0/2693359800 >> v2:172.21.15.142:3300/0 conn(0x7f858c0b35d0 msgr2=0x7f858c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f858affd700 1 --2- 172.21.15.55:0/2693359800 >> v2:172.21.15.142:3300/0 conn(0x7f858c0b35d0 0x7f858c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f858affd700 1 -- 172.21.15.55:0/2693359800 >> v1:172.21.15.142:6789/0 conn(0x7f858c0cc170 legacy=0x7f858c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f858affd700 1 -- 172.21.15.55:0/2693359800 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c0cb430 con 0x7f858c159440 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f858a7fc700 1 --2- 172.21.15.55:0/2693359800 >> v2:172.21.15.142:3300/0 conn(0x7f858c0b35d0 0x7f858c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f858affd700 1 --2- 172.21.15.55:0/2693359800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c0b3090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8584009e60 tx=0x7f8584009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d1d434c23ed068 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f8589ffb700 1 -- 172.21.15.55:0/2693359800 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858400e070 con 0x7f858c159440 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f8589ffb700 1 -- 172.21.15.55:0/2693359800 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858400bb60 con 0x7f858c159440 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.261+0000 7f8589ffb700 1 -- 172.21.15.55:0/2693359800 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584012430 con 0x7f858c159440 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 -- 172.21.15.55:0/2693359800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 msgr2=0x7f858c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 --2- 172.21.15.55:0/2693359800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c0b3090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8584009e60 tx=0x7f8584009780 comp rx=0 tx=0).stop 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 -- 172.21.15.55:0/2693359800 shutdown_connections 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 --2- 172.21.15.55:0/2693359800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c0b3090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 --2- 172.21.15.55:0/2693359800 >> v2:172.21.15.142:3300/0 conn(0x7f858c0b35d0 0x7f858c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 -- 172.21.15.55:0/2693359800 >> 172.21.15.55:0/2693359800 conn(0x7f858c06ece0 msgr2=0x7f858c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 -- 172.21.15.55:0/2693359800 shutdown_connections 2023-10-06T11:13:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.262+0000 7f85915bc700 1 -- 172.21.15.55:0/2693359800 wait complete. 2023-10-06T11:13:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.263+0000 7f85915bc700 1 Processor -- start 2023-10-06T11:13:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.263+0000 7f85915bc700 1 -- start start 2023-10-06T11:13:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f85915bc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 0x7f858c0c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f85915bc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f858c0cc170 0x7f858c0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f85915bc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f85915bc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c16af40 con 0x7f858c0b35d0 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f85915bc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0cf260 con 0x7f858c0cc170 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f85915bc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c16a980 con 0x7f858c159440 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 0x7f858c0c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 0x7f858c0c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50620/0 (socket says 172.21.15.55:50620) 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 -- 172.21.15.55:0/2479252082 learned_addr learned my addr 172.21.15.55:0/2479252082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858b7fe700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858a7fc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f858c0cc170 0x7f858c0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 -- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 msgr2=0x7f858c169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 -- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f858c0cc170 msgr2=0x7f858c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f858c0cc170 0x7f858c0c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 -- 172.21.15.55:0/2479252082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574009420 con 0x7f858c0b35d0 2023-10-06T11:13:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f858affd700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 0x7f858c0c3d00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f858c0cb290 tx=0x7f8584019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.264+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584012b30 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.265+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8584012c90 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.265+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8584009a20 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.265+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85840276c0 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.265+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c0ceef0 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.265+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c0b30e0 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.266+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8584024070 con 0x7f858c0b35d0 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.266+0000 7f8582ffd700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f856c066f30 0x7f856c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.266+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8584086e30 con 0x7f858c0b35d0 2023-10-06T11:13:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.267+0000 7f858a7fc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f856c066f30 0x7f856c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.267+0000 7f858a7fc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f856c066f30 0x7f856c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f858c0cd4e0 tx=0x7f85740091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.271+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8584053c10 con 0x7f858c0b35d0 2023-10-06T11:13:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.506+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f858c0cbcd0 con 0x7f858c0b35d0 2023-10-06T11:13:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.507+0000 7f8582ffd700 1 -- 172.21.15.55:0/2479252082 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f8584057230 con 0x7f858c0b35d0 2023-10-06T11:13:59.509 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:59.509 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3959525432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3959525432},{"type":"v1","addr":"172.21.15.55:6835","nonce":3959525432}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4085655939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4085655939},{"type":"v1","addr":"172.21.15.142:6837","nonce":4085655939}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3770259242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3770259242},{"type":"v1","addr":"172.21.15.55:6834","nonce":3770259242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:12.502638+0000","modified":"2023-10-06T11:13:26.184677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2998784723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2998784723},{"type":"v1","addr":"172.21.15.142:6836","nonce":2998784723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f856c066f30 msgr2=0x7f856c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f856c066f30 0x7f856c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f858c0cd4e0 tx=0x7f85740091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 msgr2=0x7f858c0c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 0x7f858c0c3d00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f858c0cb290 tx=0x7f8584019000 comp rx=0 tx=0).stop 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 shutdown_connections 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f856c066f30 0x7f856c0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f858c0b35d0 0x7f858c0c3d00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f858c159440 0x7f858c169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 --2- 172.21.15.55:0/2479252082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f858c0cc170 0x7f858c0c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 >> 172.21.15.55:0/2479252082 conn(0x7f858c06ece0 msgr2=0x7f858c0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 shutdown_connections 2023-10-06T11:13:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.509+0000 7f85915bc700 1 -- 172.21.15.55:0/2479252082 wait complete. 2023-10-06T11:13:59.512 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2023-10-06T11:13:59.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:59.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.641+0000 7f8e192a1700 1 Processor -- start 2023-10-06T11:13:59.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.641+0000 7f8e192a1700 1 -- start start 2023-10-06T11:13:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e192a1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e14067cc0 0x7f8e141643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e192a1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e140cde30 con 0x7f8e14159580 2023-10-06T11:13:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e192a1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1406ef20 con 0x7f8e14159950 2023-10-06T11:13:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e192a1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1406f200 con 0x7f8e14067cc0 2023-10-06T11:13:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e12ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8e14159580 0x7f8e1406e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41782/0 (socket says 172.21.15.55:41782) 2023-10-06T11:13:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e12ffd700 1 -- 172.21.15.55:0/4260290195 learned_addr learned my addr 172.21.15.55:0/4260290195 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e137fe700 1 --2- 172.21.15.55:0/4260290195 >> v2:172.21.15.142:3300/0 conn(0x7f8e14067cc0 0x7f8e141643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737665678 0 0) 0x7f8e140cde30 con 0x7f8e14159580 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e00003570 con 0x7f8e14159580 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955248347 0 0) 0x7f8e1406ef20 con 0x7f8e14159950 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e140cde30 con 0x7f8e14159950 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e137fe700 1 -- 172.21.15.55:0/4260290195 >> v1:172.21.15.142:6789/0 conn(0x7f8e14159950 legacy=0x7f8e140675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e137fe700 1 -- 172.21.15.55:0/4260290195 >> v1:172.21.15.55:6789/0 conn(0x7f8e14159580 legacy=0x7f8e1406e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.642+0000 7f8e137fe700 1 -- 172.21.15.55:0/4260290195 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140b0150 con 0x7f8e14067cc0 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e137fe700 1 --2- 172.21.15.55:0/4260290195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e141643c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e04006fd0 tx=0x7f8e040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0250c46e000a365 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04005c60 con 0x7f8e14067cc0 2023-10-06T11:13:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04005de0 con 0x7f8e14067cc0 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e11ffb700 1 -- 172.21.15.55:0/4260290195 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04006240 con 0x7f8e14067cc0 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e192a1700 1 -- 172.21.15.55:0/4260290195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 msgr2=0x7f8e141643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e192a1700 1 --2- 172.21.15.55:0/4260290195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e141643c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e04006fd0 tx=0x7f8e040091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e192a1700 1 -- 172.21.15.55:0/4260290195 shutdown_connections 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e192a1700 1 --2- 172.21.15.55:0/4260290195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e141643c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e192a1700 1 -- 172.21.15.55:0/4260290195 >> 172.21.15.55:0/4260290195 conn(0x7f8e14069140 msgr2=0x7f8e140cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.643+0000 7f8e192a1700 1 -- 172.21.15.55:0/4260290195 shutdown_connections 2023-10-06T11:13:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.644+0000 7f8e192a1700 1 -- 172.21.15.55:0/4260290195 wait complete. 2023-10-06T11:13:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.645+0000 7f8e192a1700 1 Processor -- start 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.645+0000 7f8e192a1700 1 -- start start 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e1416a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 0x7f8e141562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e14159950 0x7f8e140cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140c52e0 con 0x7f8e14159580 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1416a550 con 0x7f8e14067cc0 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e14169f50 con 0x7f8e14159950 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 0x7f8e141562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 0x7f8e141562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50636/0 (socket says 172.21.15.55:50636) 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 -- 172.21.15.55:0/221697853 learned_addr learned my addr 172.21.15.55:0/221697853 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e12ffd700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e1416a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 -- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e14159950 msgr2=0x7f8e140cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e14159950 0x7f8e140cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 -- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 msgr2=0x7f8e1416a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e1416a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 -- 172.21.15.55:0/221697853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04009420 con 0x7f8e14159580 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e127fc700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 0x7f8e141562b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c590 tx=0x7f8dfc007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc010510 con 0x7f8e14159580 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc010670 con 0x7f8e14159580 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140c73e0 con 0x7f8e14159580 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc010a30 con 0x7f8e14159580 2023-10-06T11:13:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.646+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1416a1e0 con 0x7f8e14159580 2023-10-06T11:13:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.647+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1416a700 con 0x7f8e14159580 2023-10-06T11:13:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.648+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8dfc01b400 con 0x7f8e14159580 2023-10-06T11:13:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.648+0000 7f8e0affd700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8df4066f60 0x7f8df4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.648+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8dfc0846b0 con 0x7f8e14159580 2023-10-06T11:13:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.648+0000 7f8e12ffd700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8df4066f60 0x7f8df4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.649+0000 7f8e12ffd700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8df4066f60 0x7f8df4069410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005c50 tx=0x7f8e0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.652+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e1416a700 con 0x7f8e14159580 2023-10-06T11:13:59.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.850+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e1416a700 con 0x7f8e14159580 2023-10-06T11:13:59.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.851+0000 7f8e0affd700 1 -- 172.21.15.55:0/221697853 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f8e1416a700 con 0x7f8e14159580 2023-10-06T11:13:59.853 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:13:59.853 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:13:54.753042+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:10.219143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:11.479173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T11:13:15.162401+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8df4066f60 msgr2=0x7f8df4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8df4066f60 0x7f8df4069410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005c50 tx=0x7f8e0c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 msgr2=0x7f8e141562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 0x7f8e141562b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c590 tx=0x7f8dfc007dc0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 shutdown_connections 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8df4066f60 0x7f8df4069410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e14159950 0x7f8e140cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e14067cc0 0x7f8e1416a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 --2- 172.21.15.55:0/221697853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e14159580 0x7f8e141562b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 >> 172.21.15.55:0/221697853 conn(0x7f8e14069140 msgr2=0x7f8e14158010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 shutdown_connections 2023-10-06T11:13:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.853+0000 7f8e192a1700 1 -- 172.21.15.55:0/221697853 wait complete. 2023-10-06T11:13:59.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:13:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.985+0000 7fb26359e700 1 Processor -- start 2023-10-06T11:13:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.985+0000 7fb26359e700 1 -- start start 2023-10-06T11:13:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb264159440 0x7fb2640b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b2100 0x7fb2640b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26359e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640cb7a0 con 0x7fb2640b35d0 2023-10-06T11:13:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2640b0860 con 0x7fb264159440 2023-10-06T11:13:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640cb150 con 0x7fb2640b2100 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb261d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb2640b35d0 0x7fb2640cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41798/0 (socket says 172.21.15.55:41798) 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb261d9b700 1 -- 172.21.15.55:0/4057666931 learned_addr learned my addr 172.21.15.55:0/4057666931 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb262d9d700 1 --2- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b2100 0x7fb2640b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26259c700 1 --2- 172.21.15.55:0/4057666931 >> v2:172.21.15.142:3300/0 conn(0x7fb264159440 0x7fb2640b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26159a700 1 -- 172.21.15.55:0/4057666931 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503734377 0 0) 0x7fb2640cb7a0 con 0x7fb2640b35d0 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.986+0000 7fb26159a700 1 -- 172.21.15.55:0/4057666931 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb250003570 con 0x7fb2640b35d0 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26259c700 1 -- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b2100 msgr2=0x7fb2640b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26259c700 1 --2- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b2100 0x7fb2640b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26259c700 1 -- 172.21.15.55:0/4057666931 >> v1:172.21.15.55:6789/0 conn(0x7fb2640b35d0 legacy=0x7fb2640cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26159a700 1 -- 172.21.15.55:0/4057666931 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2466619540 0 0) 0x7fb250003570 con 0x7fb2640b35d0 2023-10-06T11:13:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26259c700 1 -- 172.21.15.55:0/4057666931 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640cb430 con 0x7fb264159440 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26259c700 1 --2- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb264159440 0x7fb2640b3090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098e0 tx=0x7fb25c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f52d504b0f3e6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26159a700 1 -- 172.21.15.55:0/4057666931 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c001470 con 0x7fb264159440 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26159a700 1 -- 172.21.15.55:0/4057666931 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c011420 con 0x7fb264159440 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26159a700 1 -- 172.21.15.55:0/4057666931 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0117a0 con 0x7fb264159440 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26359e700 1 -- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb264159440 msgr2=0x7fb2640b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.987+0000 7fb26359e700 1 --2- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb264159440 0x7fb2640b3090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098e0 tx=0x7fb25c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.988+0000 7fb26359e700 1 -- 172.21.15.55:0/4057666931 shutdown_connections 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.988+0000 7fb26359e700 1 --2- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b2100 0x7fb2640b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.988+0000 7fb26359e700 1 --2- 172.21.15.55:0/4057666931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb264159440 0x7fb2640b3090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.988+0000 7fb26359e700 1 -- 172.21.15.55:0/4057666931 >> 172.21.15.55:0/4057666931 conn(0x7fb26406ece0 msgr2=0x7fb26406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.988+0000 7fb26359e700 1 -- 172.21.15.55:0/4057666931 shutdown_connections 2023-10-06T11:13:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.988+0000 7fb26359e700 1 -- 172.21.15.55:0/4057666931 wait complete. 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 Processor -- start 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 -- start start 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2640b2100 0x7fb2640c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b35d0 0x7fb2640c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 0x7fb2640c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb264155ae0 con 0x7fb264159440 2023-10-06T11:13:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26415aa40 con 0x7fb2640b2100 2023-10-06T11:13:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.989+0000 7fb26359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640b53b0 con 0x7fb2640b35d0 2023-10-06T11:13:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 0x7fb2640c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 0x7fb2640c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50638/0 (socket says 172.21.15.55:50638) 2023-10-06T11:13:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 -- 172.21.15.55:0/3154974333 learned_addr learned my addr 172.21.15.55:0/3154974333 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:13:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb26259c700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2640b2100 0x7fb2640c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb261d9b700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b35d0 0x7fb2640c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 -- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b35d0 msgr2=0x7fb2640c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b35d0 0x7fb2640c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 -- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2640b2100 msgr2=0x7fb2640c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2640b2100 0x7fb2640c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 -- 172.21.15.55:0/3154974333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c009420 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb262d9d700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 0x7fb2640c93e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb254009e90 tx=0x7fb25400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400cc20 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400f040 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254014480 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2640b50d0 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.990+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26415a6d0 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.991+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26415abd0 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.991+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2540147f0 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.992+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.992+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb2540856f0 con 0x7fb264159440 2023-10-06T11:13:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.992+0000 7fb26259c700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:59.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.993+0000 7fb26259c700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb244066f30 0x7fb2440693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0091e0 tx=0x7fb25c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:59.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:13:59.996+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb254055f60 con 0x7fb264159440 2023-10-06T11:14:00.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.235+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb26405f230 con 0x7fb264159440 2023-10-06T11:14:00.237 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:14:00.235+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:14:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.240+0000 7fb25a7fc700 1 -- 172.21.15.55:0/3154974333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb254055af0 con 0x7fb264159440 2023-10-06T11:14:00.244 INFO:tasks.ceph.mds.b.smithi142.stderr: -3707> 2023-10-06T11:13:18.162+0000 7fdf6c383700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb244066f30 msgr2=0x7fb2440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb244066f30 0x7fb2440693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0091e0 tx=0x7fb25c016000 comp rx=0 tx=0).stop 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 msgr2=0x7fb2640c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 0x7fb2640c93e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb254009e90 tx=0x7fb25400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 shutdown_connections 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb264159440 0x7fb2640c93e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2640b2100 0x7fb2640c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 --2- 172.21.15.55:0/3154974333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2640b35d0 0x7fb2640c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 >> 172.21.15.55:0/3154974333 conn(0x7fb26406ece0 msgr2=0x7fb2641565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 shutdown_connections 2023-10-06T11:14:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.243+0000 7fb26359e700 1 -- 172.21.15.55:0/3154974333 wait complete. 2023-10-06T11:14:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:14:00.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:14:00.271 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:14:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.376+0000 7f3640e87700 1 Processor -- start 2023-10-06T11:14:00.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.376+0000 7f3640e87700 1 -- start start 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f3640e87700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f363c0c5250 0x7f363c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f3640e87700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f363c0cd300 0x7f363c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f3640e87700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c15ac30 con 0x7f363c150940 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f3640e87700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0cb6a0 con 0x7f363c0cd300 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f3640e87700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0cb090 con 0x7f363c0c5250 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f363c0cd300 0x7f363c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f363c0cd300 0x7f363c0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50654/0 (socket says 172.21.15.55:50654) 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363a59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f363c150940 0x7f363c159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41812/0 (socket says 172.21.15.55:41812) 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 -- 172.21.15.55:0/1867897266 learned_addr learned my addr 172.21.15.55:0/1867897266 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f3639d9b700 1 --2- 172.21.15.55:0/1867897266 >> v2:172.21.15.142:3300/0 conn(0x7f363c0c5250 0x7f363c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 -- 172.21.15.55:0/1867897266 >> v2:172.21.15.142:3300/0 conn(0x7f363c0c5250 msgr2=0x7f363c0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 --2- 172.21.15.55:0/1867897266 >> v2:172.21.15.142:3300/0 conn(0x7f363c0c5250 0x7f363c0ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 -- 172.21.15.55:0/1867897266 >> v1:172.21.15.55:6789/0 conn(0x7f363c150940 legacy=0x7f363c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363ad9d700 1 -- 172.21.15.55:0/1867897266 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0cd700 con 0x7f363c0cd300 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.377+0000 7f363959a700 1 -- 172.21.15.55:0/1867897266 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181914270 0 0) 0x7f362c0011d0 con 0x7f363c150940 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f363ad9d700 1 --2- 172.21.15.55:0/1867897266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c0b2050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f363c088f00 tx=0x7f3634009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60aaed676920b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f363959a700 1 -- 172.21.15.55:0/1867897266 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363400e070 con 0x7f363c0cd300 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f363959a700 1 -- 172.21.15.55:0/1867897266 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363400ba20 con 0x7f363c0cd300 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f363959a700 1 -- 172.21.15.55:0/1867897266 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340092e0 con 0x7f363c0cd300 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 -- 172.21.15.55:0/1867897266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 msgr2=0x7f363c0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 --2- 172.21.15.55:0/1867897266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c0b2050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f363c088f00 tx=0x7f3634009840 comp rx=0 tx=0).stop 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 -- 172.21.15.55:0/1867897266 shutdown_connections 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 --2- 172.21.15.55:0/1867897266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c0b2050 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 --2- 172.21.15.55:0/1867897266 >> v2:172.21.15.142:3300/0 conn(0x7f363c0c5250 0x7f363c0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 -- 172.21.15.55:0/1867897266 >> 172.21.15.55:0/1867897266 conn(0x7f363c099700 msgr2=0x7f363c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 -- 172.21.15.55:0/1867897266 shutdown_connections 2023-10-06T11:14:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.378+0000 7f3640e87700 1 -- 172.21.15.55:0/1867897266 wait complete. 2023-10-06T11:14:00.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.379+0000 7f3640e87700 1 Processor -- start 2023-10-06T11:14:00.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.379+0000 7f3640e87700 1 -- start start 2023-10-06T11:14:00.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3640e87700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f363c0c5250 0x7f363c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3640e87700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3640e87700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c14f690 0x7f363c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3640e87700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c16a150 con 0x7f363c0cd300 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3640e87700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c16a3f0 con 0x7f363c14f690 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3640e87700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c16cc10 con 0x7f363c0c5250 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3639d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3639d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50666/0 (socket says 172.21.15.55:50666) 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f3639d9b700 1 -- 172.21.15.55:0/2606861398 learned_addr learned my addr 172.21.15.55:0/2606861398 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f363a59c700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f363c0c5250 0x7f363c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.380+0000 7f363ad9d700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c14f690 0x7f363c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3639d9b700 1 -- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f363c0c5250 msgr2=0x7f363c14fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3639d9b700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f363c0c5250 0x7f363c14fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3639d9b700 1 -- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c14f690 msgr2=0x7f363c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3639d9b700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c14f690 0x7f363c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3639d9b700 1 -- 172.21.15.55:0/2606861398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634009ae0 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3639d9b700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c150090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f362400ec80 tx=0x7f36240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400c850 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400c9b0 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400cd50 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c16cef0 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.381+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c0b54b0 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.382+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c064a90 con 0x7f363c0cd300 2023-10-06T11:14:00.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.382+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3624013680 con 0x7f363c0cd300 2023-10-06T11:14:00.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.383+0000 7f36327fc700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f361c066f30 0x7f361c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.383+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f3624084c40 con 0x7f363c0cd300 2023-10-06T11:14:00.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.383+0000 7f363a59c700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f361c066f30 0x7f361c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.384+0000 7f363a59c700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f361c066f30 0x7f361c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f362c007090 tx=0x7f362c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.387+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36240519d0 con 0x7f363c0cd300 2023-10-06T11:14:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:00.626+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f363c04bb40 con 0x7f363c0cd300 2023-10-06T11:14:01.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.244+0000 7f36327fc700 1 -- 172.21.15.55:0/2606861398 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3624054ff0 con 0x7f363c0cd300 2023-10-06T11:14:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.246+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f361c066f30 msgr2=0x7f361c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.246+0000 7f3640e87700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f361c066f30 0x7f361c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f362c007090 tx=0x7f362c007e80 comp rx=0 tx=0).stop 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.246+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 msgr2=0x7f363c150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.246+0000 7f3640e87700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c150090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f362400ec80 tx=0x7f36240091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 shutdown_connections 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f361c066f30 0x7f361c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c14f690 0x7f363c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f363c0c5250 0x7f363c14fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 --2- 172.21.15.55:0/2606861398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f363c0cd300 0x7f363c150090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 >> 172.21.15.55:0/2606861398 conn(0x7f363c099700 msgr2=0x7f363c0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 shutdown_connections 2023-10-06T11:14:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.247+0000 7f3640e87700 1 -- 172.21.15.55:0/2606861398 wait complete. 2023-10-06T11:14:01.262 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:14:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 Processor -- start 2023-10-06T11:14:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 -- start start 2023-10-06T11:14:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9dac0a7be0 0x7f9dac15a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac067cc0 0x7f9dac06a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0c9a50 con 0x7f9dac0ae570 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0c9440 con 0x7f9dac0a7be0 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.389+0000 7f9db47ad700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0ad0d0 con 0x7f9dac067cc0 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9dac0a7be0 0x7f9dac15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9dac0a7be0 0x7f9dac15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50668/0 (socket says 172.21.15.55:50668) 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 -- 172.21.15.55:0/2323291036 learned_addr learned my addr 172.21.15.55:0/2323291036 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2d4a700 1 --2- 172.21.15.55:0/2323291036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac067cc0 0x7f9dac06a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 -- 172.21.15.55:0/2323291036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac067cc0 msgr2=0x7f9dac06a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 --2- 172.21.15.55:0/2323291036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac067cc0 0x7f9dac06a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 -- 172.21.15.55:0/2323291036 >> v1:172.21.15.142:6789/0 conn(0x7f9dac0ae570 legacy=0x7f9dac0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 -- 172.21.15.55:0/2323291036 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac15aba0 con 0x7f9dac0a7be0 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db2549700 1 --2- 172.21.15.55:0/2323291036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac15a660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9da40099b0 tx=0x7f9da4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be44974219499e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db1547700 1 -- 172.21.15.55:0/2323291036 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400b820 con 0x7f9dac0a7be0 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db1547700 1 -- 172.21.15.55:0/2323291036 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400b980 con 0x7f9dac0a7be0 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.390+0000 7f9db1547700 1 -- 172.21.15.55:0/2323291036 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400bd20 con 0x7f9dac0a7be0 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 -- 172.21.15.55:0/2323291036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 msgr2=0x7f9dac15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 --2- 172.21.15.55:0/2323291036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac15a660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9da40099b0 tx=0x7f9da4009250 comp rx=0 tx=0).stop 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 -- 172.21.15.55:0/2323291036 shutdown_connections 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 --2- 172.21.15.55:0/2323291036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac067cc0 0x7f9dac06a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 --2- 172.21.15.55:0/2323291036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac15a660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 -- 172.21.15.55:0/2323291036 >> 172.21.15.55:0/2323291036 conn(0x7f9dac0cd1e0 msgr2=0x7f9dac0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:01.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 -- 172.21.15.55:0/2323291036 shutdown_connections 2023-10-06T11:14:01.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.391+0000 7f9db47ad700 1 -- 172.21.15.55:0/2323291036 wait complete. 2023-10-06T11:14:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.392+0000 7f9db47ad700 1 Processor -- start 2023-10-06T11:14:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.392+0000 7f9db47ad700 1 -- start start 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dac067cc0 0x7f9dac155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac16a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac0ae570 0x7f9dac0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac16b180 con 0x7f9dac0a7be0 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac16dcf0 con 0x7f9dac067cc0 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac16abc0 con 0x7f9dac0ae570 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac16a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac16a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50676/0 (socket says 172.21.15.55:50676) 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 -- 172.21.15.55:0/496365148 learned_addr learned my addr 172.21.15.55:0/496365148 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db2d4a700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac0ae570 0x7f9dac0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db2549700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dac067cc0 0x7f9dac155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 -- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac0ae570 msgr2=0x7f9dac0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac0ae570 0x7f9dac0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 -- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dac067cc0 msgr2=0x7f9dac155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dac067cc0 0x7f9dac155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 -- 172.21.15.55:0/496365148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da40094f0 con 0x7f9dac0a7be0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db2549700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dac067cc0 0x7f9dac155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db1d48700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac16a1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9da000b610 tx=0x7f9da0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000f510 con 0x7f9dac0a7be0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da000f690 con 0x7f9dac0a7be0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac16aea0 con 0x7f9dac0a7be0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.393+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000fa50 con 0x7f9dac0a7be0 2023-10-06T11:14:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.394+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac155a50 con 0x7f9dac0a7be0 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.394+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac16d7e0 con 0x7f9dac0a7be0 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.395+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9da001a400 con 0x7f9dac0a7be0 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.395+0000 7f9daa7fc700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9d98066f30 0x7f9d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.395+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f9da00844a0 con 0x7f9dac0a7be0 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.395+0000 7f9db2549700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9d98066f30 0x7f9d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.396+0000 7f9db2549700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9d98066f30 0x7f9d980693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9da40099b0 tx=0x7f9da4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.400+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dac16d7e0 con 0x7f9dac0a7be0 2023-10-06T11:14:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:01.593+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9dac16d7e0 con 0x7f9dac0a7be0 2023-10-06T11:14:02.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.254+0000 7f9daa7fc700 1 -- 172.21.15.55:0/496365148 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9dac16d7e0 con 0x7f9dac0a7be0 2023-10-06T11:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9d98066f30 msgr2=0x7f9d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9d98066f30 0x7f9d980693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9da40099b0 tx=0x7f9da4016000 comp rx=0 tx=0).stop 2023-10-06T11:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 msgr2=0x7f9dac16a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac16a1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9da000b610 tx=0x7f9da0009120 comp rx=0 tx=0).stop 2023-10-06T11:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 shutdown_connections 2023-10-06T11:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9d98066f30 0x7f9d980693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dac0ae570 0x7f9dac0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dac067cc0 0x7f9dac155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 --2- 172.21.15.55:0/496365148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dac0a7be0 0x7f9dac16a1e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 >> 172.21.15.55:0/496365148 conn(0x7f9dac0cd1e0 msgr2=0x7f9dac0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 shutdown_connections 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.258+0000 7f9db47ad700 1 -- 172.21.15.55:0/496365148 wait complete. 2023-10-06T11:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:14:02.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:14:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.405+0000 7f8962471700 1 Processor -- start 2023-10-06T11:14:02.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.405+0000 7f8962471700 1 -- start start 2023-10-06T11:14:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8962471700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f895c15ad30 0x7f895c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8962471700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c15c400 con 0x7f895c153d20 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8962471700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c158200 con 0x7f895c153950 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8962471700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c15cfa0 con 0x7f895c15ad30 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f895c153d20 0x7f895c1577a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41814/0 (socket says 172.21.15.55:41814) 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895b7fe700 1 -- 172.21.15.55:0/3245256618 learned_addr learned my addr 172.21.15.55:0/3245256618 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8960a0e700 1 --2- 172.21.15.55:0/3245256618 >> v2:172.21.15.142:3300/0 conn(0x7f895c15ad30 0x7f895c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284384690 0 0) 0x7f895c15c400 con 0x7f895c153d20 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8944003570 con 0x7f895c153d20 2023-10-06T11:14:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522841926 0 0) 0x7f895c158200 con 0x7f895c153950 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f895c15c400 con 0x7f895c153950 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8960a0e700 1 -- 172.21.15.55:0/3245256618 >> v1:172.21.15.142:6789/0 conn(0x7f895c153950 legacy=0x7f895c15c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8960a0e700 1 -- 172.21.15.55:0/3245256618 >> v1:172.21.15.55:6789/0 conn(0x7f895c153d20 legacy=0x7f895c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638996454 0 0) 0x7f8944003570 con 0x7f895c153d20 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.406+0000 7f8960a0e700 1 -- 172.21.15.55:0/3245256618 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c15b7f0 con 0x7f895c15ad30 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8960a0e700 1 --2- 172.21.15.55:0/3245256618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c15b120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8954009e60 tx=0x7f8954009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ea7ece72ad10df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400e070 con 0x7f895c15ad30 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400b7a0 con 0x7f895c15ad30 2023-10-06T11:14:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f895affd700 1 -- 172.21.15.55:0/3245256618 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950001470 con 0x7f895c15ad30 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 -- 172.21.15.55:0/3245256618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 msgr2=0x7f895c15b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 --2- 172.21.15.55:0/3245256618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c15b120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8954009e60 tx=0x7f8954009780 comp rx=0 tx=0).stop 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 -- 172.21.15.55:0/3245256618 shutdown_connections 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 --2- 172.21.15.55:0/3245256618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c15b120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 -- 172.21.15.55:0/3245256618 >> 172.21.15.55:0/3245256618 conn(0x7f895c06ece0 msgr2=0x7f895c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 -- 172.21.15.55:0/3245256618 shutdown_connections 2023-10-06T11:14:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.407+0000 7f8962471700 1 -- 172.21.15.55:0/3245256618 wait complete. 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.408+0000 7f8962471700 1 Processor -- start 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 -- start start 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 0x7f895c146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f895c153d20 0x7f895c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c154290 con 0x7f895c153950 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c154530 con 0x7f895c15ad30 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f8962471700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c154810 con 0x7f895c153d20 2023-10-06T11:14:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f895bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 0x7f895c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f895bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 0x7f895c146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50682/0 (socket says 172.21.15.55:50682) 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.409+0000 7f895bfff700 1 -- 172.21.15.55:0/2968230426 learned_addr learned my addr 172.21.15.55:0/2968230426 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f8960a0e700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f895bfff700 1 -- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f895c153d20 msgr2=0x7f895c152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f895bfff700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f895c153d20 0x7f895c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f895bfff700 1 -- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 msgr2=0x7f895c153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f895bfff700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f895bfff700 1 -- 172.21.15.55:0/2968230426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954009a20 con 0x7f895c153950 2023-10-06T11:14:02.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f895bfff700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 0x7f895c146020 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f894c00c560 tx=0x7f894c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c010510 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c010670 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c154af0 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c010a30 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.410+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c143720 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.411+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c064a90 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.412+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f894c002050 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.412+0000 7f8943fff700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.412+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f894c084270 con 0x7f895c153950 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.412+0000 7f895b7fe700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.413+0000 7f895b7fe700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8948066f30 0x7f89480693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f895c0d13d0 tx=0x7f89500012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.416+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f894c0511b0 con 0x7f895c153950 2023-10-06T11:14:02.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:02.609+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f895c15bad0 con 0x7f895c153950 2023-10-06T11:14:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.262+0000 7f8943fff700 1 -- 172.21.15.55:0/2968230426 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f894c0547d0 con 0x7f895c153950 2023-10-06T11:14:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8948066f30 msgr2=0x7f89480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8948066f30 0x7f89480693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f895c0d13d0 tx=0x7f89500012e0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 msgr2=0x7f895c146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 0x7f895c146020 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f894c00c560 tx=0x7f894c007e00 comp rx=0 tx=0).stop 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 shutdown_connections 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f895c153950 0x7f895c146020 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f895c15ad30 0x7f895c153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 --2- 172.21.15.55:0/2968230426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f895c153d20 0x7f895c152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 >> 172.21.15.55:0/2968230426 conn(0x7f895c06ece0 msgr2=0x7f895c159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 shutdown_connections 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.266+0000 7f8962471700 1 -- 172.21.15.55:0/2968230426 wait complete. 2023-10-06T11:14:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:14:03.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T11:14:03.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.411+0000 7f5077056700 1 Processor -- start 2023-10-06T11:14:03.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.411+0000 7f5077056700 1 -- start start 2023-10-06T11:14:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5077056700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 0x7f50701642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5077056700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cdbf0 con 0x7f5070153990 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5077056700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cb4c0 con 0x7f50700cca70 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5077056700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ccfe0 con 0x7f50700d09c0 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5076054700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5070153990 0x7f507015a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41824/0 (socket says 172.21.15.55:41824) 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5076054700 1 -- 172.21.15.55:0/3476919174 learned_addr learned my addr 172.21.15.55:0/3476919174 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5076855700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 0x7f50701642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703345054 0 0) 0x7f50700cdbf0 con 0x7f5070153990 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.412+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5058003570 con 0x7f5070153990 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834283915 0 0) 0x7f5058003570 con 0x7f5070153990 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 msgr2=0x7f50701642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 0x7f50701642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 >> v1:172.21.15.142:6789/0 conn(0x7f50700cca70 legacy=0x7f50700d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700cd2c0 con 0x7f5070153990 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f5068001470 con 0x7f5070153990 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 >> v1:172.21.15.55:6789/0 conn(0x7f5070153990 legacy=0x7f507015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f5058003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5058004810 0x7f5058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 0x7f50580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ccfe0 con 0x7f5058003a90 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505800bb10 con 0x7f5058004810 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505800bcd0 con 0x7f50700d09c0 2023-10-06T11:14:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f5058003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5075853700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5058004810 0x7f5058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076855700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 0x7f50580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 -- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 msgr2=0x7f50580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50700d09c0 0x7f50580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 -- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5058004810 msgr2=0x7f5058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5058004810 0x7f5058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 -- 172.21.15.55:0/3476919174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058003570 con 0x7f5058003a90 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.413+0000 7f5076054700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f5058003e60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f506800c3c0 tx=0x7f5068001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426954339889fc1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800cc90 con 0x7f5058003a90 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800ce10 con 0x7f5058003a90 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5075052700 1 -- 172.21.15.55:0/3476919174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005b70 con 0x7f5058003a90 2023-10-06T11:14:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5077056700 1 -- 172.21.15.55:0/3476919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 msgr2=0x7f5058003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5077056700 1 --2- 172.21.15.55:0/3476919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f5058003e60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f506800c3c0 tx=0x7f5068001e70 comp rx=0 tx=0).stop 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5076855700 1 -- 172.21.15.55:0/3476919174 reap_dead start 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5077056700 1 -- 172.21.15.55:0/3476919174 shutdown_connections 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5077056700 1 -- 172.21.15.55:0/3476919174 >> 172.21.15.55:0/3476919174 conn(0x7f50700680c0 msgr2=0x7f5070068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5077056700 1 -- 172.21.15.55:0/3476919174 shutdown_connections 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.414+0000 7f5077056700 1 -- 172.21.15.55:0/3476919174 wait complete. 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.415+0000 7f5077056700 1 Processor -- start 2023-10-06T11:14:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.415+0000 7f5077056700 1 -- start start 2023-10-06T11:14:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5077056700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f507016d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5077056700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070148ca0 0x7f5070151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5077056700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070149110 0x7f5070151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5077056700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507016dcf0 con 0x7f5058003a90 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5077056700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070150150 con 0x7f5070148ca0 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5077056700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070150430 con 0x7f5070149110 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f507016d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f507016d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50698/0 (socket says 172.21.15.55:50698) 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 -- 172.21.15.55:0/869087185 learned_addr learned my addr 172.21.15.55:0/869087185 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5075853700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070148ca0 0x7f5070151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076855700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070149110 0x7f5070151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 -- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070149110 msgr2=0x7f5070151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070149110 0x7f5070151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 -- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070148ca0 msgr2=0x7f5070151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070148ca0 0x7f5070151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 -- 172.21.15.55:0/869087185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070150710 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5075853700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070148ca0 0x7f5070151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.416+0000 7f5076054700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f507016d7b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5058004770 tx=0x7f5068015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.417+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800cc90 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.417+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680072e0 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.417+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50701509f0 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.417+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068007680 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.417+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070150fb0 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.417+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507005f230 con 0x7f5058003a90 2023-10-06T11:14:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.418+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5068019030 con 0x7f5058003a90 2023-10-06T11:14:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.418+0000 7f506e7fc700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f505c066f30 0x7f505c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.418+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f5068086160 con 0x7f5058003a90 2023-10-06T11:14:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.419+0000 7f5075853700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f505c066f30 0x7f505c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.419+0000 7f5075853700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f505c066f30 0x7f505c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5064007a60 tx=0x7f5064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.423+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5068053280 con 0x7f5058003a90 2023-10-06T11:14:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:03.616+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50700cd5a0 con 0x7f5058003a90 2023-10-06T11:14:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.266+0000 7f506e7fc700 1 -- 172.21.15.55:0/869087185 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f50680568a0 con 0x7f5058003a90 2023-10-06T11:14:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f505c066f30 msgr2=0x7f505c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f505c066f30 0x7f505c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5064007a60 tx=0x7f5064009040 comp rx=0 tx=0).stop 2023-10-06T11:14:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 msgr2=0x7f507016d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f507016d7b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5058004770 tx=0x7f5068015000 comp rx=0 tx=0).stop 2023-10-06T11:14:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 shutdown_connections 2023-10-06T11:14:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f505c066f30 0x7f505c0693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5058003a90 0x7f507016d7b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070149110 0x7f5070151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 --2- 172.21.15.55:0/869087185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070148ca0 0x7f5070151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 >> 172.21.15.55:0/869087185 conn(0x7f50700680c0 msgr2=0x7f5070158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 shutdown_connections 2023-10-06T11:14:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:04.270+0000 7f5077056700 1 -- 172.21.15.55:0/869087185 wait complete. 2023-10-06T11:14:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data_ec' removed 2023-10-06T11:14:04.287 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:14:04.287 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:14:04.287 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:14:04.287 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:04.288 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:14:04.288 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:14:04.288 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:14:04.288 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:04.288 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:14:04.289 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:14:04.289 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:14:04.289 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:04.289 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:14:04.289 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:14:04.290 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:14:04.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:04.298 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:14:04.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:14:04.299 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:14:04.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:14:04.300 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:14:04.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:14:04.341 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:14:04.342 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:04.343 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:14:04.343 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:04.344 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:14:04.344 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:04.423 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:14:04.424 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:14:04.424 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:14:08.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:08.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:09.633 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T11:14:10.300 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:14:10.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:14:10.304 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:14:10.304 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:10.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:14:10.384 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:14:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.436+0000 7f2beacfa700 1 Processor -- start 2023-10-06T11:14:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2beacfa700 1 -- start start 2023-10-06T11:14:10.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2beacfa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2be40b25e0 0x7f2be40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2beacfa700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4159830 0x7f2be40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2beacfa700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be40cbfa0 con 0x7f2be40b29b0 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2beacfa700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be40cb390 con 0x7f2be4159830 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2beacfa700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be40cb670 con 0x7f2be40b25e0 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.437+0000 7f2be9297700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4159830 0x7f2be40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be3fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2be40b29b0 0x7f2be4159120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47462/0 (socket says 172.21.15.55:47462) 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be3fff700 1 -- 172.21.15.55:0/3257373206 learned_addr learned my addr 172.21.15.55:0/3257373206 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be8a96700 1 --2- 172.21.15.55:0/3257373206 >> v2:172.21.15.142:3300/0 conn(0x7f2be40b25e0 0x7f2be40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be9297700 1 -- 172.21.15.55:0/3257373206 >> v2:172.21.15.142:3300/0 conn(0x7f2be40b25e0 msgr2=0x7f2be40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be9297700 1 --2- 172.21.15.55:0/3257373206 >> v2:172.21.15.142:3300/0 conn(0x7f2be40b25e0 0x7f2be40b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be9297700 1 -- 172.21.15.55:0/3257373206 >> v1:172.21.15.55:6789/0 conn(0x7f2be40b29b0 legacy=0x7f2be4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be37fe700 1 -- 172.21.15.55:0/3257373206 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505761333 0 0) 0x7f2be40cbfa0 con 0x7f2be40b29b0 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be9297700 1 -- 172.21.15.55:0/3257373206 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40cb950 con 0x7f2be4159830 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be8a96700 1 --2- 172.21.15.55:0/3257373206 >> v2:172.21.15.142:3300/0 conn(0x7f2be40b25e0 0x7f2be40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be9297700 1 --2- 172.21.15.55:0/3257373206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4159830 0x7f2be40cc430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2be40d0420 tx=0x7f2bd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0520d6395f6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be37fe700 1 -- 172.21.15.55:0/3257373206 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400b6b0 con 0x7f2be4159830 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be37fe700 1 -- 172.21.15.55:0/3257373206 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400b810 con 0x7f2be4159830 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.438+0000 7f2be37fe700 1 -- 172.21.15.55:0/3257373206 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400bbb0 con 0x7f2be4159830 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 -- 172.21.15.55:0/3257373206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4159830 msgr2=0x7f2be40cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 --2- 172.21.15.55:0/3257373206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4159830 0x7f2be40cc430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2be40d0420 tx=0x7f2bd40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 -- 172.21.15.55:0/3257373206 shutdown_connections 2023-10-06T11:14:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 --2- 172.21.15.55:0/3257373206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4159830 0x7f2be40cc430 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 --2- 172.21.15.55:0/3257373206 >> v2:172.21.15.142:3300/0 conn(0x7f2be40b25e0 0x7f2be40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 -- 172.21.15.55:0/3257373206 >> 172.21.15.55:0/3257373206 conn(0x7f2be406ece0 msgr2=0x7f2be406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:10.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 -- 172.21.15.55:0/3257373206 shutdown_connections 2023-10-06T11:14:10.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.439+0000 7f2beacfa700 1 -- 172.21.15.55:0/3257373206 wait complete. 2023-10-06T11:14:10.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.440+0000 7f2beacfa700 1 Processor -- start 2023-10-06T11:14:10.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.440+0000 7f2beacfa700 1 -- start start 2023-10-06T11:14:10.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2beacfa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 0x7f2be40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2beacfa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2be40b29b0 0x7f2be415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2beacfa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2be4159830 0x7f2be40af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2beacfa700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40c7b20 con 0x7f2be40b25e0 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2beacfa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be416ed60 con 0x7f2be40b29b0 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2beacfa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40c7d00 con 0x7f2be4159830 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 0x7f2be40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 0x7f2be40c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33050/0 (socket says 172.21.15.55:33050) 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 -- 172.21.15.55:0/2395531589 learned_addr learned my addr 172.21.15.55:0/2395531589 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be9297700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2be4159830 0x7f2be40af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be3fff700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2be40b29b0 0x7f2be415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 -- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2be4159830 msgr2=0x7f2be40af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2be4159830 0x7f2be40af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 -- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2be40b29b0 msgr2=0x7f2be415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2be40b29b0 0x7f2be415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 -- 172.21.15.55:0/2395531589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009420 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be3fff700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2be40b29b0 0x7f2be415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.441+0000 7f2be8a96700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 0x7f2be40c87c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00a520 tx=0x7f2bdc007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.442+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc008590 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.442+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc0086f0 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.442+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be40c7fe0 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.442+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc008a90 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.442+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be415bd80 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.443+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be4064a90 con 0x7f2be40b25e0 2023-10-06T11:14:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.443+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bdc014410 con 0x7f2be40b25e0 2023-10-06T11:14:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.444+0000 7f2be0ff9700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2bd0066f30 0x7f2bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.444+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2bdc0850b0 con 0x7f2be40b25e0 2023-10-06T11:14:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.444+0000 7f2be3fff700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2bd0066f30 0x7f2bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.444+0000 7f2be3fff700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2bd0066f30 0x7f2bd00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2be415d190 tx=0x7f2bd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.448+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bdc052380 con 0x7f2be40b25e0 2023-10-06T11:14:10.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:10.656+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2be40cbc30 con 0x7f2be40b25e0 2023-10-06T11:14:11.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.913+0000 7f2be0ff9700 1 -- 172.21.15.55:0/2395531589 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2bdc0559a0 con 0x7f2be40b25e0 2023-10-06T11:14:11.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2bd0066f30 msgr2=0x7f2bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2bd0066f30 0x7f2bd00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2be415d190 tx=0x7f2bd8009040 comp rx=0 tx=0).stop 2023-10-06T11:14:11.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 msgr2=0x7f2be40c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 0x7f2be40c87c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00a520 tx=0x7f2bdc007960 comp rx=0 tx=0).stop 2023-10-06T11:14:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 shutdown_connections 2023-10-06T11:14:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2bd0066f30 0x7f2bd00693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40b25e0 0x7f2be40c87c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2be4159830 0x7f2be40af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 --2- 172.21.15.55:0/2395531589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2be40b29b0 0x7f2be415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 >> 172.21.15.55:0/2395531589 conn(0x7f2be406ece0 msgr2=0x7f2be40cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.916+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 shutdown_connections 2023-10-06T11:14:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:11.917+0000 7f2beacfa700 1 -- 172.21.15.55:0/2395531589 wait complete. 2023-10-06T11:14:11.921 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-10-06T11:14:11.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:14:12.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.058+0000 7fc08d94c700 1 Processor -- start 2023-10-06T11:14:12.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.058+0000 7fc08d94c700 1 -- start start 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc08d94c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0880b49a0 0x7fc0880aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc08d94c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc0880b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc08d94c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880b0c60 con 0x7fc088159560 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc08d94c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880b0f40 con 0x7fc0880b49a0 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc08d94c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880b1220 con 0x7fc0880b0760 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0880b49a0 0x7fc0880aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0880b49a0 0x7fc0880aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33066/0 (socket says 172.21.15.55:33066) 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 -- 172.21.15.55:0/507416074 learned_addr learned my addr 172.21.15.55:0/507416074 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0877fe700 1 --2- 172.21.15.55:0/507416074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc0880b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 -- 172.21.15.55:0/507416074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 msgr2=0x7fc0880b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 --2- 172.21.15.55:0/507416074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc0880b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 -- 172.21.15.55:0/507416074 >> v1:172.21.15.142:6789/0 conn(0x7fc088159560 legacy=0x7fc0880aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.059+0000 7fc0867fc700 1 -- 172.21.15.55:0/507416074 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880b1500 con 0x7fc0880b49a0 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc0867fc700 1 --2- 172.21.15.55:0/507416074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880aac40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc0700099e0 tx=0x7fc070009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70da2efec51fceb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc085ffb700 1 -- 172.21.15.55:0/507416074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000b820 con 0x7fc0880b49a0 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc085ffb700 1 -- 172.21.15.55:0/507416074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000b980 con 0x7fc0880b49a0 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc085ffb700 1 -- 172.21.15.55:0/507416074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000bd20 con 0x7fc0880b49a0 2023-10-06T11:14:12.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 -- 172.21.15.55:0/507416074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 msgr2=0x7fc0880aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 --2- 172.21.15.55:0/507416074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880aac40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc0700099e0 tx=0x7fc070009250 comp rx=0 tx=0).stop 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 -- 172.21.15.55:0/507416074 shutdown_connections 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 --2- 172.21.15.55:0/507416074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc0880b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 --2- 172.21.15.55:0/507416074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880aac40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 -- 172.21.15.55:0/507416074 >> 172.21.15.55:0/507416074 conn(0x7fc0880997f0 msgr2=0x7fc08806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 -- 172.21.15.55:0/507416074 shutdown_connections 2023-10-06T11:14:12.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.060+0000 7fc08d94c700 1 -- 172.21.15.55:0/507416074 wait complete. 2023-10-06T11:14:12.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 Processor -- start 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 -- start start 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc08809a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc088159560 0x7fc0880ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08816cfe0 con 0x7fc0880b49a0 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08816d230 con 0x7fc088159560 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc08d94c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08816d510 con 0x7fc0880b0760 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc0867fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc0867fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33068/0 (socket says 172.21.15.55:33068) 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.062+0000 7fc0867fc700 1 -- 172.21.15.55:0/652152589 learned_addr learned my addr 172.21.15.55:0/652152589 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0877fe700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc088159560 0x7fc0880ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc086ffd700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc08809a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0867fc700 1 -- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 msgr2=0x7fc08809a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0867fc700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc08809a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0867fc700 1 -- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc088159560 msgr2=0x7fc0880ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0867fc700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc088159560 0x7fc0880ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0867fc700 1 -- 172.21.15.55:0/652152589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700094f0 con 0x7fc0880b49a0 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0877fe700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc088159560 0x7fc0880ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc0867fc700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880ae970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc088067c20 tx=0x7fc070017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070011e50 con 0x7fc0880b49a0 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070024440 con 0x7fc0880b49a0 2023-10-06T11:14:12.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08816d7f0 con 0x7fc0880b49a0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070024800 con 0x7fc0880b49a0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.063+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08816ddb0 con 0x7fc0880b49a0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.064+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc088169a70 con 0x7fc0880b49a0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.064+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc07001a420 con 0x7fc0880b49a0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.065+0000 7fc07effd700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc068066f60 0x7fc068069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.065+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc070086330 con 0x7fc0880b49a0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.065+0000 7fc086ffd700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc068066f60 0x7fc068069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.066+0000 7fc086ffd700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc068066f60 0x7fc068069410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc08000e160 tx=0x7fc080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.070+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc088169a70 con 0x7fc0880b49a0 2023-10-06T11:14:12.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.341+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc088169a70 con 0x7fc0880b49a0 2023-10-06T11:14:12.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.341+0000 7fc07effd700 1 -- 172.21.15.55:0/652152589 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc088169a70 con 0x7fc0880b49a0 2023-10-06T11:14:12.344 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:12.344 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:14:12.344 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-10-06T11:14:12.344 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ==", 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.345 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg==", 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-10-06T11:14:12.346 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q==", 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag==", 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.347 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw==", 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.348 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw==", 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.349 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA==", 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.350 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA==", 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ==", 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.351 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug==", 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.352 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw==", 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.353 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg==", 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w==", 2023-10-06T11:14:12.354 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg==", 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.355 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ==", 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:12.356 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA==", 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9loAeQDxAAHRWvLBSoBR/HeRdtrvbGCw==", 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.358 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCv6x9lk8gRDRAAvx2Y75MK0TCbLeQ5SpwKjQ==", 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCv6x9l29QRDRAAm0h8GsnPQHKmcgA8bUizcg==", 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.359 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCv6x9lO90RDRAA+2T2GVP4ZR+gRFXq/c8SuQ==", 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T11:14:12.360 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCv6x9lUuURDRAAXk+pHznySwC3CB/Bw2NJgA==", 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCv6x9lvO4RDRAA89IPrck06OYg/VsnB+E4pw==", 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCv6x9lD/cRDRAAVO0tDiBb4b242v2hSsDG1A==", 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA==", 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:14:12.362 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g==", 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:12.363 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:14:12.364 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:14:12.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc068066f60 msgr2=0x7fc068069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc068066f60 0x7fc068069410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc08000e160 tx=0x7fc080009040 comp rx=0 tx=0).stop 2023-10-06T11:14:12.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 msgr2=0x7fc0880ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880ae970 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc088067c20 tx=0x7fc070017000 comp rx=0 tx=0).stop 2023-10-06T11:14:12.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 shutdown_connections 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc068066f60 0x7fc068069410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc088159560 0x7fc0880ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0880b0760 0x7fc08809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 --2- 172.21.15.55:0/652152589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0880b49a0 0x7fc0880ae970 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 >> 172.21.15.55:0/652152589 conn(0x7fc0880997f0 msgr2=0x7fc0880b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 shutdown_connections 2023-10-06T11:14:12.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.343+0000 7fc08d94c700 1 -- 172.21.15.55:0/652152589 wait complete. 2023-10-06T11:14:12.366 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T11:14:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.484+0000 7f0a99ed6700 1 Processor -- start 2023-10-06T11:14:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.484+0000 7f0a99ed6700 1 -- start start 2023-10-06T11:14:12.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a99ed6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a940c8f20 0x7f0a941620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a99ed6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940cdb40 con 0x7f0a9415ac40 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a99ed6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940ccf30 con 0x7f0a9415a870 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a99ed6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a940cd210 con 0x7f0a940c8f20 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a92ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0a9415ac40 0x7f0a940c8810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47470/0 (socket says 172.21.15.55:47470) 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a92ffd700 1 -- 172.21.15.55:0/1639902981 learned_addr learned my addr 172.21.15.55:0/1639902981 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a93fff700 1 --2- 172.21.15.55:0/1639902981 >> v2:172.21.15.142:3300/0 conn(0x7f0a940c8f20 0x7f0a941620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576630268 0 0) 0x7f0a940cdb40 con 0x7f0a9415ac40 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a7c003570 con 0x7f0a9415ac40 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1644703584 0 0) 0x7f0a7c003570 con 0x7f0a9415ac40 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 >> v2:172.21.15.142:3300/0 conn(0x7f0a940c8f20 msgr2=0x7f0a941620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 --2- 172.21.15.55:0/1639902981 >> v2:172.21.15.142:3300/0 conn(0x7f0a940c8f20 0x7f0a941620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 >> v1:172.21.15.142:6789/0 conn(0x7f0a9415a870 legacy=0x7f0a940ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940cd4f0 con 0x7f0a9415ac40 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.485+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f0a88001470 con 0x7f0a9415ac40 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 >> v1:172.21.15.55:6789/0 conn(0x7f0a9415ac40 legacy=0x7f0a940c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7c003a60 0x7f0a7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c004810 0x7f0a7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7c0051c0 0x7f0a7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940cd210 con 0x7f0a7c0051c0 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c00c0d0 con 0x7f0a7c003a60 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c00c290 con 0x7f0a7c004810 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7c0051c0 0x7f0a7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a937fe700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7c003a60 0x7f0a7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a92ffd700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c004810 0x7f0a7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 -- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c004810 msgr2=0x7f0a7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c004810 0x7f0a7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 -- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7c003a60 msgr2=0x7f0a7c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a7c003a60 0x7f0a7c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 -- 172.21.15.55:0/1639902981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c003570 con 0x7f0a7c0051c0 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a92ffd700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c004810 0x7f0a7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 -- 172.21.15.55:0/1639902981 reap_dead start 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a93fff700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7c0051c0 0x7f0a7c00ba60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00e210 tx=0x7f0a8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7044079f45de51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00eac0 con 0x7f0a7c0051c0 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00f040 con 0x7f0a7c0051c0 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.486+0000 7f0a927fc700 1 -- 172.21.15.55:0/1639902981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00ee70 con 0x7f0a7c0051c0 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 -- 172.21.15.55:0/1639902981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7c0051c0 msgr2=0x7f0a7c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7c0051c0 0x7f0a7c00ba60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00e210 tx=0x7f0a8c00b040 comp rx=0 tx=0).stop 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 -- 172.21.15.55:0/1639902981 shutdown_connections 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/1639902981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a7c0051c0 0x7f0a7c00ba60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 -- 172.21.15.55:0/1639902981 >> 172.21.15.55:0/1639902981 conn(0x7f0a94067d90 msgr2=0x7f0a940ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 -- 172.21.15.55:0/1639902981 shutdown_connections 2023-10-06T11:14:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.487+0000 7f0a99ed6700 1 -- 172.21.15.55:0/1639902981 wait complete. 2023-10-06T11:14:12.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.488+0000 7f0a99ed6700 1 Processor -- start 2023-10-06T11:14:12.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.488+0000 7f0a99ed6700 1 -- start start 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a99ed6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c0051c0 0x7f0a94155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a99ed6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a940afcf0 0x7f0a940b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a99ed6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 0x7f0a940b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a99ed6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940b06a0 con 0x7f0a940b1020 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a99ed6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940b1d10 con 0x7f0a940afcf0 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a99ed6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940b1ff0 con 0x7f0a7c0051c0 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 0x7f0a940b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 0x7f0a940b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33080/0 (socket says 172.21.15.55:33080) 2023-10-06T11:14:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 -- 172.21.15.55:0/176051508 learned_addr learned my addr 172.21.15.55:0/176051508 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a937fe700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c0051c0 0x7f0a94155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a92ffd700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a940afcf0 0x7f0a940b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 -- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c0051c0 msgr2=0x7f0a94155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c0051c0 0x7f0a94155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 -- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a940afcf0 msgr2=0x7f0a940b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a940afcf0 0x7f0a940b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 -- 172.21.15.55:0/176051508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940b22d0 con 0x7f0a940b1020 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.489+0000 7f0a93fff700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 0x7f0a940b14a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a9406f3e0 tx=0x7f0a8c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.490+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00eec0 con 0x7f0a940b1020 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.490+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c022070 con 0x7f0a940b1020 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.490+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a940b25b0 con 0x7f0a940b1020 2023-10-06T11:14:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.490+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c01d8b0 con 0x7f0a940b1020 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.490+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a940b2db0 con 0x7f0a940b1020 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.490+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a940b2ad0 con 0x7f0a940b1020 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.491+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a8c003020 con 0x7f0a940b1020 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.491+0000 7f0a7b7fe700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a80066f30 0x7f0a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.491+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0a8c024070 con 0x7f0a940b1020 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.492+0000 7f0a937fe700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a80066f30 0x7f0a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.492+0000 7f0a937fe700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a80066f30 0x7f0a800693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a84007e90 tx=0x7f0a84007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.496+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a940b2ad0 con 0x7f0a940b1020 2023-10-06T11:14:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.769+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0a940b2ad0 con 0x7f0a940b1020 2023-10-06T11:14:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.773+0000 7f0a7b7fe700 1 -- 172.21.15.55:0/176051508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0a940b2ad0 con 0x7f0a940b1020 2023-10-06T11:14:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a80066f30 msgr2=0x7f0a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a80066f30 0x7f0a800693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a84007e90 tx=0x7f0a84007d80 comp rx=0 tx=0).stop 2023-10-06T11:14:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 msgr2=0x7f0a940b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 0x7f0a940b14a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a9406f3e0 tx=0x7f0a8c019000 comp rx=0 tx=0).stop 2023-10-06T11:14:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 shutdown_connections 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a80066f30 0x7f0a800693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a940b1020 0x7f0a940b14a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a7c0051c0 0x7f0a94155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 --2- 172.21.15.55:0/176051508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a940afcf0 0x7f0a940b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 >> 172.21.15.55:0/176051508 conn(0x7f0a94067d90 msgr2=0x7f0a94155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 shutdown_connections 2023-10-06T11:14:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.775+0000 7f0a99ed6700 1 -- 172.21.15.55:0/176051508 wait complete. 2023-10-06T11:14:12.790 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T11:14:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.907+0000 7f860c898700 1 Processor -- start 2023-10-06T11:14:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.907+0000 7f860c898700 1 -- start start 2023-10-06T11:14:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860c898700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8608159560 0x7f86080aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860c898700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b0760 0x7f86080b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860c898700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080b0c60 con 0x7f86080b49a0 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860c898700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080b0f40 con 0x7f8608159560 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860c898700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080b1220 con 0x7f86080b0760 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8608159560 0x7f86080aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8608159560 0x7f86080aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33094/0 (socket says 172.21.15.55:33094) 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.908+0000 7f860659c700 1 -- 172.21.15.55:0/4248151882 learned_addr learned my addr 172.21.15.55:0/4248151882 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f8606d9d700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b0760 0x7f86080b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860659c700 1 -- 172.21.15.55:0/4248151882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b0760 msgr2=0x7f86080b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860659c700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b0760 0x7f86080b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860659c700 1 -- 172.21.15.55:0/4248151882 >> v1:172.21.15.142:6789/0 conn(0x7f86080b49a0 legacy=0x7f86080aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860659c700 1 -- 172.21.15.55:0/4248151882 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080b1500 con 0x7f8608159560 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f8606d9d700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b0760 0x7f86080b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860659c700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8608159560 0x7f86080aa530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8600009fa0 tx=0x7f8600009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1def496899bc53b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860559a700 1 -- 172.21.15.55:0/4248151882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860000e070 con 0x7f8608159560 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860559a700 1 -- 172.21.15.55:0/4248151882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860000bac0 con 0x7f8608159560 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.909+0000 7f860559a700 1 -- 172.21.15.55:0/4248151882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000092e0 con 0x7f8608159560 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 -- 172.21.15.55:0/4248151882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8608159560 msgr2=0x7f86080aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8608159560 0x7f86080aa530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8600009fa0 tx=0x7f8600009840 comp rx=0 tx=0).stop 2023-10-06T11:14:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 -- 172.21.15.55:0/4248151882 shutdown_connections 2023-10-06T11:14:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b0760 0x7f86080b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 --2- 172.21.15.55:0/4248151882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8608159560 0x7f86080aa530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 -- 172.21.15.55:0/4248151882 >> 172.21.15.55:0/4248151882 conn(0x7f86080997f0 msgr2=0x7f860806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 -- 172.21.15.55:0/4248151882 shutdown_connections 2023-10-06T11:14:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.910+0000 7f860c898700 1 -- 172.21.15.55:0/4248151882 wait complete. 2023-10-06T11:14:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.911+0000 7f860c898700 1 Processor -- start 2023-10-06T11:14:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.911+0000 7f860c898700 1 -- start start 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 0x7f86080ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b49a0 0x7f8608157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8608159560 0x7f860809a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080af580 con 0x7f86080b0760 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080af860 con 0x7f8608159560 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860809c520 con 0x7f86080b49a0 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 0x7f86080ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 0x7f86080ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33106/0 (socket says 172.21.15.55:33106) 2023-10-06T11:14:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 -- 172.21.15.55:0/1046263061 learned_addr learned my addr 172.21.15.55:0/1046263061 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f8606d9d700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8608159560 0x7f860809a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 -- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b49a0 msgr2=0x7f8608157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f8605d9b700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b49a0 0x7f8608157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b49a0 0x7f8608157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 -- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8608159560 msgr2=0x7f860809a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8608159560 0x7f860809a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 -- 172.21.15.55:0/1046263061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009ae0 con 0x7f86080b0760 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f8605d9b700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b49a0 0x7f8608157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f8606d9d700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8608159560 0x7f860809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860659c700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 0x7f86080ae2c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8600009fd0 tx=0x7f8600018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600008c50 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600008dd0 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860809c800 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000256b0 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.912+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86080ae800 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.913+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8608064a90 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.914+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8600003040 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.914+0000 7f85fe7fc700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f85e8066f30 0x7f85e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.914+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8600085bf0 con 0x7f86080b0760 2023-10-06T11:14:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.914+0000 7f8605d9b700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f85e8066f30 0x7f85e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.915+0000 7f8605d9b700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f85e8066f30 0x7f85e80693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f86080b26d0 tx=0x7f85f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:12.919+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8600052e70 con 0x7f86080b0760 2023-10-06T11:14:13.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.189+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f86080b17e0 con 0x7f86080b0760 2023-10-06T11:14:13.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.193+0000 7f85fe7fc700 1 -- 172.21.15.55:0/1046263061 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8600056490 con 0x7f86080b0760 2023-10-06T11:14:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f85e8066f30 msgr2=0x7f85e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f85e8066f30 0x7f85e80693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f86080b26d0 tx=0x7f85f0009040 comp rx=0 tx=0).stop 2023-10-06T11:14:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 msgr2=0x7f86080ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 0x7f86080ae2c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8600009fd0 tx=0x7f8600018000 comp rx=0 tx=0).stop 2023-10-06T11:14:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 shutdown_connections 2023-10-06T11:14:13.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f85e8066f30 0x7f85e80693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86080b0760 0x7f86080ae2c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8608159560 0x7f860809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 --2- 172.21.15.55:0/1046263061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86080b49a0 0x7f8608157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 >> 172.21.15.55:0/1046263061 conn(0x7f86080997f0 msgr2=0x7f8608158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 shutdown_connections 2023-10-06T11:14:13.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.195+0000 7f860c898700 1 -- 172.21.15.55:0/1046263061 wait complete. 2023-10-06T11:14:13.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T11:14:13.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.327+0000 7fd882324700 1 Processor -- start 2023-10-06T11:14:13.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.327+0000 7fd882324700 1 -- start start 2023-10-06T11:14:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd882324700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd87c0b49a0 0x7fd87c0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd882324700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd882324700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0b0c60 con 0x7fd87c159560 2023-10-06T11:14:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd882324700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c0b0f40 con 0x7fd87c0b49a0 2023-10-06T11:14:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd882324700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0b1220 con 0x7fd87c0b0760 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd87c0b49a0 0x7fd87c0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd87c159560 0x7fd87c0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47486/0 (socket says 172.21.15.55:47486) 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87bfff700 1 -- 172.21.15.55:0/2276790569 learned_addr learned my addr 172.21.15.55:0/2276790569 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87b7fe700 1 -- 172.21.15.55:0/2276790569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 msgr2=0x7fd87c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87b7fe700 1 --2- 172.21.15.55:0/2276790569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87b7fe700 1 -- 172.21.15.55:0/2276790569 >> v1:172.21.15.55:6789/0 conn(0x7fd87c159560 legacy=0x7fd87c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87b7fe700 1 -- 172.21.15.55:0/2276790569 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0b1500 con 0x7fd87c0b49a0 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87affd700 1 -- 172.21.15.55:0/2276790569 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905771921 0 0) 0x7fd87c0b0c60 con 0x7fd87c159560 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87b7fe700 1 --2- 172.21.15.55:0/2276790569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0aac40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd870009910 tx=0x7fd8700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d536d989332fa971 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87affd700 1 -- 172.21.15.55:0/2276790569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000b820 con 0x7fd87c0b49a0 2023-10-06T11:14:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87affd700 1 -- 172.21.15.55:0/2276790569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000b980 con 0x7fd87c0b49a0 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.328+0000 7fd87affd700 1 -- 172.21.15.55:0/2276790569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000bd20 con 0x7fd87c0b49a0 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 -- 172.21.15.55:0/2276790569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c0b49a0 msgr2=0x7fd87c0aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 --2- 172.21.15.55:0/2276790569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0aac40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd870009910 tx=0x7fd8700091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 -- 172.21.15.55:0/2276790569 shutdown_connections 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 --2- 172.21.15.55:0/2276790569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 --2- 172.21.15.55:0/2276790569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0aac40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 -- 172.21.15.55:0/2276790569 >> 172.21.15.55:0/2276790569 conn(0x7fd87c0997f0 msgr2=0x7fd87c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 -- 172.21.15.55:0/2276790569 shutdown_connections 2023-10-06T11:14:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.329+0000 7fd882324700 1 -- 172.21.15.55:0/2276790569 wait complete. 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.330+0000 7fd882324700 1 Processor -- start 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.330+0000 7fd882324700 1 -- start start 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd882324700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd882324700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd882324700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 0x7fd87c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd882324700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c09c470 con 0x7fd87c159560 2023-10-06T11:14:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd882324700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c09b720 con 0x7fd87c0b49a0 2023-10-06T11:14:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd882324700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c09bb40 con 0x7fd87c0b0760 2023-10-06T11:14:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 0x7fd87c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 0x7fd87c0b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33114/0 (socket says 172.21.15.55:33114) 2023-10-06T11:14:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 -- 172.21.15.55:0/2758525380 learned_addr learned my addr 172.21.15.55:0/2758525380 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd87bfff700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd87b7fe700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 -- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 msgr2=0x7fd87c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 -- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd87c0b49a0 msgr2=0x7fd87c0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd8808c1700 1 -- 172.21.15.55:0/2758525380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009420 con 0x7fd87c159560 2023-10-06T11:14:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.331+0000 7fd87bfff700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.332+0000 7fd8808c1700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 0x7fd87c0b2090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd87400bb60 tx=0x7fd874009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.332+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400c940 con 0x7fd87c159560 2023-10-06T11:14:13.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.332+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400cac0 con 0x7fd87c159560 2023-10-06T11:14:13.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.332+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c09be20 con 0x7fd87c159560 2023-10-06T11:14:13.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.332+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400ce80 con 0x7fd87c159560 2023-10-06T11:14:13.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.332+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c15f010 con 0x7fd87c159560 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.333+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c15f200 con 0x7fd87c159560 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.333+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd874014620 con 0x7fd87c159560 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.333+0000 7fd863fff700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.333+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd874084520 con 0x7fd87c159560 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.334+0000 7fd87bfff700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.335+0000 7fd87bfff700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd86c001840 tx=0x7fd86c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.338+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd87404c5a0 con 0x7fd87c159560 2023-10-06T11:14:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.607+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd87c064a90 con 0x7fd87c159560 2023-10-06T11:14:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.612+0000 7fd863fff700 1 -- 172.21.15.55:0/2758525380 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd874051840 con 0x7fd87c159560 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 msgr2=0x7fd8680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd86c001840 tx=0x7fd86c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 msgr2=0x7fd87c0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 0x7fd87c0b2090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd87400bb60 tx=0x7fd874009810 comp rx=0 tx=0).stop 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 shutdown_connections 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c159560 0x7fd87c0b2090 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd87c0b0760 0x7fd87c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 --2- 172.21.15.55:0/2758525380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd87c0b49a0 0x7fd87c0b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 >> 172.21.15.55:0/2758525380 conn(0x7fd87c0997f0 msgr2=0x7fd87c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 shutdown_connections 2023-10-06T11:14:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.614+0000 7fd882324700 1 -- 172.21.15.55:0/2758525380 wait complete. 2023-10-06T11:14:13.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T11:14:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.745+0000 7fc8d9783700 1 Processor -- start 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.745+0000 7fc8d9783700 1 -- start start 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d9783700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 0x7fc8d4159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d9783700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8d4159660 0x7fc8d40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d9783700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d40b0da0 con 0x7fc8d40b25e0 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d9783700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d40cbfa0 con 0x7fc8d4159660 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d9783700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40cb390 con 0x7fc8d40b29b0 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d27fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 0x7fc8d4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8d4159660 0x7fc8d40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d37fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8d4159660 0x7fc8d40cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:49904/0 (socket says 172.21.15.55:49904) 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d27fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 0x7fc8d4159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:33282/0 (socket says 172.21.15.55:33282) 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.746+0000 7fc8d37fe700 1 -- 172.21.15.55:0/1758426555 learned_addr learned my addr 172.21.15.55:0/1758426555 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d37fe700 1 -- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 msgr2=0x7fc8d4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d37fe700 1 --2- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 0x7fc8d4159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d37fe700 1 -- 172.21.15.55:0/1758426555 >> v1:172.21.15.142:6789/0 conn(0x7fc8d40b25e0 legacy=0x7fc8d40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d37fe700 1 -- 172.21.15.55:0/1758426555 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40cb670 con 0x7fc8d4159660 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d27fc700 1 --2- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 0x7fc8d4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d37fe700 1 --2- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d4159660 0x7fc8d40cc430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009f20 tx=0x7fc8c4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3156ca9facc6e683 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d1ffb700 1 -- 172.21.15.55:0/1758426555 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400e070 con 0x7fc8d4159660 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d1ffb700 1 -- 172.21.15.55:0/1758426555 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c400b9d0 con 0x7fc8d4159660 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.747+0000 7fc8d1ffb700 1 -- 172.21.15.55:0/1758426555 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c40092e0 con 0x7fc8d4159660 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 -- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d4159660 msgr2=0x7fc8d40cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 --2- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d4159660 0x7fc8d40cc430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009f20 tx=0x7fc8c4009840 comp rx=0 tx=0).stop 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 -- 172.21.15.55:0/1758426555 shutdown_connections 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 --2- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d4159660 0x7fc8d40cc430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 --2- 172.21.15.55:0/1758426555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b29b0 0x7fc8d4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 -- 172.21.15.55:0/1758426555 >> 172.21.15.55:0/1758426555 conn(0x7fc8d406ece0 msgr2=0x7fc8d406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 -- 172.21.15.55:0/1758426555 shutdown_connections 2023-10-06T11:14:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.748+0000 7fc8d9783700 1 -- 172.21.15.55:0/1758426555 wait complete. 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.749+0000 7fc8d9783700 1 Processor -- start 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.749+0000 7fc8d9783700 1 -- start start 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d9783700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b25e0 0x7fc8d40c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d9783700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d40b29b0 0x7fc8d414a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d9783700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 0x7fc8d415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d9783700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d41560f0 con 0x7fc8d4159660 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d9783700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40c8870 con 0x7fc8d40b29b0 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d9783700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40c5d40 con 0x7fc8d40b25e0 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 0x7fc8d415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 0x7fc8d415ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33122/0 (socket says 172.21.15.55:33122) 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 -- 172.21.15.55:0/2915939339 learned_addr learned my addr 172.21.15.55:0/2915939339 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d27fc700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d40b29b0 0x7fc8d414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d2ffd700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b25e0 0x7fc8d40c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 -- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b25e0 msgr2=0x7fc8d40c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b25e0 0x7fc8d40c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 -- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d40b29b0 msgr2=0x7fc8d414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d40b29b0 0x7fc8d414a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 -- 172.21.15.55:0/2915939339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc009420 con 0x7fc8d4159660 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d27fc700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d40b29b0 0x7fc8d414a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.750+0000 7fc8d37fe700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 0x7fc8d415ba70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400b610 tx=0x7fc8c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.751+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4008c30 con 0x7fc8d4159660 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.751+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4008d90 con 0x7fc8d4159660 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.751+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c4009ae0 con 0x7fc8d4159660 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.751+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c401c640 con 0x7fc8d4159660 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.751+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d4155aa0 con 0x7fc8d4159660 2023-10-06T11:14:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.751+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d4156260 con 0x7fc8d4159660 2023-10-06T11:14:13.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.752+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8c4003040 con 0x7fc8d4159660 2023-10-06T11:14:13.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.752+0000 7fc8caffd700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b4066f30 0x7fc8b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.752+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc8c4085cf0 con 0x7fc8d4159660 2023-10-06T11:14:13.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.752+0000 7fc8d2ffd700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b4066f30 0x7fc8b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.753+0000 7fc8d2ffd700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b4066f30 0x7fc8b40693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc003890 tx=0x7fc8cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:13.757+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8c408a070 con 0x7fc8d4159660 2023-10-06T11:14:14.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.030+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc8d4064a90 con 0x7fc8d4159660 2023-10-06T11:14:14.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.035+0000 7fc8caffd700 1 -- 172.21.15.55:0/2915939339 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc8c4053010 con 0x7fc8d4159660 2023-10-06T11:14:14.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b4066f30 msgr2=0x7fc8b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b4066f30 0x7fc8b40693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc003890 tx=0x7fc8cc009040 comp rx=0 tx=0).stop 2023-10-06T11:14:14.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 msgr2=0x7fc8d415ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 0x7fc8d415ba70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400b610 tx=0x7fc8c4018000 comp rx=0 tx=0).stop 2023-10-06T11:14:14.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 shutdown_connections 2023-10-06T11:14:14.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc8b4066f30 0x7fc8b40693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8d4159660 0x7fc8d415ba70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8d40b25e0 0x7fc8d40c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 --2- 172.21.15.55:0/2915939339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8d40b29b0 0x7fc8d414a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 >> 172.21.15.55:0/2915939339 conn(0x7fc8d406ece0 msgr2=0x7fc8d40b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 shutdown_connections 2023-10-06T11:14:14.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.037+0000 7fc8d9783700 1 -- 172.21.15.55:0/2915939339 wait complete. 2023-10-06T11:14:14.051 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T11:14:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 Processor -- start 2023-10-06T11:14:14.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 -- start start 2023-10-06T11:14:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45100b49a0 0x7f45100aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f45100b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100b0c60 con 0x7f4510159560 2023-10-06T11:14:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45100b0f40 con 0x7f45100b49a0 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.169+0000 7f4516f71700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b1220 con 0x7f45100b0760 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f4514d0d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4510159560 0x7f45100aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47488/0 (socket says 172.21.15.55:47488) 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f4514d0d700 1 -- 172.21.15.55:0/3779632704 learned_addr learned my addr 172.21.15.55:0/3779632704 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f451550e700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f45100b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720116137 0 0) 0x7f45100b0c60 con 0x7f4510159560 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450ffff700 1 --2- 172.21.15.55:0/3779632704 >> v2:172.21.15.142:3300/0 conn(0x7f45100b49a0 0x7f45100aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44fc003570 con 0x7f4510159560 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1116057307 0 0) 0x7f44fc003570 con 0x7f4510159560 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 msgr2=0x7f45100b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f45100b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 >> v2:172.21.15.142:3300/0 conn(0x7f45100b49a0 msgr2=0x7f45100aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 --2- 172.21.15.55:0/3779632704 >> v2:172.21.15.142:3300/0 conn(0x7f45100b49a0 0x7f45100aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100b1500 con 0x7f4510159560 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f4508001970 con 0x7f4510159560 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 >> v1:172.21.15.55:6789/0 conn(0x7f4510159560 legacy=0x7f45100aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc003a60 0x7f44fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f44fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc004d50 0x7f44fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b0f40 con 0x7f44fc003a60 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b1220 con 0x7f44fc004d50 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc00ba60 con 0x7f45100b0760 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f4514d0d700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc003a60 0x7f44fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f450ffff700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f44fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.170+0000 7f451550e700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc004d50 0x7f44fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4514d0d700 1 -- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 msgr2=0x7f44fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4514d0d700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f44fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4514d0d700 1 -- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc004d50 msgr2=0x7f44fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4514d0d700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc004d50 0x7f44fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4514d0d700 1 -- 172.21.15.55:0/3779632704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc003570 con 0x7f44fc003a60 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f450ffff700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100b0760 0x7f44fc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f451550e700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc004d50 0x7f44fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4514d0d700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc003a60 0x7f44fc003e70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f450800c670 tx=0x7f4508007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b799660694e2bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508005b70 con 0x7f44fc003a60 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508005cf0 con 0x7f44fc003a60 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f450f7fe700 1 -- 172.21.15.55:0/3779632704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508007360 con 0x7f44fc003a60 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4516f71700 1 -- 172.21.15.55:0/3779632704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc003a60 msgr2=0x7f44fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4516f71700 1 --2- 172.21.15.55:0/3779632704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc003a60 0x7f44fc003e70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f450800c670 tx=0x7f4508007ca0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f451550e700 1 -- 172.21.15.55:0/3779632704 reap_dead start 2023-10-06T11:14:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4516f71700 1 -- 172.21.15.55:0/3779632704 shutdown_connections 2023-10-06T11:14:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4516f71700 1 -- 172.21.15.55:0/3779632704 >> 172.21.15.55:0/3779632704 conn(0x7f45100997f0 msgr2=0x7f451006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4516f71700 1 -- 172.21.15.55:0/3779632704 shutdown_connections 2023-10-06T11:14:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.171+0000 7f4516f71700 1 -- 172.21.15.55:0/3779632704 wait complete. 2023-10-06T11:14:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 Processor -- start 2023-10-06T11:14:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 -- start start 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc003a60 0x7f4510157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100ab200 0x7f45100ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 0x7f45100ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100acbe0 con 0x7f45100abbb0 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100ac020 con 0x7f44fc003a60 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.173+0000 7f4516f71700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451009de60 con 0x7f45100ab200 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 0x7f45100ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 0x7f45100ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33144/0 (socket says 172.21.15.55:33144) 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 -- 172.21.15.55:0/2137002849 learned_addr learned my addr 172.21.15.55:0/2137002849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f450ffff700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100ab200 0x7f45100ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f4514d0d700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc003a60 0x7f4510157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 -- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100ab200 msgr2=0x7f45100ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100ab200 0x7f45100ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 -- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc003a60 msgr2=0x7f4510157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc003a60 0x7f4510157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 -- 172.21.15.55:0/2137002849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100ac2b0 con 0x7f45100abbb0 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f451550e700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 0x7f45100ad6e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f45100b2f10 tx=0x7f44f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8011ed0 con 0x7f45100abbb0 2023-10-06T11:14:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8015670 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45100ac590 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8015a30 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.174+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45101582a0 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.175+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100ad530 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.176+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44f801e400 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.176+0000 7f450cff9700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f44f0066f30 0x7f44f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.176+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f44f8084660 con 0x7f45100abbb0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.176+0000 7f4514d0d700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f44f0066f30 0x7f44f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.177+0000 7f4514d0d700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f44f0066f30 0x7f44f00693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f450800c670 tx=0x7f4508015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.181+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f8051980 con 0x7f45100abbb0 2023-10-06T11:14:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.453+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4510064a90 con 0x7f45100abbb0 2023-10-06T11:14:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.457+0000 7f450cff9700 1 -- 172.21.15.55:0/2137002849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f44f8054fa0 con 0x7f45100abbb0 2023-10-06T11:14:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f44f0066f30 msgr2=0x7f44f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f44f0066f30 0x7f44f00693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f450800c670 tx=0x7f4508015000 comp rx=0 tx=0).stop 2023-10-06T11:14:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 msgr2=0x7f45100ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 0x7f45100ad6e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f45100b2f10 tx=0x7f44f8008040 comp rx=0 tx=0).stop 2023-10-06T11:14:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 shutdown_connections 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f44f0066f30 0x7f44f00693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45100abbb0 0x7f45100ad6e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44fc003a60 0x7f4510157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 --2- 172.21.15.55:0/2137002849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45100ab200 0x7f45100ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 >> 172.21.15.55:0/2137002849 conn(0x7f45100997f0 msgr2=0x7f4510158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 shutdown_connections 2023-10-06T11:14:14.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.459+0000 7f4516f71700 1 -- 172.21.15.55:0/2137002849 wait complete. 2023-10-06T11:14:14.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T11:14:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.590+0000 7f154e12f700 1 Processor -- start 2023-10-06T11:14:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.590+0000 7f154e12f700 1 -- start start 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f154e12f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15480b49a0 0x7f15480aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f154e12f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15480b0760 0x7f15480b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f154e12f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15480b0c60 con 0x7f1548159560 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f154e12f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480b0f40 con 0x7f15480b0760 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f154e12f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480b1220 con 0x7f15480b49a0 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f1547fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15480b0760 0x7f15480b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f15477fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1548159560 0x7f15480aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55790/0 (socket says 172.21.15.55:55790) 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f15477fe700 1 -- 172.21.15.55:0/2930071778 learned_addr learned my addr 172.21.15.55:0/2930071778 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.591+0000 7f1546ffd700 1 --2- 172.21.15.55:0/2930071778 >> v2:172.21.15.142:3300/0 conn(0x7f15480b49a0 0x7f15480aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f1547fff700 1 -- 172.21.15.55:0/2930071778 >> v2:172.21.15.142:3300/0 conn(0x7f15480b49a0 msgr2=0x7f15480aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f1547fff700 1 --2- 172.21.15.55:0/2930071778 >> v2:172.21.15.142:3300/0 conn(0x7f15480b49a0 0x7f15480aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f1547fff700 1 -- 172.21.15.55:0/2930071778 >> v1:172.21.15.55:6789/0 conn(0x7f1548159560 legacy=0x7f15480aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f1547fff700 1 -- 172.21.15.55:0/2930071778 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480b1500 con 0x7f15480b0760 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f1546ffd700 1 --2- 172.21.15.55:0/2930071778 >> v2:172.21.15.142:3300/0 conn(0x7f15480b49a0 0x7f15480aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f15467fc700 1 -- 172.21.15.55:0/2930071778 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977611218 0 0) 0x7f15480b0c60 con 0x7f1548159560 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f1547fff700 1 --2- 172.21.15.55:0/2930071778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b0760 0x7f15480b1bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1540009e60 tx=0x7f1540009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e5eadd1ba7b23e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f15467fc700 1 -- 172.21.15.55:0/2930071778 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154000e070 con 0x7f15480b0760 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f15467fc700 1 -- 172.21.15.55:0/2930071778 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154000bbf0 con 0x7f15480b0760 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f15467fc700 1 -- 172.21.15.55:0/2930071778 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540012430 con 0x7f15480b0760 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 -- 172.21.15.55:0/2930071778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b0760 msgr2=0x7f15480b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 --2- 172.21.15.55:0/2930071778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b0760 0x7f15480b1bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1540009e60 tx=0x7f1540009780 comp rx=0 tx=0).stop 2023-10-06T11:14:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 -- 172.21.15.55:0/2930071778 shutdown_connections 2023-10-06T11:14:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 --2- 172.21.15.55:0/2930071778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b0760 0x7f15480b1bc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 --2- 172.21.15.55:0/2930071778 >> v2:172.21.15.142:3300/0 conn(0x7f15480b49a0 0x7f15480aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 -- 172.21.15.55:0/2930071778 >> 172.21.15.55:0/2930071778 conn(0x7f15480997f0 msgr2=0x7f154806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 -- 172.21.15.55:0/2930071778 shutdown_connections 2023-10-06T11:14:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.592+0000 7f154e12f700 1 -- 172.21.15.55:0/2930071778 wait complete. 2023-10-06T11:14:14.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.594+0000 7f154e12f700 1 Processor -- start 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.594+0000 7f154e12f700 1 -- start start 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.594+0000 7f154e12f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15480b0760 0x7f15481471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.594+0000 7f154e12f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 0x7f15480ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.594+0000 7f154e12f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1548159560 0x7f154815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f154e12f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480adeb0 con 0x7f15480b49a0 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f154e12f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480ab970 con 0x7f1548159560 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f154e12f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480ad2a0 con 0x7f15480b0760 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 0x7f15480ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 0x7f15480ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50136/0 (socket says 172.21.15.55:50136) 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 -- 172.21.15.55:0/3443378159 learned_addr learned my addr 172.21.15.55:0/3443378159 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f15477fe700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15480b0760 0x7f15481471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1547fff700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1548159560 0x7f154815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 -- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15480b0760 msgr2=0x7f15481471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15480b0760 0x7f15481471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 -- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1548159560 msgr2=0x7f154815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1548159560 0x7f154815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 -- 172.21.15.55:0/3443378159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1540009a20 con 0x7f15480b49a0 2023-10-06T11:14:14.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f1546ffd700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 0x7f15480ab430 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c800 tx=0x7f153c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011600 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c011760 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15480ad580 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011b20 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.595+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480adb40 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.596+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1548064a90 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.597+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f153c0073d0 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.597+0000 7f152f7fe700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1534066f30 0x7f15340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.597+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f153c0845b0 con 0x7f15480b49a0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.597+0000 7f15477fe700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1534066f30 0x7f15340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.598+0000 7f15477fe700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1534066f30 0x7f15340693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15480b3e40 tx=0x7f1538009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.601+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f153c0518d0 con 0x7f15480b49a0 2023-10-06T11:14:14.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.876+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f15480b17e0 con 0x7f15480b49a0 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.884+0000 7f152f7fe700 1 -- 172.21.15.55:0/3443378159 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f153c054ef0 con 0x7f15480b49a0 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1534066f30 msgr2=0x7f15340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1534066f30 0x7f15340693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15480b3e40 tx=0x7f1538009040 comp rx=0 tx=0).stop 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 msgr2=0x7f15480ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 0x7f15480ab430 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c800 tx=0x7f153c008040 comp rx=0 tx=0).stop 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 shutdown_connections 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1534066f30 0x7f15340693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1548159560 0x7f154815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15480b0760 0x7f15481471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 --2- 172.21.15.55:0/3443378159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15480b49a0 0x7f15480ab430 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 >> 172.21.15.55:0/3443378159 conn(0x7f15480997f0 msgr2=0x7f1548158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 shutdown_connections 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:14.886+0000 7f154e12f700 1 -- 172.21.15.55:0/3443378159 wait complete. 2023-10-06T11:14:14.901 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:15.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.018+0000 7f6478cbb700 1 Processor -- start 2023-10-06T11:14:15.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.018+0000 7f6478cbb700 1 -- start start 2023-10-06T11:14:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6474159560 0x7f64740aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64740b0760 0x7f64740b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64740b0c60 con 0x7f64740b49a0 2023-10-06T11:14:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740b0f40 con 0x7f64740b0760 2023-10-06T11:14:15.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740b1220 con 0x7f6474159560 2023-10-06T11:14:15.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64740b0760 0x7f64740b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64740b0760 0x7f64740b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50146/0 (socket says 172.21.15.55:50146) 2023-10-06T11:14:15.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 -- 172.21.15.55:0/2766015828 learned_addr learned my addr 172.21.15.55:0/2766015828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f647259c700 1 --2- 172.21.15.55:0/2766015828 >> v2:172.21.15.142:3300/0 conn(0x7f6474159560 0x7f64740aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 -- 172.21.15.55:0/2766015828 >> v2:172.21.15.142:3300/0 conn(0x7f6474159560 msgr2=0x7f64740aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 --2- 172.21.15.55:0/2766015828 >> v2:172.21.15.142:3300/0 conn(0x7f6474159560 0x7f64740aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 -- 172.21.15.55:0/2766015828 >> v1:172.21.15.142:6789/0 conn(0x7f64740b49a0 legacy=0x7f64740aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 -- 172.21.15.55:0/2766015828 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64740b1500 con 0x7f64740b0760 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6472d9d700 1 --2- 172.21.15.55:0/2766015828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64740b0760 0x7f64740b1bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f646c0099b0 tx=0x7f646c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7891e4cd82430fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f647159a700 1 -- 172.21.15.55:0/2766015828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00b820 con 0x7f64740b0760 2023-10-06T11:14:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f647159a700 1 -- 172.21.15.55:0/2766015828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c00b980 con 0x7f64740b0760 2023-10-06T11:14:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f647159a700 1 -- 172.21.15.55:0/2766015828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00bd20 con 0x7f64740b0760 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- 172.21.15.55:0/2766015828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64740b0760 msgr2=0x7f64740b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 --2- 172.21.15.55:0/2766015828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64740b0760 0x7f64740b1bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f646c0099b0 tx=0x7f646c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- 172.21.15.55:0/2766015828 shutdown_connections 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 --2- 172.21.15.55:0/2766015828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64740b0760 0x7f64740b1bc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 --2- 172.21.15.55:0/2766015828 >> v2:172.21.15.142:3300/0 conn(0x7f6474159560 0x7f64740aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- 172.21.15.55:0/2766015828 >> 172.21.15.55:0/2766015828 conn(0x7f64740997f0 msgr2=0x7f647406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- 172.21.15.55:0/2766015828 shutdown_connections 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.019+0000 7f6478cbb700 1 -- 172.21.15.55:0/2766015828 wait complete. 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.020+0000 7f6478cbb700 1 Processor -- start 2023-10-06T11:14:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.020+0000 7f6478cbb700 1 -- start start 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6478cbb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64740b0760 0x7f6474157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6478cbb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64740b49a0 0x7f647409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6478cbb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 0x7f64740acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6478cbb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740af200 con 0x7f6474159560 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6478cbb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740ab200 con 0x7f64740b0760 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6478cbb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64740ae1f0 con 0x7f64740b49a0 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 0x7f64740acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 0x7f64740acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50156/0 (socket says 172.21.15.55:50156) 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 -- 172.21.15.55:0/1290300663 learned_addr learned my addr 172.21.15.55:0/1290300663 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6471d9b700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64740b49a0 0x7f647409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f647259c700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64740b0760 0x7f6474157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 -- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64740b49a0 msgr2=0x7f647409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64740b49a0 0x7f647409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 -- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64740b0760 msgr2=0x7f6474157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64740b0760 0x7f6474157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f6472d9d700 1 -- 172.21.15.55:0/1290300663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0094f0 con 0x7f6474159560 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.021+0000 7f647259c700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64740b0760 0x7f6474157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.022+0000 7f6472d9d700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 0x7f64740acc70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6474067c20 tx=0x7f646c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.022+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c01a630 con 0x7f6474159560 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.022+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c01a7b0 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.022+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64740aef20 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.022+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c01ab70 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.022+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647409a4d0 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.023+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647409a050 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.023+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f646c02d440 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.023+0000 7f646a7fc700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.024+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f646c086170 con 0x7f6474159560 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.024+0000 7f647259c700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.024+0000 7f647259c700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6454066f30 0x7f64540693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6464007470 tx=0x7f646400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.028+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f647409a050 con 0x7f6474159560 2023-10-06T11:14:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.225+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64740ab370 con 0x7f6474159560 2023-10-06T11:14:15.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.226+0000 7f646a7fc700 1 -- 172.21.15.55:0/1290300663 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13855 (secure 0 0 0) 0x7f64740ab370 con 0x7f6474159560 2023-10-06T11:14:15.229 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:15.229 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":39,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:11.911499+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6454066f30 msgr2=0x7f64540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6454066f30 0x7f64540693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6464007470 tx=0x7f646400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 msgr2=0x7f64740acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 0x7f64740acc70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6474067c20 tx=0x7f646c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 shutdown_connections 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6474159560 0x7f64740acc70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64740b0760 0x7f6474157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 --2- 172.21.15.55:0/1290300663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64740b49a0 0x7f647409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 >> 172.21.15.55:0/1290300663 conn(0x7f64740997f0 msgr2=0x7f6474158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 shutdown_connections 2023-10-06T11:14:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.228+0000 7f6478cbb700 1 -- 172.21.15.55:0/1290300663 wait complete. 2023-10-06T11:14:15.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:14:15.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.364+0000 7fe49acd8700 1 Processor -- start 2023-10-06T11:14:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.364+0000 7fe49acd8700 1 -- start start 2023-10-06T11:14:15.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.364+0000 7fe49acd8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 0x7fe4940675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.364+0000 7fe49acd8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940b0650 con 0x7fe4941598e0 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.364+0000 7fe49acd8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49406efe0 con 0x7fe49406eaa0 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.364+0000 7fe49acd8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406f2c0 con 0x7fe494159510 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe493fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe4941598e0 0x7fe49406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55800/0 (socket says 172.21.15.55:55800) 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe493fff700 1 -- 172.21.15.55:0/753186359 learned_addr learned my addr 172.21.15.55:0/753186359 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe498a74700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 0x7fe4940675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602681066 0 0) 0x7fe4940b0650 con 0x7fe4941598e0 2023-10-06T11:14:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe484003570 con 0x7fe4941598e0 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559707189 0 0) 0x7fe484003570 con 0x7fe4941598e0 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 msgr2=0x7fe4940675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 0x7fe4940675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 >> v1:172.21.15.142:6789/0 conn(0x7fe49406eaa0 legacy=0x7fe4940b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940b0000 con 0x7fe4941598e0 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fe480001470 con 0x7fe4941598e0 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 >> v1:172.21.15.55:6789/0 conn(0x7fe4941598e0 legacy=0x7fe49406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 0x7fe484003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe484003fd0 0x7fe484004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe484004d50 0x7fe4840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406f2c0 con 0x7fe484004d50 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48400bb40 con 0x7fe484003fd0 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48400bd00 con 0x7fe494159510 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe499275700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe484004d50 0x7fe4840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe498a74700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 0x7fe484003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.365+0000 7fe493fff700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe484003fd0 0x7fe484004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 -- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 msgr2=0x7fe484003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe494159510 0x7fe484003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 -- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe484003fd0 msgr2=0x7fe484004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe484003fd0 0x7fe484004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 -- 172.21.15.55:0/753186359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484003570 con 0x7fe484004d50 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe484004d50 0x7fe4840051c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0020a0 tx=0x7fe48c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ba3d228d1ffff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0019e0 con 0x7fe484004d50 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c00c8b0 con 0x7fe484004d50 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe4937fe700 1 -- 172.21.15.55:0/753186359 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00cc50 con 0x7fe484004d50 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe49acd8700 1 -- 172.21.15.55:0/753186359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe484004d50 msgr2=0x7fe4840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe49acd8700 1 --2- 172.21.15.55:0/753186359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe484004d50 0x7fe4840051c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0020a0 tx=0x7fe48c0016d0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.366+0000 7fe499275700 1 -- 172.21.15.55:0/753186359 reap_dead start 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.367+0000 7fe49acd8700 1 -- 172.21.15.55:0/753186359 shutdown_connections 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.367+0000 7fe49acd8700 1 -- 172.21.15.55:0/753186359 >> 172.21.15.55:0/753186359 conn(0x7fe494069150 msgr2=0x7fe4940cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.367+0000 7fe49acd8700 1 -- 172.21.15.55:0/753186359 shutdown_connections 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.367+0000 7fe49acd8700 1 -- 172.21.15.55:0/753186359 wait complete. 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.369+0000 7fe49acd8700 1 Processor -- start 2023-10-06T11:14:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.369+0000 7fe49acd8700 1 -- start start 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 0x7fe4940c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4940c0bd0 0x7fe4940c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4940c6640 0x7fe4940c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940c6ab0 con 0x7fe494147640 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940c1fc0 con 0x7fe4940c0bd0 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940c13b0 con 0x7fe4940c6640 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 0x7fe4940c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 0x7fe4940c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50166/0 (socket says 172.21.15.55:50166) 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 -- 172.21.15.55:0/2172372249 learned_addr learned my addr 172.21.15.55:0/2172372249 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe499275700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4940c6640 0x7fe4940c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe493fff700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4940c0bd0 0x7fe4940c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 -- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4940c6640 msgr2=0x7fe4940c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4940c6640 0x7fe4940c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 -- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4940c0bd0 msgr2=0x7fe4940c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4940c0bd0 0x7fe4940c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 -- 172.21.15.55:0/2172372249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940c1690 con 0x7fe494147640 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe493fff700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4940c0bd0 0x7fe4940c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe498a74700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 0x7fe4940c3440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe488011b10 tx=0x7fe488009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488005c10 con 0x7fe494147640 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488005d70 con 0x7fe494147640 2023-10-06T11:14:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940c1970 con 0x7fe494147640 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48800f900 con 0x7fe494147640 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe494147a10 con 0x7fe494147640 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.370+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4940c1e10 con 0x7fe494147640 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.371+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe48800fcb0 con 0x7fe494147640 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.371+0000 7fe490ff9700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe478066f30 0x7fe4780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.371+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe488084d50 con 0x7fe494147640 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.371+0000 7fe493fff700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe478066f30 0x7fe4780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.372+0000 7fe493fff700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe478066f30 0x7fe4780693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe480001d00 tx=0x7fe480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.376+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe488088030 con 0x7fe494147640 2023-10-06T11:14:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.569+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe494064a90 con 0x7fe494147640 2023-10-06T11:14:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.569+0000 7fe490ff9700 1 -- 172.21.15.55:0/2172372249 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe488052070 con 0x7fe494147640 2023-10-06T11:14:15.572 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:14:15.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.571+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe478066f30 msgr2=0x7fe4780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.571+0000 7fe49acd8700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe478066f30 0x7fe4780693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe480001d00 tx=0x7fe480009040 comp rx=0 tx=0).stop 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.571+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 msgr2=0x7fe4940c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.571+0000 7fe49acd8700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 0x7fe4940c3440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe488011b10 tx=0x7fe488009120 comp rx=0 tx=0).stop 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 shutdown_connections 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe478066f30 0x7fe4780693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe494147640 0x7fe4940c3440 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4940c6640 0x7fe4940c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 --2- 172.21.15.55:0/2172372249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4940c0bd0 0x7fe4940c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 >> 172.21.15.55:0/2172372249 conn(0x7fe494069150 msgr2=0x7fe49406e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 shutdown_connections 2023-10-06T11:14:15.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.572+0000 7fe49acd8700 1 -- 172.21.15.55:0/2172372249 wait complete. 2023-10-06T11:14:15.586 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 Processor -- start 2023-10-06T11:14:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 -- start start 2023-10-06T11:14:15.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81e00b2620 0x7f81e00cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81e00b29f0 0x7f81e00cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e00cc970 con 0x7f81e00ceaa0 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00cbd60 con 0x7f81e00b2620 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e7157700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00cc040 con 0x7f81e00b29f0 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6155700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81e00b2620 0x7f81e00cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6956700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81e00ceaa0 0x7f81e00cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55802/0 (socket says 172.21.15.55:55802) 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6956700 1 -- 172.21.15.55:0/3286744871 learned_addr learned my addr 172.21.15.55:0/3286744871 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e5954700 1 --2- 172.21.15.55:0/3286744871 >> v2:172.21.15.142:3300/0 conn(0x7f81e00b29f0 0x7f81e00cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6155700 1 -- 172.21.15.55:0/3286744871 >> v2:172.21.15.142:3300/0 conn(0x7f81e00b29f0 msgr2=0x7f81e00cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6155700 1 --2- 172.21.15.55:0/3286744871 >> v2:172.21.15.142:3300/0 conn(0x7f81e00b29f0 0x7f81e00cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6155700 1 -- 172.21.15.55:0/3286744871 >> v1:172.21.15.55:6789/0 conn(0x7f81e00ceaa0 legacy=0x7f81e00cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e6155700 1 -- 172.21.15.55:0/3286744871 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00cc320 con 0x7f81e00b2620 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.706+0000 7f81e5153700 1 -- 172.21.15.55:0/3286744871 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188931821 0 0) 0x7f81e00cc970 con 0x7f81e00ceaa0 2023-10-06T11:14:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e6155700 1 --2- 172.21.15.55:0/3286744871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00b2620 0x7f81e00cccb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f81e00b62d0 tx=0x7f81d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37214b13f90baba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e5153700 1 -- 172.21.15.55:0/3286744871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000e070 con 0x7f81e00b2620 2023-10-06T11:14:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e5153700 1 -- 172.21.15.55:0/3286744871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000bb60 con 0x7f81e00b2620 2023-10-06T11:14:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e5153700 1 -- 172.21.15.55:0/3286744871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0012430 con 0x7f81e00b2620 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 -- 172.21.15.55:0/3286744871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00b2620 msgr2=0x7f81e00cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 --2- 172.21.15.55:0/3286744871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00b2620 0x7f81e00cccb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f81e00b62d0 tx=0x7f81d0009780 comp rx=0 tx=0).stop 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 -- 172.21.15.55:0/3286744871 shutdown_connections 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 --2- 172.21.15.55:0/3286744871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00b2620 0x7f81e00cccb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 --2- 172.21.15.55:0/3286744871 >> v2:172.21.15.142:3300/0 conn(0x7f81e00b29f0 0x7f81e00cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 -- 172.21.15.55:0/3286744871 >> 172.21.15.55:0/3286744871 conn(0x7f81e0099520 msgr2=0x7f81e006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 -- 172.21.15.55:0/3286744871 shutdown_connections 2023-10-06T11:14:15.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.708+0000 7f81e7157700 1 -- 172.21.15.55:0/3286744871 wait complete. 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.709+0000 7f81e7157700 1 Processor -- start 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 -- start start 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81e00b2620 0x7f81e0152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e00b29f0 0x7f81e00b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 0x7f81e0147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e016a550 con 0x7f81e00ceaa0 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0169940 con 0x7f81e00b2620 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e7157700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0169c20 con 0x7f81e00b29f0 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e6956700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 0x7f81e0147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e6956700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 0x7f81e0147cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50186/0 (socket says 172.21.15.55:50186) 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e6956700 1 -- 172.21.15.55:0/4060350607 learned_addr learned my addr 172.21.15.55:0/4060350607 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:15.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e5954700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e00b29f0 0x7f81e00b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.710+0000 7f81e6155700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81e00b2620 0x7f81e0152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e6956700 1 -- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e00b29f0 msgr2=0x7f81e00b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e6956700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e00b29f0 0x7f81e00b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e6956700 1 -- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81e00b2620 msgr2=0x7f81e0152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e6956700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81e00b2620 0x7f81e0152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e6956700 1 -- 172.21.15.55:0/4060350607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0009a20 con 0x7f81e00ceaa0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e6956700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 0x7f81e0147cd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c7e0 tx=0x7f81d8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8005c00 con 0x7f81e00ceaa0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8005d60 con 0x7f81e00ceaa0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e0169f00 con 0x7f81e00ceaa0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8004a80 con 0x7f81e00ceaa0 2023-10-06T11:14:15.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.711+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e00b5fc0 con 0x7f81e00ceaa0 2023-10-06T11:14:15.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.712+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e005f230 con 0x7f81e00ceaa0 2023-10-06T11:14:15.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.712+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81d8005030 con 0x7f81e00ceaa0 2023-10-06T11:14:15.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.713+0000 7f81de7fc700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f81cc066f30 0x7f81cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.713+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f81d80838f0 con 0x7f81e00ceaa0 2023-10-06T11:14:15.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.713+0000 7f81e6155700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f81cc066f30 0x7f81cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.713+0000 7f81e6155700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f81cc066f30 0x7f81cc0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81d00097c0 tx=0x7f81d0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.717+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81d804b5a0 con 0x7f81e00ceaa0 2023-10-06T11:14:15.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.909+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81e016a690 con 0x7f81e00ceaa0 2023-10-06T11:14:15.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.909+0000 7f81de7fc700 1 -- 172.21.15.55:0/4060350607 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81d8050c10 con 0x7f81e00ceaa0 2023-10-06T11:14:15.911 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f81cc066f30 msgr2=0x7f81cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f81cc066f30 0x7f81cc0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81d00097c0 tx=0x7f81d0019000 comp rx=0 tx=0).stop 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 msgr2=0x7f81e0147cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 0x7f81e0147cd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c7e0 tx=0x7f81d8007d90 comp rx=0 tx=0).stop 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 shutdown_connections 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f81cc066f30 0x7f81cc0693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e00ceaa0 0x7f81e0147cd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81e00b2620 0x7f81e0152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 --2- 172.21.15.55:0/4060350607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81e00b29f0 0x7f81e00b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 >> 172.21.15.55:0/4060350607 conn(0x7f81e0099520 msgr2=0x7f81e0068110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 shutdown_connections 2023-10-06T11:14:15.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:15.911+0000 7f81e7157700 1 -- 172.21.15.55:0/4060350607 wait complete. 2023-10-06T11:14:15.925 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:14:16.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.042+0000 7f7bbb123700 1 Processor -- start 2023-10-06T11:14:16.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.042+0000 7f7bbb123700 1 -- start start 2023-10-06T11:14:16.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bbb123700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7bb40ca370 0x7f7bb4158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bbb123700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7bb40adb60 0x7f7bb40ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bbb123700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb4157de0 con 0x7f7bb40ce6d0 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bbb123700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb40cbb90 con 0x7f7bb40adb60 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bbb123700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb40ceb10 con 0x7f7bb40ca370 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bb3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7bb40adb60 0x7f7bb40ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bb3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7bb40adb60 0x7f7bb40ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50192/0 (socket says 172.21.15.55:50192) 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.043+0000 7f7bb3fff700 1 -- 172.21.15.55:0/3232302745 learned_addr learned my addr 172.21.15.55:0/3232302745 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb8ebf700 1 --2- 172.21.15.55:0/3232302745 >> v2:172.21.15.142:3300/0 conn(0x7f7bb40ca370 0x7f7bb4158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb3fff700 1 -- 172.21.15.55:0/3232302745 >> v2:172.21.15.142:3300/0 conn(0x7f7bb40ca370 msgr2=0x7f7bb4158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb3fff700 1 --2- 172.21.15.55:0/3232302745 >> v2:172.21.15.142:3300/0 conn(0x7f7bb40ca370 0x7f7bb4158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb3fff700 1 -- 172.21.15.55:0/3232302745 >> v1:172.21.15.142:6789/0 conn(0x7f7bb40ce6d0 legacy=0x7f7bb415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb3fff700 1 -- 172.21.15.55:0/3232302745 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40cb5d0 con 0x7f7bb40adb60 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb3fff700 1 --2- 172.21.15.55:0/3232302745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb40ce190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406f2c0 tx=0x7f7ba8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e753a3dcab1f769 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb37fe700 1 -- 172.21.15.55:0/3232302745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800b820 con 0x7f7bb40adb60 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb37fe700 1 -- 172.21.15.55:0/3232302745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba800b980 con 0x7f7bb40adb60 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bb37fe700 1 -- 172.21.15.55:0/3232302745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800bd20 con 0x7f7bb40adb60 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bbb123700 1 -- 172.21.15.55:0/3232302745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 msgr2=0x7f7bb40ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.044+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3232302745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb40ce190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406f2c0 tx=0x7f7ba8009250 comp rx=0 tx=0).stop 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.045+0000 7f7bbb123700 1 -- 172.21.15.55:0/3232302745 shutdown_connections 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.045+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3232302745 >> v2:172.21.15.142:3300/0 conn(0x7f7bb40ca370 0x7f7bb4158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.045+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3232302745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb40ce190 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.045+0000 7f7bbb123700 1 -- 172.21.15.55:0/3232302745 >> 172.21.15.55:0/3232302745 conn(0x7f7bb40707d0 msgr2=0x7f7bb4070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.045+0000 7f7bbb123700 1 -- 172.21.15.55:0/3232302745 shutdown_connections 2023-10-06T11:14:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.045+0000 7f7bbb123700 1 -- 172.21.15.55:0/3232302745 wait complete. 2023-10-06T11:14:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.046+0000 7f7bbb123700 1 Processor -- start 2023-10-06T11:14:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.046+0000 7f7bbb123700 1 -- start start 2023-10-06T11:14:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb4169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bb40ca370 0x7f7bb414b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bb40ce6d0 0x7f7bb40c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb416aed0 con 0x7f7bb40adb60 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb416a910 con 0x7f7bb40ca370 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb416abf0 con 0x7f7bb40ce6d0 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb4169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb4169f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50200/0 (socket says 172.21.15.55:50200) 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 -- 172.21.15.55:0/3342353612 learned_addr learned my addr 172.21.15.55:0/3342353612 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb3fff700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bb40ca370 0x7f7bb414b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb96c0700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bb40ce6d0 0x7f7bb40c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 -- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bb40ce6d0 msgr2=0x7f7bb40c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bb40ce6d0 0x7f7bb40c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 -- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bb40ca370 msgr2=0x7f7bb414b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bb40ca370 0x7f7bb414b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 -- 172.21.15.55:0/3342353612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80094f0 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb3fff700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bb40ca370 0x7f7bb414b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb8ebf700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb4169f70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009fa0 tx=0x7f7bac009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00ed20 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac00ee80 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb416d6a0 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac014670 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.047+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb416a4b0 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.048+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb416dcf0 con 0x7f7bb40adb60 2023-10-06T11:14:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.049+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bac0149e0 con 0x7f7bb40adb60 2023-10-06T11:14:16.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.049+0000 7f7bb0ff9700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ba0066f30 0x7f7ba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.049+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7bac084c00 con 0x7f7bb40adb60 2023-10-06T11:14:16.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.050+0000 7f7bb3fff700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ba0066f30 0x7f7ba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.050+0000 7f7bb3fff700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ba0066f30 0x7f7ba00693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406f2c0 tx=0x7f7ba8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.054+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bac08b080 con 0x7f7bb40adb60 2023-10-06T11:14:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.250+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7bb4064a90 con 0x7f7bb40adb60 2023-10-06T11:14:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.251+0000 7f7bb0ff9700 1 -- 172.21.15.55:0/3342353612 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7bac051f20 con 0x7f7bb40adb60 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:16.253 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ba0066f30 msgr2=0x7f7ba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ba0066f30 0x7f7ba00693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7bb406f2c0 tx=0x7f7ba8016000 comp rx=0 tx=0).stop 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 msgr2=0x7f7bb4169f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb4169f70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009fa0 tx=0x7f7bac009880 comp rx=0 tx=0).stop 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 shutdown_connections 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ba0066f30 0x7f7ba00693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb40adb60 0x7f7bb4169f70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bb40ce6d0 0x7f7bb40c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 --2- 172.21.15.55:0/3342353612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bb40ca370 0x7f7bb414b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 >> 172.21.15.55:0/3342353612 conn(0x7f7bb40707d0 msgr2=0x7f7bb415a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 shutdown_connections 2023-10-06T11:14:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.253+0000 7f7bbb123700 1 -- 172.21.15.55:0/3342353612 wait complete. 2023-10-06T11:14:16.266 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:14:16.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:14:16.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T11:14:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.388+0000 7fd8483a1700 1 Processor -- start 2023-10-06T11:14:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.388+0000 7fd8483a1700 1 -- start start 2023-10-06T11:14:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.388+0000 7fd8483a1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 0x7fd840157740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd8483a1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8400cdd40 con 0x7fd84015d350 2023-10-06T11:14:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd8483a1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84015b0b0 con 0x7fd840159f80 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd8483a1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400b2c80 con 0x7fd84015d720 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84613d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd84015d350 0x7fd8400cd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55816/0 (socket says 172.21.15.55:55816) 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84613d700 1 -- 172.21.15.55:0/90684012 learned_addr learned my addr 172.21.15.55:0/90684012 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84593c700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 0x7fd840157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044035445 0 0) 0x7fd8400cdd40 con 0x7fd84015d350 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd828003570 con 0x7fd84015d350 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768508406 0 0) 0x7fd828003570 con 0x7fd84015d350 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 msgr2=0x7fd840157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 0x7fd840157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 >> v1:172.21.15.142:6789/0 conn(0x7fd840159f80 legacy=0x7fd84015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84015b390 con 0x7fd84015d350 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fd8300015f0 con 0x7fd84015d350 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 >> v1:172.21.15.55:6789/0 conn(0x7fd84015d350 legacy=0x7fd8400cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828003a90 0x7fd828003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd828004810 0x7fd828004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 0x7fd8280051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400b2c80 con 0x7fd828004810 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82800bb60 con 0x7fd828003a90 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82800bd20 con 0x7fd84015d720 2023-10-06T11:14:16.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84593c700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd828004810 0x7fd828004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.389+0000 7fd84613d700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828003a90 0x7fd828003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84693e700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 0x7fd8280051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84593c700 1 -- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 msgr2=0x7fd8280051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84593c700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84015d720 0x7fd8280051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84593c700 1 -- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828003a90 msgr2=0x7fd828003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84593c700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828003a90 0x7fd828003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84593c700 1 -- 172.21.15.55:0/90684012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828003570 con 0x7fd828004810 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84593c700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd828004810 0x7fd828004c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd834009c00 tx=0x7fd8340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb98ee1a1c4142b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400e710 con 0x7fd828004810 2023-10-06T11:14:16.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83400e870 con 0x7fd828004810 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.390+0000 7fd84513b700 1 -- 172.21.15.55:0/90684012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400ec30 con 0x7fd828004810 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd8483a1700 1 -- 172.21.15.55:0/90684012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd828004810 msgr2=0x7fd828004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd8483a1700 1 --2- 172.21.15.55:0/90684012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd828004810 0x7fd828004c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd834009c00 tx=0x7fd8340091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd84693e700 1 -- 172.21.15.55:0/90684012 reap_dead start 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd8483a1700 1 -- 172.21.15.55:0/90684012 shutdown_connections 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd8483a1700 1 -- 172.21.15.55:0/90684012 >> 172.21.15.55:0/90684012 conn(0x7fd840068310 msgr2=0x7fd840068710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd8483a1700 1 -- 172.21.15.55:0/90684012 shutdown_connections 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.391+0000 7fd8483a1700 1 -- 172.21.15.55:0/90684012 wait complete. 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.392+0000 7fd8483a1700 1 Processor -- start 2023-10-06T11:14:16.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.392+0000 7fd8483a1700 1 -- start start 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828004810 0x7fd8400b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 0x7fd8400b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd840144f80 0x7fd840145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400b4230 con 0x7fd8400b4820 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400b51b0 con 0x7fd828004810 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd840145940 con 0x7fd840144f80 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 0x7fd8400b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 0x7fd8400b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50216/0 (socket says 172.21.15.55:50216) 2023-10-06T11:14:16.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 -- 172.21.15.55:0/750745126 learned_addr learned my addr 172.21.15.55:0/750745126 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84613d700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828004810 0x7fd8400b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84693e700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd840144f80 0x7fd840145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 -- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd840144f80 msgr2=0x7fd840145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd840144f80 0x7fd840145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 -- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828004810 msgr2=0x7fd8400b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828004810 0x7fd8400b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 -- 172.21.15.55:0/750745126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400b3620 con 0x7fd8400b4820 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd84593c700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 0x7fd8400b4c70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd82800bb30 tx=0x7fd83401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834022070 con 0x7fd8400b4820 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83400e9e0 con 0x7fd8400b4820 2023-10-06T11:14:16.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83401c450 con 0x7fd8400b4820 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8400b3900 con 0x7fd8400b4820 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.393+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8400b3ec0 con 0x7fd8400b4820 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.394+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8400b43a0 con 0x7fd8400b4820 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.395+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd83401c8a0 con 0x7fd8400b4820 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.395+0000 7fd83e7fc700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.395+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd834085b90 con 0x7fd8400b4820 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.395+0000 7fd84613d700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.396+0000 7fd84613d700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd82c066f30 0x7fd82c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8300011d0 tx=0x7fd830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.399+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd834052f70 con 0x7fd8400b4820 2023-10-06T11:14:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.591+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd840064a90 con 0x7fd8400b4820 2023-10-06T11:14:16.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.948+0000 7fd83e7fc700 1 -- 172.21.15.55:0/750745126 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd8340170b0 con 0x7fd8400b4820 2023-10-06T11:14:16.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.951+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd82c066f30 msgr2=0x7fd82c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.951+0000 7fd8483a1700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd82c066f30 0x7fd82c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8300011d0 tx=0x7fd830009040 comp rx=0 tx=0).stop 2023-10-06T11:14:16.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.951+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 msgr2=0x7fd8400b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.951+0000 7fd8483a1700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 0x7fd8400b4c70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd82800bb30 tx=0x7fd83401a000 comp rx=0 tx=0).stop 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 shutdown_connections 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd82c066f30 0x7fd82c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd840144f80 0x7fd840145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd828004810 0x7fd8400b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 --2- 172.21.15.55:0/750745126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8400b4820 0x7fd8400b4c70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 >> 172.21.15.55:0/750745126 conn(0x7fd840068310 msgr2=0x7fd8400c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 shutdown_connections 2023-10-06T11:14:16.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:16.952+0000 7fd8483a1700 1 -- 172.21.15.55:0/750745126 wait complete. 2023-10-06T11:14:16.957 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:14:16.967 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:14:17.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.094+0000 7f579b59e700 1 Processor -- start 2023-10-06T11:14:17.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.094+0000 7f579b59e700 1 -- start start 2023-10-06T11:14:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579b59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f579c0cd3c0 0x7f579c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579b59e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f579c0b29f0 0x7f579c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c0cc970 con 0x7f579c0b2620 2023-10-06T11:14:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579b59e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0cf520 con 0x7f579c0b29f0 2023-10-06T11:14:17.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579b59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0cbd60 con 0x7f579c0cd3c0 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579ad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f579c0b29f0 0x7f579c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579ad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f579c0b29f0 0x7f579c0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50230/0 (socket says 172.21.15.55:50230) 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f579ad9d700 1 -- 172.21.15.55:0/2533973440 learned_addr learned my addr 172.21.15.55:0/2533973440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.095+0000 7f5799d9b700 1 --2- 172.21.15.55:0/2533973440 >> v2:172.21.15.142:3300/0 conn(0x7f579c0cd3c0 0x7f579c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579ad9d700 1 -- 172.21.15.55:0/2533973440 >> v2:172.21.15.142:3300/0 conn(0x7f579c0cd3c0 msgr2=0x7f579c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579ad9d700 1 --2- 172.21.15.55:0/2533973440 >> v2:172.21.15.142:3300/0 conn(0x7f579c0cd3c0 0x7f579c0ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579ad9d700 1 -- 172.21.15.55:0/2533973440 >> v1:172.21.15.142:6789/0 conn(0x7f579c0b2620 legacy=0x7f579c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579ad9d700 1 -- 172.21.15.55:0/2533973440 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0cc040 con 0x7f579c0b29f0 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579ad9d700 1 --2- 172.21.15.55:0/2533973440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b29f0 0x7f579c0cefe0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f579c0b62d0 tx=0x7f578c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf7212435686323 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579959a700 1 -- 172.21.15.55:0/2533973440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00e070 con 0x7f579c0b29f0 2023-10-06T11:14:17.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579959a700 1 -- 172.21.15.55:0/2533973440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00ba10 con 0x7f579c0b29f0 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579959a700 1 -- 172.21.15.55:0/2533973440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0092e0 con 0x7f579c0b29f0 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579b59e700 1 -- 172.21.15.55:0/2533973440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b29f0 msgr2=0x7f579c0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.096+0000 7f579b59e700 1 --2- 172.21.15.55:0/2533973440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b29f0 0x7f579c0cefe0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f579c0b62d0 tx=0x7f578c009840 comp rx=0 tx=0).stop 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.097+0000 7f579b59e700 1 -- 172.21.15.55:0/2533973440 shutdown_connections 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.097+0000 7f579b59e700 1 --2- 172.21.15.55:0/2533973440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b29f0 0x7f579c0cefe0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.097+0000 7f579b59e700 1 --2- 172.21.15.55:0/2533973440 >> v2:172.21.15.142:3300/0 conn(0x7f579c0cd3c0 0x7f579c0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.097+0000 7f579b59e700 1 -- 172.21.15.55:0/2533973440 >> 172.21.15.55:0/2533973440 conn(0x7f579c099520 msgr2=0x7f579c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.097+0000 7f579b59e700 1 -- 172.21.15.55:0/2533973440 shutdown_connections 2023-10-06T11:14:17.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.097+0000 7f579b59e700 1 -- 172.21.15.55:0/2533973440 wait complete. 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 Processor -- start 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 -- start start 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 0x7f579c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f579c0b29f0 0x7f579c068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f579c0cd3c0 0x7f579c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0b55c0 con 0x7f579c0b2620 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0c77d0 con 0x7f579c0cd3c0 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.098+0000 7f579b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0c8320 con 0x7f579c0b29f0 2023-10-06T11:14:17.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 0x7f579c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 0x7f579c0b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50232/0 (socket says 172.21.15.55:50232) 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 -- 172.21.15.55:0/591888255 learned_addr learned my addr 172.21.15.55:0/591888255 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 -- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f579c0b29f0 msgr2=0x7f579c068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f579c0b29f0 0x7f579c068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 -- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f579c0cd3c0 msgr2=0x7f579c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f579c0cd3c0 0x7f579c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 -- 172.21.15.55:0/591888255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009ae0 con 0x7f579c0b2620 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579a59c700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 0x7f579c0b4c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f579400b610 tx=0x7f57940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400f510 con 0x7f579c0b2620 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400f670 con 0x7f579c0b2620 2023-10-06T11:14:17.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c0c79f0 con 0x7f579c0b2620 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400fa30 con 0x7f579c0b2620 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.099+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c0c7fb0 con 0x7f579c0b2620 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.100+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c05f230 con 0x7f579c0b2620 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.101+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f579401a400 con 0x7f579c0b2620 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.101+0000 7f57927fc700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f577c066f30 0x7f577c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.101+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f5794084030 con 0x7f579c0b2620 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.101+0000 7f5799d9b700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f577c066f30 0x7f577c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.102+0000 7f5799d9b700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f577c066f30 0x7f577c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f579c0b2110 tx=0x7f5784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:17.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.106+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5794051260 con 0x7f579c0b2620 2023-10-06T11:14:17.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.303+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f579c0cc320 con 0x7f579c0b2620 2023-10-06T11:14:17.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.948+0000 7f57927fc700 1 -- 172.21.15.55:0/591888255 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5794054880 con 0x7f579c0b2620 2023-10-06T11:14:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.954+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f577c066f30 msgr2=0x7f577c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.954+0000 7f579b59e700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f577c066f30 0x7f577c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f579c0b2110 tx=0x7f5784008040 comp rx=0 tx=0).stop 2023-10-06T11:14:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.954+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 msgr2=0x7f579c0b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.954+0000 7f579b59e700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 0x7f579c0b4c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f579400b610 tx=0x7f57940090f0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 shutdown_connections 2023-10-06T11:14:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f577c066f30 0x7f577c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f579c0b2620 0x7f579c0b4c50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f579c0cd3c0 0x7f579c069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 --2- 172.21.15.55:0/591888255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f579c0b29f0 0x7f579c068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 >> 172.21.15.55:0/591888255 conn(0x7f579c099520 msgr2=0x7f579c0c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.955+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 shutdown_connections 2023-10-06T11:14:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:17.956+0000 7f579b59e700 1 -- 172.21.15.55:0/591888255 wait complete. 2023-10-06T11:14:17.967 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:14:17.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:14:18.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.105+0000 7f18b159d700 1 Processor -- start 2023-10-06T11:14:18.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.105+0000 7f18b159d700 1 -- start start 2023-10-06T11:14:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18b159d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18ac1598a0 0x7f18ac0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18b159d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0cf5d0 con 0x7f18ac0cbc70 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18b159d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0cf8b0 con 0x7f18ac1594d0 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18b159d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac0cfb90 con 0x7f18ac1598a0 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18ab7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f18ac0cbc70 0x7f18ac0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55818/0 (socket says 172.21.15.55:55818) 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18ab7fe700 1 -- 172.21.15.55:0/2201874111 learned_addr learned my addr 172.21.15.55:0/2201874111 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906012546 0 0) 0x7f18ac0cf5d0 con 0x7f18ac0cbc70 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18aa7fc700 1 --2- 172.21.15.55:0/2201874111 >> v2:172.21.15.142:3300/0 conn(0x7f18ac1598a0 0x7f18ac0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1894003570 con 0x7f18ac0cbc70 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1084749731 0 0) 0x7f1894003570 con 0x7f18ac0cbc70 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 >> v2:172.21.15.142:3300/0 conn(0x7f18ac1598a0 msgr2=0x7f18ac0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 --2- 172.21.15.55:0/2201874111 >> v2:172.21.15.142:3300/0 conn(0x7f18ac1598a0 0x7f18ac0ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 >> v1:172.21.15.142:6789/0 conn(0x7f18ac1594d0 legacy=0x7f18ac0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0cfe70 con 0x7f18ac0cbc70 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.106+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f18a40017f0 con 0x7f18ac0cbc70 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 >> v1:172.21.15.55:6789/0 conn(0x7f18ac0cbc70 legacy=0x7f18ac0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1894003a60 0x7f1894003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1894004810 0x7f1894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940051c0 0x7f189400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0cfb90 con 0x7f18940051c0 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189400c0d0 con 0x7f1894003a60 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189400c290 con 0x7f1894004810 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940051c0 0x7f189400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18aa7fc700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1894004810 0x7f1894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18aaffd700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1894003a60 0x7f1894003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 -- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1894004810 msgr2=0x7f1894004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1894004810 0x7f1894004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 -- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1894003a60 msgr2=0x7f1894003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1894003a60 0x7f1894003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 -- 172.21.15.55:0/2201874111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894003570 con 0x7f18940051c0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 -- 172.21.15.55:0/2201874111 reap_dead start 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18ab7fe700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940051c0 0x7f189400ba60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f18ac06f9a0 tx=0x7f18a40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d502f4a0960c42e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40070d0 con 0x7f18940051c0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4007230 con 0x7f18940051c0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.107+0000 7f18a9ffb700 1 -- 172.21.15.55:0/2201874111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40075d0 con 0x7f18940051c0 2023-10-06T11:14:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 -- 172.21.15.55:0/2201874111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940051c0 msgr2=0x7f189400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940051c0 0x7f189400ba60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f18ac06f9a0 tx=0x7f18a40021d0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 -- 172.21.15.55:0/2201874111 shutdown_connections 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 --2- 172.21.15.55:0/2201874111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18940051c0 0x7f189400ba60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 -- 172.21.15.55:0/2201874111 >> 172.21.15.55:0/2201874111 conn(0x7f18ac089e50 msgr2=0x7f18ac099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 -- 172.21.15.55:0/2201874111 shutdown_connections 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.108+0000 7f18b159d700 1 -- 172.21.15.55:0/2201874111 wait complete. 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.109+0000 7f18b159d700 1 Processor -- start 2023-10-06T11:14:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.109+0000 7f18b159d700 1 -- start start 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18b159d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18940051c0 0x7f18ac14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18b159d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 0x7f18ac14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18b159d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18ac149840 0x7f18ac149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18b159d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15ae40 con 0x7f18ac159cc0 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18b159d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15a230 con 0x7f18ac149840 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18b159d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15a510 con 0x7f18940051c0 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 0x7f18ac14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 0x7f18ac14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50258/0 (socket says 172.21.15.55:50258) 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 -- 172.21.15.55:0/548333082 learned_addr learned my addr 172.21.15.55:0/548333082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aaffd700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18940051c0 0x7f18ac14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18ab7fe700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18ac149840 0x7f18ac149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 -- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18940051c0 msgr2=0x7f18ac14ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18940051c0 0x7f18ac14ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 -- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18ac149840 msgr2=0x7f18ac149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18ac149840 0x7f18ac149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.110+0000 7f18aa7fc700 1 -- 172.21.15.55:0/548333082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac15a7f0 con 0x7f18ac159cc0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.111+0000 7f18aa7fc700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 0x7f18ac14e330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009fd0 tx=0x7f18a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.111+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a000f940 con 0x7f18ac159cc0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.111+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a000faa0 con 0x7f18ac159cc0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.111+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac15aad0 con 0x7f18ac159cc0 2023-10-06T11:14:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.111+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a000fe20 con 0x7f18ac159cc0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.111+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac14a3b0 con 0x7f18ac159cc0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.112+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac14a690 con 0x7f18ac159cc0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.112+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18a0014650 con 0x7f18ac159cc0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.112+0000 7f1892ffd700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1898066f30 0x7f18980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.113+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f18a0018030 con 0x7f18ac159cc0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.113+0000 7f18aaffd700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1898066f30 0x7f18980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.113+0000 7f18aaffd700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1898066f30 0x7f18980693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f189c007e40 tx=0x7f189c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.117+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18a0052120 con 0x7f18ac159cc0 2023-10-06T11:14:18.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.357+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18ac064a90 con 0x7f18ac159cc0 2023-10-06T11:14:18.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.971+0000 7f1892ffd700 1 -- 172.21.15.55:0/548333082 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v15) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18a0055740 con 0x7f18ac159cc0 2023-10-06T11:14:18.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.977+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1898066f30 msgr2=0x7f18980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.977+0000 7f18b159d700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1898066f30 0x7f18980693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f189c007e40 tx=0x7f189c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:18.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.977+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 msgr2=0x7f18ac14e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.977+0000 7f18b159d700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 0x7f18ac14e330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009fd0 tx=0x7f18a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.978+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 shutdown_connections 2023-10-06T11:14:18.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.978+0000 7f18b159d700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1898066f30 0x7f18980693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.978+0000 7f18b159d700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18ac149840 0x7f18ac149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.978+0000 7f18b159d700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18940051c0 0x7f18ac14ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.978+0000 7f18b159d700 1 --2- 172.21.15.55:0/548333082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18ac159cc0 0x7f18ac14e330 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.978+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 >> 172.21.15.55:0/548333082 conn(0x7f18ac089e50 msgr2=0x7f18ac0c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:18.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.979+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 shutdown_connections 2023-10-06T11:14:18.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:18.979+0000 7f18b159d700 1 -- 172.21.15.55:0/548333082 wait complete. 2023-10-06T11:14:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T11:14:18.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.116+0000 7f517dbc1700 1 Processor -- start 2023-10-06T11:14:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.116+0000 7f517dbc1700 1 -- start start 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.117+0000 7f517dbc1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 0x7f51780aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.117+0000 7f517dbc1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 0x7f51780aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.117+0000 7f517dbc1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51780b0c60 con 0x7f51780b0760 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.117+0000 7f517dbc1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51780b0f40 con 0x7f51780b49a0 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.117+0000 7f517dbc1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51780b1220 con 0x7f5178159560 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f5176ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 0x7f51780aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 0x7f51780aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 0x7f51780aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:60744/0 (socket says 172.21.15.55:60744) 2023-10-06T11:14:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f5177fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f51780b0760 0x7f51780b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:59820/0 (socket says 172.21.15.55:59820) 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 -- 172.21.15.55:0/516470488 learned_addr learned my addr 172.21.15.55:0/516470488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f5176ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 0x7f51780aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:55126/0 (socket says 172.21.15.55:55126) 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 -- 172.21.15.55:0/516470488 >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 msgr2=0x7f51780aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 --2- 172.21.15.55:0/516470488 >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 0x7f51780aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 -- 172.21.15.55:0/516470488 >> v1:172.21.15.142:6789/0 conn(0x7f51780b0760 legacy=0x7f51780b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 -- 172.21.15.55:0/516470488 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780b1500 con 0x7f5178159560 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f5176ffd700 1 --2- 172.21.15.55:0/516470488 >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 0x7f51780aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51777fe700 1 --2- 172.21.15.55:0/516470488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 0x7f51780aa530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5168009990 tx=0x7f5168009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5497961f85a4e0f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51767fc700 1 -- 172.21.15.55:0/516470488 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168009e80 con 0x7f5178159560 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51767fc700 1 -- 172.21.15.55:0/516470488 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5168005c10 con 0x7f5178159560 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.118+0000 7f51767fc700 1 -- 172.21.15.55:0/516470488 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516800b650 con 0x7f5178159560 2023-10-06T11:14:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 -- 172.21.15.55:0/516470488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 msgr2=0x7f51780aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 --2- 172.21.15.55:0/516470488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 0x7f51780aa530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5168009990 tx=0x7f5168009220 comp rx=0 tx=0).stop 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 -- 172.21.15.55:0/516470488 shutdown_connections 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 --2- 172.21.15.55:0/516470488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5178159560 0x7f51780aa530 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 --2- 172.21.15.55:0/516470488 >> v2:172.21.15.142:3300/0 conn(0x7f51780b49a0 0x7f51780aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 -- 172.21.15.55:0/516470488 >> 172.21.15.55:0/516470488 conn(0x7f51780997f0 msgr2=0x7f517806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 -- 172.21.15.55:0/516470488 shutdown_connections 2023-10-06T11:14:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.119+0000 7f517dbc1700 1 -- 172.21.15.55:0/516470488 wait complete. 2023-10-06T11:14:19.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.120+0000 7f517dbc1700 1 Processor -- start 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.120+0000 7f517dbc1700 1 -- start start 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f517dbc1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780b0760 0x7f51780c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f517dbc1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51780b49a0 0x7f5178157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f517dbc1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 0x7f5178169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f517dbc1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5178157fe0 con 0x7f5178159560 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f517dbc1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517816d280 con 0x7f51780b0760 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f517dbc1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517816cf30 con 0x7f51780b49a0 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5176ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51780b49a0 0x7f5178157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 0x7f5178169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f51777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780b0760 0x7f51780c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 0x7f5178169930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50274/0 (socket says 172.21.15.55:50274) 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5176ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51780b49a0 0x7f5178157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:60748/0 (socket says 172.21.15.55:60748) 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 -- 172.21.15.55:0/1932888774 learned_addr learned my addr 172.21.15.55:0/1932888774 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 -- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51780b49a0 msgr2=0x7f5178157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51780b49a0 0x7f5178157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 -- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780b0760 msgr2=0x7f51780c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.121+0000 7f5177fff700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780b0760 0x7f51780c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f5177fff700 1 -- 172.21.15.55:0/1932888774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c009420 con 0x7f5178159560 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f51777fe700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780b0760 0x7f51780c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f5177fff700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 0x7f5178169930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f517000cd00 tx=0x7f5170001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517000ce60 con 0x7f5178159560 2023-10-06T11:14:19.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5170005df0 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5168009480 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517000ab00 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.122+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517816a460 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.123+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5178064a90 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.123+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51700070f0 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.124+0000 7f515f7fe700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5164066f30 0x7f51640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.124+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f51700847c0 con 0x7f5178159560 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.124+0000 7f51777fe700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5164066f30 0x7f51640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.124+0000 7f51777fe700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5164066f30 0x7f51640693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51780d1110 tx=0x7f5168016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.128+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5170051810 con 0x7f5178159560 2023-10-06T11:14:19.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.322+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51780b17e0 con 0x7f5178159560 2023-10-06T11:14:19.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.322+0000 7f515f7fe700 1 -- 172.21.15.55:0/1932888774 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f5170082e60 con 0x7f5178159560 2023-10-06T11:14:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:19.324 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:18.359133+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.621851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.333304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:19.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5164066f30 msgr2=0x7f51640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5164066f30 0x7f51640693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51780d1110 tx=0x7f5168016000 comp rx=0 tx=0).stop 2023-10-06T11:14:19.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 msgr2=0x7f5178169930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 0x7f5178169930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f517000cd00 tx=0x7f5170001b10 comp rx=0 tx=0).stop 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 shutdown_connections 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5164066f30 0x7f51640693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5178159560 0x7f5178169930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51780b0760 0x7f51780c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 --2- 172.21.15.55:0/1932888774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51780b49a0 0x7f5178157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 >> 172.21.15.55:0/1932888774 conn(0x7f51780997f0 msgr2=0x7f51780cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 shutdown_connections 2023-10-06T11:14:19.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.324+0000 7f517dbc1700 1 -- 172.21.15.55:0/1932888774 wait complete. 2023-10-06T11:14:19.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.456+0000 7f64915f3700 1 Processor -- start 2023-10-06T11:14:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.456+0000 7f64915f3700 1 -- start start 2023-10-06T11:14:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f64915f3700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f648c159440 0x7f648c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f64915f3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f64915f3700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0cb7a0 con 0x7f648c0cc170 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f64915f3700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0b0860 con 0x7f648c159440 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f64915f3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0cb150 con 0x7f648c0b35d0 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648affd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f648c159440 0x7f648c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f648c0cc170 0x7f648c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55826/0 (socket says 172.21.15.55:55826) 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648b7fe700 1 -- 172.21.15.55:0/3256736735 learned_addr learned my addr 172.21.15.55:0/3256736735 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648affd700 1 -- 172.21.15.55:0/3256736735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 msgr2=0x7f648c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648a7fc700 1 --2- 172.21.15.55:0/3256736735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f6489ffb700 1 -- 172.21.15.55:0/3256736735 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739628188 0 0) 0x7f648c0cb7a0 con 0x7f648c0cc170 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648affd700 1 --2- 172.21.15.55:0/3256736735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648affd700 1 -- 172.21.15.55:0/3256736735 >> v1:172.21.15.55:6789/0 conn(0x7f648c0cc170 legacy=0x7f648c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.457+0000 7f648affd700 1 -- 172.21.15.55:0/3256736735 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0cb430 con 0x7f648c159440 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f648affd700 1 --2- 172.21.15.55:0/3256736735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c159440 0x7f648c0b3090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6484009e60 tx=0x7f6484009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7826a36a828f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f6489ffb700 1 -- 172.21.15.55:0/3256736735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400e070 con 0x7f648c159440 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f6489ffb700 1 -- 172.21.15.55:0/3256736735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400bc30 con 0x7f648c159440 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f6489ffb700 1 -- 172.21.15.55:0/3256736735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484012430 con 0x7f648c159440 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 -- 172.21.15.55:0/3256736735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c159440 msgr2=0x7f648c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 --2- 172.21.15.55:0/3256736735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c159440 0x7f648c0b3090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6484009e60 tx=0x7f6484009780 comp rx=0 tx=0).stop 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 -- 172.21.15.55:0/3256736735 shutdown_connections 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 --2- 172.21.15.55:0/3256736735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c159440 0x7f648c0b3090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 --2- 172.21.15.55:0/3256736735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 -- 172.21.15.55:0/3256736735 >> 172.21.15.55:0/3256736735 conn(0x7f648c06ece0 msgr2=0x7f648c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 -- 172.21.15.55:0/3256736735 shutdown_connections 2023-10-06T11:14:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.458+0000 7f64915f3700 1 -- 172.21.15.55:0/3256736735 wait complete. 2023-10-06T11:14:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 Processor -- start 2023-10-06T11:14:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 -- start start 2023-10-06T11:14:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 0x7f648c1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f648c159440 0x7f648c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0af710 con 0x7f648c0cc170 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c8040 con 0x7f648c159440 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f64915f3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c7450 con 0x7f648c0b35d0 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f648a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 0x7f648c1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f648a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 0x7f648c1541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50288/0 (socket says 172.21.15.55:50288) 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.460+0000 7f648a7fc700 1 -- 172.21.15.55:0/1856264234 learned_addr learned my addr 172.21.15.55:0/1856264234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648affd700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648b7fe700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f648c159440 0x7f648c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648a7fc700 1 -- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 msgr2=0x7f648c1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648a7fc700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648a7fc700 1 -- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f648c159440 msgr2=0x7f648c1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648a7fc700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f648c159440 0x7f648c1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648a7fc700 1 -- 172.21.15.55:0/1856264234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484009a20 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f648a7fc700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 0x7f648c1541f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f647400c800 tx=0x7f6474008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474011600 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474011760 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474011b20 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c0c7710 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.461+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c0c7cd0 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.462+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c05f230 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.462+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64740193f0 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.463+0000 7f6482ffd700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f646c066f30 0x7f646c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.463+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6474084b00 con 0x7f648c0cc170 2023-10-06T11:14:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.463+0000 7f648affd700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f646c066f30 0x7f646c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.464+0000 7f648affd700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f646c066f30 0x7f646c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6484009e60 tx=0x7f6484019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.467+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6474051ad0 con 0x7f648c0cc170 2023-10-06T11:14:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.662+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f648c0c8180 con 0x7f648c0cc170 2023-10-06T11:14:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.663+0000 7f6482ffd700 1 -- 172.21.15.55:0/1856264234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f648c0c8180 con 0x7f648c0cc170 2023-10-06T11:14:19.665 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:19.666 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:18.359133+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.621851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.333304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:19.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.665+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f646c066f30 msgr2=0x7f646c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.665+0000 7f64915f3700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f646c066f30 0x7f646c0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6484009e60 tx=0x7f6484019000 comp rx=0 tx=0).stop 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.665+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 msgr2=0x7f648c1541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.665+0000 7f64915f3700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 0x7f648c1541f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f647400c800 tx=0x7f6474008040 comp rx=0 tx=0).stop 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 shutdown_connections 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f646c066f30 0x7f646c0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f648c159440 0x7f648c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f648c0b35d0 0x7f648c1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 --2- 172.21.15.55:0/1856264234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c0cc170 0x7f648c1541f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 >> 172.21.15.55:0/1856264234 conn(0x7f648c06ece0 msgr2=0x7f648c1557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 shutdown_connections 2023-10-06T11:14:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.666+0000 7f64915f3700 1 -- 172.21.15.55:0/1856264234 wait complete. 2023-10-06T11:14:19.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:14:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.799+0000 7fdc3d686700 1 Processor -- start 2023-10-06T11:14:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.799+0000 7fdc3d686700 1 -- start start 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.800+0000 7fdc3d686700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc380cc5f0 0x7fdc381621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.800+0000 7fdc3d686700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc380cca70 con 0x7fdc380b0a10 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.800+0000 7fdc3d686700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc380c53c0 con 0x7fdc380b0640 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.800+0000 7fdc3d686700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc380ca790 con 0x7fdc380cc5f0 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.800+0000 7fdc367fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc380b0a10 0x7fdc380cbee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55828/0 (socket says 172.21.15.55:55828) 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.800+0000 7fdc367fc700 1 -- 172.21.15.55:0/2378717522 learned_addr learned my addr 172.21.15.55:0/2378717522 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc377fe700 1 --2- 172.21.15.55:0/2378717522 >> v2:172.21.15.142:3300/0 conn(0x7fdc380cc5f0 0x7fdc381621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678222842 0 0) 0x7fdc380cca70 con 0x7fdc380b0a10 2023-10-06T11:14:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc24003570 con 0x7fdc380b0a10 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021946574 0 0) 0x7fdc380c53c0 con 0x7fdc380b0640 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc380cca70 con 0x7fdc380b0640 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc377fe700 1 -- 172.21.15.55:0/2378717522 >> v1:172.21.15.142:6789/0 conn(0x7fdc380b0640 legacy=0x7fdc380cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926255246 0 0) 0x7fdc24003570 con 0x7fdc380b0a10 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc377fe700 1 -- 172.21.15.55:0/2378717522 >> v1:172.21.15.55:6789/0 conn(0x7fdc380b0a10 legacy=0x7fdc380cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc377fe700 1 -- 172.21.15.55:0/2378717522 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc380ccd00 con 0x7fdc380cc5f0 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc377fe700 1 --2- 172.21.15.55:0/2378717522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380cc5f0 0x7fdc381621f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009e60 tx=0x7fdc28009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6802f97896867944 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800e070 con 0x7fdc380cc5f0 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800b7a0 con 0x7fdc380cc5f0 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.801+0000 7fdc35ffb700 1 -- 172.21.15.55:0/2378717522 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20001470 con 0x7fdc380cc5f0 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 -- 172.21.15.55:0/2378717522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380cc5f0 msgr2=0x7fdc381621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2378717522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380cc5f0 0x7fdc381621f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009e60 tx=0x7fdc28009780 comp rx=0 tx=0).stop 2023-10-06T11:14:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 -- 172.21.15.55:0/2378717522 shutdown_connections 2023-10-06T11:14:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2378717522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380cc5f0 0x7fdc381621f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 -- 172.21.15.55:0/2378717522 >> 172.21.15.55:0/2378717522 conn(0x7fdc38087fc0 msgr2=0x7fdc380ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 -- 172.21.15.55:0/2378717522 shutdown_connections 2023-10-06T11:14:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.802+0000 7fdc3d686700 1 -- 172.21.15.55:0/2378717522 wait complete. 2023-10-06T11:14:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.803+0000 7fdc3d686700 1 Processor -- start 2023-10-06T11:14:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.803+0000 7fdc3d686700 1 -- start start 2023-10-06T11:14:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc3d686700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380b0640 0x7fdc38154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc3d686700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 0x7fdc38159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc3d686700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc380cc5f0 0x7fdc3815b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc3d686700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3809c090 con 0x7fdc380b0a10 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc3d686700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc38154f70 con 0x7fdc380b0640 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc3d686700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3815a480 con 0x7fdc380cc5f0 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 0x7fdc38159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 0x7fdc38159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50294/0 (socket says 172.21.15.55:50294) 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 -- 172.21.15.55:0/2537378952 learned_addr learned my addr 172.21.15.55:0/2537378952 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc36ffd700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380b0640 0x7fdc38154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc377fe700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc380cc5f0 0x7fdc3815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 -- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc380cc5f0 msgr2=0x7fdc3815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc380cc5f0 0x7fdc3815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 -- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380b0640 msgr2=0x7fdc38154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380b0640 0x7fdc38154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.804+0000 7fdc367fc700 1 -- 172.21.15.55:0/2537378952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009a20 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.805+0000 7fdc367fc700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 0x7fdc38159f40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c810 tx=0x7fdc20001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.805+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20007360 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.805+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc200074e0 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.805+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc38168d90 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.805+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20004850 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.805+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc381684e0 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.806+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3816b430 con 0x7fdc380b0a10 2023-10-06T11:14:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.806+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc20004be0 con 0x7fdc380b0a10 2023-10-06T11:14:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.807+0000 7fdc2effd700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc18066f30 0x7fdc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.807+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc20083d80 con 0x7fdc380b0a10 2023-10-06T11:14:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.807+0000 7fdc36ffd700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc18066f30 0x7fdc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.807+0000 7fdc36ffd700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc18066f30 0x7fdc180693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc3806d0c0 tx=0x7fdc30007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:19.811+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc3816b430 con 0x7fdc380b0a10 2023-10-06T11:14:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.054+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdc3816b430 con 0x7fdc380b0a10 2023-10-06T11:14:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.978+0000 7fdc2effd700 1 -- 172.21.15.55:0/2537378952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdc3816b430 con 0x7fdc380b0a10 2023-10-06T11:14:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc18066f30 msgr2=0x7fdc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc18066f30 0x7fdc180693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc3806d0c0 tx=0x7fdc30007d40 comp rx=0 tx=0).stop 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 msgr2=0x7fdc38159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 0x7fdc38159f40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c810 tx=0x7fdc20001a30 comp rx=0 tx=0).stop 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 shutdown_connections 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc18066f30 0x7fdc180693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc380cc5f0 0x7fdc3815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc380b0640 0x7fdc38154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 --2- 172.21.15.55:0/2537378952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc380b0a10 0x7fdc38159f40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 >> 172.21.15.55:0/2537378952 conn(0x7fdc38087fc0 msgr2=0x7fdc38156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 shutdown_connections 2023-10-06T11:14:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:20.981+0000 7fdc3d686700 1 -- 172.21.15.55:0/2537378952 wait complete. 2023-10-06T11:14:20.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:14:21.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.127+0000 7f4b222d9700 1 Processor -- start 2023-10-06T11:14:21.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.127+0000 7f4b222d9700 1 -- start start 2023-10-06T11:14:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.128+0000 7f4b222d9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b1c159bd0 0x7f4b1c0d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.128+0000 7f4b222d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0d0810 0x7f4b1c163200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.128+0000 7f4b222d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0b5ef0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.128+0000 7f4b222d9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b3600 con 0x7f4b1c159bd0 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.128+0000 7f4b222d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0d0c20 con 0x7f4b1c0d0810 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.128+0000 7f4b1b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b1c159bd0 0x7f4b1c0d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b1c159bd0 0x7f4b1c0d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50304/0 (socket says 172.21.15.55:50304) 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/592485929 learned_addr learned my addr 172.21.15.55:0/592485929 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b20876700 1 --2- 172.21.15.55:0/592485929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0d0810 0x7f4b1c163200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/592485929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0d0810 msgr2=0x7f4b1c163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 --2- 172.21.15.55:0/592485929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0d0810 0x7f4b1c163200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/592485929 >> v1:172.21.15.142:6789/0 conn(0x7f4b1c0cd940 legacy=0x7f4b1c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/592485929 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0b6380 con 0x7f4b1c159bd0 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1b7fe700 1 --2- 172.21.15.55:0/592485929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c159bd0 0x7f4b1c0d02d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b040099b0 tx=0x7f4b04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7123d1c088b1df71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1affd700 1 -- 172.21.15.55:0/592485929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400b820 con 0x7f4b1c159bd0 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1affd700 1 -- 172.21.15.55:0/592485929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0400b980 con 0x7f4b1c159bd0 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.129+0000 7f4b1affd700 1 -- 172.21.15.55:0/592485929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400bd20 con 0x7f4b1c159bd0 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 -- 172.21.15.55:0/592485929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c159bd0 msgr2=0x7f4b1c0d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 --2- 172.21.15.55:0/592485929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c159bd0 0x7f4b1c0d02d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b040099b0 tx=0x7f4b04009250 comp rx=0 tx=0).stop 2023-10-06T11:14:21.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 -- 172.21.15.55:0/592485929 shutdown_connections 2023-10-06T11:14:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 --2- 172.21.15.55:0/592485929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0d0810 0x7f4b1c163200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 --2- 172.21.15.55:0/592485929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c159bd0 0x7f4b1c0d02d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 -- 172.21.15.55:0/592485929 >> 172.21.15.55:0/592485929 conn(0x7f4b1c06ece0 msgr2=0x7f4b1c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 -- 172.21.15.55:0/592485929 shutdown_connections 2023-10-06T11:14:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.130+0000 7f4b222d9700 1 -- 172.21.15.55:0/592485929 wait complete. 2023-10-06T11:14:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.131+0000 7f4b222d9700 1 Processor -- start 2023-10-06T11:14:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.131+0000 7f4b222d9700 1 -- start start 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b222d9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 0x7f4b1c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b222d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0d0810 0x7f4b1c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b222d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c159bd0 0x7f4b1c1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b222d9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c1469c0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b222d9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c154d10 con 0x7f4b1c0d0810 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b222d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c154ff0 con 0x7f4b1c159bd0 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 0x7f4b1c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 0x7f4b1c154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50318/0 (socket says 172.21.15.55:50318) 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 -- 172.21.15.55:0/1073831959 learned_addr learned my addr 172.21.15.55:0/1073831959 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1b7fe700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0d0810 0x7f4b1c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b20876700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c159bd0 0x7f4b1c1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 -- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c159bd0 msgr2=0x7f4b1c1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c159bd0 0x7f4b1c1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 -- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0d0810 msgr2=0x7f4b1c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0d0810 0x7f4b1c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 -- 172.21.15.55:0/1073831959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b040094f0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.132+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 0x7f4b1c154380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c5d0 tx=0x7f4b0c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.133+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c011590 con 0x7f4b1c0cd940 2023-10-06T11:14:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.133+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0116f0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.133+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c1552d0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.133+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c011ab0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.133+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c155890 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.134+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c0d0fe0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.134+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b0c01c460 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.134+0000 7f4b13fff700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f60 0x7f4afc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.134+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4b0c0843a0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.135+0000 7f4b1b7fe700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f60 0x7f4afc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.135+0000 7f4b1b7fe700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f60 0x7f4afc069410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b040099b0 tx=0x7f4b04016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:21.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.139+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b0c051370 con 0x7f4b1c0cd940 2023-10-06T11:14:21.283 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-10-06T11:14:21.281+0000 7fccebfc6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:14:21.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.376+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4b1c155ab0 con 0x7f4b1c0cd940 2023-10-06T11:14:21.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.979+0000 7f4b13fff700 1 -- 172.21.15.55:0/1073831959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b0c054990 con 0x7f4b1c0cd940 2023-10-06T11:14:21.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f60 msgr2=0x7f4afc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f60 0x7f4afc069410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b040099b0 tx=0x7f4b04016000 comp rx=0 tx=0).stop 2023-10-06T11:14:21.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 msgr2=0x7f4b1c154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 0x7f4b1c154380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c5d0 tx=0x7f4b0c007f60 comp rx=0 tx=0).stop 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 shutdown_connections 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f60 0x7f4afc069410 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0cd940 0x7f4b1c154380 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c159bd0 0x7f4b1c1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 --2- 172.21.15.55:0/1073831959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0d0810 0x7f4b1c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 >> 172.21.15.55:0/1073831959 conn(0x7f4b1c06ece0 msgr2=0x7f4b1c1527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 shutdown_connections 2023-10-06T11:14:21.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:21.982+0000 7f4b222d9700 1 -- 172.21.15.55:0/1073831959 wait complete. 2023-10-06T11:14:21.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:22.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 Processor -- start 2023-10-06T11:14:22.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 -- start start 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9790159560 0x7f97900aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97900b49a0 0x7f97900aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97900b0760 0x7f97900b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900b0c60 con 0x7f97900b49a0 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900b0f40 con 0x7f9790159560 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.124+0000 7f97951c7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900b1220 con 0x7f97900b0760 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97900b49a0 0x7f97900aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97900b49a0 0x7f97900aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50332/0 (socket says 172.21.15.55:50332) 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 -- 172.21.15.55:0/47728158 learned_addr learned my addr 172.21.15.55:0/47728158 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978f59e700 1 --2- 172.21.15.55:0/47728158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97900b0760 0x7f97900b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978ed9d700 1 --2- 172.21.15.55:0/47728158 >> v2:172.21.15.142:3300/0 conn(0x7f9790159560 0x7f97900aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 -- 172.21.15.55:0/47728158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97900b0760 msgr2=0x7f97900b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 --2- 172.21.15.55:0/47728158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97900b0760 0x7f97900b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 -- 172.21.15.55:0/47728158 >> v2:172.21.15.142:3300/0 conn(0x7f9790159560 msgr2=0x7f97900aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 --2- 172.21.15.55:0/47728158 >> v2:172.21.15.142:3300/0 conn(0x7f9790159560 0x7f97900aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 -- 172.21.15.55:0/47728158 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900b1500 con 0x7f97900b49a0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978e59c700 1 --2- 172.21.15.55:0/47728158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900aaa70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f97780099b0 tx=0x7f9778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef5ca95f9ba226d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978dd9b700 1 -- 172.21.15.55:0/47728158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800b820 con 0x7f97900b49a0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978dd9b700 1 -- 172.21.15.55:0/47728158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800b980 con 0x7f97900b49a0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.125+0000 7f978dd9b700 1 -- 172.21.15.55:0/47728158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800bd20 con 0x7f97900b49a0 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 -- 172.21.15.55:0/47728158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 msgr2=0x7f97900aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 --2- 172.21.15.55:0/47728158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900aaa70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f97780099b0 tx=0x7f9778009250 comp rx=0 tx=0).stop 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 -- 172.21.15.55:0/47728158 shutdown_connections 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 --2- 172.21.15.55:0/47728158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97900b0760 0x7f97900b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 --2- 172.21.15.55:0/47728158 >> v2:172.21.15.142:3300/0 conn(0x7f9790159560 0x7f97900aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 --2- 172.21.15.55:0/47728158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900aaa70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 -- 172.21.15.55:0/47728158 >> 172.21.15.55:0/47728158 conn(0x7f97900997f0 msgr2=0x7f979006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 -- 172.21.15.55:0/47728158 shutdown_connections 2023-10-06T11:14:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.126+0000 7f97951c7700 1 -- 172.21.15.55:0/47728158 wait complete. 2023-10-06T11:14:22.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.127+0000 7f97951c7700 1 Processor -- start 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.127+0000 7f97951c7700 1 -- start start 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f97951c7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97900b0760 0x7f979009ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f97951c7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f97951c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9790159560 0x7f97900cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f97951c7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979015b460 con 0x7f97900b49a0 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f97951c7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979016ac80 con 0x7f97900b0760 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f97951c7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979015ab30 con 0x7f9790159560 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50334/0 (socket says 172.21.15.55:50334) 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 -- 172.21.15.55:0/1341943094 learned_addr learned my addr 172.21.15.55:0/1341943094 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978ed9d700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97900b0760 0x7f979009ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978f59e700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9790159560 0x7f97900cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 -- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9790159560 msgr2=0x7f97900cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9790159560 0x7f97900cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 -- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97900b0760 msgr2=0x7f979009ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97900b0760 0x7f979009ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 -- 172.21.15.55:0/1341943094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780094f0 con 0x7f97900b49a0 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978f59e700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9790159560 0x7f97900cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f978e59c700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900ceec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f97780094c0 tx=0x7f9778017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.128+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778011e20 con 0x7f97900b49a0 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.129+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778024440 con 0x7f97900b49a0 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.129+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979015ae10 con 0x7f97900b49a0 2023-10-06T11:14:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.129+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778024800 con 0x7f97900b49a0 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.129+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979015b8f0 con 0x7f97900b49a0 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.129+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979015b610 con 0x7f97900b49a0 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.130+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f977801a420 con 0x7f97900b49a0 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.130+0000 7f9786ffd700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9770066f30 0x7f97700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.130+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9778086660 con 0x7f97900b49a0 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.131+0000 7f978ed9d700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9770066f30 0x7f97700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.131+0000 7f978ed9d700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9770066f30 0x7f97700693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f97880061f0 tx=0x7f9788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.135+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f979015b610 con 0x7f97900b49a0 2023-10-06T11:14:22.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.376+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f979015b610 con 0x7f97900b49a0 2023-10-06T11:14:22.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.376+0000 7f9786ffd700 1 -- 172.21.15.55:0/1341943094 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f979015b610 con 0x7f97900b49a0 2023-10-06T11:14:22.378 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:22.378 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:22.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9770066f30 msgr2=0x7f97700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9770066f30 0x7f97700693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f97880061f0 tx=0x7f9788008040 comp rx=0 tx=0).stop 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 msgr2=0x7f97900ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900ceec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f97780094c0 tx=0x7f9778017000 comp rx=0 tx=0).stop 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 shutdown_connections 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9770066f30 0x7f97700693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9790159560 0x7f97900cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97900b0760 0x7f979009ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 --2- 172.21.15.55:0/1341943094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97900b49a0 0x7f97900ceec0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 >> 172.21.15.55:0/1341943094 conn(0x7f97900997f0 msgr2=0x7f9790158940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 shutdown_connections 2023-10-06T11:14:22.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.379+0000 7f97951c7700 1 -- 172.21.15.55:0/1341943094 wait complete. 2023-10-06T11:14:22.382 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:22.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.510+0000 7f0c4574e700 1 Processor -- start 2023-10-06T11:14:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.510+0000 7f0c4574e700 1 -- start start 2023-10-06T11:14:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c4574e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c40159440 0x7f0c400b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c4574e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c400b35d0 0x7f0c400cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c4574e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c400cb7a0 con 0x7f0c400cc170 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c4574e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400b0860 con 0x7f0c40159440 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c4574e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400cb150 con 0x7f0c400b35d0 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c40159440 0x7f0c400b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0c400cc170 0x7f0c400b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55830/0 (socket says 172.21.15.55:55830) 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3f7fe700 1 -- 172.21.15.55:0/3602622862 learned_addr learned my addr 172.21.15.55:0/3602622862 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c40159440 0x7f0c400b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50350/0 (socket says 172.21.15.55:50350) 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3e7fc700 1 --2- 172.21.15.55:0/3602622862 >> v2:172.21.15.142:3300/0 conn(0x7f0c400b35d0 0x7f0c400cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3effd700 1 -- 172.21.15.55:0/3602622862 >> v2:172.21.15.142:3300/0 conn(0x7f0c400b35d0 msgr2=0x7f0c400cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3effd700 1 --2- 172.21.15.55:0/3602622862 >> v2:172.21.15.142:3300/0 conn(0x7f0c400b35d0 0x7f0c400cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3effd700 1 -- 172.21.15.55:0/3602622862 >> v1:172.21.15.55:6789/0 conn(0x7f0c400cc170 legacy=0x7f0c400b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3effd700 1 -- 172.21.15.55:0/3602622862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c400cb430 con 0x7f0c40159440 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3e7fc700 1 --2- 172.21.15.55:0/3602622862 >> v2:172.21.15.142:3300/0 conn(0x7f0c400b35d0 0x7f0c400cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.511+0000 7f0c3dffb700 1 -- 172.21.15.55:0/3602622862 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257009302 0 0) 0x7f0c400cb7a0 con 0x7f0c400cc170 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c3effd700 1 --2- 172.21.15.55:0/3602622862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c40159440 0x7f0c400b3090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0c400d0220 tx=0x7f0c380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f2d217c3b7e97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c3dffb700 1 -- 172.21.15.55:0/3602622862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800b6b0 con 0x7f0c40159440 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c3dffb700 1 -- 172.21.15.55:0/3602622862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3800b810 con 0x7f0c40159440 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c3dffb700 1 -- 172.21.15.55:0/3602622862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800bbb0 con 0x7f0c40159440 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 -- 172.21.15.55:0/3602622862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c40159440 msgr2=0x7f0c400b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 --2- 172.21.15.55:0/3602622862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c40159440 0x7f0c400b3090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0c400d0220 tx=0x7f0c380091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 -- 172.21.15.55:0/3602622862 shutdown_connections 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 --2- 172.21.15.55:0/3602622862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c40159440 0x7f0c400b3090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 --2- 172.21.15.55:0/3602622862 >> v2:172.21.15.142:3300/0 conn(0x7f0c400b35d0 0x7f0c400cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 -- 172.21.15.55:0/3602622862 >> 172.21.15.55:0/3602622862 conn(0x7f0c4006ece0 msgr2=0x7f0c4006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 -- 172.21.15.55:0/3602622862 shutdown_connections 2023-10-06T11:14:22.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.512+0000 7f0c4574e700 1 -- 172.21.15.55:0/3602622862 wait complete. 2023-10-06T11:14:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 Processor -- start 2023-10-06T11:14:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 -- start start 2023-10-06T11:14:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c400b35d0 0x7f0c4015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 0x7f0c40154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c40159440 0x7f0c40159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400ca680 con 0x7f0c400cc170 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400ca0c0 con 0x7f0c40159440 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c4574e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400ca3a0 con 0x7f0c400b35d0 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c3e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 0x7f0c40154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c3e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 0x7f0c40154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50352/0 (socket says 172.21.15.55:50352) 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.514+0000 7f0c3e7fc700 1 -- 172.21.15.55:0/261749835 learned_addr learned my addr 172.21.15.55:0/261749835 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3effd700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c400b35d0 0x7f0c4015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3f7fe700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c40159440 0x7f0c40159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3e7fc700 1 -- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c400b35d0 msgr2=0x7f0c4015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3e7fc700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c400b35d0 0x7f0c4015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3e7fc700 1 -- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c40159440 msgr2=0x7f0c40159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3e7fc700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c40159440 0x7f0c40159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3e7fc700 1 -- 172.21.15.55:0/261749835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38009420 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3f7fe700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c40159440 0x7f0c40159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c3e7fc700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 0x7f0c40154670 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c830 tx=0x7f0c28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28011600 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28011760 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4015db60 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28011b20 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.515+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40154bb0 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.516+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4015d9c0 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.517+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c280193b0 con 0x7f0c400cc170 2023-10-06T11:14:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.517+0000 7f0c36ffd700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c20066f30 0x7f0c200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.517+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0c28084820 con 0x7f0c400cc170 2023-10-06T11:14:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.517+0000 7f0c3effd700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c20066f30 0x7f0c200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.518+0000 7f0c3effd700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c20066f30 0x7f0c200693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0c380093f0 tx=0x7f0c38017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.521+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c4015d9c0 con 0x7f0c400cc170 2023-10-06T11:14:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.714+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c4015e080 con 0x7f0c400cc170 2023-10-06T11:14:22.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.714+0000 7f0c36ffd700 1 -- 172.21.15.55:0/261749835 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f0c4015e080 con 0x7f0c400cc170 2023-10-06T11:14:22.717 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:22.717 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:19.948485+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.621851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.333304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:22.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.716+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c20066f30 msgr2=0x7f0c200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c20066f30 0x7f0c200693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0c380093f0 tx=0x7f0c38017000 comp rx=0 tx=0).stop 2023-10-06T11:14:22.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 msgr2=0x7f0c40154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 0x7f0c40154670 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c830 tx=0x7f0c28008040 comp rx=0 tx=0).stop 2023-10-06T11:14:22.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 shutdown_connections 2023-10-06T11:14:22.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0c20066f30 0x7f0c200693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c40159440 0x7f0c40159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c400b35d0 0x7f0c4015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 --2- 172.21.15.55:0/261749835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c400cc170 0x7f0c40154670 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 >> 172.21.15.55:0/261749835 conn(0x7f0c4006ece0 msgr2=0x7f0c400cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 shutdown_connections 2023-10-06T11:14:22.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.717+0000 7f0c4574e700 1 -- 172.21.15.55:0/261749835 wait complete. 2023-10-06T11:14:22.731 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:14:22.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:14:22.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.849+0000 7f68bfd58700 1 Processor -- start 2023-10-06T11:14:22.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.849+0000 7f68bfd58700 1 -- start start 2023-10-06T11:14:22.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bfd58700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68b8159560 0x7f68b80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bfd58700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68b80b49a0 0x7f68b80aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bfd58700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b80b0c60 con 0x7f68b80b0760 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bfd58700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b80b0f40 con 0x7f68b8159560 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bfd58700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b80b1220 con 0x7f68b80b49a0 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68b8159560 0x7f68b80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68b8159560 0x7f68b80aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50366/0 (socket says 172.21.15.55:50366) 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 -- 172.21.15.55:0/282798490 learned_addr learned my addr 172.21.15.55:0/282798490 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bd2f3700 1 --2- 172.21.15.55:0/282798490 >> v2:172.21.15.142:3300/0 conn(0x7f68b80b49a0 0x7f68b80aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 -- 172.21.15.55:0/282798490 >> v2:172.21.15.142:3300/0 conn(0x7f68b80b49a0 msgr2=0x7f68b80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 --2- 172.21.15.55:0/282798490 >> v2:172.21.15.142:3300/0 conn(0x7f68b80b49a0 0x7f68b80aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 -- 172.21.15.55:0/282798490 >> v1:172.21.15.142:6789/0 conn(0x7f68b80b0760 legacy=0x7f68b80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 -- 172.21.15.55:0/282798490 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80b1500 con 0x7f68b8159560 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bdaf4700 1 --2- 172.21.15.55:0/282798490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b8159560 0x7f68b80aa530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009990 tx=0x7f68b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eaeadba2165bd12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bcaf2700 1 -- 172.21.15.55:0/282798490 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0005c10 con 0x7f68b8159560 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bcaf2700 1 -- 172.21.15.55:0/282798490 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0005d70 con 0x7f68b8159560 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.850+0000 7f68bcaf2700 1 -- 172.21.15.55:0/282798490 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000b800 con 0x7f68b8159560 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 -- 172.21.15.55:0/282798490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b8159560 msgr2=0x7f68b80aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 --2- 172.21.15.55:0/282798490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b8159560 0x7f68b80aa530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009990 tx=0x7f68b0009220 comp rx=0 tx=0).stop 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 -- 172.21.15.55:0/282798490 shutdown_connections 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 --2- 172.21.15.55:0/282798490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b8159560 0x7f68b80aa530 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 --2- 172.21.15.55:0/282798490 >> v2:172.21.15.142:3300/0 conn(0x7f68b80b49a0 0x7f68b80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 -- 172.21.15.55:0/282798490 >> 172.21.15.55:0/282798490 conn(0x7f68b80997f0 msgr2=0x7f68b806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 -- 172.21.15.55:0/282798490 shutdown_connections 2023-10-06T11:14:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.851+0000 7f68bfd58700 1 -- 172.21.15.55:0/282798490 wait complete. 2023-10-06T11:14:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.852+0000 7f68bfd58700 1 Processor -- start 2023-10-06T11:14:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.852+0000 7f68bfd58700 1 -- start start 2023-10-06T11:14:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bfd58700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 0x7f68b809bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bfd58700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68b80b49a0 0x7f68b8156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bfd58700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68b8159560 0x7f68b809a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bfd58700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b809b6b0 con 0x7f68b80b0760 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bfd58700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b809aaa0 con 0x7f68b80b49a0 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bfd58700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b809ad80 con 0x7f68b8159560 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 0x7f68b809bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 0x7f68b809bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50368/0 (socket says 172.21.15.55:50368) 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 -- 172.21.15.55:0/1377628456 learned_addr learned my addr 172.21.15.55:0/1377628456 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bd2f3700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68b80b49a0 0x7f68b8156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68be2f5700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68b8159560 0x7f68b809a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 -- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68b8159560 msgr2=0x7f68b809a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68b8159560 0x7f68b809a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 -- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68b80b49a0 msgr2=0x7f68b8156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68b80b49a0 0x7f68b8156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 -- 172.21.15.55:0/1377628456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009480 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68be2f5700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68b8159560 0x7f68b809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.853+0000 7f68bdaf4700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 0x7f68b809bb40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009260 tx=0x7f68b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.854+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011a30 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.854+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0011b90 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.854+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b809b060 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.854+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b001c420 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.854+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b815b870 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.855+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b809b990 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.855+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b001c850 con 0x7f68b80b0760 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.856+0000 7f68adffb700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f689c066f30 0x7f689c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.856+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f68b0086260 con 0x7f68b80b0760 2023-10-06T11:14:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.856+0000 7f68bd2f3700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f689c066f30 0x7f689c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.856+0000 7f68bd2f3700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f689c066f30 0x7f689c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f68b80d1340 tx=0x7f68a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:22.860+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b0053230 con 0x7f68b80b0760 2023-10-06T11:14:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.054+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68b809b7f0 con 0x7f689c066f30 2023-10-06T11:14:23.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.064+0000 7f68adffb700 1 -- 172.21.15.55:0/1377628456 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311253 (secure 0 0 0) 0x7f68a8010870 con 0x7f689c066f30 2023-10-06T11:14:23.069 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f689c066f30 msgr2=0x7f689c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f689c066f30 0x7f689c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f68b80d1340 tx=0x7f68a8008040 comp rx=0 tx=0).stop 2023-10-06T11:14:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 msgr2=0x7f68b809bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 0x7f68b809bb40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009260 tx=0x7f68b0015000 comp rx=0 tx=0).stop 2023-10-06T11:14:23.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 shutdown_connections 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f689c066f30 0x7f689c0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b80b0760 0x7f68b809bb40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68b8159560 0x7f68b809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 --2- 172.21.15.55:0/1377628456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68b80b49a0 0x7f68b8156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 >> 172.21.15.55:0/1377628456 conn(0x7f68b80997f0 msgr2=0x7f68b80688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 shutdown_connections 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.067+0000 7f68bfd58700 1 -- 172.21.15.55:0/1377628456 wait complete. 2023-10-06T11:14:23.073 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:14:23.081 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T11:14:22.857523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383176,"kb_used_data":4872,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591544,"statfs":{"total":773094113280,"available":770653741056,"internally_reserved":0,"allocated":4988928,"data_stored":2847584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912592"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969387+0000","last_change":"2023-10-06T11:14:18.969387+0000","last_active":"2023-10-06T11:14:18.969387+0000","last_peered":"2023-10-06T11:14:18.969387+0000","last_clean":"2023-10-06T11:14:18.969387+0000","last_became_active":"2023-10-06T11:14:18.969095+0000","last_became_peered":"2023-10-06T11:14:18.969095+0000","last_unstale":"2023-10-06T11:14:18.969387+0000","last_undegraded":"2023-10-06T11:14:18.969387+0000","last_fullsized":"2023-10-06T11:14:18.969387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:51.715839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.979586+0000","last_change":"2023-10-06T11:14:18.979586+0000","last_active":"2023-10-06T11:14:18.979586+0000","last_peered":"2023-10-06T11:14:18.979586+0000","last_clean":"2023-10-06T11:14:18.979586+0000","last_became_active":"2023-10-06T11:14:18.979337+0000","last_became_peered":"2023-10-06T11:14:18.979337+0000","last_unstale":"2023-10-06T11:14:18.979586+0000","last_undegraded":"2023-10-06T11:14:18.979586+0000","last_fullsized":"2023-10-06T11:14:18.979586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:51.715839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.962652+0000","last_change":"2023-10-06T11:14:18.962652+0000","last_active":"2023-10-06T11:14:18.962652+0000","last_peered":"2023-10-06T11:14:18.962652+0000","last_clean":"2023-10-06T11:14:18.962652+0000","last_became_active":"2023-10-06T11:14:18.962365+0000","last_became_peered":"2023-10-06T11:14:18.962365+0000","last_unstale":"2023-10-06T11:14:18.962652+0000","last_undegraded":"2023-10-06T11:14:18.962652+0000","last_fullsized":"2023-10-06T11:14:18.962652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:43.855676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968222+0000","last_change":"2023-10-06T11:14:18.968222+0000","last_active":"2023-10-06T11:14:18.968222+0000","last_peered":"2023-10-06T11:14:18.968222+0000","last_clean":"2023-10-06T11:14:18.968222+0000","last_became_active":"2023-10-06T11:14:18.967957+0000","last_became_peered":"2023-10-06T11:14:18.967957+0000","last_unstale":"2023-10-06T11:14:18.968222+0000","last_undegraded":"2023-10-06T11:14:18.968222+0000","last_fullsized":"2023-10-06T11:14:18.968222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:07.222923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.979784+0000","last_change":"2023-10-06T11:14:18.979784+0000","last_active":"2023-10-06T11:14:18.979784+0000","last_peered":"2023-10-06T11:14:18.979784+0000","last_clean":"2023-10-06T11:14:18.979784+0000","last_became_active":"2023-10-06T11:14:18.979473+0000","last_became_peered":"2023-10-06T11:14:18.979473+0000","last_unstale":"2023-10-06T11:14:18.979784+0000","last_undegraded":"2023-10-06T11:14:18.979784+0000","last_fullsized":"2023-10-06T11:14:18.979784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:01:50.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967525+0000","last_change":"2023-10-06T11:14:18.967525+0000","last_active":"2023-10-06T11:14:18.967525+0000","last_peered":"2023-10-06T11:14:18.967525+0000","last_clean":"2023-10-06T11:14:18.967525+0000","last_became_active":"2023-10-06T11:14:18.967277+0000","last_became_peered":"2023-10-06T11:14:18.967277+0000","last_unstale":"2023-10-06T11:14:18.967525+0000","last_undegraded":"2023-10-06T11:14:18.967525+0000","last_fullsized":"2023-10-06T11:14:18.967525+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:06.395481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.972491+0000","last_change":"2023-10-06T11:14:18.972491+0000","last_active":"2023-10-06T11:14:18.972491+0000","last_peered":"2023-10-06T11:14:18.972491+0000","last_clean":"2023-10-06T11:14:18.972491+0000","last_became_active":"2023-10-06T11:14:18.972209+0000","last_became_peered":"2023-10-06T11:14:18.972209+0000","last_unstale":"2023-10-06T11:14:18.972491+0000","last_undegraded":"2023-10-06T11:14:18.972491+0000","last_fullsized":"2023-10-06T11:14:18.972491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:50.938966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.977737+0000","last_change":"2023-10-06T11:14:18.977737+0000","last_active":"2023-10-06T11:14:18.977737+0000","last_peered":"2023-10-06T11:14:18.977737+0000","last_clean":"2023-10-06T11:14:18.977737+0000","last_became_active":"2023-10-06T11:14:18.977487+0000","last_became_peered":"2023-10-06T11:14:18.977487+0000","last_unstale":"2023-10-06T11:14:18.977737+0000","last_undegraded":"2023-10-06T11:14:18.977737+0000","last_fullsized":"2023-10-06T11:14:18.977737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:41.789678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.975222+0000","last_change":"2023-10-06T11:14:18.975222+0000","last_active":"2023-10-06T11:14:18.975222+0000","last_peered":"2023-10-06T11:14:18.975222+0000","last_clean":"2023-10-06T11:14:18.975222+0000","last_became_active":"2023-10-06T11:14:18.974969+0000","last_became_peered":"2023-10-06T11:14:18.974969+0000","last_unstale":"2023-10-06T11:14:18.975222+0000","last_undegraded":"2023-10-06T11:14:18.975222+0000","last_fullsized":"2023-10-06T11:14:18.975222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:42.003650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.965000+0000","last_change":"2023-10-06T11:14:18.965000+0000","last_active":"2023-10-06T11:14:18.965000+0000","last_peered":"2023-10-06T11:14:18.965000+0000","last_clean":"2023-10-06T11:14:18.965000+0000","last_became_active":"2023-10-06T11:14:18.964727+0000","last_became_peered":"2023-10-06T11:14:18.964727+0000","last_unstale":"2023-10-06T11:14:18.965000+0000","last_undegraded":"2023-10-06T11:14:18.965000+0000","last_fullsized":"2023-10-06T11:14:18.965000+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.908207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969962+0000","last_change":"2023-10-06T11:14:18.969962+0000","last_active":"2023-10-06T11:14:18.969962+0000","last_peered":"2023-10-06T11:14:18.969962+0000","last_clean":"2023-10-06T11:14:18.969962+0000","last_became_active":"2023-10-06T11:14:18.969443+0000","last_became_peered":"2023-10-06T11:14:18.969443+0000","last_unstale":"2023-10-06T11:14:18.969962+0000","last_undegraded":"2023-10-06T11:14:18.969962+0000","last_fullsized":"2023-10-06T11:14:18.969962+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:00.990170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966477+0000","last_change":"2023-10-06T11:14:18.966477+0000","last_active":"2023-10-06T11:14:18.966477+0000","last_peered":"2023-10-06T11:14:18.966477+0000","last_clean":"2023-10-06T11:14:18.966477+0000","last_became_active":"2023-10-06T11:14:18.966024+0000","last_became_peered":"2023-10-06T11:14:18.966024+0000","last_unstale":"2023-10-06T11:14:18.966477+0000","last_undegraded":"2023-10-06T11:14:18.966477+0000","last_fullsized":"2023-10-06T11:14:18.966477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:10.555011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.964533+0000","last_change":"2023-10-06T11:14:18.964533+0000","last_active":"2023-10-06T11:14:18.964533+0000","last_peered":"2023-10-06T11:14:18.964533+0000","last_clean":"2023-10-06T11:14:18.964533+0000","last_became_active":"2023-10-06T11:14:18.964283+0000","last_became_peered":"2023-10-06T11:14:18.964283+0000","last_unstale":"2023-10-06T11:14:18.964533+0000","last_undegraded":"2023-10-06T11:14:18.964533+0000","last_fullsized":"2023-10-06T11:14:18.964533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:24.366423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.976141+0000","last_change":"2023-10-06T11:14:18.976141+0000","last_active":"2023-10-06T11:14:18.976141+0000","last_peered":"2023-10-06T11:14:18.976141+0000","last_clean":"2023-10-06T11:14:18.976141+0000","last_became_active":"2023-10-06T11:14:18.975881+0000","last_became_peered":"2023-10-06T11:14:18.975881+0000","last_unstale":"2023-10-06T11:14:18.976141+0000","last_undegraded":"2023-10-06T11:14:18.976141+0000","last_fullsized":"2023-10-06T11:14:18.976141+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:37.456182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.963057+0000","last_change":"2023-10-06T11:14:18.963057+0000","last_active":"2023-10-06T11:14:18.963057+0000","last_peered":"2023-10-06T11:14:18.963057+0000","last_clean":"2023-10-06T11:14:18.963057+0000","last_became_active":"2023-10-06T11:14:18.962753+0000","last_became_peered":"2023-10-06T11:14:18.962753+0000","last_unstale":"2023-10-06T11:14:18.963057+0000","last_undegraded":"2023-10-06T11:14:18.963057+0000","last_fullsized":"2023-10-06T11:14:18.963057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:43.855676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978118+0000","last_change":"2023-10-06T11:14:18.978118+0000","last_active":"2023-10-06T11:14:18.978118+0000","last_peered":"2023-10-06T11:14:18.978118+0000","last_clean":"2023-10-06T11:14:18.978118+0000","last_became_active":"2023-10-06T11:14:18.977859+0000","last_became_peered":"2023-10-06T11:14:18.977859+0000","last_unstale":"2023-10-06T11:14:18.978118+0000","last_undegraded":"2023-10-06T11:14:18.978118+0000","last_fullsized":"2023-10-06T11:14:18.978118+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:57.259316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967418+0000","last_change":"2023-10-06T11:14:18.967418+0000","last_active":"2023-10-06T11:14:18.967418+0000","last_peered":"2023-10-06T11:14:18.967418+0000","last_clean":"2023-10-06T11:14:18.967418+0000","last_became_active":"2023-10-06T11:14:18.967182+0000","last_became_peered":"2023-10-06T11:14:18.967182+0000","last_unstale":"2023-10-06T11:14:18.967418+0000","last_undegraded":"2023-10-06T11:14:18.967418+0000","last_fullsized":"2023-10-06T11:14:18.967418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:00.990170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978054+0000","last_change":"2023-10-06T11:14:18.978054+0000","last_active":"2023-10-06T11:14:18.978054+0000","last_peered":"2023-10-06T11:14:18.978054+0000","last_clean":"2023-10-06T11:14:18.978054+0000","last_became_active":"2023-10-06T11:14:18.977494+0000","last_became_peered":"2023-10-06T11:14:18.977494+0000","last_unstale":"2023-10-06T11:14:18.978054+0000","last_undegraded":"2023-10-06T11:14:18.978054+0000","last_fullsized":"2023-10-06T11:14:18.978054+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.043895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.977799+0000","last_change":"2023-10-06T11:14:18.977799+0000","last_active":"2023-10-06T11:14:18.977799+0000","last_peered":"2023-10-06T11:14:18.977799+0000","last_clean":"2023-10-06T11:14:18.977799+0000","last_became_active":"2023-10-06T11:14:18.977538+0000","last_became_peered":"2023-10-06T11:14:18.977538+0000","last_unstale":"2023-10-06T11:14:18.977799+0000","last_undegraded":"2023-10-06T11:14:18.977799+0000","last_fullsized":"2023-10-06T11:14:18.977799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:15.982493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969377+0000","last_change":"2023-10-06T11:14:18.969377+0000","last_active":"2023-10-06T11:14:18.969377+0000","last_peered":"2023-10-06T11:14:18.969377+0000","last_clean":"2023-10-06T11:14:18.969377+0000","last_became_active":"2023-10-06T11:14:18.969109+0000","last_became_peered":"2023-10-06T11:14:18.969109+0000","last_unstale":"2023-10-06T11:14:18.969377+0000","last_undegraded":"2023-10-06T11:14:18.969377+0000","last_fullsized":"2023-10-06T11:14:18.969377+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:42.380108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.963754+0000","last_change":"2023-10-06T11:14:18.963754+0000","last_active":"2023-10-06T11:14:18.963754+0000","last_peered":"2023-10-06T11:14:18.963754+0000","last_clean":"2023-10-06T11:14:18.963754+0000","last_became_active":"2023-10-06T11:14:18.963455+0000","last_became_peered":"2023-10-06T11:14:18.963455+0000","last_unstale":"2023-10-06T11:14:18.963754+0000","last_undegraded":"2023-10-06T11:14:18.963754+0000","last_fullsized":"2023-10-06T11:14:18.963754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:48.272950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978439+0000","last_change":"2023-10-06T11:14:18.978439+0000","last_active":"2023-10-06T11:14:18.978439+0000","last_peered":"2023-10-06T11:14:18.978439+0000","last_clean":"2023-10-06T11:14:18.978439+0000","last_became_active":"2023-10-06T11:14:18.978177+0000","last_became_peered":"2023-10-06T11:14:18.978177+0000","last_unstale":"2023-10-06T11:14:18.978439+0000","last_undegraded":"2023-10-06T11:14:18.978439+0000","last_fullsized":"2023-10-06T11:14:18.978439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:32.918524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970771+0000","last_change":"2023-10-06T11:14:18.970771+0000","last_active":"2023-10-06T11:14:18.970771+0000","last_peered":"2023-10-06T11:14:18.970771+0000","last_clean":"2023-10-06T11:14:18.970771+0000","last_became_active":"2023-10-06T11:14:18.970147+0000","last_became_peered":"2023-10-06T11:14:18.970147+0000","last_unstale":"2023-10-06T11:14:18.970771+0000","last_undegraded":"2023-10-06T11:14:18.970771+0000","last_fullsized":"2023-10-06T11:14:18.970771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:04.826846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970497+0000","last_change":"2023-10-06T11:14:18.970497+0000","last_active":"2023-10-06T11:14:18.970497+0000","last_peered":"2023-10-06T11:14:18.970497+0000","last_clean":"2023-10-06T11:14:18.970497+0000","last_became_active":"2023-10-06T11:14:18.970219+0000","last_became_peered":"2023-10-06T11:14:18.970219+0000","last_unstale":"2023-10-06T11:14:18.970497+0000","last_undegraded":"2023-10-06T11:14:18.970497+0000","last_fullsized":"2023-10-06T11:14:18.970497+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:42.138962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.971451+0000","last_change":"2023-10-06T11:14:18.971451+0000","last_active":"2023-10-06T11:14:18.971451+0000","last_peered":"2023-10-06T11:14:18.971451+0000","last_clean":"2023-10-06T11:14:18.971451+0000","last_became_active":"2023-10-06T11:14:18.971156+0000","last_became_peered":"2023-10-06T11:14:18.971156+0000","last_unstale":"2023-10-06T11:14:18.971451+0000","last_undegraded":"2023-10-06T11:14:18.971451+0000","last_fullsized":"2023-10-06T11:14:18.971451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:42.380108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.958085+0000","last_change":"2023-10-06T11:14:18.958085+0000","last_active":"2023-10-06T11:14:18.958085+0000","last_peered":"2023-10-06T11:14:18.958085+0000","last_clean":"2023-10-06T11:14:18.958085+0000","last_became_active":"2023-10-06T11:14:18.957819+0000","last_became_peered":"2023-10-06T11:14:18.957819+0000","last_unstale":"2023-10-06T11:14:18.958085+0000","last_undegraded":"2023-10-06T11:14:18.958085+0000","last_fullsized":"2023-10-06T11:14:18.958085+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:42.138962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967870+0000","last_change":"2023-10-06T11:14:18.967870+0000","last_active":"2023-10-06T11:14:18.967870+0000","last_peered":"2023-10-06T11:14:18.967870+0000","last_clean":"2023-10-06T11:14:18.967870+0000","last_became_active":"2023-10-06T11:14:18.967120+0000","last_became_peered":"2023-10-06T11:14:18.967120+0000","last_unstale":"2023-10-06T11:14:18.967870+0000","last_undegraded":"2023-10-06T11:14:18.967870+0000","last_fullsized":"2023-10-06T11:14:18.967870+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:41.789678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.972837+0000","last_change":"2023-10-06T11:14:18.972837+0000","last_active":"2023-10-06T11:14:18.972837+0000","last_peered":"2023-10-06T11:14:18.972837+0000","last_clean":"2023-10-06T11:14:18.972837+0000","last_became_active":"2023-10-06T11:14:18.972590+0000","last_became_peered":"2023-10-06T11:14:18.972590+0000","last_unstale":"2023-10-06T11:14:18.972837+0000","last_undegraded":"2023-10-06T11:14:18.972837+0000","last_fullsized":"2023-10-06T11:14:18.972837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:16:42.696963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.971590+0000","last_change":"2023-10-06T11:14:18.971590+0000","last_active":"2023-10-06T11:14:18.971590+0000","last_peered":"2023-10-06T11:14:18.971590+0000","last_clean":"2023-10-06T11:14:18.971590+0000","last_became_active":"2023-10-06T11:14:18.971250+0000","last_became_peered":"2023-10-06T11:14:18.971250+0000","last_unstale":"2023-10-06T11:14:18.971590+0000","last_undegraded":"2023-10-06T11:14:18.971590+0000","last_fullsized":"2023-10-06T11:14:18.971590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:41.476256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967452+0000","last_change":"2023-10-06T11:14:18.967452+0000","last_active":"2023-10-06T11:14:18.967452+0000","last_peered":"2023-10-06T11:14:18.967452+0000","last_clean":"2023-10-06T11:14:18.967452+0000","last_became_active":"2023-10-06T11:14:18.967159+0000","last_became_peered":"2023-10-06T11:14:18.967159+0000","last_unstale":"2023-10-06T11:14:18.967452+0000","last_undegraded":"2023-10-06T11:14:18.967452+0000","last_fullsized":"2023-10-06T11:14:18.967452+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:42.003650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967647+0000","last_change":"2023-10-06T11:14:18.967647+0000","last_active":"2023-10-06T11:14:18.967647+0000","last_peered":"2023-10-06T11:14:18.967647+0000","last_clean":"2023-10-06T11:14:18.967647+0000","last_became_active":"2023-10-06T11:14:18.967379+0000","last_became_peered":"2023-10-06T11:14:18.967379+0000","last_unstale":"2023-10-06T11:14:18.967647+0000","last_undegraded":"2023-10-06T11:14:18.967647+0000","last_fullsized":"2023-10-06T11:14:18.967647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:00.990170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969394+0000","last_change":"2023-10-06T11:14:18.969394+0000","last_active":"2023-10-06T11:14:18.969394+0000","last_peered":"2023-10-06T11:14:18.969394+0000","last_clean":"2023-10-06T11:14:18.969394+0000","last_became_active":"2023-10-06T11:14:18.969162+0000","last_became_peered":"2023-10-06T11:14:18.969162+0000","last_unstale":"2023-10-06T11:14:18.969394+0000","last_undegraded":"2023-10-06T11:14:18.969394+0000","last_fullsized":"2023-10-06T11:14:18.969394+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:18.655703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.973114+0000","last_change":"2023-10-06T11:14:18.973114+0000","last_active":"2023-10-06T11:14:18.973114+0000","last_peered":"2023-10-06T11:14:18.973114+0000","last_clean":"2023-10-06T11:14:18.973114+0000","last_became_active":"2023-10-06T11:14:18.972863+0000","last_became_peered":"2023-10-06T11:14:18.972863+0000","last_unstale":"2023-10-06T11:14:18.973114+0000","last_undegraded":"2023-10-06T11:14:18.973114+0000","last_fullsized":"2023-10-06T11:14:18.973114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:44.465311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.983851+0000","last_change":"2023-10-06T11:14:17.966561+0000","last_active":"2023-10-06T11:14:18.983851+0000","last_peered":"2023-10-06T11:14:18.983851+0000","last_clean":"2023-10-06T11:14:18.983851+0000","last_became_active":"2023-10-06T11:14:17.966258+0000","last_became_peered":"2023-10-06T11:14:17.966258+0000","last_unstale":"2023-10-06T11:14:18.983851+0000","last_undegraded":"2023-10-06T11:14:18.983851+0000","last_fullsized":"2023-10-06T11:14:18.983851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:48:23.159467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969709+0000","last_change":"2023-10-06T11:14:18.969709+0000","last_active":"2023-10-06T11:14:18.969709+0000","last_peered":"2023-10-06T11:14:18.969709+0000","last_clean":"2023-10-06T11:14:18.969709+0000","last_became_active":"2023-10-06T11:14:18.969487+0000","last_became_peered":"2023-10-06T11:14:18.969487+0000","last_unstale":"2023-10-06T11:14:18.969709+0000","last_undegraded":"2023-10-06T11:14:18.969709+0000","last_fullsized":"2023-10-06T11:14:18.969709+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:44:18.156221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.955451+0000","last_change":"2023-10-06T11:14:17.967507+0000","last_active":"2023-10-06T11:14:18.955451+0000","last_peered":"2023-10-06T11:14:18.955451+0000","last_clean":"2023-10-06T11:14:18.955451+0000","last_became_active":"2023-10-06T11:14:17.966743+0000","last_became_peered":"2023-10-06T11:14:17.966743+0000","last_unstale":"2023-10-06T11:14:18.955451+0000","last_undegraded":"2023-10-06T11:14:18.955451+0000","last_fullsized":"2023-10-06T11:14:18.955451+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:01:49.150933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974239+0000","last_change":"2023-10-06T11:14:18.974239+0000","last_active":"2023-10-06T11:14:18.974239+0000","last_peered":"2023-10-06T11:14:18.974239+0000","last_clean":"2023-10-06T11:14:18.974239+0000","last_became_active":"2023-10-06T11:14:18.973992+0000","last_became_peered":"2023-10-06T11:14:18.973992+0000","last_unstale":"2023-10-06T11:14:18.974239+0000","last_undegraded":"2023-10-06T11:14:18.974239+0000","last_fullsized":"2023-10-06T11:14:18.974239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:36.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.982625+0000","last_change":"2023-10-06T11:14:17.966186+0000","last_active":"2023-10-06T11:14:18.982625+0000","last_peered":"2023-10-06T11:14:18.982625+0000","last_clean":"2023-10-06T11:14:18.982625+0000","last_became_active":"2023-10-06T11:14:17.965942+0000","last_became_peered":"2023-10-06T11:14:17.965942+0000","last_unstale":"2023-10-06T11:14:18.982625+0000","last_undegraded":"2023-10-06T11:14:18.982625+0000","last_fullsized":"2023-10-06T11:14:18.982625+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:17.644623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974096+0000","last_change":"2023-10-06T11:14:18.974096+0000","last_active":"2023-10-06T11:14:18.974096+0000","last_peered":"2023-10-06T11:14:18.974096+0000","last_clean":"2023-10-06T11:14:18.974096+0000","last_became_active":"2023-10-06T11:14:18.973848+0000","last_became_peered":"2023-10-06T11:14:18.973848+0000","last_unstale":"2023-10-06T11:14:18.974096+0000","last_undegraded":"2023-10-06T11:14:18.974096+0000","last_fullsized":"2023-10-06T11:14:18.974096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:15.577506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.984295+0000","last_change":"2023-10-06T11:14:17.961794+0000","last_active":"2023-10-06T11:14:18.984295+0000","last_peered":"2023-10-06T11:14:18.984295+0000","last_clean":"2023-10-06T11:14:18.984295+0000","last_became_active":"2023-10-06T11:14:17.961101+0000","last_became_peered":"2023-10-06T11:14:17.961101+0000","last_unstale":"2023-10-06T11:14:18.984295+0000","last_undegraded":"2023-10-06T11:14:18.984295+0000","last_fullsized":"2023-10-06T11:14:18.984295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:14.971412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974464+0000","last_change":"2023-10-06T11:14:18.974464+0000","last_active":"2023-10-06T11:14:18.974464+0000","last_peered":"2023-10-06T11:14:18.974464+0000","last_clean":"2023-10-06T11:14:18.974464+0000","last_became_active":"2023-10-06T11:14:18.974200+0000","last_became_peered":"2023-10-06T11:14:18.974200+0000","last_unstale":"2023-10-06T11:14:18.974464+0000","last_undegraded":"2023-10-06T11:14:18.974464+0000","last_fullsized":"2023-10-06T11:14:18.974464+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:06.395481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.955968+0000","last_change":"2023-10-06T11:14:17.966656+0000","last_active":"2023-10-06T11:14:18.955968+0000","last_peered":"2023-10-06T11:14:18.955968+0000","last_clean":"2023-10-06T11:14:18.955968+0000","last_became_active":"2023-10-06T11:14:17.965995+0000","last_became_peered":"2023-10-06T11:14:17.965995+0000","last_unstale":"2023-10-06T11:14:18.955968+0000","last_undegraded":"2023-10-06T11:14:18.955968+0000","last_fullsized":"2023-10-06T11:14:18.955968+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:38.716683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968575+0000","last_change":"2023-10-06T11:14:18.968575+0000","last_active":"2023-10-06T11:14:18.968575+0000","last_peered":"2023-10-06T11:14:18.968575+0000","last_clean":"2023-10-06T11:14:18.968575+0000","last_became_active":"2023-10-06T11:14:18.968319+0000","last_became_peered":"2023-10-06T11:14:18.968319+0000","last_unstale":"2023-10-06T11:14:18.968575+0000","last_undegraded":"2023-10-06T11:14:18.968575+0000","last_fullsized":"2023-10-06T11:14:18.968575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:48.272950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.955259+0000","last_change":"2023-10-06T11:14:17.964336+0000","last_active":"2023-10-06T11:14:18.955259+0000","last_peered":"2023-10-06T11:14:18.955259+0000","last_clean":"2023-10-06T11:14:18.955259+0000","last_became_active":"2023-10-06T11:14:17.964054+0000","last_became_peered":"2023-10-06T11:14:17.964054+0000","last_unstale":"2023-10-06T11:14:18.955259+0000","last_undegraded":"2023-10-06T11:14:18.955259+0000","last_fullsized":"2023-10-06T11:14:18.955259+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:09.543931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.965521+0000","last_change":"2023-10-06T11:14:18.965521+0000","last_active":"2023-10-06T11:14:18.965521+0000","last_peered":"2023-10-06T11:14:18.965521+0000","last_clean":"2023-10-06T11:14:18.965521+0000","last_became_active":"2023-10-06T11:14:18.965271+0000","last_became_peered":"2023-10-06T11:14:18.965271+0000","last_unstale":"2023-10-06T11:14:18.965521+0000","last_undegraded":"2023-10-06T11:14:18.965521+0000","last_fullsized":"2023-10-06T11:14:18.965521+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:41:12.286981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.966974+0000","last_change":"2023-10-06T11:14:17.963762+0000","last_active":"2023-10-06T11:14:17.966974+0000","last_peered":"2023-10-06T11:14:17.966974+0000","last_clean":"2023-10-06T11:14:17.966974+0000","last_became_active":"2023-10-06T11:14:17.963528+0000","last_became_peered":"2023-10-06T11:14:17.963528+0000","last_unstale":"2023-10-06T11:14:17.966974+0000","last_undegraded":"2023-10-06T11:14:17.966974+0000","last_fullsized":"2023-10-06T11:14:17.966974+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:43.454231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970813+0000","last_change":"2023-10-06T11:14:18.970813+0000","last_active":"2023-10-06T11:14:18.970813+0000","last_peered":"2023-10-06T11:14:18.970813+0000","last_clean":"2023-10-06T11:14:18.970813+0000","last_became_active":"2023-10-06T11:14:18.970502+0000","last_became_peered":"2023-10-06T11:14:18.970502+0000","last_unstale":"2023-10-06T11:14:18.970813+0000","last_undegraded":"2023-10-06T11:14:18.970813+0000","last_fullsized":"2023-10-06T11:14:18.970813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.207652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969623+0000","last_change":"2023-10-06T11:14:17.964120+0000","last_active":"2023-10-06T11:14:17.969623+0000","last_peered":"2023-10-06T11:14:17.969623+0000","last_clean":"2023-10-06T11:14:17.969623+0000","last_became_active":"2023-10-06T11:14:17.963845+0000","last_became_peered":"2023-10-06T11:14:17.963845+0000","last_unstale":"2023-10-06T11:14:17.969623+0000","last_undegraded":"2023-10-06T11:14:17.969623+0000","last_fullsized":"2023-10-06T11:14:17.969623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.337460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978218+0000","last_change":"2023-10-06T11:14:18.978218+0000","last_active":"2023-10-06T11:14:18.978218+0000","last_peered":"2023-10-06T11:14:18.978218+0000","last_clean":"2023-10-06T11:14:18.978218+0000","last_became_active":"2023-10-06T11:14:18.977812+0000","last_became_peered":"2023-10-06T11:14:18.977812+0000","last_unstale":"2023-10-06T11:14:18.978218+0000","last_undegraded":"2023-10-06T11:14:18.978218+0000","last_fullsized":"2023-10-06T11:14:18.978218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:32.918524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.966228+0000","last_change":"2023-10-06T11:14:17.960650+0000","last_active":"2023-10-06T11:14:17.966228+0000","last_peered":"2023-10-06T11:14:17.966228+0000","last_clean":"2023-10-06T11:14:17.966228+0000","last_became_active":"2023-10-06T11:14:17.960379+0000","last_became_peered":"2023-10-06T11:14:17.960379+0000","last_unstale":"2023-10-06T11:14:17.966228+0000","last_undegraded":"2023-10-06T11:14:17.966228+0000","last_fullsized":"2023-10-06T11:14:17.966228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:50.704759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970536+0000","last_change":"2023-10-06T11:14:18.970536+0000","last_active":"2023-10-06T11:14:18.970536+0000","last_peered":"2023-10-06T11:14:18.970536+0000","last_clean":"2023-10-06T11:14:18.970536+0000","last_became_active":"2023-10-06T11:14:18.970231+0000","last_became_peered":"2023-10-06T11:14:18.970231+0000","last_unstale":"2023-10-06T11:14:18.970536+0000","last_undegraded":"2023-10-06T11:14:18.970536+0000","last_fullsized":"2023-10-06T11:14:18.970536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:16:42.696963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969734+0000","last_change":"2023-10-06T11:14:17.967166+0000","last_active":"2023-10-06T11:14:17.969734+0000","last_peered":"2023-10-06T11:14:17.969734+0000","last_clean":"2023-10-06T11:14:17.969734+0000","last_became_active":"2023-10-06T11:14:17.966899+0000","last_became_peered":"2023-10-06T11:14:17.966899+0000","last_unstale":"2023-10-06T11:14:17.969734+0000","last_undegraded":"2023-10-06T11:14:17.969734+0000","last_fullsized":"2023-10-06T11:14:17.969734+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:14.971412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.964557+0000","last_change":"2023-10-06T11:14:18.964557+0000","last_active":"2023-10-06T11:14:18.964557+0000","last_peered":"2023-10-06T11:14:18.964557+0000","last_clean":"2023-10-06T11:14:18.964557+0000","last_became_active":"2023-10-06T11:14:18.964296+0000","last_became_peered":"2023-10-06T11:14:18.964296+0000","last_unstale":"2023-10-06T11:14:18.964557+0000","last_undegraded":"2023-10-06T11:14:18.964557+0000","last_fullsized":"2023-10-06T11:14:18.964557+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:41.789678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.983679+0000","last_change":"2023-10-06T11:14:17.968212+0000","last_active":"2023-10-06T11:14:18.983679+0000","last_peered":"2023-10-06T11:14:18.983679+0000","last_clean":"2023-10-06T11:14:18.983679+0000","last_became_active":"2023-10-06T11:14:17.967538+0000","last_became_peered":"2023-10-06T11:14:17.967538+0000","last_unstale":"2023-10-06T11:14:18.983679+0000","last_undegraded":"2023-10-06T11:14:18.983679+0000","last_fullsized":"2023-10-06T11:14:18.983679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:44.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970455+0000","last_change":"2023-10-06T11:14:18.970455+0000","last_active":"2023-10-06T11:14:18.970455+0000","last_peered":"2023-10-06T11:14:18.970455+0000","last_clean":"2023-10-06T11:14:18.970455+0000","last_became_active":"2023-10-06T11:14:18.970183+0000","last_became_peered":"2023-10-06T11:14:18.970183+0000","last_unstale":"2023-10-06T11:14:18.970455+0000","last_undegraded":"2023-10-06T11:14:18.970455+0000","last_fullsized":"2023-10-06T11:14:18.970455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:36.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.986457+0000","last_change":"2023-10-06T11:14:17.964760+0000","last_active":"2023-10-06T11:14:18.986457+0000","last_peered":"2023-10-06T11:14:18.986457+0000","last_clean":"2023-10-06T11:14:18.986457+0000","last_became_active":"2023-10-06T11:14:17.964392+0000","last_became_peered":"2023-10-06T11:14:17.964392+0000","last_unstale":"2023-10-06T11:14:18.986457+0000","last_undegraded":"2023-10-06T11:14:18.986457+0000","last_fullsized":"2023-10-06T11:14:18.986457+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:39.154169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.980865+0000","last_change":"2023-10-06T11:14:18.980865+0000","last_active":"2023-10-06T11:14:18.980865+0000","last_peered":"2023-10-06T11:14:18.980865+0000","last_clean":"2023-10-06T11:14:18.980865+0000","last_became_active":"2023-10-06T11:14:18.980569+0000","last_became_peered":"2023-10-06T11:14:18.980569+0000","last_unstale":"2023-10-06T11:14:18.980865+0000","last_undegraded":"2023-10-06T11:14:18.980865+0000","last_fullsized":"2023-10-06T11:14:18.980865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:22.359522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.986106+0000","last_change":"2023-10-06T11:14:17.966558+0000","last_active":"2023-10-06T11:14:18.986106+0000","last_peered":"2023-10-06T11:14:18.986106+0000","last_clean":"2023-10-06T11:14:18.986106+0000","last_became_active":"2023-10-06T11:14:17.965636+0000","last_became_peered":"2023-10-06T11:14:17.965636+0000","last_unstale":"2023-10-06T11:14:18.986106+0000","last_undegraded":"2023-10-06T11:14:18.986106+0000","last_fullsized":"2023-10-06T11:14:18.986106+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:09.543931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970325+0000","last_change":"2023-10-06T11:14:18.970325+0000","last_active":"2023-10-06T11:14:18.970325+0000","last_peered":"2023-10-06T11:14:18.970325+0000","last_clean":"2023-10-06T11:14:18.970325+0000","last_became_active":"2023-10-06T11:14:18.970033+0000","last_became_peered":"2023-10-06T11:14:18.970033+0000","last_unstale":"2023-10-06T11:14:18.970325+0000","last_undegraded":"2023-10-06T11:14:18.970325+0000","last_fullsized":"2023-10-06T11:14:18.970325+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:06.395481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.963286+0000","last_change":"2023-10-06T11:14:17.959651+0000","last_active":"2023-10-06T11:14:17.963286+0000","last_peered":"2023-10-06T11:14:17.963286+0000","last_clean":"2023-10-06T11:14:17.963286+0000","last_became_active":"2023-10-06T11:14:17.958106+0000","last_became_peered":"2023-10-06T11:14:17.958106+0000","last_unstale":"2023-10-06T11:14:17.963286+0000","last_undegraded":"2023-10-06T11:14:17.963286+0000","last_fullsized":"2023-10-06T11:14:17.963286+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:21.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.963960+0000","last_change":"2023-10-06T11:14:18.963960+0000","last_active":"2023-10-06T11:14:18.963960+0000","last_peered":"2023-10-06T11:14:18.963960+0000","last_clean":"2023-10-06T11:14:18.963960+0000","last_became_active":"2023-10-06T11:14:18.963671+0000","last_became_peered":"2023-10-06T11:14:18.963671+0000","last_unstale":"2023-10-06T11:14:18.963960+0000","last_undegraded":"2023-10-06T11:14:18.963960+0000","last_fullsized":"2023-10-06T11:14:18.963960+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:37.456182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.968743+0000","last_change":"2023-10-06T11:14:17.962482+0000","last_active":"2023-10-06T11:14:17.968743+0000","last_peered":"2023-10-06T11:14:17.968743+0000","last_clean":"2023-10-06T11:14:17.968743+0000","last_became_active":"2023-10-06T11:14:17.962195+0000","last_became_peered":"2023-10-06T11:14:17.962195+0000","last_unstale":"2023-10-06T11:14:17.968743+0000","last_undegraded":"2023-10-06T11:14:17.968743+0000","last_fullsized":"2023-10-06T11:14:17.968743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:16:41.685883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.975912+0000","last_change":"2023-10-06T11:14:18.975912+0000","last_active":"2023-10-06T11:14:18.975912+0000","last_peered":"2023-10-06T11:14:18.975912+0000","last_clean":"2023-10-06T11:14:18.975912+0000","last_became_active":"2023-10-06T11:14:18.975639+0000","last_became_peered":"2023-10-06T11:14:18.975639+0000","last_unstale":"2023-10-06T11:14:18.975912+0000","last_undegraded":"2023-10-06T11:14:18.975912+0000","last_fullsized":"2023-10-06T11:14:18.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:31.610595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.986908+0000","last_change":"2023-10-06T11:14:17.965207+0000","last_active":"2023-10-06T11:14:18.986908+0000","last_peered":"2023-10-06T11:14:18.986908+0000","last_clean":"2023-10-06T11:14:18.986908+0000","last_became_active":"2023-10-06T11:14:17.964914+0000","last_became_peered":"2023-10-06T11:14:17.964914+0000","last_unstale":"2023-10-06T11:14:18.986908+0000","last_undegraded":"2023-10-06T11:14:18.986908+0000","last_fullsized":"2023-10-06T11:14:18.986908+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:44.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967484+0000","last_change":"2023-10-06T11:14:18.967484+0000","last_active":"2023-10-06T11:14:18.967484+0000","last_peered":"2023-10-06T11:14:18.967484+0000","last_clean":"2023-10-06T11:14:18.967484+0000","last_became_active":"2023-10-06T11:14:18.967169+0000","last_became_peered":"2023-10-06T11:14:18.967169+0000","last_unstale":"2023-10-06T11:14:18.967484+0000","last_undegraded":"2023-10-06T11:14:18.967484+0000","last_fullsized":"2023-10-06T11:14:18.967484+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:04.826846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.950666+0000","last_change":"2023-10-06T11:14:17.964976+0000","last_active":"2023-10-06T11:14:18.950666+0000","last_peered":"2023-10-06T11:14:18.950666+0000","last_clean":"2023-10-06T11:14:18.950666+0000","last_became_active":"2023-10-06T11:14:17.964682+0000","last_became_peered":"2023-10-06T11:14:17.964682+0000","last_unstale":"2023-10-06T11:14:18.950666+0000","last_undegraded":"2023-10-06T11:14:18.950666+0000","last_fullsized":"2023-10-06T11:14:18.950666+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:57.806481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.977918+0000","last_change":"2023-10-06T11:14:18.977918+0000","last_active":"2023-10-06T11:14:18.977918+0000","last_peered":"2023-10-06T11:14:18.977918+0000","last_clean":"2023-10-06T11:14:18.977918+0000","last_became_active":"2023-10-06T11:14:18.977593+0000","last_became_peered":"2023-10-06T11:14:18.977593+0000","last_unstale":"2023-10-06T11:14:18.977918+0000","last_undegraded":"2023-10-06T11:14:18.977918+0000","last_fullsized":"2023-10-06T11:14:18.977918+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:43.855676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.985479+0000","last_change":"2023-10-06T11:14:17.958731+0000","last_active":"2023-10-06T11:14:18.985479+0000","last_peered":"2023-10-06T11:14:18.985479+0000","last_clean":"2023-10-06T11:14:18.985479+0000","last_became_active":"2023-10-06T11:14:17.958450+0000","last_became_peered":"2023-10-06T11:14:17.958450+0000","last_unstale":"2023-10-06T11:14:18.985479+0000","last_undegraded":"2023-10-06T11:14:18.985479+0000","last_fullsized":"2023-10-06T11:14:18.985479+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:35.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.973598+0000","last_change":"2023-10-06T11:14:18.973598+0000","last_active":"2023-10-06T11:14:18.973598+0000","last_peered":"2023-10-06T11:14:18.973598+0000","last_clean":"2023-10-06T11:14:18.973598+0000","last_became_active":"2023-10-06T11:14:18.972875+0000","last_became_peered":"2023-10-06T11:14:18.972875+0000","last_unstale":"2023-10-06T11:14:18.973598+0000","last_undegraded":"2023-10-06T11:14:18.973598+0000","last_fullsized":"2023-10-06T11:14:18.973598+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:18.655703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.960268+0000","last_change":"2023-10-06T11:14:17.964781+0000","last_active":"2023-10-06T11:14:18.960268+0000","last_peered":"2023-10-06T11:14:18.960268+0000","last_clean":"2023-10-06T11:14:18.960268+0000","last_became_active":"2023-10-06T11:14:17.964488+0000","last_became_peered":"2023-10-06T11:14:17.964488+0000","last_unstale":"2023-10-06T11:14:18.960268+0000","last_undegraded":"2023-10-06T11:14:18.960268+0000","last_fullsized":"2023-10-06T11:14:18.960268+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:14.971412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.971494+0000","last_change":"2023-10-06T11:14:18.971494+0000","last_active":"2023-10-06T11:14:18.971494+0000","last_peered":"2023-10-06T11:14:18.971494+0000","last_clean":"2023-10-06T11:14:18.971494+0000","last_became_active":"2023-10-06T11:14:18.971208+0000","last_became_peered":"2023-10-06T11:14:18.971208+0000","last_unstale":"2023-10-06T11:14:18.971494+0000","last_undegraded":"2023-10-06T11:14:18.971494+0000","last_fullsized":"2023-10-06T11:14:18.971494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:49.510963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969815+0000","last_change":"2023-10-06T11:14:17.966342+0000","last_active":"2023-10-06T11:14:17.969815+0000","last_peered":"2023-10-06T11:14:17.969815+0000","last_clean":"2023-10-06T11:14:17.969815+0000","last_became_active":"2023-10-06T11:14:17.966073+0000","last_became_peered":"2023-10-06T11:14:17.966073+0000","last_unstale":"2023-10-06T11:14:17.969815+0000","last_undegraded":"2023-10-06T11:14:17.969815+0000","last_fullsized":"2023-10-06T11:14:17.969815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:44.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966197+0000","last_change":"2023-10-06T11:14:18.966197+0000","last_active":"2023-10-06T11:14:18.966197+0000","last_peered":"2023-10-06T11:14:18.966197+0000","last_clean":"2023-10-06T11:14:18.966197+0000","last_became_active":"2023-10-06T11:14:18.965908+0000","last_became_peered":"2023-10-06T11:14:18.965908+0000","last_unstale":"2023-10-06T11:14:18.966197+0000","last_undegraded":"2023-10-06T11:14:18.966197+0000","last_fullsized":"2023-10-06T11:14:18.966197+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:17.351818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.981410+0000","last_change":"2023-10-06T11:14:17.966763+0000","last_active":"2023-10-06T11:14:18.981410+0000","last_peered":"2023-10-06T11:14:18.981410+0000","last_clean":"2023-10-06T11:14:18.981410+0000","last_became_active":"2023-10-06T11:14:17.966361+0000","last_became_peered":"2023-10-06T11:14:17.966361+0000","last_unstale":"2023-10-06T11:14:18.981410+0000","last_undegraded":"2023-10-06T11:14:18.981410+0000","last_fullsized":"2023-10-06T11:14:18.981410+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:00.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968456+0000","last_change":"2023-10-06T11:14:18.968456+0000","last_active":"2023-10-06T11:14:18.968456+0000","last_peered":"2023-10-06T11:14:18.968456+0000","last_clean":"2023-10-06T11:14:18.968456+0000","last_became_active":"2023-10-06T11:14:18.968201+0000","last_became_peered":"2023-10-06T11:14:18.968201+0000","last_unstale":"2023-10-06T11:14:18.968456+0000","last_undegraded":"2023-10-06T11:14:18.968456+0000","last_fullsized":"2023-10-06T11:14:18.968456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:15.982493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970236+0000","last_change":"2023-10-06T11:14:17.967319+0000","last_active":"2023-10-06T11:14:17.970236+0000","last_peered":"2023-10-06T11:14:17.970236+0000","last_clean":"2023-10-06T11:14:17.970236+0000","last_became_active":"2023-10-06T11:14:17.967051+0000","last_became_peered":"2023-10-06T11:14:17.967051+0000","last_unstale":"2023-10-06T11:14:17.970236+0000","last_undegraded":"2023-10-06T11:14:17.970236+0000","last_fullsized":"2023-10-06T11:14:17.970236+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:14.566425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968875+0000","last_change":"2023-10-06T11:14:18.968875+0000","last_active":"2023-10-06T11:14:18.968875+0000","last_peered":"2023-10-06T11:14:18.968875+0000","last_clean":"2023-10-06T11:14:18.968875+0000","last_became_active":"2023-10-06T11:14:18.967108+0000","last_became_peered":"2023-10-06T11:14:18.967108+0000","last_unstale":"2023-10-06T11:14:18.968875+0000","last_undegraded":"2023-10-06T11:14:18.968875+0000","last_fullsized":"2023-10-06T11:14:18.968875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.207652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969787+0000","last_change":"2023-10-06T11:14:17.967090+0000","last_active":"2023-10-06T11:14:17.969787+0000","last_peered":"2023-10-06T11:14:17.969787+0000","last_clean":"2023-10-06T11:14:17.969787+0000","last_became_active":"2023-10-06T11:14:17.966814+0000","last_became_peered":"2023-10-06T11:14:17.966814+0000","last_unstale":"2023-10-06T11:14:17.969787+0000","last_undegraded":"2023-10-06T11:14:17.969787+0000","last_fullsized":"2023-10-06T11:14:17.969787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:21.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974852+0000","last_change":"2023-10-06T11:14:18.974852+0000","last_active":"2023-10-06T11:14:18.974852+0000","last_peered":"2023-10-06T11:14:18.974852+0000","last_clean":"2023-10-06T11:14:18.974852+0000","last_became_active":"2023-10-06T11:14:18.974587+0000","last_became_peered":"2023-10-06T11:14:18.974587+0000","last_unstale":"2023-10-06T11:14:18.974852+0000","last_undegraded":"2023-10-06T11:14:18.974852+0000","last_fullsized":"2023-10-06T11:14:18.974852+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:10.927643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.963396+0000","last_change":"2023-10-06T11:14:17.959791+0000","last_active":"2023-10-06T11:14:17.963396+0000","last_peered":"2023-10-06T11:14:17.963396+0000","last_clean":"2023-10-06T11:14:17.963396+0000","last_became_active":"2023-10-06T11:14:17.959490+0000","last_became_peered":"2023-10-06T11:14:17.959490+0000","last_unstale":"2023-10-06T11:14:17.963396+0000","last_undegraded":"2023-10-06T11:14:17.963396+0000","last_fullsized":"2023-10-06T11:14:17.963396+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:22.336499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.964583+0000","last_change":"2023-10-06T11:14:18.964583+0000","last_active":"2023-10-06T11:14:18.964583+0000","last_peered":"2023-10-06T11:14:18.964583+0000","last_clean":"2023-10-06T11:14:18.964583+0000","last_became_active":"2023-10-06T11:14:18.964344+0000","last_became_peered":"2023-10-06T11:14:18.964344+0000","last_unstale":"2023-10-06T11:14:18.964583+0000","last_undegraded":"2023-10-06T11:14:18.964583+0000","last_fullsized":"2023-10-06T11:14:18.964583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:48.272950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.974582+0000","last_change":"2023-10-06T11:14:17.969522+0000","last_active":"2023-10-06T11:14:17.974582+0000","last_peered":"2023-10-06T11:14:17.974582+0000","last_clean":"2023-10-06T11:14:17.974582+0000","last_became_active":"2023-10-06T11:14:17.969237+0000","last_became_peered":"2023-10-06T11:14:17.969237+0000","last_unstale":"2023-10-06T11:14:17.974582+0000","last_undegraded":"2023-10-06T11:14:17.974582+0000","last_fullsized":"2023-10-06T11:14:17.974582+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:14.566425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.953065+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:14:17.953065+0000","last_peered":"2023-10-06T11:14:17.953065+0000","last_clean":"2023-10-06T11:14:17.953065+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:14:17.953065+0000","last_undegraded":"2023-10-06T11:14:17.953065+0000","last_fullsized":"2023-10-06T11:14:17.953065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.980576+0000","last_change":"2023-10-06T11:14:18.980576+0000","last_active":"2023-10-06T11:14:18.980576+0000","last_peered":"2023-10-06T11:14:18.980576+0000","last_clean":"2023-10-06T11:14:18.980576+0000","last_became_active":"2023-10-06T11:14:18.980309+0000","last_became_peered":"2023-10-06T11:14:18.980309+0000","last_unstale":"2023-10-06T11:14:18.980576+0000","last_undegraded":"2023-10-06T11:14:18.980576+0000","last_fullsized":"2023-10-06T11:14:18.980576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:23.347579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969961+0000","last_change":"2023-10-06T11:14:17.963551+0000","last_active":"2023-10-06T11:14:17.969961+0000","last_peered":"2023-10-06T11:14:17.969961+0000","last_clean":"2023-10-06T11:14:17.969961+0000","last_became_active":"2023-10-06T11:14:17.963279+0000","last_became_peered":"2023-10-06T11:14:17.963279+0000","last_unstale":"2023-10-06T11:14:17.969961+0000","last_undegraded":"2023-10-06T11:14:17.969961+0000","last_fullsized":"2023-10-06T11:14:17.969961+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:47.320930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.959251+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:14:17.959251+0000","last_peered":"2023-10-06T11:14:17.959251+0000","last_clean":"2023-10-06T11:14:17.959251+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:14:17.959251+0000","last_undegraded":"2023-10-06T11:14:17.959251+0000","last_fullsized":"2023-10-06T11:14:17.959251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.973939+0000","last_change":"2023-10-06T11:14:18.973939+0000","last_active":"2023-10-06T11:14:18.973939+0000","last_peered":"2023-10-06T11:14:18.973939+0000","last_clean":"2023-10-06T11:14:18.973939+0000","last_became_active":"2023-10-06T11:14:18.973651+0000","last_became_peered":"2023-10-06T11:14:18.973651+0000","last_unstale":"2023-10-06T11:14:18.973939+0000","last_undegraded":"2023-10-06T11:14:18.973939+0000","last_fullsized":"2023-10-06T11:14:18.973939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:45:11.573526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970019+0000","last_change":"2023-10-06T11:14:17.968086+0000","last_active":"2023-10-06T11:14:17.970019+0000","last_peered":"2023-10-06T11:14:17.970019+0000","last_clean":"2023-10-06T11:14:17.970019+0000","last_became_active":"2023-10-06T11:14:17.967134+0000","last_became_peered":"2023-10-06T11:14:17.967134+0000","last_unstale":"2023-10-06T11:14:17.970019+0000","last_undegraded":"2023-10-06T11:14:17.970019+0000","last_fullsized":"2023-10-06T11:14:17.970019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:14.566425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.952403+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:14:17.952403+0000","last_peered":"2023-10-06T11:14:17.952403+0000","last_clean":"2023-10-06T11:14:17.952403+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:14:17.952403+0000","last_undegraded":"2023-10-06T11:14:17.952403+0000","last_fullsized":"2023-10-06T11:14:17.952403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974183+0000","last_change":"2023-10-06T11:14:18.974183+0000","last_active":"2023-10-06T11:14:18.974183+0000","last_peered":"2023-10-06T11:14:18.974183+0000","last_clean":"2023-10-06T11:14:18.974183+0000","last_became_active":"2023-10-06T11:14:18.970202+0000","last_became_peered":"2023-10-06T11:14:18.970202+0000","last_unstale":"2023-10-06T11:14:18.974183+0000","last_undegraded":"2023-10-06T11:14:18.974183+0000","last_fullsized":"2023-10-06T11:14:18.974183+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.043895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.984211+0000","last_change":"2023-10-06T11:14:17.969680+0000","last_active":"2023-10-06T11:14:18.984211+0000","last_peered":"2023-10-06T11:14:18.984211+0000","last_clean":"2023-10-06T11:14:18.984211+0000","last_became_active":"2023-10-06T11:14:17.969373+0000","last_became_peered":"2023-10-06T11:14:17.969373+0000","last_unstale":"2023-10-06T11:14:18.984211+0000","last_undegraded":"2023-10-06T11:14:18.984211+0000","last_fullsized":"2023-10-06T11:14:18.984211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:21.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.958962+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:14:17.958962+0000","last_peered":"2023-10-06T11:14:17.958962+0000","last_clean":"2023-10-06T11:14:17.958962+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:14:17.958962+0000","last_undegraded":"2023-10-06T11:14:17.958962+0000","last_fullsized":"2023-10-06T11:14:17.958962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.950911+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:14:17.950911+0000","last_peered":"2023-10-06T11:14:17.950911+0000","last_clean":"2023-10-06T11:14:17.950911+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:14:17.950911+0000","last_undegraded":"2023-10-06T11:14:17.950911+0000","last_fullsized":"2023-10-06T11:14:17.950911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966645+0000","last_change":"2023-10-06T11:14:18.966645+0000","last_active":"2023-10-06T11:14:18.966645+0000","last_peered":"2023-10-06T11:14:18.966645+0000","last_clean":"2023-10-06T11:14:18.966645+0000","last_became_active":"2023-10-06T11:14:18.966362+0000","last_became_peered":"2023-10-06T11:14:18.966362+0000","last_unstale":"2023-10-06T11:14:18.966645+0000","last_undegraded":"2023-10-06T11:14:18.966645+0000","last_fullsized":"2023-10-06T11:14:18.966645+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:01:50.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970975+0000","last_change":"2023-10-06T11:14:17.964330+0000","last_active":"2023-10-06T11:14:17.970975+0000","last_peered":"2023-10-06T11:14:17.970975+0000","last_clean":"2023-10-06T11:14:17.970975+0000","last_became_active":"2023-10-06T11:14:17.964049+0000","last_became_peered":"2023-10-06T11:14:17.964049+0000","last_unstale":"2023-10-06T11:14:17.970975+0000","last_undegraded":"2023-10-06T11:14:17.970975+0000","last_fullsized":"2023-10-06T11:14:17.970975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:41.369028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.950996+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:14:17.950996+0000","last_peered":"2023-10-06T11:14:17.950996+0000","last_clean":"2023-10-06T11:14:17.950996+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:14:17.950996+0000","last_undegraded":"2023-10-06T11:14:17.950996+0000","last_fullsized":"2023-10-06T11:14:17.950996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.972318+0000","last_change":"2023-10-06T11:14:18.972318+0000","last_active":"2023-10-06T11:14:18.972318+0000","last_peered":"2023-10-06T11:14:18.972318+0000","last_clean":"2023-10-06T11:14:18.972318+0000","last_became_active":"2023-10-06T11:14:18.972069+0000","last_became_peered":"2023-10-06T11:14:18.972069+0000","last_unstale":"2023-10-06T11:14:18.972318+0000","last_undegraded":"2023-10-06T11:14:18.972318+0000","last_fullsized":"2023-10-06T11:14:18.972318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:50.938966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.971038+0000","last_change":"2023-10-06T11:14:17.967562+0000","last_active":"2023-10-06T11:14:17.971038+0000","last_peered":"2023-10-06T11:14:17.971038+0000","last_clean":"2023-10-06T11:14:17.971038+0000","last_became_active":"2023-10-06T11:14:17.967315+0000","last_became_peered":"2023-10-06T11:14:17.967315+0000","last_unstale":"2023-10-06T11:14:17.971038+0000","last_undegraded":"2023-10-06T11:14:17.971038+0000","last_fullsized":"2023-10-06T11:14:17.971038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:40.465176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.956311+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:14:17.956311+0000","last_peered":"2023-10-06T11:14:17.956311+0000","last_clean":"2023-10-06T11:14:17.956311+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:14:17.956311+0000","last_undegraded":"2023-10-06T11:14:17.956311+0000","last_fullsized":"2023-10-06T11:14:17.956311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966707+0000","last_change":"2023-10-06T11:14:18.966707+0000","last_active":"2023-10-06T11:14:18.966707+0000","last_peered":"2023-10-06T11:14:18.966707+0000","last_clean":"2023-10-06T11:14:18.966707+0000","last_became_active":"2023-10-06T11:14:18.966383+0000","last_became_peered":"2023-10-06T11:14:18.966383+0000","last_unstale":"2023-10-06T11:14:18.966707+0000","last_undegraded":"2023-10-06T11:14:18.966707+0000","last_fullsized":"2023-10-06T11:14:18.966707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:41:12.286981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970125+0000","last_change":"2023-10-06T11:14:17.969441+0000","last_active":"2023-10-06T11:14:17.970125+0000","last_peered":"2023-10-06T11:14:17.970125+0000","last_clean":"2023-10-06T11:14:17.970125+0000","last_became_active":"2023-10-06T11:14:17.969180+0000","last_became_peered":"2023-10-06T11:14:17.969180+0000","last_unstale":"2023-10-06T11:14:17.970125+0000","last_undegraded":"2023-10-06T11:14:17.970125+0000","last_fullsized":"2023-10-06T11:14:17.970125+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:38.716683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.954277+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:14:17.954277+0000","last_peered":"2023-10-06T11:14:17.954277+0000","last_clean":"2023-10-06T11:14:17.954277+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:14:17.954277+0000","last_undegraded":"2023-10-06T11:14:17.954277+0000","last_fullsized":"2023-10-06T11:14:17.954277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970132+0000","last_change":"2023-10-06T11:14:18.970132+0000","last_active":"2023-10-06T11:14:18.970132+0000","last_peered":"2023-10-06T11:14:18.970132+0000","last_clean":"2023-10-06T11:14:18.970132+0000","last_became_active":"2023-10-06T11:14:18.969883+0000","last_became_peered":"2023-10-06T11:14:18.969883+0000","last_unstale":"2023-10-06T11:14:18.970132+0000","last_undegraded":"2023-10-06T11:14:18.970132+0000","last_fullsized":"2023-10-06T11:14:18.970132+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:42.003650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970153+0000","last_change":"2023-10-06T11:14:17.969290+0000","last_active":"2023-10-06T11:14:17.970153+0000","last_peered":"2023-10-06T11:14:17.970153+0000","last_clean":"2023-10-06T11:14:17.970153+0000","last_became_active":"2023-10-06T11:14:17.968663+0000","last_became_peered":"2023-10-06T11:14:17.968663+0000","last_unstale":"2023-10-06T11:14:17.970153+0000","last_undegraded":"2023-10-06T11:14:17.970153+0000","last_fullsized":"2023-10-06T11:14:17.970153+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:43.454231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.963587+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:14:17.963587+0000","last_peered":"2023-10-06T11:14:17.963587+0000","last_clean":"2023-10-06T11:14:17.963587+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:14:17.963587+0000","last_undegraded":"2023-10-06T11:14:17.963587+0000","last_fullsized":"2023-10-06T11:14:17.963587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":798724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.501},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.6850000000000005,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":798724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.378},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28000000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.312},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.373}]},{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.317},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.372},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.442}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:14:23.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.239+0000 7fa055ab9700 1 Processor -- start 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.239+0000 7fa055ab9700 1 -- start start 2023-10-06T11:14:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa055ab9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa050159440 0x7fa0500b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa055ab9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0500b35d0 0x7fa0500cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa055ab9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0500cb7a0 con 0x7fa0500cc170 2023-10-06T11:14:23.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa055ab9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500b0860 con 0x7fa0500b35d0 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa055ab9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500cb150 con 0x7fa050159440 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa04ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa0500b35d0 0x7fa0500cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa0552b8700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa0500cc170 0x7fa0500b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55846/0 (socket says 172.21.15.55:55846) 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa0552b8700 1 -- 172.21.15.55:0/1324817104 learned_addr learned my addr 172.21.15.55:0/1324817104 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa04ffff700 1 -- 172.21.15.55:0/1324817104 >> v2:172.21.15.142:3300/0 conn(0x7fa050159440 msgr2=0x7fa0500b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa054ab7700 1 --2- 172.21.15.55:0/1324817104 >> v2:172.21.15.142:3300/0 conn(0x7fa050159440 0x7fa0500b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04ffff700 1 --2- 172.21.15.55:0/1324817104 >> v2:172.21.15.142:3300/0 conn(0x7fa050159440 0x7fa0500b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04ffff700 1 -- 172.21.15.55:0/1324817104 >> v1:172.21.15.55:6789/0 conn(0x7fa0500cc170 legacy=0x7fa0500b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04ffff700 1 -- 172.21.15.55:0/1324817104 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500cb430 con 0x7fa0500b35d0 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.240+0000 7fa04f7fe700 1 -- 172.21.15.55:0/1324817104 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873892670 0 0) 0x7fa0500cb7a0 con 0x7fa0500cc170 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa054ab7700 1 --2- 172.21.15.55:0/1324817104 >> v2:172.21.15.142:3300/0 conn(0x7fa050159440 0x7fa0500b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:23.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04ffff700 1 --2- 172.21.15.55:0/1324817104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500cbc30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa05006f9f0 tx=0x7fa0440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649abf43449c41ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04f7fe700 1 -- 172.21.15.55:0/1324817104 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400b6b0 con 0x7fa0500b35d0 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04f7fe700 1 -- 172.21.15.55:0/1324817104 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400b810 con 0x7fa0500b35d0 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa04f7fe700 1 -- 172.21.15.55:0/1324817104 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400bbb0 con 0x7fa0500b35d0 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 -- 172.21.15.55:0/1324817104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 msgr2=0x7fa0500cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1324817104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500cbc30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa05006f9f0 tx=0x7fa0440091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 -- 172.21.15.55:0/1324817104 shutdown_connections 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1324817104 >> v2:172.21.15.142:3300/0 conn(0x7fa050159440 0x7fa0500b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1324817104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500cbc30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 -- 172.21.15.55:0/1324817104 >> 172.21.15.55:0/1324817104 conn(0x7fa05006ece0 msgr2=0x7fa05006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 -- 172.21.15.55:0/1324817104 shutdown_connections 2023-10-06T11:14:23.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.241+0000 7fa055ab9700 1 -- 172.21.15.55:0/1324817104 wait complete. 2023-10-06T11:14:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 Processor -- start 2023-10-06T11:14:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 -- start start 2023-10-06T11:14:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0500cc170 0x7fa0500d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa050159440 0x7fa05016c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500d0680 con 0x7fa0500b35d0 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500c5410 con 0x7fa0500cc170 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.243+0000 7fa055ab9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500c7490 con 0x7fa050159440 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50392/0 (socket says 172.21.15.55:50392) 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 -- 172.21.15.55:0/1392635413 learned_addr learned my addr 172.21.15.55:0/1392635413 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa04ffff700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0500cc170 0x7fa0500d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa0552b8700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa050159440 0x7fa05016c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 -- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa050159440 msgr2=0x7fa05016c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa050159440 0x7fa05016c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 -- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0500cc170 msgr2=0x7fa0500d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0500cc170 0x7fa0500d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 -- 172.21.15.55:0/1392635413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009420 con 0x7fa0500b35d0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa04ffff700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0500cc170 0x7fa0500d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa054ab7700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500c44d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c880 tx=0x7fa040008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011600 con 0x7fa0500b35d0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040011760 con 0x7fa0500b35d0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0500c4b70 con 0x7fa0500b35d0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011b00 con 0x7fa0500b35d0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.244+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0500c5130 con 0x7fa0500b35d0 2023-10-06T11:14:23.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.245+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05005f230 con 0x7fa0500b35d0 2023-10-06T11:14:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.246+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa040018350 con 0x7fa0500b35d0 2023-10-06T11:14:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.246+0000 7fa04cff9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa03c066f30 0x7fa03c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.246+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa040084710 con 0x7fa0500b35d0 2023-10-06T11:14:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.246+0000 7fa04ffff700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa03c066f30 0x7fa03c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.247+0000 7fa04ffff700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa03c066f30 0x7fa03c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa05016d8b0 tx=0x7fa044017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.250+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0400516e0 con 0x7fa0500b35d0 2023-10-06T11:14:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.441+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0500c75d0 con 0x7fa03c066f30 2023-10-06T11:14:23.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.450+0000 7fa04cff9700 1 -- 172.21.15.55:0/1392635413 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311253 (secure 0 0 0) 0x7fa04400b980 con 0x7fa03c066f30 2023-10-06T11:14:23.455 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:23.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa03c066f30 msgr2=0x7fa03c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa03c066f30 0x7fa03c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa05016d8b0 tx=0x7fa044017000 comp rx=0 tx=0).stop 2023-10-06T11:14:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 msgr2=0x7fa0500c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500c44d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c880 tx=0x7fa040008040 comp rx=0 tx=0).stop 2023-10-06T11:14:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 shutdown_connections 2023-10-06T11:14:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa03c066f30 0x7fa03c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0500b35d0 0x7fa0500c44d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa050159440 0x7fa05016c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 --2- 172.21.15.55:0/1392635413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0500cc170 0x7fa0500d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 >> 172.21.15.55:0/1392635413 conn(0x7fa05006ece0 msgr2=0x7fa0500b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 shutdown_connections 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.453+0000 7fa055ab9700 1 -- 172.21.15.55:0/1392635413 wait complete. 2023-10-06T11:14:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:14:23.467 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-06T11:14:22.857523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383176,"kb_used_data":4872,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591544,"statfs":{"total":773094113280,"available":770653741056,"internally_reserved":0,"allocated":4988928,"data_stored":2847584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912592"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969387+0000","last_change":"2023-10-06T11:14:18.969387+0000","last_active":"2023-10-06T11:14:18.969387+0000","last_peered":"2023-10-06T11:14:18.969387+0000","last_clean":"2023-10-06T11:14:18.969387+0000","last_became_active":"2023-10-06T11:14:18.969095+0000","last_became_peered":"2023-10-06T11:14:18.969095+0000","last_unstale":"2023-10-06T11:14:18.969387+0000","last_undegraded":"2023-10-06T11:14:18.969387+0000","last_fullsized":"2023-10-06T11:14:18.969387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:51.715839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.979586+0000","last_change":"2023-10-06T11:14:18.979586+0000","last_active":"2023-10-06T11:14:18.979586+0000","last_peered":"2023-10-06T11:14:18.979586+0000","last_clean":"2023-10-06T11:14:18.979586+0000","last_became_active":"2023-10-06T11:14:18.979337+0000","last_became_peered":"2023-10-06T11:14:18.979337+0000","last_unstale":"2023-10-06T11:14:18.979586+0000","last_undegraded":"2023-10-06T11:14:18.979586+0000","last_fullsized":"2023-10-06T11:14:18.979586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:51.715839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.962652+0000","last_change":"2023-10-06T11:14:18.962652+0000","last_active":"2023-10-06T11:14:18.962652+0000","last_peered":"2023-10-06T11:14:18.962652+0000","last_clean":"2023-10-06T11:14:18.962652+0000","last_became_active":"2023-10-06T11:14:18.962365+0000","last_became_peered":"2023-10-06T11:14:18.962365+0000","last_unstale":"2023-10-06T11:14:18.962652+0000","last_undegraded":"2023-10-06T11:14:18.962652+0000","last_fullsized":"2023-10-06T11:14:18.962652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:43.855676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968222+0000","last_change":"2023-10-06T11:14:18.968222+0000","last_active":"2023-10-06T11:14:18.968222+0000","last_peered":"2023-10-06T11:14:18.968222+0000","last_clean":"2023-10-06T11:14:18.968222+0000","last_became_active":"2023-10-06T11:14:18.967957+0000","last_became_peered":"2023-10-06T11:14:18.967957+0000","last_unstale":"2023-10-06T11:14:18.968222+0000","last_undegraded":"2023-10-06T11:14:18.968222+0000","last_fullsized":"2023-10-06T11:14:18.968222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:07.222923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.979784+0000","last_change":"2023-10-06T11:14:18.979784+0000","last_active":"2023-10-06T11:14:18.979784+0000","last_peered":"2023-10-06T11:14:18.979784+0000","last_clean":"2023-10-06T11:14:18.979784+0000","last_became_active":"2023-10-06T11:14:18.979473+0000","last_became_peered":"2023-10-06T11:14:18.979473+0000","last_unstale":"2023-10-06T11:14:18.979784+0000","last_undegraded":"2023-10-06T11:14:18.979784+0000","last_fullsized":"2023-10-06T11:14:18.979784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:01:50.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967525+0000","last_change":"2023-10-06T11:14:18.967525+0000","last_active":"2023-10-06T11:14:18.967525+0000","last_peered":"2023-10-06T11:14:18.967525+0000","last_clean":"2023-10-06T11:14:18.967525+0000","last_became_active":"2023-10-06T11:14:18.967277+0000","last_became_peered":"2023-10-06T11:14:18.967277+0000","last_unstale":"2023-10-06T11:14:18.967525+0000","last_undegraded":"2023-10-06T11:14:18.967525+0000","last_fullsized":"2023-10-06T11:14:18.967525+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:06.395481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.972491+0000","last_change":"2023-10-06T11:14:18.972491+0000","last_active":"2023-10-06T11:14:18.972491+0000","last_peered":"2023-10-06T11:14:18.972491+0000","last_clean":"2023-10-06T11:14:18.972491+0000","last_became_active":"2023-10-06T11:14:18.972209+0000","last_became_peered":"2023-10-06T11:14:18.972209+0000","last_unstale":"2023-10-06T11:14:18.972491+0000","last_undegraded":"2023-10-06T11:14:18.972491+0000","last_fullsized":"2023-10-06T11:14:18.972491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:50.938966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.977737+0000","last_change":"2023-10-06T11:14:18.977737+0000","last_active":"2023-10-06T11:14:18.977737+0000","last_peered":"2023-10-06T11:14:18.977737+0000","last_clean":"2023-10-06T11:14:18.977737+0000","last_became_active":"2023-10-06T11:14:18.977487+0000","last_became_peered":"2023-10-06T11:14:18.977487+0000","last_unstale":"2023-10-06T11:14:18.977737+0000","last_undegraded":"2023-10-06T11:14:18.977737+0000","last_fullsized":"2023-10-06T11:14:18.977737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:41.789678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.975222+0000","last_change":"2023-10-06T11:14:18.975222+0000","last_active":"2023-10-06T11:14:18.975222+0000","last_peered":"2023-10-06T11:14:18.975222+0000","last_clean":"2023-10-06T11:14:18.975222+0000","last_became_active":"2023-10-06T11:14:18.974969+0000","last_became_peered":"2023-10-06T11:14:18.974969+0000","last_unstale":"2023-10-06T11:14:18.975222+0000","last_undegraded":"2023-10-06T11:14:18.975222+0000","last_fullsized":"2023-10-06T11:14:18.975222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:42.003650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.965000+0000","last_change":"2023-10-06T11:14:18.965000+0000","last_active":"2023-10-06T11:14:18.965000+0000","last_peered":"2023-10-06T11:14:18.965000+0000","last_clean":"2023-10-06T11:14:18.965000+0000","last_became_active":"2023-10-06T11:14:18.964727+0000","last_became_peered":"2023-10-06T11:14:18.964727+0000","last_unstale":"2023-10-06T11:14:18.965000+0000","last_undegraded":"2023-10-06T11:14:18.965000+0000","last_fullsized":"2023-10-06T11:14:18.965000+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.908207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969962+0000","last_change":"2023-10-06T11:14:18.969962+0000","last_active":"2023-10-06T11:14:18.969962+0000","last_peered":"2023-10-06T11:14:18.969962+0000","last_clean":"2023-10-06T11:14:18.969962+0000","last_became_active":"2023-10-06T11:14:18.969443+0000","last_became_peered":"2023-10-06T11:14:18.969443+0000","last_unstale":"2023-10-06T11:14:18.969962+0000","last_undegraded":"2023-10-06T11:14:18.969962+0000","last_fullsized":"2023-10-06T11:14:18.969962+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:00.990170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966477+0000","last_change":"2023-10-06T11:14:18.966477+0000","last_active":"2023-10-06T11:14:18.966477+0000","last_peered":"2023-10-06T11:14:18.966477+0000","last_clean":"2023-10-06T11:14:18.966477+0000","last_became_active":"2023-10-06T11:14:18.966024+0000","last_became_peered":"2023-10-06T11:14:18.966024+0000","last_unstale":"2023-10-06T11:14:18.966477+0000","last_undegraded":"2023-10-06T11:14:18.966477+0000","last_fullsized":"2023-10-06T11:14:18.966477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:10.555011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.964533+0000","last_change":"2023-10-06T11:14:18.964533+0000","last_active":"2023-10-06T11:14:18.964533+0000","last_peered":"2023-10-06T11:14:18.964533+0000","last_clean":"2023-10-06T11:14:18.964533+0000","last_became_active":"2023-10-06T11:14:18.964283+0000","last_became_peered":"2023-10-06T11:14:18.964283+0000","last_unstale":"2023-10-06T11:14:18.964533+0000","last_undegraded":"2023-10-06T11:14:18.964533+0000","last_fullsized":"2023-10-06T11:14:18.964533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:24.366423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.976141+0000","last_change":"2023-10-06T11:14:18.976141+0000","last_active":"2023-10-06T11:14:18.976141+0000","last_peered":"2023-10-06T11:14:18.976141+0000","last_clean":"2023-10-06T11:14:18.976141+0000","last_became_active":"2023-10-06T11:14:18.975881+0000","last_became_peered":"2023-10-06T11:14:18.975881+0000","last_unstale":"2023-10-06T11:14:18.976141+0000","last_undegraded":"2023-10-06T11:14:18.976141+0000","last_fullsized":"2023-10-06T11:14:18.976141+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:37.456182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.963057+0000","last_change":"2023-10-06T11:14:18.963057+0000","last_active":"2023-10-06T11:14:18.963057+0000","last_peered":"2023-10-06T11:14:18.963057+0000","last_clean":"2023-10-06T11:14:18.963057+0000","last_became_active":"2023-10-06T11:14:18.962753+0000","last_became_peered":"2023-10-06T11:14:18.962753+0000","last_unstale":"2023-10-06T11:14:18.963057+0000","last_undegraded":"2023-10-06T11:14:18.963057+0000","last_fullsized":"2023-10-06T11:14:18.963057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:43.855676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978118+0000","last_change":"2023-10-06T11:14:18.978118+0000","last_active":"2023-10-06T11:14:18.978118+0000","last_peered":"2023-10-06T11:14:18.978118+0000","last_clean":"2023-10-06T11:14:18.978118+0000","last_became_active":"2023-10-06T11:14:18.977859+0000","last_became_peered":"2023-10-06T11:14:18.977859+0000","last_unstale":"2023-10-06T11:14:18.978118+0000","last_undegraded":"2023-10-06T11:14:18.978118+0000","last_fullsized":"2023-10-06T11:14:18.978118+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:57.259316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967418+0000","last_change":"2023-10-06T11:14:18.967418+0000","last_active":"2023-10-06T11:14:18.967418+0000","last_peered":"2023-10-06T11:14:18.967418+0000","last_clean":"2023-10-06T11:14:18.967418+0000","last_became_active":"2023-10-06T11:14:18.967182+0000","last_became_peered":"2023-10-06T11:14:18.967182+0000","last_unstale":"2023-10-06T11:14:18.967418+0000","last_undegraded":"2023-10-06T11:14:18.967418+0000","last_fullsized":"2023-10-06T11:14:18.967418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:00.990170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978054+0000","last_change":"2023-10-06T11:14:18.978054+0000","last_active":"2023-10-06T11:14:18.978054+0000","last_peered":"2023-10-06T11:14:18.978054+0000","last_clean":"2023-10-06T11:14:18.978054+0000","last_became_active":"2023-10-06T11:14:18.977494+0000","last_became_peered":"2023-10-06T11:14:18.977494+0000","last_unstale":"2023-10-06T11:14:18.978054+0000","last_undegraded":"2023-10-06T11:14:18.978054+0000","last_fullsized":"2023-10-06T11:14:18.978054+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.043895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.977799+0000","last_change":"2023-10-06T11:14:18.977799+0000","last_active":"2023-10-06T11:14:18.977799+0000","last_peered":"2023-10-06T11:14:18.977799+0000","last_clean":"2023-10-06T11:14:18.977799+0000","last_became_active":"2023-10-06T11:14:18.977538+0000","last_became_peered":"2023-10-06T11:14:18.977538+0000","last_unstale":"2023-10-06T11:14:18.977799+0000","last_undegraded":"2023-10-06T11:14:18.977799+0000","last_fullsized":"2023-10-06T11:14:18.977799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:15.982493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969377+0000","last_change":"2023-10-06T11:14:18.969377+0000","last_active":"2023-10-06T11:14:18.969377+0000","last_peered":"2023-10-06T11:14:18.969377+0000","last_clean":"2023-10-06T11:14:18.969377+0000","last_became_active":"2023-10-06T11:14:18.969109+0000","last_became_peered":"2023-10-06T11:14:18.969109+0000","last_unstale":"2023-10-06T11:14:18.969377+0000","last_undegraded":"2023-10-06T11:14:18.969377+0000","last_fullsized":"2023-10-06T11:14:18.969377+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:42.380108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.963754+0000","last_change":"2023-10-06T11:14:18.963754+0000","last_active":"2023-10-06T11:14:18.963754+0000","last_peered":"2023-10-06T11:14:18.963754+0000","last_clean":"2023-10-06T11:14:18.963754+0000","last_became_active":"2023-10-06T11:14:18.963455+0000","last_became_peered":"2023-10-06T11:14:18.963455+0000","last_unstale":"2023-10-06T11:14:18.963754+0000","last_undegraded":"2023-10-06T11:14:18.963754+0000","last_fullsized":"2023-10-06T11:14:18.963754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:48.272950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978439+0000","last_change":"2023-10-06T11:14:18.978439+0000","last_active":"2023-10-06T11:14:18.978439+0000","last_peered":"2023-10-06T11:14:18.978439+0000","last_clean":"2023-10-06T11:14:18.978439+0000","last_became_active":"2023-10-06T11:14:18.978177+0000","last_became_peered":"2023-10-06T11:14:18.978177+0000","last_unstale":"2023-10-06T11:14:18.978439+0000","last_undegraded":"2023-10-06T11:14:18.978439+0000","last_fullsized":"2023-10-06T11:14:18.978439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:32.918524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970771+0000","last_change":"2023-10-06T11:14:18.970771+0000","last_active":"2023-10-06T11:14:18.970771+0000","last_peered":"2023-10-06T11:14:18.970771+0000","last_clean":"2023-10-06T11:14:18.970771+0000","last_became_active":"2023-10-06T11:14:18.970147+0000","last_became_peered":"2023-10-06T11:14:18.970147+0000","last_unstale":"2023-10-06T11:14:18.970771+0000","last_undegraded":"2023-10-06T11:14:18.970771+0000","last_fullsized":"2023-10-06T11:14:18.970771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:04.826846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970497+0000","last_change":"2023-10-06T11:14:18.970497+0000","last_active":"2023-10-06T11:14:18.970497+0000","last_peered":"2023-10-06T11:14:18.970497+0000","last_clean":"2023-10-06T11:14:18.970497+0000","last_became_active":"2023-10-06T11:14:18.970219+0000","last_became_peered":"2023-10-06T11:14:18.970219+0000","last_unstale":"2023-10-06T11:14:18.970497+0000","last_undegraded":"2023-10-06T11:14:18.970497+0000","last_fullsized":"2023-10-06T11:14:18.970497+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:42.138962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.971451+0000","last_change":"2023-10-06T11:14:18.971451+0000","last_active":"2023-10-06T11:14:18.971451+0000","last_peered":"2023-10-06T11:14:18.971451+0000","last_clean":"2023-10-06T11:14:18.971451+0000","last_became_active":"2023-10-06T11:14:18.971156+0000","last_became_peered":"2023-10-06T11:14:18.971156+0000","last_unstale":"2023-10-06T11:14:18.971451+0000","last_undegraded":"2023-10-06T11:14:18.971451+0000","last_fullsized":"2023-10-06T11:14:18.971451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:42.380108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.958085+0000","last_change":"2023-10-06T11:14:18.958085+0000","last_active":"2023-10-06T11:14:18.958085+0000","last_peered":"2023-10-06T11:14:18.958085+0000","last_clean":"2023-10-06T11:14:18.958085+0000","last_became_active":"2023-10-06T11:14:18.957819+0000","last_became_peered":"2023-10-06T11:14:18.957819+0000","last_unstale":"2023-10-06T11:14:18.958085+0000","last_undegraded":"2023-10-06T11:14:18.958085+0000","last_fullsized":"2023-10-06T11:14:18.958085+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:42.138962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967870+0000","last_change":"2023-10-06T11:14:18.967870+0000","last_active":"2023-10-06T11:14:18.967870+0000","last_peered":"2023-10-06T11:14:18.967870+0000","last_clean":"2023-10-06T11:14:18.967870+0000","last_became_active":"2023-10-06T11:14:18.967120+0000","last_became_peered":"2023-10-06T11:14:18.967120+0000","last_unstale":"2023-10-06T11:14:18.967870+0000","last_undegraded":"2023-10-06T11:14:18.967870+0000","last_fullsized":"2023-10-06T11:14:18.967870+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:41.789678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.972837+0000","last_change":"2023-10-06T11:14:18.972837+0000","last_active":"2023-10-06T11:14:18.972837+0000","last_peered":"2023-10-06T11:14:18.972837+0000","last_clean":"2023-10-06T11:14:18.972837+0000","last_became_active":"2023-10-06T11:14:18.972590+0000","last_became_peered":"2023-10-06T11:14:18.972590+0000","last_unstale":"2023-10-06T11:14:18.972837+0000","last_undegraded":"2023-10-06T11:14:18.972837+0000","last_fullsized":"2023-10-06T11:14:18.972837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:16:42.696963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.971590+0000","last_change":"2023-10-06T11:14:18.971590+0000","last_active":"2023-10-06T11:14:18.971590+0000","last_peered":"2023-10-06T11:14:18.971590+0000","last_clean":"2023-10-06T11:14:18.971590+0000","last_became_active":"2023-10-06T11:14:18.971250+0000","last_became_peered":"2023-10-06T11:14:18.971250+0000","last_unstale":"2023-10-06T11:14:18.971590+0000","last_undegraded":"2023-10-06T11:14:18.971590+0000","last_fullsized":"2023-10-06T11:14:18.971590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:41.476256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967452+0000","last_change":"2023-10-06T11:14:18.967452+0000","last_active":"2023-10-06T11:14:18.967452+0000","last_peered":"2023-10-06T11:14:18.967452+0000","last_clean":"2023-10-06T11:14:18.967452+0000","last_became_active":"2023-10-06T11:14:18.967159+0000","last_became_peered":"2023-10-06T11:14:18.967159+0000","last_unstale":"2023-10-06T11:14:18.967452+0000","last_undegraded":"2023-10-06T11:14:18.967452+0000","last_fullsized":"2023-10-06T11:14:18.967452+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:42.003650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967647+0000","last_change":"2023-10-06T11:14:18.967647+0000","last_active":"2023-10-06T11:14:18.967647+0000","last_peered":"2023-10-06T11:14:18.967647+0000","last_clean":"2023-10-06T11:14:18.967647+0000","last_became_active":"2023-10-06T11:14:18.967379+0000","last_became_peered":"2023-10-06T11:14:18.967379+0000","last_unstale":"2023-10-06T11:14:18.967647+0000","last_undegraded":"2023-10-06T11:14:18.967647+0000","last_fullsized":"2023-10-06T11:14:18.967647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:00.990170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969394+0000","last_change":"2023-10-06T11:14:18.969394+0000","last_active":"2023-10-06T11:14:18.969394+0000","last_peered":"2023-10-06T11:14:18.969394+0000","last_clean":"2023-10-06T11:14:18.969394+0000","last_became_active":"2023-10-06T11:14:18.969162+0000","last_became_peered":"2023-10-06T11:14:18.969162+0000","last_unstale":"2023-10-06T11:14:18.969394+0000","last_undegraded":"2023-10-06T11:14:18.969394+0000","last_fullsized":"2023-10-06T11:14:18.969394+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:18.655703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.973114+0000","last_change":"2023-10-06T11:14:18.973114+0000","last_active":"2023-10-06T11:14:18.973114+0000","last_peered":"2023-10-06T11:14:18.973114+0000","last_clean":"2023-10-06T11:14:18.973114+0000","last_became_active":"2023-10-06T11:14:18.972863+0000","last_became_peered":"2023-10-06T11:14:18.972863+0000","last_unstale":"2023-10-06T11:14:18.973114+0000","last_undegraded":"2023-10-06T11:14:18.973114+0000","last_fullsized":"2023-10-06T11:14:18.973114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:44.465311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.983851+0000","last_change":"2023-10-06T11:14:17.966561+0000","last_active":"2023-10-06T11:14:18.983851+0000","last_peered":"2023-10-06T11:14:18.983851+0000","last_clean":"2023-10-06T11:14:18.983851+0000","last_became_active":"2023-10-06T11:14:17.966258+0000","last_became_peered":"2023-10-06T11:14:17.966258+0000","last_unstale":"2023-10-06T11:14:18.983851+0000","last_undegraded":"2023-10-06T11:14:18.983851+0000","last_fullsized":"2023-10-06T11:14:18.983851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:48:23.159467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.969709+0000","last_change":"2023-10-06T11:14:18.969709+0000","last_active":"2023-10-06T11:14:18.969709+0000","last_peered":"2023-10-06T11:14:18.969709+0000","last_clean":"2023-10-06T11:14:18.969709+0000","last_became_active":"2023-10-06T11:14:18.969487+0000","last_became_peered":"2023-10-06T11:14:18.969487+0000","last_unstale":"2023-10-06T11:14:18.969709+0000","last_undegraded":"2023-10-06T11:14:18.969709+0000","last_fullsized":"2023-10-06T11:14:18.969709+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:44:18.156221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.955451+0000","last_change":"2023-10-06T11:14:17.967507+0000","last_active":"2023-10-06T11:14:18.955451+0000","last_peered":"2023-10-06T11:14:18.955451+0000","last_clean":"2023-10-06T11:14:18.955451+0000","last_became_active":"2023-10-06T11:14:17.966743+0000","last_became_peered":"2023-10-06T11:14:17.966743+0000","last_unstale":"2023-10-06T11:14:18.955451+0000","last_undegraded":"2023-10-06T11:14:18.955451+0000","last_fullsized":"2023-10-06T11:14:18.955451+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:01:49.150933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974239+0000","last_change":"2023-10-06T11:14:18.974239+0000","last_active":"2023-10-06T11:14:18.974239+0000","last_peered":"2023-10-06T11:14:18.974239+0000","last_clean":"2023-10-06T11:14:18.974239+0000","last_became_active":"2023-10-06T11:14:18.973992+0000","last_became_peered":"2023-10-06T11:14:18.973992+0000","last_unstale":"2023-10-06T11:14:18.974239+0000","last_undegraded":"2023-10-06T11:14:18.974239+0000","last_fullsized":"2023-10-06T11:14:18.974239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:36.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.982625+0000","last_change":"2023-10-06T11:14:17.966186+0000","last_active":"2023-10-06T11:14:18.982625+0000","last_peered":"2023-10-06T11:14:18.982625+0000","last_clean":"2023-10-06T11:14:18.982625+0000","last_became_active":"2023-10-06T11:14:17.965942+0000","last_became_peered":"2023-10-06T11:14:17.965942+0000","last_unstale":"2023-10-06T11:14:18.982625+0000","last_undegraded":"2023-10-06T11:14:18.982625+0000","last_fullsized":"2023-10-06T11:14:18.982625+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:17.644623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974096+0000","last_change":"2023-10-06T11:14:18.974096+0000","last_active":"2023-10-06T11:14:18.974096+0000","last_peered":"2023-10-06T11:14:18.974096+0000","last_clean":"2023-10-06T11:14:18.974096+0000","last_became_active":"2023-10-06T11:14:18.973848+0000","last_became_peered":"2023-10-06T11:14:18.973848+0000","last_unstale":"2023-10-06T11:14:18.974096+0000","last_undegraded":"2023-10-06T11:14:18.974096+0000","last_fullsized":"2023-10-06T11:14:18.974096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:15.577506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.984295+0000","last_change":"2023-10-06T11:14:17.961794+0000","last_active":"2023-10-06T11:14:18.984295+0000","last_peered":"2023-10-06T11:14:18.984295+0000","last_clean":"2023-10-06T11:14:18.984295+0000","last_became_active":"2023-10-06T11:14:17.961101+0000","last_became_peered":"2023-10-06T11:14:17.961101+0000","last_unstale":"2023-10-06T11:14:18.984295+0000","last_undegraded":"2023-10-06T11:14:18.984295+0000","last_fullsized":"2023-10-06T11:14:18.984295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:14.971412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974464+0000","last_change":"2023-10-06T11:14:18.974464+0000","last_active":"2023-10-06T11:14:18.974464+0000","last_peered":"2023-10-06T11:14:18.974464+0000","last_clean":"2023-10-06T11:14:18.974464+0000","last_became_active":"2023-10-06T11:14:18.974200+0000","last_became_peered":"2023-10-06T11:14:18.974200+0000","last_unstale":"2023-10-06T11:14:18.974464+0000","last_undegraded":"2023-10-06T11:14:18.974464+0000","last_fullsized":"2023-10-06T11:14:18.974464+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:06.395481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.955968+0000","last_change":"2023-10-06T11:14:17.966656+0000","last_active":"2023-10-06T11:14:18.955968+0000","last_peered":"2023-10-06T11:14:18.955968+0000","last_clean":"2023-10-06T11:14:18.955968+0000","last_became_active":"2023-10-06T11:14:17.965995+0000","last_became_peered":"2023-10-06T11:14:17.965995+0000","last_unstale":"2023-10-06T11:14:18.955968+0000","last_undegraded":"2023-10-06T11:14:18.955968+0000","last_fullsized":"2023-10-06T11:14:18.955968+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:38.716683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968575+0000","last_change":"2023-10-06T11:14:18.968575+0000","last_active":"2023-10-06T11:14:18.968575+0000","last_peered":"2023-10-06T11:14:18.968575+0000","last_clean":"2023-10-06T11:14:18.968575+0000","last_became_active":"2023-10-06T11:14:18.968319+0000","last_became_peered":"2023-10-06T11:14:18.968319+0000","last_unstale":"2023-10-06T11:14:18.968575+0000","last_undegraded":"2023-10-06T11:14:18.968575+0000","last_fullsized":"2023-10-06T11:14:18.968575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:48.272950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.955259+0000","last_change":"2023-10-06T11:14:17.964336+0000","last_active":"2023-10-06T11:14:18.955259+0000","last_peered":"2023-10-06T11:14:18.955259+0000","last_clean":"2023-10-06T11:14:18.955259+0000","last_became_active":"2023-10-06T11:14:17.964054+0000","last_became_peered":"2023-10-06T11:14:17.964054+0000","last_unstale":"2023-10-06T11:14:18.955259+0000","last_undegraded":"2023-10-06T11:14:18.955259+0000","last_fullsized":"2023-10-06T11:14:18.955259+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:09.543931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.965521+0000","last_change":"2023-10-06T11:14:18.965521+0000","last_active":"2023-10-06T11:14:18.965521+0000","last_peered":"2023-10-06T11:14:18.965521+0000","last_clean":"2023-10-06T11:14:18.965521+0000","last_became_active":"2023-10-06T11:14:18.965271+0000","last_became_peered":"2023-10-06T11:14:18.965271+0000","last_unstale":"2023-10-06T11:14:18.965521+0000","last_undegraded":"2023-10-06T11:14:18.965521+0000","last_fullsized":"2023-10-06T11:14:18.965521+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:41:12.286981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.966974+0000","last_change":"2023-10-06T11:14:17.963762+0000","last_active":"2023-10-06T11:14:17.966974+0000","last_peered":"2023-10-06T11:14:17.966974+0000","last_clean":"2023-10-06T11:14:17.966974+0000","last_became_active":"2023-10-06T11:14:17.963528+0000","last_became_peered":"2023-10-06T11:14:17.963528+0000","last_unstale":"2023-10-06T11:14:17.966974+0000","last_undegraded":"2023-10-06T11:14:17.966974+0000","last_fullsized":"2023-10-06T11:14:17.966974+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:43.454231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970813+0000","last_change":"2023-10-06T11:14:18.970813+0000","last_active":"2023-10-06T11:14:18.970813+0000","last_peered":"2023-10-06T11:14:18.970813+0000","last_clean":"2023-10-06T11:14:18.970813+0000","last_became_active":"2023-10-06T11:14:18.970502+0000","last_became_peered":"2023-10-06T11:14:18.970502+0000","last_unstale":"2023-10-06T11:14:18.970813+0000","last_undegraded":"2023-10-06T11:14:18.970813+0000","last_fullsized":"2023-10-06T11:14:18.970813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.207652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969623+0000","last_change":"2023-10-06T11:14:17.964120+0000","last_active":"2023-10-06T11:14:17.969623+0000","last_peered":"2023-10-06T11:14:17.969623+0000","last_clean":"2023-10-06T11:14:17.969623+0000","last_became_active":"2023-10-06T11:14:17.963845+0000","last_became_peered":"2023-10-06T11:14:17.963845+0000","last_unstale":"2023-10-06T11:14:17.969623+0000","last_undegraded":"2023-10-06T11:14:17.969623+0000","last_fullsized":"2023-10-06T11:14:17.969623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.337460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.978218+0000","last_change":"2023-10-06T11:14:18.978218+0000","last_active":"2023-10-06T11:14:18.978218+0000","last_peered":"2023-10-06T11:14:18.978218+0000","last_clean":"2023-10-06T11:14:18.978218+0000","last_became_active":"2023-10-06T11:14:18.977812+0000","last_became_peered":"2023-10-06T11:14:18.977812+0000","last_unstale":"2023-10-06T11:14:18.978218+0000","last_undegraded":"2023-10-06T11:14:18.978218+0000","last_fullsized":"2023-10-06T11:14:18.978218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:32.918524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.966228+0000","last_change":"2023-10-06T11:14:17.960650+0000","last_active":"2023-10-06T11:14:17.966228+0000","last_peered":"2023-10-06T11:14:17.966228+0000","last_clean":"2023-10-06T11:14:17.966228+0000","last_became_active":"2023-10-06T11:14:17.960379+0000","last_became_peered":"2023-10-06T11:14:17.960379+0000","last_unstale":"2023-10-06T11:14:17.966228+0000","last_undegraded":"2023-10-06T11:14:17.966228+0000","last_fullsized":"2023-10-06T11:14:17.966228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:50.704759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970536+0000","last_change":"2023-10-06T11:14:18.970536+0000","last_active":"2023-10-06T11:14:18.970536+0000","last_peered":"2023-10-06T11:14:18.970536+0000","last_clean":"2023-10-06T11:14:18.970536+0000","last_became_active":"2023-10-06T11:14:18.970231+0000","last_became_peered":"2023-10-06T11:14:18.970231+0000","last_unstale":"2023-10-06T11:14:18.970536+0000","last_undegraded":"2023-10-06T11:14:18.970536+0000","last_fullsized":"2023-10-06T11:14:18.970536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:16:42.696963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969734+0000","last_change":"2023-10-06T11:14:17.967166+0000","last_active":"2023-10-06T11:14:17.969734+0000","last_peered":"2023-10-06T11:14:17.969734+0000","last_clean":"2023-10-06T11:14:17.969734+0000","last_became_active":"2023-10-06T11:14:17.966899+0000","last_became_peered":"2023-10-06T11:14:17.966899+0000","last_unstale":"2023-10-06T11:14:17.969734+0000","last_undegraded":"2023-10-06T11:14:17.969734+0000","last_fullsized":"2023-10-06T11:14:17.969734+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:14.971412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.964557+0000","last_change":"2023-10-06T11:14:18.964557+0000","last_active":"2023-10-06T11:14:18.964557+0000","last_peered":"2023-10-06T11:14:18.964557+0000","last_clean":"2023-10-06T11:14:18.964557+0000","last_became_active":"2023-10-06T11:14:18.964296+0000","last_became_peered":"2023-10-06T11:14:18.964296+0000","last_unstale":"2023-10-06T11:14:18.964557+0000","last_undegraded":"2023-10-06T11:14:18.964557+0000","last_fullsized":"2023-10-06T11:14:18.964557+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:41.789678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.983679+0000","last_change":"2023-10-06T11:14:17.968212+0000","last_active":"2023-10-06T11:14:18.983679+0000","last_peered":"2023-10-06T11:14:18.983679+0000","last_clean":"2023-10-06T11:14:18.983679+0000","last_became_active":"2023-10-06T11:14:17.967538+0000","last_became_peered":"2023-10-06T11:14:17.967538+0000","last_unstale":"2023-10-06T11:14:18.983679+0000","last_undegraded":"2023-10-06T11:14:18.983679+0000","last_fullsized":"2023-10-06T11:14:18.983679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:44.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970455+0000","last_change":"2023-10-06T11:14:18.970455+0000","last_active":"2023-10-06T11:14:18.970455+0000","last_peered":"2023-10-06T11:14:18.970455+0000","last_clean":"2023-10-06T11:14:18.970455+0000","last_became_active":"2023-10-06T11:14:18.970183+0000","last_became_peered":"2023-10-06T11:14:18.970183+0000","last_unstale":"2023-10-06T11:14:18.970455+0000","last_undegraded":"2023-10-06T11:14:18.970455+0000","last_fullsized":"2023-10-06T11:14:18.970455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:36.931037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.986457+0000","last_change":"2023-10-06T11:14:17.964760+0000","last_active":"2023-10-06T11:14:18.986457+0000","last_peered":"2023-10-06T11:14:18.986457+0000","last_clean":"2023-10-06T11:14:18.986457+0000","last_became_active":"2023-10-06T11:14:17.964392+0000","last_became_peered":"2023-10-06T11:14:17.964392+0000","last_unstale":"2023-10-06T11:14:18.986457+0000","last_undegraded":"2023-10-06T11:14:18.986457+0000","last_fullsized":"2023-10-06T11:14:18.986457+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:39.154169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.980865+0000","last_change":"2023-10-06T11:14:18.980865+0000","last_active":"2023-10-06T11:14:18.980865+0000","last_peered":"2023-10-06T11:14:18.980865+0000","last_clean":"2023-10-06T11:14:18.980865+0000","last_became_active":"2023-10-06T11:14:18.980569+0000","last_became_peered":"2023-10-06T11:14:18.980569+0000","last_unstale":"2023-10-06T11:14:18.980865+0000","last_undegraded":"2023-10-06T11:14:18.980865+0000","last_fullsized":"2023-10-06T11:14:18.980865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:22.359522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.986106+0000","last_change":"2023-10-06T11:14:17.966558+0000","last_active":"2023-10-06T11:14:18.986106+0000","last_peered":"2023-10-06T11:14:18.986106+0000","last_clean":"2023-10-06T11:14:18.986106+0000","last_became_active":"2023-10-06T11:14:17.965636+0000","last_became_peered":"2023-10-06T11:14:17.965636+0000","last_unstale":"2023-10-06T11:14:18.986106+0000","last_undegraded":"2023-10-06T11:14:18.986106+0000","last_fullsized":"2023-10-06T11:14:18.986106+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:09.543931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970325+0000","last_change":"2023-10-06T11:14:18.970325+0000","last_active":"2023-10-06T11:14:18.970325+0000","last_peered":"2023-10-06T11:14:18.970325+0000","last_clean":"2023-10-06T11:14:18.970325+0000","last_became_active":"2023-10-06T11:14:18.970033+0000","last_became_peered":"2023-10-06T11:14:18.970033+0000","last_unstale":"2023-10-06T11:14:18.970325+0000","last_undegraded":"2023-10-06T11:14:18.970325+0000","last_fullsized":"2023-10-06T11:14:18.970325+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:06.395481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.963286+0000","last_change":"2023-10-06T11:14:17.959651+0000","last_active":"2023-10-06T11:14:17.963286+0000","last_peered":"2023-10-06T11:14:17.963286+0000","last_clean":"2023-10-06T11:14:17.963286+0000","last_became_active":"2023-10-06T11:14:17.958106+0000","last_became_peered":"2023-10-06T11:14:17.958106+0000","last_unstale":"2023-10-06T11:14:17.963286+0000","last_undegraded":"2023-10-06T11:14:17.963286+0000","last_fullsized":"2023-10-06T11:14:17.963286+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:21.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.963960+0000","last_change":"2023-10-06T11:14:18.963960+0000","last_active":"2023-10-06T11:14:18.963960+0000","last_peered":"2023-10-06T11:14:18.963960+0000","last_clean":"2023-10-06T11:14:18.963960+0000","last_became_active":"2023-10-06T11:14:18.963671+0000","last_became_peered":"2023-10-06T11:14:18.963671+0000","last_unstale":"2023-10-06T11:14:18.963960+0000","last_undegraded":"2023-10-06T11:14:18.963960+0000","last_fullsized":"2023-10-06T11:14:18.963960+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:37.456182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.968743+0000","last_change":"2023-10-06T11:14:17.962482+0000","last_active":"2023-10-06T11:14:17.968743+0000","last_peered":"2023-10-06T11:14:17.968743+0000","last_clean":"2023-10-06T11:14:17.968743+0000","last_became_active":"2023-10-06T11:14:17.962195+0000","last_became_peered":"2023-10-06T11:14:17.962195+0000","last_unstale":"2023-10-06T11:14:17.968743+0000","last_undegraded":"2023-10-06T11:14:17.968743+0000","last_fullsized":"2023-10-06T11:14:17.968743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:16:41.685883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.975912+0000","last_change":"2023-10-06T11:14:18.975912+0000","last_active":"2023-10-06T11:14:18.975912+0000","last_peered":"2023-10-06T11:14:18.975912+0000","last_clean":"2023-10-06T11:14:18.975912+0000","last_became_active":"2023-10-06T11:14:18.975639+0000","last_became_peered":"2023-10-06T11:14:18.975639+0000","last_unstale":"2023-10-06T11:14:18.975912+0000","last_undegraded":"2023-10-06T11:14:18.975912+0000","last_fullsized":"2023-10-06T11:14:18.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:31.610595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.986908+0000","last_change":"2023-10-06T11:14:17.965207+0000","last_active":"2023-10-06T11:14:18.986908+0000","last_peered":"2023-10-06T11:14:18.986908+0000","last_clean":"2023-10-06T11:14:18.986908+0000","last_became_active":"2023-10-06T11:14:17.964914+0000","last_became_peered":"2023-10-06T11:14:17.964914+0000","last_unstale":"2023-10-06T11:14:18.986908+0000","last_undegraded":"2023-10-06T11:14:18.986908+0000","last_fullsized":"2023-10-06T11:14:18.986908+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:44.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.967484+0000","last_change":"2023-10-06T11:14:18.967484+0000","last_active":"2023-10-06T11:14:18.967484+0000","last_peered":"2023-10-06T11:14:18.967484+0000","last_clean":"2023-10-06T11:14:18.967484+0000","last_became_active":"2023-10-06T11:14:18.967169+0000","last_became_peered":"2023-10-06T11:14:18.967169+0000","last_unstale":"2023-10-06T11:14:18.967484+0000","last_undegraded":"2023-10-06T11:14:18.967484+0000","last_fullsized":"2023-10-06T11:14:18.967484+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:04.826846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.950666+0000","last_change":"2023-10-06T11:14:17.964976+0000","last_active":"2023-10-06T11:14:18.950666+0000","last_peered":"2023-10-06T11:14:18.950666+0000","last_clean":"2023-10-06T11:14:18.950666+0000","last_became_active":"2023-10-06T11:14:17.964682+0000","last_became_peered":"2023-10-06T11:14:17.964682+0000","last_unstale":"2023-10-06T11:14:18.950666+0000","last_undegraded":"2023-10-06T11:14:18.950666+0000","last_fullsized":"2023-10-06T11:14:18.950666+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:57.806481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.977918+0000","last_change":"2023-10-06T11:14:18.977918+0000","last_active":"2023-10-06T11:14:18.977918+0000","last_peered":"2023-10-06T11:14:18.977918+0000","last_clean":"2023-10-06T11:14:18.977918+0000","last_became_active":"2023-10-06T11:14:18.977593+0000","last_became_peered":"2023-10-06T11:14:18.977593+0000","last_unstale":"2023-10-06T11:14:18.977918+0000","last_undegraded":"2023-10-06T11:14:18.977918+0000","last_fullsized":"2023-10-06T11:14:18.977918+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:43.855676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.985479+0000","last_change":"2023-10-06T11:14:17.958731+0000","last_active":"2023-10-06T11:14:18.985479+0000","last_peered":"2023-10-06T11:14:18.985479+0000","last_clean":"2023-10-06T11:14:18.985479+0000","last_became_active":"2023-10-06T11:14:17.958450+0000","last_became_peered":"2023-10-06T11:14:17.958450+0000","last_unstale":"2023-10-06T11:14:18.985479+0000","last_undegraded":"2023-10-06T11:14:18.985479+0000","last_fullsized":"2023-10-06T11:14:18.985479+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:35.919957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.973598+0000","last_change":"2023-10-06T11:14:18.973598+0000","last_active":"2023-10-06T11:14:18.973598+0000","last_peered":"2023-10-06T11:14:18.973598+0000","last_clean":"2023-10-06T11:14:18.973598+0000","last_became_active":"2023-10-06T11:14:18.972875+0000","last_became_peered":"2023-10-06T11:14:18.972875+0000","last_unstale":"2023-10-06T11:14:18.973598+0000","last_undegraded":"2023-10-06T11:14:18.973598+0000","last_fullsized":"2023-10-06T11:14:18.973598+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:18.655703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.960268+0000","last_change":"2023-10-06T11:14:17.964781+0000","last_active":"2023-10-06T11:14:18.960268+0000","last_peered":"2023-10-06T11:14:18.960268+0000","last_clean":"2023-10-06T11:14:18.960268+0000","last_became_active":"2023-10-06T11:14:17.964488+0000","last_became_peered":"2023-10-06T11:14:17.964488+0000","last_unstale":"2023-10-06T11:14:18.960268+0000","last_undegraded":"2023-10-06T11:14:18.960268+0000","last_fullsized":"2023-10-06T11:14:18.960268+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:14.971412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.971494+0000","last_change":"2023-10-06T11:14:18.971494+0000","last_active":"2023-10-06T11:14:18.971494+0000","last_peered":"2023-10-06T11:14:18.971494+0000","last_clean":"2023-10-06T11:14:18.971494+0000","last_became_active":"2023-10-06T11:14:18.971208+0000","last_became_peered":"2023-10-06T11:14:18.971208+0000","last_unstale":"2023-10-06T11:14:18.971494+0000","last_undegraded":"2023-10-06T11:14:18.971494+0000","last_fullsized":"2023-10-06T11:14:18.971494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:49.510963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969815+0000","last_change":"2023-10-06T11:14:17.966342+0000","last_active":"2023-10-06T11:14:17.969815+0000","last_peered":"2023-10-06T11:14:17.969815+0000","last_clean":"2023-10-06T11:14:17.969815+0000","last_became_active":"2023-10-06T11:14:17.966073+0000","last_became_peered":"2023-10-06T11:14:17.966073+0000","last_unstale":"2023-10-06T11:14:17.969815+0000","last_undegraded":"2023-10-06T11:14:17.969815+0000","last_fullsized":"2023-10-06T11:14:17.969815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:44.110217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966197+0000","last_change":"2023-10-06T11:14:18.966197+0000","last_active":"2023-10-06T11:14:18.966197+0000","last_peered":"2023-10-06T11:14:18.966197+0000","last_clean":"2023-10-06T11:14:18.966197+0000","last_became_active":"2023-10-06T11:14:18.965908+0000","last_became_peered":"2023-10-06T11:14:18.965908+0000","last_unstale":"2023-10-06T11:14:18.966197+0000","last_undegraded":"2023-10-06T11:14:18.966197+0000","last_fullsized":"2023-10-06T11:14:18.966197+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:17.351818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.981410+0000","last_change":"2023-10-06T11:14:17.966763+0000","last_active":"2023-10-06T11:14:18.981410+0000","last_peered":"2023-10-06T11:14:18.981410+0000","last_clean":"2023-10-06T11:14:18.981410+0000","last_became_active":"2023-10-06T11:14:17.966361+0000","last_became_peered":"2023-10-06T11:14:17.966361+0000","last_unstale":"2023-10-06T11:14:18.981410+0000","last_undegraded":"2023-10-06T11:14:18.981410+0000","last_fullsized":"2023-10-06T11:14:18.981410+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:00.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968456+0000","last_change":"2023-10-06T11:14:18.968456+0000","last_active":"2023-10-06T11:14:18.968456+0000","last_peered":"2023-10-06T11:14:18.968456+0000","last_clean":"2023-10-06T11:14:18.968456+0000","last_became_active":"2023-10-06T11:14:18.968201+0000","last_became_peered":"2023-10-06T11:14:18.968201+0000","last_unstale":"2023-10-06T11:14:18.968456+0000","last_undegraded":"2023-10-06T11:14:18.968456+0000","last_fullsized":"2023-10-06T11:14:18.968456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:15.982493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970236+0000","last_change":"2023-10-06T11:14:17.967319+0000","last_active":"2023-10-06T11:14:17.970236+0000","last_peered":"2023-10-06T11:14:17.970236+0000","last_clean":"2023-10-06T11:14:17.970236+0000","last_became_active":"2023-10-06T11:14:17.967051+0000","last_became_peered":"2023-10-06T11:14:17.967051+0000","last_unstale":"2023-10-06T11:14:17.970236+0000","last_undegraded":"2023-10-06T11:14:17.970236+0000","last_fullsized":"2023-10-06T11:14:17.970236+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:14.566425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.968875+0000","last_change":"2023-10-06T11:14:18.968875+0000","last_active":"2023-10-06T11:14:18.968875+0000","last_peered":"2023-10-06T11:14:18.968875+0000","last_clean":"2023-10-06T11:14:18.968875+0000","last_became_active":"2023-10-06T11:14:18.967108+0000","last_became_peered":"2023-10-06T11:14:18.967108+0000","last_unstale":"2023-10-06T11:14:18.968875+0000","last_undegraded":"2023-10-06T11:14:18.968875+0000","last_fullsized":"2023-10-06T11:14:18.968875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.207652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969787+0000","last_change":"2023-10-06T11:14:17.967090+0000","last_active":"2023-10-06T11:14:17.969787+0000","last_peered":"2023-10-06T11:14:17.969787+0000","last_clean":"2023-10-06T11:14:17.969787+0000","last_became_active":"2023-10-06T11:14:17.966814+0000","last_became_peered":"2023-10-06T11:14:17.966814+0000","last_unstale":"2023-10-06T11:14:17.969787+0000","last_undegraded":"2023-10-06T11:14:17.969787+0000","last_fullsized":"2023-10-06T11:14:17.969787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:21.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974852+0000","last_change":"2023-10-06T11:14:18.974852+0000","last_active":"2023-10-06T11:14:18.974852+0000","last_peered":"2023-10-06T11:14:18.974852+0000","last_clean":"2023-10-06T11:14:18.974852+0000","last_became_active":"2023-10-06T11:14:18.974587+0000","last_became_peered":"2023-10-06T11:14:18.974587+0000","last_unstale":"2023-10-06T11:14:18.974852+0000","last_undegraded":"2023-10-06T11:14:18.974852+0000","last_fullsized":"2023-10-06T11:14:18.974852+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:10.927643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.963396+0000","last_change":"2023-10-06T11:14:17.959791+0000","last_active":"2023-10-06T11:14:17.963396+0000","last_peered":"2023-10-06T11:14:17.963396+0000","last_clean":"2023-10-06T11:14:17.963396+0000","last_became_active":"2023-10-06T11:14:17.959490+0000","last_became_peered":"2023-10-06T11:14:17.959490+0000","last_unstale":"2023-10-06T11:14:17.963396+0000","last_undegraded":"2023-10-06T11:14:17.963396+0000","last_fullsized":"2023-10-06T11:14:17.963396+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:22.336499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.964583+0000","last_change":"2023-10-06T11:14:18.964583+0000","last_active":"2023-10-06T11:14:18.964583+0000","last_peered":"2023-10-06T11:14:18.964583+0000","last_clean":"2023-10-06T11:14:18.964583+0000","last_became_active":"2023-10-06T11:14:18.964344+0000","last_became_peered":"2023-10-06T11:14:18.964344+0000","last_unstale":"2023-10-06T11:14:18.964583+0000","last_undegraded":"2023-10-06T11:14:18.964583+0000","last_fullsized":"2023-10-06T11:14:18.964583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:48.272950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.974582+0000","last_change":"2023-10-06T11:14:17.969522+0000","last_active":"2023-10-06T11:14:17.974582+0000","last_peered":"2023-10-06T11:14:17.974582+0000","last_clean":"2023-10-06T11:14:17.974582+0000","last_became_active":"2023-10-06T11:14:17.969237+0000","last_became_peered":"2023-10-06T11:14:17.969237+0000","last_unstale":"2023-10-06T11:14:17.974582+0000","last_undegraded":"2023-10-06T11:14:17.974582+0000","last_fullsized":"2023-10-06T11:14:17.974582+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:14.566425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.953065+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:14:17.953065+0000","last_peered":"2023-10-06T11:14:17.953065+0000","last_clean":"2023-10-06T11:14:17.953065+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:14:17.953065+0000","last_undegraded":"2023-10-06T11:14:17.953065+0000","last_fullsized":"2023-10-06T11:14:17.953065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.980576+0000","last_change":"2023-10-06T11:14:18.980576+0000","last_active":"2023-10-06T11:14:18.980576+0000","last_peered":"2023-10-06T11:14:18.980576+0000","last_clean":"2023-10-06T11:14:18.980576+0000","last_became_active":"2023-10-06T11:14:18.980309+0000","last_became_peered":"2023-10-06T11:14:18.980309+0000","last_unstale":"2023-10-06T11:14:18.980576+0000","last_undegraded":"2023-10-06T11:14:18.980576+0000","last_fullsized":"2023-10-06T11:14:18.980576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:23.347579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.969961+0000","last_change":"2023-10-06T11:14:17.963551+0000","last_active":"2023-10-06T11:14:17.969961+0000","last_peered":"2023-10-06T11:14:17.969961+0000","last_clean":"2023-10-06T11:14:17.969961+0000","last_became_active":"2023-10-06T11:14:17.963279+0000","last_became_peered":"2023-10-06T11:14:17.963279+0000","last_unstale":"2023-10-06T11:14:17.969961+0000","last_undegraded":"2023-10-06T11:14:17.969961+0000","last_fullsized":"2023-10-06T11:14:17.969961+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:47.320930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.959251+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:14:17.959251+0000","last_peered":"2023-10-06T11:14:17.959251+0000","last_clean":"2023-10-06T11:14:17.959251+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:14:17.959251+0000","last_undegraded":"2023-10-06T11:14:17.959251+0000","last_fullsized":"2023-10-06T11:14:17.959251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.973939+0000","last_change":"2023-10-06T11:14:18.973939+0000","last_active":"2023-10-06T11:14:18.973939+0000","last_peered":"2023-10-06T11:14:18.973939+0000","last_clean":"2023-10-06T11:14:18.973939+0000","last_became_active":"2023-10-06T11:14:18.973651+0000","last_became_peered":"2023-10-06T11:14:18.973651+0000","last_unstale":"2023-10-06T11:14:18.973939+0000","last_undegraded":"2023-10-06T11:14:18.973939+0000","last_fullsized":"2023-10-06T11:14:18.973939+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:45:11.573526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970019+0000","last_change":"2023-10-06T11:14:17.968086+0000","last_active":"2023-10-06T11:14:17.970019+0000","last_peered":"2023-10-06T11:14:17.970019+0000","last_clean":"2023-10-06T11:14:17.970019+0000","last_became_active":"2023-10-06T11:14:17.967134+0000","last_became_peered":"2023-10-06T11:14:17.967134+0000","last_unstale":"2023-10-06T11:14:17.970019+0000","last_undegraded":"2023-10-06T11:14:17.970019+0000","last_fullsized":"2023-10-06T11:14:17.970019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:14.566425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.952403+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:14:17.952403+0000","last_peered":"2023-10-06T11:14:17.952403+0000","last_clean":"2023-10-06T11:14:17.952403+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:14:17.952403+0000","last_undegraded":"2023-10-06T11:14:17.952403+0000","last_fullsized":"2023-10-06T11:14:17.952403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.974183+0000","last_change":"2023-10-06T11:14:18.974183+0000","last_active":"2023-10-06T11:14:18.974183+0000","last_peered":"2023-10-06T11:14:18.974183+0000","last_clean":"2023-10-06T11:14:18.974183+0000","last_became_active":"2023-10-06T11:14:18.970202+0000","last_became_peered":"2023-10-06T11:14:18.970202+0000","last_unstale":"2023-10-06T11:14:18.974183+0000","last_undegraded":"2023-10-06T11:14:18.974183+0000","last_fullsized":"2023-10-06T11:14:18.974183+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.043895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.984211+0000","last_change":"2023-10-06T11:14:17.969680+0000","last_active":"2023-10-06T11:14:18.984211+0000","last_peered":"2023-10-06T11:14:18.984211+0000","last_clean":"2023-10-06T11:14:18.984211+0000","last_became_active":"2023-10-06T11:14:17.969373+0000","last_became_peered":"2023-10-06T11:14:17.969373+0000","last_unstale":"2023-10-06T11:14:18.984211+0000","last_undegraded":"2023-10-06T11:14:18.984211+0000","last_fullsized":"2023-10-06T11:14:18.984211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:21.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.958962+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:14:17.958962+0000","last_peered":"2023-10-06T11:14:17.958962+0000","last_clean":"2023-10-06T11:14:17.958962+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:14:17.958962+0000","last_undegraded":"2023-10-06T11:14:17.958962+0000","last_fullsized":"2023-10-06T11:14:17.958962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.950911+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:14:17.950911+0000","last_peered":"2023-10-06T11:14:17.950911+0000","last_clean":"2023-10-06T11:14:17.950911+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:14:17.950911+0000","last_undegraded":"2023-10-06T11:14:17.950911+0000","last_fullsized":"2023-10-06T11:14:17.950911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966645+0000","last_change":"2023-10-06T11:14:18.966645+0000","last_active":"2023-10-06T11:14:18.966645+0000","last_peered":"2023-10-06T11:14:18.966645+0000","last_clean":"2023-10-06T11:14:18.966645+0000","last_became_active":"2023-10-06T11:14:18.966362+0000","last_became_peered":"2023-10-06T11:14:18.966362+0000","last_unstale":"2023-10-06T11:14:18.966645+0000","last_undegraded":"2023-10-06T11:14:18.966645+0000","last_fullsized":"2023-10-06T11:14:18.966645+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:01:50.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970975+0000","last_change":"2023-10-06T11:14:17.964330+0000","last_active":"2023-10-06T11:14:17.970975+0000","last_peered":"2023-10-06T11:14:17.970975+0000","last_clean":"2023-10-06T11:14:17.970975+0000","last_became_active":"2023-10-06T11:14:17.964049+0000","last_became_peered":"2023-10-06T11:14:17.964049+0000","last_unstale":"2023-10-06T11:14:17.970975+0000","last_undegraded":"2023-10-06T11:14:17.970975+0000","last_fullsized":"2023-10-06T11:14:17.970975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:41.369028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.950996+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:14:17.950996+0000","last_peered":"2023-10-06T11:14:17.950996+0000","last_clean":"2023-10-06T11:14:17.950996+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:14:17.950996+0000","last_undegraded":"2023-10-06T11:14:17.950996+0000","last_fullsized":"2023-10-06T11:14:17.950996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.972318+0000","last_change":"2023-10-06T11:14:18.972318+0000","last_active":"2023-10-06T11:14:18.972318+0000","last_peered":"2023-10-06T11:14:18.972318+0000","last_clean":"2023-10-06T11:14:18.972318+0000","last_became_active":"2023-10-06T11:14:18.972069+0000","last_became_peered":"2023-10-06T11:14:18.972069+0000","last_unstale":"2023-10-06T11:14:18.972318+0000","last_undegraded":"2023-10-06T11:14:18.972318+0000","last_fullsized":"2023-10-06T11:14:18.972318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:50.938966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.971038+0000","last_change":"2023-10-06T11:14:17.967562+0000","last_active":"2023-10-06T11:14:17.971038+0000","last_peered":"2023-10-06T11:14:17.971038+0000","last_clean":"2023-10-06T11:14:17.971038+0000","last_became_active":"2023-10-06T11:14:17.967315+0000","last_became_peered":"2023-10-06T11:14:17.967315+0000","last_unstale":"2023-10-06T11:14:17.971038+0000","last_undegraded":"2023-10-06T11:14:17.971038+0000","last_fullsized":"2023-10-06T11:14:17.971038+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:40.465176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.956311+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:14:17.956311+0000","last_peered":"2023-10-06T11:14:17.956311+0000","last_clean":"2023-10-06T11:14:17.956311+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:14:17.956311+0000","last_undegraded":"2023-10-06T11:14:17.956311+0000","last_fullsized":"2023-10-06T11:14:17.956311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.966707+0000","last_change":"2023-10-06T11:14:18.966707+0000","last_active":"2023-10-06T11:14:18.966707+0000","last_peered":"2023-10-06T11:14:18.966707+0000","last_clean":"2023-10-06T11:14:18.966707+0000","last_became_active":"2023-10-06T11:14:18.966383+0000","last_became_peered":"2023-10-06T11:14:18.966383+0000","last_unstale":"2023-10-06T11:14:18.966707+0000","last_undegraded":"2023-10-06T11:14:18.966707+0000","last_fullsized":"2023-10-06T11:14:18.966707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:41:12.286981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970125+0000","last_change":"2023-10-06T11:14:17.969441+0000","last_active":"2023-10-06T11:14:17.970125+0000","last_peered":"2023-10-06T11:14:17.970125+0000","last_clean":"2023-10-06T11:14:17.970125+0000","last_became_active":"2023-10-06T11:14:17.969180+0000","last_became_peered":"2023-10-06T11:14:17.969180+0000","last_unstale":"2023-10-06T11:14:17.970125+0000","last_undegraded":"2023-10-06T11:14:17.970125+0000","last_fullsized":"2023-10-06T11:14:17.970125+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:38.716683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.954277+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:14:17.954277+0000","last_peered":"2023-10-06T11:14:17.954277+0000","last_clean":"2023-10-06T11:14:17.954277+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:14:17.954277+0000","last_undegraded":"2023-10-06T11:14:17.954277+0000","last_fullsized":"2023-10-06T11:14:17.954277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.970132+0000","last_change":"2023-10-06T11:14:18.970132+0000","last_active":"2023-10-06T11:14:18.970132+0000","last_peered":"2023-10-06T11:14:18.970132+0000","last_clean":"2023-10-06T11:14:18.970132+0000","last_became_active":"2023-10-06T11:14:18.969883+0000","last_became_peered":"2023-10-06T11:14:18.969883+0000","last_unstale":"2023-10-06T11:14:18.970132+0000","last_undegraded":"2023-10-06T11:14:18.970132+0000","last_fullsized":"2023-10-06T11:14:18.970132+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.942248+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.942248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:42.003650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.970153+0000","last_change":"2023-10-06T11:14:17.969290+0000","last_active":"2023-10-06T11:14:17.970153+0000","last_peered":"2023-10-06T11:14:17.970153+0000","last_clean":"2023-10-06T11:14:17.970153+0000","last_became_active":"2023-10-06T11:14:17.968663+0000","last_became_peered":"2023-10-06T11:14:17.968663+0000","last_unstale":"2023-10-06T11:14:17.970153+0000","last_undegraded":"2023-10-06T11:14:17.970153+0000","last_fullsized":"2023-10-06T11:14:17.970153+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:16.931168+0000","last_clean_scrub_stamp":"2023-10-06T11:14:16.931168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:43.454231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T11:14:17.963587+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:14:17.963587+0000","last_peered":"2023-10-06T11:14:17.963587+0000","last_clean":"2023-10-06T11:14:17.963587+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:14:17.963587+0000","last_undegraded":"2023-10-06T11:14:17.963587+0000","last_fullsized":"2023-10-06T11:14:17.963587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":798724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.501},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.6850000000000005,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.34000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":798724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.378},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.28000000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.312},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.373}]},{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.317},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.372},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.442}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":208356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.503},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:14:23.475 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:14:23.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:14:23.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.632+0000 7f63df819700 1 Processor -- start 2023-10-06T11:14:23.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.632+0000 7f63df819700 1 -- start start 2023-10-06T11:14:23.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63df819700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63d80b0820 0x7f63d80686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63df819700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63d80cc740 0x7f63d80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63df819700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d80c9670 con 0x7f63d80c4450 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63df819700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d8159c00 con 0x7f63d80b0820 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63df819700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d80c8a60 con 0x7f63d80cc740 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63dd5b5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63d80b0820 0x7f63d80686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63dd5b5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63d80b0820 0x7f63d80686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50400/0 (socket says 172.21.15.55:50400) 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.633+0000 7f63dd5b5700 1 -- 172.21.15.55:0/1692470739 learned_addr learned my addr 172.21.15.55:0/1692470739 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dddb6700 1 --2- 172.21.15.55:0/1692470739 >> v2:172.21.15.142:3300/0 conn(0x7f63d80cc740 0x7f63d80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dd5b5700 1 -- 172.21.15.55:0/1692470739 >> v2:172.21.15.142:3300/0 conn(0x7f63d80cc740 msgr2=0x7f63d80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dd5b5700 1 --2- 172.21.15.55:0/1692470739 >> v2:172.21.15.142:3300/0 conn(0x7f63d80cc740 0x7f63d80ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dd5b5700 1 -- 172.21.15.55:0/1692470739 >> v1:172.21.15.142:6789/0 conn(0x7f63d80c4450 legacy=0x7f63d80cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dd5b5700 1 -- 172.21.15.55:0/1692470739 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d80c8d40 con 0x7f63d80b0820 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dddb6700 1 --2- 172.21.15.55:0/1692470739 >> v2:172.21.15.142:3300/0 conn(0x7f63d80cc740 0x7f63d80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63dd5b5700 1 --2- 172.21.15.55:0/1692470739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80b0820 0x7f63d80686c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63d80cddd0 tx=0x7f63d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37fd3354c0a3347 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63d7fff700 1 -- 172.21.15.55:0/1692470739 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0005c10 con 0x7f63d80b0820 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63d7fff700 1 -- 172.21.15.55:0/1692470739 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0005d70 con 0x7f63d80b0820 2023-10-06T11:14:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63d7fff700 1 -- 172.21.15.55:0/1692470739 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000b880 con 0x7f63d80b0820 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63df819700 1 -- 172.21.15.55:0/1692470739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80b0820 msgr2=0x7f63d80686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.634+0000 7f63df819700 1 --2- 172.21.15.55:0/1692470739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80b0820 0x7f63d80686c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63d80cddd0 tx=0x7f63d0009220 comp rx=0 tx=0).stop 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.635+0000 7f63df819700 1 -- 172.21.15.55:0/1692470739 shutdown_connections 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.635+0000 7f63df819700 1 --2- 172.21.15.55:0/1692470739 >> v2:172.21.15.142:3300/0 conn(0x7f63d80cc740 0x7f63d80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.635+0000 7f63df819700 1 --2- 172.21.15.55:0/1692470739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80b0820 0x7f63d80686c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.635+0000 7f63df819700 1 -- 172.21.15.55:0/1692470739 >> 172.21.15.55:0/1692470739 conn(0x7f63d8087fc0 msgr2=0x7f63d80ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.635+0000 7f63df819700 1 -- 172.21.15.55:0/1692470739 shutdown_connections 2023-10-06T11:14:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.635+0000 7f63df819700 1 -- 172.21.15.55:0/1692470739 wait complete. 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.636+0000 7f63df819700 1 Processor -- start 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.636+0000 7f63df819700 1 -- start start 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d80b0820 0x7f63d806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d80c4450 0x7f63d816a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 0x7f63d80c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d806d030 con 0x7f63d80cc740 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d816a7a0 con 0x7f63d80c4450 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d806ba50 con 0x7f63d80b0820 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 0x7f63d80c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 0x7f63d80c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50406/0 (socket says 172.21.15.55:50406) 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 -- 172.21.15.55:0/1152233098 learned_addr learned my addr 172.21.15.55:0/1152233098 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 -- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d80b0820 msgr2=0x7f63d806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d80b0820 0x7f63d806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 -- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d80c4450 msgr2=0x7f63d816a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d80c4450 0x7f63d816a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 -- 172.21.15.55:0/1152233098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009480 con 0x7f63d80cc740 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63dddb6700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 0x7f63d80c59a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009fc0 tx=0x7f63c80099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800dd40 con 0x7f63d80cc740 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800f040 con 0x7f63d80cc740 2023-10-06T11:14:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d806bd30 con 0x7f63d80cc740 2023-10-06T11:14:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8015690 con 0x7f63d80cc740 2023-10-06T11:14:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.637+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d806c2f0 con 0x7f63d80cc740 2023-10-06T11:14:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.638+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d8064a90 con 0x7f63d80cc740 2023-10-06T11:14:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.639+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63c801e3b0 con 0x7f63d80cc740 2023-10-06T11:14:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.639+0000 7f63d57fa700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f63c4066f30 0x7f63c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.639+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f63c8084d30 con 0x7f63d80cc740 2023-10-06T11:14:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.640+0000 7f63dd5b5700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f63c4066f30 0x7f63c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.640+0000 7f63dd5b5700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f63c4066f30 0x7f63c40693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009260 tx=0x7f63d0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.644+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63c8051d00 con 0x7f63d80cc740 2023-10-06T11:14:23.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.918+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f63d80688e0 con 0x7f63d80cc740 2023-10-06T11:14:23.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.922+0000 7f63d57fa700 1 -- 172.21.15.55:0/1152233098 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f63c801a0e0 con 0x7f63d80cc740 2023-10-06T11:14:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f63c4066f30 msgr2=0x7f63c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f63c4066f30 0x7f63c40693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009260 tx=0x7f63d0016000 comp rx=0 tx=0).stop 2023-10-06T11:14:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 msgr2=0x7f63d80c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 0x7f63d80c59a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009fc0 tx=0x7f63c80099b0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 shutdown_connections 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f63c4066f30 0x7f63c40693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63d80cc740 0x7f63d80c59a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63d80b0820 0x7f63d806caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 --2- 172.21.15.55:0/1152233098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d80c4450 0x7f63d816a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 >> 172.21.15.55:0/1152233098 conn(0x7f63d8087fc0 msgr2=0x7f63d8157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 shutdown_connections 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:23.924+0000 7f63df819700 1 -- 172.21.15.55:0/1152233098 wait complete. 2023-10-06T11:14:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-10-06T11:14:23.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.056+0000 7f4c6cc5b700 1 Processor -- start 2023-10-06T11:14:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.056+0000 7f4c6cc5b700 1 -- start start 2023-10-06T11:14:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c6cc5b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4c68159440 0x7f4c680b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c6cc5b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c680b2100 0x7f4c680b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c6cc5b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c680cb7a0 con 0x7f4c680b35d0 2023-10-06T11:14:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c6cc5b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680b0860 con 0x7f4c680b2100 2023-10-06T11:14:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c6cc5b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680cb150 con 0x7f4c68159440 2023-10-06T11:14:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c67fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c680b2100 0x7f4c680b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c66ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4c680b35d0 0x7f4c680cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55854/0 (socket says 172.21.15.55:55854) 2023-10-06T11:14:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c66ffd700 1 -- 172.21.15.55:0/2076690790 learned_addr learned my addr 172.21.15.55:0/2076690790 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c677fe700 1 --2- 172.21.15.55:0/2076690790 >> v2:172.21.15.142:3300/0 conn(0x7f4c68159440 0x7f4c680b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c67fff700 1 -- 172.21.15.55:0/2076690790 >> v2:172.21.15.142:3300/0 conn(0x7f4c68159440 msgr2=0x7f4c680b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c67fff700 1 --2- 172.21.15.55:0/2076690790 >> v2:172.21.15.142:3300/0 conn(0x7f4c68159440 0x7f4c680b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c67fff700 1 -- 172.21.15.55:0/2076690790 >> v1:172.21.15.55:6789/0 conn(0x7f4c680b35d0 legacy=0x7f4c680cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c67fff700 1 -- 172.21.15.55:0/2076690790 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680cb430 con 0x7f4c680b2100 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.057+0000 7f4c667fc700 1 -- 172.21.15.55:0/2076690790 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652447191 0 0) 0x7f4c680cb7a0 con 0x7f4c680b35d0 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c67fff700 1 --2- 172.21.15.55:0/2076690790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b2100 0x7f4c680b2520 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c6806f9f0 tx=0x7f4c60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25926bccc97d7873 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c667fc700 1 -- 172.21.15.55:0/2076690790 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000e070 con 0x7f4c680b2100 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c667fc700 1 -- 172.21.15.55:0/2076690790 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000bc30 con 0x7f4c680b2100 2023-10-06T11:14:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c667fc700 1 -- 172.21.15.55:0/2076690790 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60012430 con 0x7f4c680b2100 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/2076690790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b2100 msgr2=0x7f4c680b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/2076690790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b2100 0x7f4c680b2520 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c6806f9f0 tx=0x7f4c60009780 comp rx=0 tx=0).stop 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/2076690790 shutdown_connections 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/2076690790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b2100 0x7f4c680b2520 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/2076690790 >> v2:172.21.15.142:3300/0 conn(0x7f4c68159440 0x7f4c680b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/2076690790 >> 172.21.15.55:0/2076690790 conn(0x7f4c6806ece0 msgr2=0x7f4c6806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/2076690790 shutdown_connections 2023-10-06T11:14:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.058+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/2076690790 wait complete. 2023-10-06T11:14:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 Processor -- start 2023-10-06T11:14:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 -- start start 2023-10-06T11:14:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c680b2100 0x7f4c6816a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 0x7f4c680c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c68159440 0x7f4c680c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c8f50 con 0x7f4c680b35d0 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c8340 con 0x7f4c680b2100 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c6cc5b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c8620 con 0x7f4c68159440 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c66ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 0x7f4c680c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c66ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 0x7f4c680c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50418/0 (socket says 172.21.15.55:50418) 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.060+0000 7f4c66ffd700 1 -- 172.21.15.55:0/355944447 learned_addr learned my addr 172.21.15.55:0/355944447 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c66ffd700 1 -- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c68159440 msgr2=0x7f4c680c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c67fff700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c68159440 0x7f4c680c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c677fe700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c680b2100 0x7f4c6816a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c66ffd700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c68159440 0x7f4c680c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c66ffd700 1 -- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c680b2100 msgr2=0x7f4c6816a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c66ffd700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c680b2100 0x7f4c6816a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c66ffd700 1 -- 172.21.15.55:0/355944447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60009a20 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c67fff700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c68159440 0x7f4c680c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c677fe700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c680b2100 0x7f4c6816a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c66ffd700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 0x7f4c680c93e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00c7e0 tx=0x7f4c5c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c005b30 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c005c90 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c007300 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c680c8900 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.061+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6816a5d0 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.062+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c680c90c0 con 0x7f4c680b35d0 2023-10-06T11:14:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.063+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c5c01b400 con 0x7f4c680b35d0 2023-10-06T11:14:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.063+0000 7f4c4f7fe700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4c54066f30 0x7f4c540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.063+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4c5c084260 con 0x7f4c680b35d0 2023-10-06T11:14:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.063+0000 7f4c677fe700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4c54066f30 0x7f4c540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.064+0000 7f4c677fe700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4c54066f30 0x7f4c540693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009990 tx=0x7f4c58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.067+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c5c051360 con 0x7f4c680b35d0 2023-10-06T11:14:24.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.306+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c6805f230 con 0x7f4c680b35d0 2023-10-06T11:14:24.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.306+0000 7f4c4f7fe700 1 -- 172.21.15.55:0/355944447 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f4c5c007730 con 0x7f4c680b35d0 2023-10-06T11:14:24.308 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:24.308 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.308+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4c54066f30 msgr2=0x7f4c540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.308+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4c54066f30 0x7f4c540693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009990 tx=0x7f4c58008040 comp rx=0 tx=0).stop 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 msgr2=0x7f4c680c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 0x7f4c680c93e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00c7e0 tx=0x7f4c5c007df0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 shutdown_connections 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4c54066f30 0x7f4c540693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c68159440 0x7f4c680c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c680b2100 0x7f4c6816a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 --2- 172.21.15.55:0/355944447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c680b35d0 0x7f4c680c93e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 >> 172.21.15.55:0/355944447 conn(0x7f4c6806ece0 msgr2=0x7f4c681583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 shutdown_connections 2023-10-06T11:14:24.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.309+0000 7f4c6cc5b700 1 -- 172.21.15.55:0/355944447 wait complete. 2023-10-06T11:14:24.312 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:24.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:14:18.359436+0000', 'modified': '2023-10-06T11:14:21.977777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5106}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5106': {'gid': 5106, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.55:6835/1585118360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1585118360}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1585118360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:14:24.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:14:24.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:14:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.849+0000 7fa1c6316700 1 Processor -- start 2023-10-06T11:14:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.849+0000 7fa1c6316700 1 -- start start 2023-10-06T11:14:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1c6316700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1c0159560 0x7fa1c00aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1c6316700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1c00b0760 0x7fa1c00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1c6316700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c00b0c60 con 0x7fa1c00b49a0 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1c6316700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c00b0f40 con 0x7fa1c0159560 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1c6316700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c00b1220 con 0x7fa1c00b0760 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1bffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1c0159560 0x7fa1c00aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1bffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1c0159560 0x7fa1c00aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51630/0 (socket says 172.21.15.55:51630) 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.850+0000 7fa1bffff700 1 -- 172.21.15.55:0/1875299617 learned_addr learned my addr 172.21.15.55:0/1875299617 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/1875299617 >> v2:172.21.15.142:3300/0 conn(0x7fa1c00b0760 0x7fa1c00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1bffff700 1 -- 172.21.15.55:0/1875299617 >> v2:172.21.15.142:3300/0 conn(0x7fa1c00b0760 msgr2=0x7fa1c00b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1bffff700 1 --2- 172.21.15.55:0/1875299617 >> v2:172.21.15.142:3300/0 conn(0x7fa1c00b0760 0x7fa1c00b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1bffff700 1 -- 172.21.15.55:0/1875299617 >> v1:172.21.15.142:6789/0 conn(0x7fa1c00b49a0 legacy=0x7fa1c00aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1bffff700 1 -- 172.21.15.55:0/1875299617 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c00b1500 con 0x7fa1c0159560 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1bffff700 1 --2- 172.21.15.55:0/1875299617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c0159560 0x7fa1c00aa530 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009990 tx=0x7fa1b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76121eea6710b0a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1beffd700 1 -- 172.21.15.55:0/1875299617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0005c10 con 0x7fa1c0159560 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1beffd700 1 -- 172.21.15.55:0/1875299617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0005d70 con 0x7fa1c0159560 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1beffd700 1 -- 172.21.15.55:0/1875299617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000b800 con 0x7fa1c0159560 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1c6316700 1 -- 172.21.15.55:0/1875299617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c0159560 msgr2=0x7fa1c00aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.851+0000 7fa1c6316700 1 --2- 172.21.15.55:0/1875299617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c0159560 0x7fa1c00aa530 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009990 tx=0x7fa1b0009220 comp rx=0 tx=0).stop 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.852+0000 7fa1c6316700 1 -- 172.21.15.55:0/1875299617 shutdown_connections 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.852+0000 7fa1c6316700 1 --2- 172.21.15.55:0/1875299617 >> v2:172.21.15.142:3300/0 conn(0x7fa1c00b0760 0x7fa1c00b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.852+0000 7fa1c6316700 1 --2- 172.21.15.55:0/1875299617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c0159560 0x7fa1c00aa530 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.852+0000 7fa1c6316700 1 -- 172.21.15.55:0/1875299617 >> 172.21.15.55:0/1875299617 conn(0x7fa1c00997f0 msgr2=0x7fa1c006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.852+0000 7fa1c6316700 1 -- 172.21.15.55:0/1875299617 shutdown_connections 2023-10-06T11:14:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.852+0000 7fa1c6316700 1 -- 172.21.15.55:0/1875299617 wait complete. 2023-10-06T11:14:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.853+0000 7fa1c6316700 1 Processor -- start 2023-10-06T11:14:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.853+0000 7fa1c6316700 1 -- start start 2023-10-06T11:14:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 0x7fa1c00ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c00b49a0 0x7fa1c01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c0159560 0x7fa1c0157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c009b9c0 con 0x7fa1c00b0760 2023-10-06T11:14:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0158350 con 0x7fa1c00b49a0 2023-10-06T11:14:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c009adb0 con 0x7fa1c0159560 2023-10-06T11:14:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 0x7fa1c00ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 0x7fa1c00ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51642/0 (socket says 172.21.15.55:51642) 2023-10-06T11:14:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 -- 172.21.15.55:0/3730249756 learned_addr learned my addr 172.21.15.55:0/3730249756 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 -- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c0159560 msgr2=0x7fa1c0157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c0159560 0x7fa1c0157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 -- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c00b49a0 msgr2=0x7fa1c01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c00b49a0 0x7fa1c01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 -- 172.21.15.55:0/3730249756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009480 con 0x7fa1c00b0760 2023-10-06T11:14:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1bffff700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 0x7fa1c00ac030 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0003080 tx=0x7fa1b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1b7fff700 1 -- 172.21.15.55:0/3730249756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011cc0 con 0x7fa1c00b0760 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1b7fff700 1 -- 172.21.15.55:0/3730249756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0011e40 con 0x7fa1c00b0760 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c009b090 con 0x7fa1c00b0760 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1b7fff700 1 -- 172.21.15.55:0/3730249756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b001c670 con 0x7fa1c00b0760 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.854+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c009b650 con 0x7fa1c00b0760 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.856+0000 7fa1b7fff700 1 -- 172.21.15.55:0/3730249756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1b001caa0 con 0x7fa1c00b0760 2023-10-06T11:14:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.856+0000 7fa1b7fff700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa1a0066f30 0x7fa1a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.856+0000 7fa1b7fff700 1 -- 172.21.15.55:0/3730249756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa1b0086260 con 0x7fa1c00b0760 2023-10-06T11:14:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.856+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa1a0066f30 0x7fa1a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.857+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa1a0066f30 0x7fa1a00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00cf5a0 tx=0x7fa1a8006ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.858+0000 7fa1cf60eb80 1 Processor -- start 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.858+0000 7fa1cf60eb80 1 -- start start 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa5212e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ce9a0 0x555aa51cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa514bc80 con 0x555aa51ccbd0 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa5122a70 con 0x555aa5212a90 2023-10-06T11:14:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa5120270 con 0x555aa51ce9a0 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1bf7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ce9a0 0x555aa51cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51646/0 (socket says 172.21.15.55:51646) 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 -- 172.21.15.55:0/1297169892 learned_addr learned my addr 172.21.15.55:0/1297169892 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1bffff700 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa5212e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 -- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ce9a0 msgr2=0x555aa51cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ce9a0 0x555aa51cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 -- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 msgr2=0x555aa5212e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa5212e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 -- 172.21.15.55:0/1297169892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa4fb6270 con 0x555aa51ccbd0 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.859+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51cbac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8007f30 tx=0x7fa1b8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d4599e0f3f0edf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1b57fa700 1 -- 172.21.15.55:0/1297169892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800ce80 con 0x555aa51ccbd0 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1b57fa700 1 -- 172.21.15.55:0/1297169892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b8017480 con 0x555aa51ccbd0 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1b57fa700 1 -- 172.21.15.55:0/1297169892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8017840 con 0x555aa51ccbd0 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1297169892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 msgr2=0x555aa51cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51cbac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8007f30 tx=0x7fa1b8007870 comp rx=0 tx=0).stop 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1297169892 shutdown_connections 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51cbac0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa5212e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1297169892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ce9a0 0x555aa51cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1297169892 >> 172.21.15.55:0/1297169892 conn(0x555aa51cd070 msgr2=0x555aa51cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1297169892 shutdown_connections 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.860+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1297169892 wait complete. 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.861+0000 7fa1cf60eb80 1 -- start start 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.861+0000 7fa1cf60eb80 1 Processor -- start 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa5221bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa51f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 0x555aa51f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa511c060 con 0x555aa5212a90 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa50c7890 con 0x555aa51ce9a0 2023-10-06T11:14:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa50e2ea0 con 0x555aa51ccbd0 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1cf60eb80 10 client.0 _ll_register_callbacks cb 0x555aa4fb8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 0x555aa51f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 0x555aa51f4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51652/0 (socket says 172.21.15.55:51652) 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 -- 172.21.15.55:0/3072514662 learned_addr learned my addr 172.21.15.55:0/3072514662 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1bffff700 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa5221bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 -- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 msgr2=0x555aa5221bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa5221bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 -- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 msgr2=0x555aa51f0b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:14:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa51f0b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 -- 172.21.15.55:0/3072514662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b8007b30 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 0x555aa51f4540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x555aa51ceef0 tx=0x7fa1b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a68343454ffcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.862+0000 7fa19e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa19e7fc700 1 -- 172.21.15.55:0/3072514662 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b80175f0 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555aa51c0690 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa19e7fc700 1 -- 172.21.15.55:0/3072514662 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa1b8012070 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa19e7fc700 1 -- 172.21.15.55:0/3072514662 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1b8022420 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 10 client.5289 fetch_fsmap learned FSMap version 19 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x555aa4f58fe0 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa19e7fc700 1 -- 172.21.15.55:0/3072514662 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555aa51c0690 con 0x555aa5212a90 2023-10-06T11:14:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa19e7fc700 1 -- 172.21.15.55:0/3072514662 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa1b8022580 con 0x555aa5212a90 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 10 client.5289 fetch_fsmap finished waiting for FSMap version 19 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 10 client.5289 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 20 client.5289 populate_metadata read hostname 'smithi055' 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f1070 0x555aa5216340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 4 client.5289 mds_command: new command op to 5106 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 --> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555aa519d5c0 con 0x555aa51f1070 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.863+0000 7fa1bffff700 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f1070 0x555aa5216340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa19e7fc700 10 client.5289 ms_handle_connect on v2:172.21.15.55:6832/1585118360 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1bffff700 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f1070 0x555aa5216340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acff46e9231678fe server_cookie=7d495e40c29153 in_seq=0 out_seq=0 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa19e7fc700 1 -- 172.21.15.55:0/3072514662 <== mds.0 v2:172.21.15.55:6832/1585118360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555aa519d5c0 con 0x555aa51f1070 2023-10-06T11:14:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa19e7fc700 10 client.5289 handle_command_reply: tid=0 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 client.5289 shutdown 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 msgr2=0x555aa51f4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 0x555aa51f4540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x555aa51ceef0 tx=0x7fa1b8019000 comp rx=0 tx=0).stop 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 shutdown_connections 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f1070 0x555aa5216340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa5212a90 0x555aa51f4540 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa5221bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa19e7fc700 0 client.5289 ms_handle_reset on v2:172.21.15.55:6832/1585118360 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/3072514662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa51f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 >> 172.21.15.55:0/3072514662 conn(0x555aa51cd070 msgr2=0x555aa51c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 shutdown_connections 2023-10-06T11:14:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.864+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/3072514662 wait complete. 2023-10-06T11:14:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.865+0000 7fa1cf60eb80 20 client.5289 trim_cache size 0 max 16384 2023-10-06T11:14:24.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.881+0000 7fa1cf60eb80 1 Processor -- start 2023-10-06T11:14:24.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.881+0000 7fa1cf60eb80 1 -- start start 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa52102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa5212a90 0x555aa5210810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa4f9ee30 con 0x555aa51ccbd0 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa51c60c0 con 0x555aa51ce9a0 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa51cc830 con 0x555aa5212a90 2023-10-06T11:14:24.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51666/0 (socket says 172.21.15.55:51666) 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 -- 172.21.15.55:0/1852543201 learned_addr learned my addr 172.21.15.55:0/1852543201 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa5212a90 0x555aa5210810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa52102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 -- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa5212a90 msgr2=0x555aa5210810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa5212a90 0x555aa5210810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 -- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 msgr2=0x555aa52102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa52102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bffff700 1 -- 172.21.15.55:0/1852543201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa50ea780 con 0x555aa51ccbd0 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1c48b3700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa5212a90 0x555aa5210810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:24.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.882+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa52102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1bffff700 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51c7eb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009260 tx=0x7fa1b006b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2438c60305bd6e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1b5ffb700 1 -- 172.21.15.55:0/1852543201 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0056ef0 con 0x555aa51ccbd0 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1b5ffb700 1 -- 172.21.15.55:0/1852543201 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b005a140 con 0x555aa51ccbd0 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1b5ffb700 1 -- 172.21.15.55:0/1852543201 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b005de90 con 0x555aa51ccbd0 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1852543201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 msgr2=0x555aa51c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51c7eb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009260 tx=0x7fa1b006b040 comp rx=0 tx=0).stop 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1852543201 shutdown_connections 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ccbd0 0x555aa51c7eb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa5212a90 0x555aa5210810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/1852543201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa51ce9a0 0x555aa52102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1852543201 >> 172.21.15.55:0/1852543201 conn(0x555aa51cd070 msgr2=0x555aa51cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1852543201 shutdown_connections 2023-10-06T11:14:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.883+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/1852543201 wait complete. 2023-10-06T11:14:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.884+0000 7fa1cf60eb80 1 -- start start 2023-10-06T11:14:24.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.884+0000 7fa1cf60eb80 1 Processor -- start 2023-10-06T11:14:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa51f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 0x555aa525d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa51f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa525dba0 con 0x555aa51ce9a0 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa51f2180 con 0x555aa5212a90 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa51f3160 con 0x555aa51ccbd0 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1cf60eb80 10 client.0 _ll_register_callbacks cb 0x555aa4fb8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 0x555aa525d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 0x555aa525d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51678/0 (socket says 172.21.15.55:51678) 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 -- 172.21.15.55:0/119817885 learned_addr learned my addr 172.21.15.55:0/119817885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 -- 172.21.15.55:0/119817885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 msgr2=0x555aa51f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa51f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 -- 172.21.15.55:0/119817885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 msgr2=0x555aa51f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa51f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 -- 172.21.15.55:0/119817885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c009b650 con 0x555aa51ce9a0 2023-10-06T11:14:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa1bf7fe700 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 0x555aa525d660 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0088de0 tx=0x7fa1a8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7aabd30165100b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.885+0000 7fa19e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:14:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 1 -- 172.21.15.55:0/119817885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8014ea0 con 0x555aa51ce9a0 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 1 -- 172.21.15.55:0/119817885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa1a801f580 con 0x555aa51ce9a0 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1b8017480 con 0x555aa51ce9a0 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 1 -- 172.21.15.55:0/119817885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1a801f950 con 0x555aa51ce9a0 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 10 client.5295 fetch_fsmap learned FSMap version 19 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x555aa50d1470 con 0x555aa51ce9a0 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 1 -- 172.21.15.55:0/119817885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b8017480 con 0x555aa51ce9a0 2023-10-06T11:14:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 1 -- 172.21.15.55:0/119817885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa1a801fab0 con 0x555aa51ce9a0 2023-10-06T11:14:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 10 client.5295 fetch_fsmap finished waiting for FSMap version 19 2023-10-06T11:14:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 10 client.5295 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:14:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 20 client.5295 populate_metadata read hostname 'smithi055' 2023-10-06T11:14:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f6a30 0x555aa51f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 4 client.5295 mds_command: new command op to 5106 tid=0[{"prefix": "status"}] 2023-10-06T11:14:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 --> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555aa50bee00 con 0x555aa51f6a30 2023-10-06T11:14:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1bffff700 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f6a30 0x555aa51f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 10 client.5295 ms_handle_connect on v2:172.21.15.55:6832/1585118360 2023-10-06T11:14:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa1bffff700 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f6a30 0x555aa51f6e00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16517fba27ee448 server_cookie=7a6ad9e61065744c in_seq=0 out_seq=0 2023-10-06T11:14:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.886+0000 7fa19e7fc700 1 -- 172.21.15.55:0/119817885 <== mds.0 v2:172.21.15.55:6832/1585118360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x555aa50bee00 con 0x555aa51f6a30 2023-10-06T11:14:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa19e7fc700 10 client.5295 handle_command_reply: tid=0 2023-10-06T11:14:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 client.5295 shutdown 2023-10-06T11:14:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 msgr2=0x555aa525d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 0x555aa525d660 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0088de0 tx=0x7fa1a8010000 comp rx=0 tx=0).stop 2023-10-06T11:14:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 shutdown_connections 2023-10-06T11:14:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:6832/1585118360,v1:172.21.15.55:6835/1585118360] conn(0x555aa51f6a30 0x555aa51f6e00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555aa5212a90 0x555aa51f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa19e7fc700 0 client.5295 ms_handle_reset on v2:172.21.15.55:6832/1585118360 2023-10-06T11:14:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555aa51ccbd0 0x555aa51f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 --2- 172.21.15.55:0/119817885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555aa51ce9a0 0x555aa525d660 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 >> 172.21.15.55:0/119817885 conn(0x555aa51cd070 msgr2=0x555aa51f4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 shutdown_connections 2023-10-06T11:14:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 1 -- 172.21.15.55:0/119817885 wait complete. 2023-10-06T11:14:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1cf60eb80 20 client.5295 trim_cache size 0 max 16384 2023-10-06T11:14:24.900 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:14:24.900 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:14:24.900 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:14:24.901 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5106, 2023-10-06T11:14:24.901 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:14:24.901 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:14:24.901 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:14:24.901 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.92474539, 2023-10-06T11:14:24.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 19, 2023-10-06T11:14:24.902 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 43, 2023-10-06T11:14:24.902 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 43, 2023-10-06T11:14:24.902 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 20.462320085000002 2023-10-06T11:14:24.902 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:14:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa1a0066f30 msgr2=0x7fa1a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa1a0066f30 0x7fa1a00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00cf5a0 tx=0x7fa1a8006ce0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 msgr2=0x7fa1c00ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 0x7fa1c00ac030 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0003080 tx=0x7fa1b0015000 comp rx=0 tx=0).stop 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 shutdown_connections 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa1a0066f30 0x7fa1a00693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1c00b0760 0x7fa1c00ac030 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1c0159560 0x7fa1c0157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 --2- 172.21.15.55:0/3730249756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1c00b49a0 0x7fa1c01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 >> 172.21.15.55:0/3730249756 conn(0x7fa1c00997f0 msgr2=0x7fa1c00ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 shutdown_connections 2023-10-06T11:14:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:24.887+0000 7fa1c6316700 1 -- 172.21.15.55:0/3730249756 wait complete. 2023-10-06T11:14:24.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:14:25.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.023+0000 7f573e4da700 1 Processor -- start 2023-10-06T11:14:25.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f573e4da700 1 -- start start 2023-10-06T11:14:25.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f573e4da700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57380b0760 0x7f57380ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f573e4da700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380b0c60 con 0x7f5738159560 2023-10-06T11:14:25.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f573e4da700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380b0f40 con 0x7f57380b49a0 2023-10-06T11:14:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f573e4da700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380ab350 con 0x7f57380b0760 2023-10-06T11:14:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f573ca77700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57380b0760 0x7f57380ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f5737fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5738159560 0x7f57380aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41244/0 (socket says 172.21.15.55:41244) 2023-10-06T11:14:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.024+0000 7f5737fff700 1 -- 172.21.15.55:0/2166915639 learned_addr learned my addr 172.21.15.55:0/2166915639 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:25.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f573ca77700 1 -- 172.21.15.55:0/2166915639 >> v1:172.21.15.142:6789/0 conn(0x7f57380b49a0 legacy=0x7f57380aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f573ca77700 1 -- 172.21.15.55:0/2166915639 >> v1:172.21.15.55:6789/0 conn(0x7f5738159560 legacy=0x7f57380aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f573ca77700 1 -- 172.21.15.55:0/2166915639 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380b1220 con 0x7f57380b0760 2023-10-06T11:14:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f5736ffd700 1 -- 172.21.15.55:0/2166915639 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735673600 0 0) 0x7f57380b0c60 con 0x7f5738159560 2023-10-06T11:14:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f573ca77700 1 --2- 172.21.15.55:0/2166915639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57380b0760 0x7f57380ccf90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5730009e90 tx=0x7f5730009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b7d2f67619e96b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f5736ffd700 1 -- 172.21.15.55:0/2166915639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000e070 con 0x7f57380b0760 2023-10-06T11:14:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f5736ffd700 1 -- 172.21.15.55:0/2166915639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000bbf0 con 0x7f57380b0760 2023-10-06T11:14:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.025+0000 7f5736ffd700 1 -- 172.21.15.55:0/2166915639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730012430 con 0x7f57380b0760 2023-10-06T11:14:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 -- 172.21.15.55:0/2166915639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57380b0760 msgr2=0x7f57380ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 --2- 172.21.15.55:0/2166915639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57380b0760 0x7f57380ccf90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5730009e90 tx=0x7f5730009780 comp rx=0 tx=0).stop 2023-10-06T11:14:25.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 -- 172.21.15.55:0/2166915639 shutdown_connections 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 --2- 172.21.15.55:0/2166915639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57380b0760 0x7f57380ccf90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 -- 172.21.15.55:0/2166915639 >> 172.21.15.55:0/2166915639 conn(0x7f57380997f0 msgr2=0x7f573806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 -- 172.21.15.55:0/2166915639 shutdown_connections 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.026+0000 7f573e4da700 1 -- 172.21.15.55:0/2166915639 wait complete. 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.027+0000 7f573e4da700 1 Processor -- start 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.027+0000 7f573e4da700 1 -- start start 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573e4da700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57380b0760 0x7f57380aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573e4da700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57380b49a0 0x7f5738159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573e4da700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 0x7f5738169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573e4da700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573809a3c0 con 0x7f5738159560 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573e4da700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573816a450 con 0x7f57380b0760 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573e4da700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573816a730 con 0x7f57380b49a0 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 0x7f5738169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 0x7f5738169b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51684/0 (socket says 172.21.15.55:51684) 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 -- 172.21.15.55:0/567779138 learned_addr learned my addr 172.21.15.55:0/567779138 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f5737fff700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57380b0760 0x7f57380aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f57377fe700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57380b49a0 0x7f5738159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 -- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57380b49a0 msgr2=0x7f5738159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57380b49a0 0x7f5738159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 -- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57380b0760 msgr2=0x7f57380aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57380b0760 0x7f57380aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 -- 172.21.15.55:0/567779138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009a20 con 0x7f5738159560 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f57377fe700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57380b49a0 0x7f5738159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.029+0000 7f573ca77700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 0x7f5738169b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5738067c20 tx=0x7f5730019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.030+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730012e50 con 0x7f5738159560 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.030+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573001b630 con 0x7f5738159560 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.030+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573001b9f0 con 0x7f5738159560 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.030+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573816aa10 con 0x7f5738159560 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.030+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5738159e70 con 0x7f5738159560 2023-10-06T11:14:25.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.031+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5738064a90 con 0x7f5738159560 2023-10-06T11:14:25.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.032+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5730011390 con 0x7f5738159560 2023-10-06T11:14:25.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.032+0000 7f571ffff700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.033+0000 7f5737fff700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.033+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5730057c20 con 0x7f5738159560 2023-10-06T11:14:25.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.033+0000 7f5737fff700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5724066f30 0x7f57240693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5738167780 tx=0x7f5728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.037+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5730053860 con 0x7f5738159560 2023-10-06T11:14:25.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.276+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57380b1500 con 0x7f5738159560 2023-10-06T11:14:25.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.277+0000 7f571ffff700 1 -- 172.21.15.55:0/567779138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f573002a070 con 0x7f5738159560 2023-10-06T11:14:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5724066f30 msgr2=0x7f57240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5724066f30 0x7f57240693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5738167780 tx=0x7f5728009040 comp rx=0 tx=0).stop 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 msgr2=0x7f5738169b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 0x7f5738169b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5738067c20 tx=0x7f5730019000 comp rx=0 tx=0).stop 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 shutdown_connections 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5738159560 0x7f5738169b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57380b0760 0x7f57380aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 --2- 172.21.15.55:0/567779138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57380b49a0 0x7f5738159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 >> 172.21.15.55:0/567779138 conn(0x7f57380997f0 msgr2=0x7f5738158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 shutdown_connections 2023-10-06T11:14:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:25.279+0000 7f573e4da700 1 -- 172.21.15.55:0/567779138 wait complete. 2023-10-06T11:14:25.292 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:14:25.292 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:14:25.293 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:25.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.293 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:14:25.309 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:14:25.309 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:14:25.309 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:14:25.309 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.309 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:14:25.309 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42428sec preferred_lft 42428sec 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.310 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.311 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.312 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:14:25.373 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:14:25.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.375 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:14:25.431 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:14:25.431 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:14:25.431 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:14:25.431 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:14:25.431 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:14:25.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.431 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:14:25.432 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:14:25.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:14:25.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:14:25.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:14:25.432 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:14:25.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.534 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:14:25.549 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:14:25.549 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:14:25.549 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:25.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:14:25.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:25.615 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:25.671 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:25.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:25.672 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:25.726 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:14:25.726 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:25.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:25.807 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:25.807 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:25.827 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:25.827 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:25.848 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:25.848 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:25.848 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:25.848 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:25.848 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:25.849 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:25.849 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:25.849 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:25.849 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:14:25.849 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:14:25.850 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:14:25.854 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:14:25.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:25.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:14:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.077+0000 7f3bba7e3700 1 Processor -- start 2023-10-06T11:14:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.078+0000 7f3bba7e3700 1 -- start start 2023-10-06T11:14:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.078+0000 7f3bba7e3700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bb40b29b0 0x7f3bb4159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.078+0000 7f3bba7e3700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb40b0da0 con 0x7f3bb40b25e0 2023-10-06T11:14:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.078+0000 7f3bba7e3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb40cbfa0 con 0x7f3bb4159660 2023-10-06T11:14:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.078+0000 7f3bba7e3700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40cb390 con 0x7f3bb40b29b0 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bb40b29b0 0x7f3bb4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bb40b29b0 0x7f3bb4159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51692/0 (socket says 172.21.15.55:51692) 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb3fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bb40b25e0 0x7f3bb40b0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41260/0 (socket says 172.21.15.55:41260) 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 -- 172.21.15.55:0/4245634045 learned_addr learned my addr 172.21.15.55:0/4245634045 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 -- 172.21.15.55:0/4245634045 >> v1:172.21.15.142:6789/0 conn(0x7f3bb4159660 legacy=0x7f3bb40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 -- 172.21.15.55:0/4245634045 >> v1:172.21.15.55:6789/0 conn(0x7f3bb40b25e0 legacy=0x7f3bb40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 -- 172.21.15.55:0/4245634045 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40cb670 con 0x7f3bb40b29b0 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb2ffd700 1 -- 172.21.15.55:0/4245634045 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087348933 0 0) 0x7f3ba40011d0 con 0x7f3bb40b25e0 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb37fe700 1 --2- 172.21.15.55:0/4245634045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb40b29b0 0x7f3bb4159120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0099b0 tx=0x7f3b9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594d6b286e381568 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb2ffd700 1 -- 172.21.15.55:0/4245634045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00b820 con 0x7f3bb40b29b0 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb2ffd700 1 -- 172.21.15.55:0/4245634045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c00b980 con 0x7f3bb40b29b0 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.079+0000 7f3bb2ffd700 1 -- 172.21.15.55:0/4245634045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00bd20 con 0x7f3bb40b29b0 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 -- 172.21.15.55:0/4245634045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb40b29b0 msgr2=0x7f3bb4159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/4245634045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb40b29b0 0x7f3bb4159120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0099b0 tx=0x7f3b9c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 -- 172.21.15.55:0/4245634045 shutdown_connections 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/4245634045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb40b29b0 0x7f3bb4159120 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 -- 172.21.15.55:0/4245634045 >> 172.21.15.55:0/4245634045 conn(0x7f3bb406ece0 msgr2=0x7f3bb406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 -- 172.21.15.55:0/4245634045 shutdown_connections 2023-10-06T11:14:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.080+0000 7f3bba7e3700 1 -- 172.21.15.55:0/4245634045 wait complete. 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.081+0000 7f3bba7e3700 1 Processor -- start 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.081+0000 7f3bba7e3700 1 -- start start 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb40b25e0 0x7f3bb416a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb40b29b0 0x7f3bb4157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 0x7f3bb40c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40d02a0 con 0x7f3bb4159660 2023-10-06T11:14:26.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41573e0 con 0x7f3bb40b25e0 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40cffc0 con 0x7f3bb40b29b0 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 0x7f3bb40c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 0x7f3bb40c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51694/0 (socket says 172.21.15.55:51694) 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 -- 172.21.15.55:0/3112959276 learned_addr learned my addr 172.21.15.55:0/3112959276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb37fe700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb40b29b0 0x7f3bb4157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb3fff700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb40b25e0 0x7f3bb416a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 -- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb40b29b0 msgr2=0x7f3bb4157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb40b29b0 0x7f3bb4157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 -- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb40b25e0 msgr2=0x7f3bb416a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb40b25e0 0x7f3bb416a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 -- 172.21.15.55:0/3112959276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0094f0 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bb8d80700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 0x7f3bb40c6390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00bc30 tx=0x7f3bac009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00c9b0 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00cb50 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb4156d90 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.082+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac014410 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.083+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb4157db0 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.083+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb4156bf0 con 0x7f3bb4159660 2023-10-06T11:14:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.084+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bac014800 con 0x7f3bb4159660 2023-10-06T11:14:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.084+0000 7f3babfff700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b94066f30 0x7f3b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.085+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3bac084880 con 0x7f3bb4159660 2023-10-06T11:14:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.085+0000 7f3bb3fff700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b94066f30 0x7f3b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.085+0000 7f3bb3fff700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b94066f30 0x7f3b940693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4002890 tx=0x7f3ba4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:26.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.089+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bac04c5a0 con 0x7f3bb4159660 2023-10-06T11:14:26.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.329+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3bb4064a90 con 0x7f3bb4159660 2023-10-06T11:14:26.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.329+0000 7f3babfff700 1 -- 172.21.15.55:0/3112959276 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3bb4156bf0 con 0x7f3bb4159660 2023-10-06T11:14:26.331 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:14:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b94066f30 msgr2=0x7f3b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b94066f30 0x7f3b940693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4002890 tx=0x7f3ba4009040 comp rx=0 tx=0).stop 2023-10-06T11:14:26.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 msgr2=0x7f3bb40c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 0x7f3bb40c6390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00bc30 tx=0x7f3bac009820 comp rx=0 tx=0).stop 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 shutdown_connections 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3b94066f30 0x7f3b940693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bb4159660 0x7f3bb40c6390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb40b25e0 0x7f3bb416a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 --2- 172.21.15.55:0/3112959276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb40b29b0 0x7f3bb4157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.331+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 >> 172.21.15.55:0/3112959276 conn(0x7f3bb406ece0 msgr2=0x7f3bb40b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.332+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 shutdown_connections 2023-10-06T11:14:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:26.332+0000 7f3bba7e3700 1 -- 172.21.15.55:0/3112959276 wait complete. 2023-10-06T11:14:26.345 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:14:26.345 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:14:26.345 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:14:26.345 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:14:26.346 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:26.346 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:14:26.346 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:14:26.346 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:14:26.346 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:14:26.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.346 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:14:26.364 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:14:26.364 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:14:26.365 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42429sec preferred_lft 42429sec 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:14:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:26.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.368 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:14:26.432 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:14:26.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.434 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:14:26.491 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:14:26.492 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:14:26.492 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:14:26.492 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:14:26.492 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:14:26.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.492 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:14:26.492 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:14:26.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:14:26.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:14:26.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:14:26.493 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:14:26.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.596 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:14:26.610 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:14:26.610 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:14:26.610 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:14:26.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:14:26.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:26.679 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:26.734 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:14:26.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:26.735 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:26.790 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:14:26.790 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:26.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:26.870 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:26.870 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:26.888 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:26.889 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:26.911 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:26.911 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:26.911 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:26.911 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:14:26.912 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:14:26.913 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:14:26.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:26.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:26.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2023-10-06T11:14:27.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.106+0000 7f99e9f09700 1 Processor -- start 2023-10-06T11:14:27.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.106+0000 7f99e9f09700 1 -- start start 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e9f09700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99e413fe00 0x7f99e40c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e9f09700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e9f09700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e406e7e0 con 0x7f99e40c7ac0 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e9f09700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e415ade0 con 0x7f99e413fe00 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e9f09700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e406ea20 con 0x7f99e406e340 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e2ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99e413fe00 0x7f99e40c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99e40c7ac0 0x7f99e413f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41270/0 (socket says 172.21.15.55:41270) 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e37fe700 1 -- 172.21.15.55:0/1709433889 learned_addr learned my addr 172.21.15.55:0/1709433889 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e3fff700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e2ffd700 1 -- 172.21.15.55:0/1709433889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 msgr2=0x7f99e415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e2ffd700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e2ffd700 1 -- 172.21.15.55:0/1709433889 >> v1:172.21.15.55:6789/0 conn(0x7f99e40c7ac0 legacy=0x7f99e413f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e27fc700 1 -- 172.21.15.55:0/1709433889 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629016938 0 0) 0x7f99d4001110 con 0x7f99e40c7ac0 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e2ffd700 1 -- 172.21.15.55:0/1709433889 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e406ed00 con 0x7f99e413fe00 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e3fff700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e2ffd700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e40c7e90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009910 tx=0x7f99d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a2447dd5f7c068 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:27.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e27fc700 1 -- 172.21.15.55:0/1709433889 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800b8b0 con 0x7f99e413fe00 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e27fc700 1 -- 172.21.15.55:0/1709433889 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800ba10 con 0x7f99e413fe00 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.107+0000 7f99e27fc700 1 -- 172.21.15.55:0/1709433889 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800bdb0 con 0x7f99e413fe00 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 -- 172.21.15.55:0/1709433889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 msgr2=0x7f99e40c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e40c7e90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009910 tx=0x7f99d80091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 -- 172.21.15.55:0/1709433889 shutdown_connections 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1709433889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e40c7e90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 -- 172.21.15.55:0/1709433889 >> 172.21.15.55:0/1709433889 conn(0x7f99e40cc0a0 msgr2=0x7f99e40cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 -- 172.21.15.55:0/1709433889 shutdown_connections 2023-10-06T11:14:27.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.108+0000 7f99e9f09700 1 -- 172.21.15.55:0/1709433889 wait complete. 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.109+0000 7f99e9f09700 1 Processor -- start 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.109+0000 7f99e9f09700 1 -- start start 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e9f09700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e41676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e9f09700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e40c7ac0 0x7f99e4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e9f09700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e413e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e9f09700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4155390 con 0x7f99e413fe00 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e9f09700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4167d40 con 0x7f99e40c7ac0 2023-10-06T11:14:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e9f09700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4168020 con 0x7f99e406e340 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e413e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51716/0 (socket says 172.21.15.55:51716) 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 -- 172.21.15.55:0/1266504612 learned_addr learned my addr 172.21.15.55:0/1266504612 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e37fe700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e41676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e2ffd700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e40c7ac0 0x7f99e4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 -- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 msgr2=0x7f99e41676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e41676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 -- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e40c7ac0 msgr2=0x7f99e4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.110+0000 7f99e3fff700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e40c7ac0 0x7f99e4154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99e3fff700 1 -- 172.21.15.55:0/1266504612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009420 con 0x7f99e413fe00 2023-10-06T11:14:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99e3fff700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e413e980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00cef0 tx=0x7f99dc007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00ad20 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc016420 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e4168300 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00aea0 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.111+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40c31f0 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.112+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4064a90 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.112+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99dc016a70 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.113+0000 7f99cb7fe700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99d0066f30 0x7f99d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.113+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f99dc012070 con 0x7f99e413fe00 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.113+0000 7f99e37fe700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99d0066f30 0x7f99d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.114+0000 7f99e37fe700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99d0066f30 0x7f99d00693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99e413d120 tx=0x7f99d4007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:27.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.117+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99dc04e5a0 con 0x7f99e413fe00 2023-10-06T11:14:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.309+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7f99e404bb40 con 0x7f99e413fe00 2023-10-06T11:14:27.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.313+0000 7f99cb7fe700 1 -- 172.21.15.55:0/1266504612 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v11)=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f99dc055a50 con 0x7f99e413fe00 2023-10-06T11:14:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99d0066f30 msgr2=0x7f99d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99d0066f30 0x7f99d00693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99e413d120 tx=0x7f99d4007b90 comp rx=0 tx=0).stop 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 msgr2=0x7f99e413e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e413e980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00cef0 tx=0x7f99dc007860 comp rx=0 tx=0).stop 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 shutdown_connections 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99d0066f30 0x7f99d00693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e413fe00 0x7f99e413e980 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99e406e340 0x7f99e41676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 --2- 172.21.15.55:0/1266504612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99e40c7ac0 0x7f99e4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 >> 172.21.15.55:0/1266504612 conn(0x7f99e40cc0a0 msgr2=0x7f99e4159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 shutdown_connections 2023-10-06T11:14:27.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.315+0000 7f99e9f09700 1 -- 172.21.15.55:0/1266504612 wait complete. 2023-10-06T11:14:27.329 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:14:27.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:27.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:27.369 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:14:27.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:27.369 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:14:27.425 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:14:27.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:27.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:27.461 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:14:27.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:27.462 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:14:27.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:27.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.635+0000 7f31d7469700 1 Processor -- start 2023-10-06T11:14:27.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.635+0000 7f31d7469700 1 -- start start 2023-10-06T11:14:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d7469700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f31d00cd330 0x7f31d00ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d7469700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 0x7f31d00ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d7469700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00cc800 con 0x7f31d0159470 2023-10-06T11:14:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d7469700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d00cbc30 con 0x7f31d00cd330 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d7469700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00cf400 con 0x7f31d00c6220 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d6467700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f31d0159470 0x7f31d00ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41284/0 (socket says 172.21.15.55:41284) 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d6467700 1 -- 172.21.15.55:0/4028225155 learned_addr learned my addr 172.21.15.55:0/4028225155 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d6c68700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 0x7f31d00ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966867981 0 0) 0x7f31d00cc800 con 0x7f31d0159470 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d5c66700 1 --2- 172.21.15.55:0/4028225155 >> v2:172.21.15.142:3300/0 conn(0x7f31d00cd330 0x7f31d00ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.636+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b8003570 con 0x7f31d0159470 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342875575 0 0) 0x7f31b8003570 con 0x7f31d0159470 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 msgr2=0x7f31d00ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 0x7f31d00ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 >> v2:172.21.15.142:3300/0 conn(0x7f31d00cd330 msgr2=0x7f31d00ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 --2- 172.21.15.55:0/4028225155 >> v2:172.21.15.142:3300/0 conn(0x7f31d00cd330 0x7f31d00ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00cbed0 con 0x7f31d0159470 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f31c80015f0 con 0x7f31d0159470 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 >> v1:172.21.15.55:6789/0 conn(0x7f31d0159470 legacy=0x7f31d00ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 0x7f31b8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8004d50 0x7f31b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00cbc30 con 0x7f31b8003fe0 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00cf400 con 0x7f31b8004d50 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b800bb40 con 0x7f31d00c6220 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d6c68700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8004d50 0x7f31b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d6467700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 0x7f31b8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 -- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 msgr2=0x7f31b8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d00c6220 0x7f31b8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 -- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8004d50 msgr2=0x7f31b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8004d50 0x7f31b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 -- 172.21.15.55:0/4028225155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8003570 con 0x7f31b8003fe0 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d6c68700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8004d50 0x7f31b80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.637+0000 7f31d5c66700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31b8004810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f31c4006ea0 tx=0x7f31c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3f67c47c70ee4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4005a00 con 0x7f31b8003fe0 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c4005b60 con 0x7f31b8003fe0 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d5465700 1 -- 172.21.15.55:0/4028225155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400e640 con 0x7f31b8003fe0 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d7469700 1 -- 172.21.15.55:0/4028225155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 msgr2=0x7f31b8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d7469700 1 --2- 172.21.15.55:0/4028225155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31b8004810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f31c4006ea0 tx=0x7f31c4009120 comp rx=0 tx=0).stop 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d6c68700 1 -- 172.21.15.55:0/4028225155 reap_dead start 2023-10-06T11:14:27.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d7469700 1 -- 172.21.15.55:0/4028225155 shutdown_connections 2023-10-06T11:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d7469700 1 -- 172.21.15.55:0/4028225155 >> 172.21.15.55:0/4028225155 conn(0x7f31d00995c0 msgr2=0x7f31d006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d7469700 1 -- 172.21.15.55:0/4028225155 shutdown_connections 2023-10-06T11:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.638+0000 7f31d7469700 1 -- 172.21.15.55:0/4028225155 wait complete. 2023-10-06T11:14:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.639+0000 7f31d7469700 1 Processor -- start 2023-10-06T11:14:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.639+0000 7f31d7469700 1 -- start start 2023-10-06T11:14:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d7469700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31d00c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d7469700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d015d950 0x7f31d0154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d7469700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d015f570 0x7f31d015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d7469700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0155fc0 con 0x7f31b8003fe0 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d7469700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d015ea20 con 0x7f31d015d950 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d7469700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0156280 con 0x7f31d015f570 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31d00c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31d00c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51740/0 (socket says 172.21.15.55:51740) 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 -- 172.21.15.55:0/2352549815 learned_addr learned my addr 172.21.15.55:0/2352549815 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6c68700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d015f570 0x7f31d015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d5c66700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d015d950 0x7f31d0154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 -- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d015f570 msgr2=0x7f31d015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d015f570 0x7f31d015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 -- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d015d950 msgr2=0x7f31d0154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d015d950 0x7f31d0154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.640+0000 7f31d6467700 1 -- 172.21.15.55:0/2352549815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d015ff00 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.641+0000 7f31d6467700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31d00c9690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f31c800fc60 tx=0x7f31c8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.641+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80072e0 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.641+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8007460 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.641+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d015e180 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.641+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80057f0 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.641+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d015e740 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.642+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d005f230 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.642+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31c8005ba0 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.642+0000 7f31ce7fc700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31bc066f30 0x7f31bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.643+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f31c80848f0 con 0x7f31b8003fe0 2023-10-06T11:14:27.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.643+0000 7f31d5c66700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31bc066f30 0x7f31bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.644+0000 7f31d5c66700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31bc066f30 0x7f31bc0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009160 tx=0x7f31c4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:27.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.647+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31c80518c0 con 0x7f31b8003fe0 2023-10-06T11:14:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.888+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31d00cc1b0 con 0x7f31b8003fe0 2023-10-06T11:14:27.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.889+0000 7f31ce7fc700 1 -- 172.21.15.55:0/2352549815 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f31c8054ee0 con 0x7f31b8003fe0 2023-10-06T11:14:27.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:27.891 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31bc066f30 msgr2=0x7f31bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31bc066f30 0x7f31bc0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009160 tx=0x7f31c4019000 comp rx=0 tx=0).stop 2023-10-06T11:14:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 msgr2=0x7f31d00c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31d00c9690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f31c800fc60 tx=0x7f31c8009040 comp rx=0 tx=0).stop 2023-10-06T11:14:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 shutdown_connections 2023-10-06T11:14:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31bc066f30 0x7f31bc0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b8003fe0 0x7f31d00c9690 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d015f570 0x7f31d015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 --2- 172.21.15.55:0/2352549815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d015d950 0x7f31d0154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 >> 172.21.15.55:0/2352549815 conn(0x7f31d00995c0 msgr2=0x7f31d00cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 shutdown_connections 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:27.891+0000 7f31d7469700 1 -- 172.21.15.55:0/2352549815 wait complete. 2023-10-06T11:14:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:27.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T11:14:28.043 INFO:teuthology.orchestra.run.smithi055.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":71,"msgr_send_messages":63,"msgr_recv_bytes":111981,"msgr_send_bytes":16491,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.007887594,"msgr_running_send_time":0.001314560,"msgr_running_recv_time":0.009430554,"msgr_running_fast_dispatch_time":0.000318865,"msgr_send_messages_queue_lat":{"avgcount":63,"sum":0.054342769,"avgtime":0.000862583},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":22,"msgr_send_messages":29,"msgr_recv_bytes":4908,"msgr_send_bytes":116114,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.005834779,"msgr_running_send_time":0.000842767,"msgr_running_recv_time":0.004616002,"msgr_running_fast_dispatch_time":0.000278290,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.022776677,"avgtime":0.000813452},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000004039,"avgtime":0.000000577}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":27,"msgr_send_messages":28,"msgr_recv_bytes":6827,"msgr_send_bytes":14060,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.004458017,"msgr_running_send_time":0.000453341,"msgr_running_recv_time":0.003332390,"msgr_running_fast_dispatch_time":0.000555529,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.086267056,"avgtime":0.003195076},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000995,"avgtime":0.000000497}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":52,"sum":0.002533477,"avgtime":0.000048720}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012840,"avgtime":0.000006420}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000750509,"avgtime":0.000187627},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":187,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196957,"rdpos":0,"jlat":{"avgcount":5,"sum":0.008775843,"avgtime":0.001755168},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":33736,"heap":207104},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000455834,"avgtime":0.000151944},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000294675,"avgtime":0.000294675},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":1,"avg_session_uptime":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":213438,"buffer_anon_items":56,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13597,"op_resend":37,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":43,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":115,"get_sum":109075,"get_or_fail_fail":0,"get_or_fail_success":115,"take":0,"take_sum":0,"put":115,"put_sum":109075,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13597,"put":43,"put_sum":13597,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x562337f1fe00":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2653,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2653,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T11:14:28.044 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111981, "msgr_recv_messages": 71, "msgr_running_fast_dispatch_time": 0.000318865, "msgr_running_recv_time": 0.009430554, "msgr_running_send_time": 0.00131456, "msgr_running_total_time": 0.007887594, "msgr_send_bytes": 16491, "msgr_send_messages": 63, "msgr_send_messages_queue_lat": { "avgcount": 63, "avgtime": 0.000862583, "sum": 0.054342769 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 5.77e-07, "sum": 4.039e-06 }, "msgr_recv_bytes": 4908, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.00027829, "msgr_running_recv_time": 0.004616002, "msgr_running_send_time": 0.000842767, "msgr_running_total_time": 0.005834779, "msgr_send_bytes": 116114, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.000813452, "sum": 0.022776677 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 4.97e-07, "sum": 9.95e-07 }, "msgr_recv_bytes": 6827, "msgr_recv_messages": 27, "msgr_running_fast_dispatch_time": 0.000555529, "msgr_running_recv_time": 0.00333239, "msgr_running_send_time": 0.000453341, "msgr_running_total_time": 0.004458017, "msgr_send_bytes": 14060, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.003195076, "sum": 0.086267056 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 52, "avgtime": 4.872e-05, "sum": 0.002533477 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.42e-06, "sum": 1.284e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 187, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000187627, "sum": 0.000750509 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.001755168, "sum": 0.008775843 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196957 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 33736 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000151944, "sum": 0.000455834 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000294675, "sum": 0.000294675 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 213438, "buffer_anon_items": 56, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 43, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13597, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 115, "get_or_fail_fail": 0, "get_or_fail_success": 115, "get_started": 0, "get_sum": 109075, "max": 104857600, "put": 115, "put_sum": 109075, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13597, "take": 43, "take_sum": 13597, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x562337f1fe00": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2653, "max": 3758096384, "put": 5, "put_sum": 2653, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T11:14:28.045 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:14:28.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.163+0000 7f466c83b700 1 Processor -- start 2023-10-06T11:14:28.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.163+0000 7f466c83b700 1 -- start start 2023-10-06T11:14:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466c83b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4668159760 0x7f46680aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466c83b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46680686c0 con 0x7f466806a120 2023-10-06T11:14:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466c83b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4668068c80 con 0x7f4668159390 2023-10-06T11:14:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466c83b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46680ad0f0 con 0x7f4668159760 2023-10-06T11:14:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4668159760 0x7f46680aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466759e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f466806a120 0x7f46680aeb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41286/0 (socket says 172.21.15.55:41286) 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466759e700 1 -- 172.21.15.55:0/2281096813 learned_addr learned my addr 172.21.15.55:0/2281096813 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466659c700 1 -- 172.21.15.55:0/2281096813 >> v1:172.21.15.142:6789/0 conn(0x7f4668159390 legacy=0x7f46680ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466659c700 1 -- 172.21.15.55:0/2281096813 >> v1:172.21.15.55:6789/0 conn(0x7f466806a120 legacy=0x7f46680aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466659c700 1 -- 172.21.15.55:0/2281096813 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46680ad3d0 con 0x7f4668159760 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.164+0000 7f466659c700 1 --2- 172.21.15.55:0/2281096813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f46680aad00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f46500098e0 tx=0x7f46500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550a548d5e42373b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f4665d9b700 1 -- 172.21.15.55:0/2281096813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650009e80 con 0x7f4668159760 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f4665d9b700 1 -- 172.21.15.55:0/2281096813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000b860 con 0x7f4668159760 2023-10-06T11:14:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f4665d9b700 1 -- 172.21.15.55:0/2281096813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465000bbe0 con 0x7f4668159760 2023-10-06T11:14:28.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 -- 172.21.15.55:0/2281096813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 msgr2=0x7f46680aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 --2- 172.21.15.55:0/2281096813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f46680aad00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f46500098e0 tx=0x7f46500091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 -- 172.21.15.55:0/2281096813 shutdown_connections 2023-10-06T11:14:28.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 --2- 172.21.15.55:0/2281096813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f46680aad00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 -- 172.21.15.55:0/2281096813 >> 172.21.15.55:0/2281096813 conn(0x7f4668097410 msgr2=0x7f4668067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:28.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 -- 172.21.15.55:0/2281096813 shutdown_connections 2023-10-06T11:14:28.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.165+0000 7f466c83b700 1 -- 172.21.15.55:0/2281096813 wait complete. 2023-10-06T11:14:28.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.166+0000 7f466c83b700 1 Processor -- start 2023-10-06T11:14:28.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.166+0000 7f466c83b700 1 -- start start 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466c83b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466806a120 0x7f466806c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466c83b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4668159390 0x7f4668154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466c83b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f4668153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466c83b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466806d3f0 con 0x7f4668159760 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466c83b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46681548b0 con 0x7f466806a120 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466c83b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466815a840 con 0x7f4668159390 2023-10-06T11:14:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f4668153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f4668153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51754/0 (socket says 172.21.15.55:51754) 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466759e700 1 -- 172.21.15.55:0/8678430 learned_addr learned my addr 172.21.15.55:0/8678430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f466659c700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4668159390 0x7f4668154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.167+0000 7f4666d9d700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466806a120 0x7f466806c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466759e700 1 -- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4668159390 msgr2=0x7f4668154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466759e700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4668159390 0x7f4668154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466759e700 1 -- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466806a120 msgr2=0x7f466806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466759e700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466806a120 0x7f466806c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466759e700 1 -- 172.21.15.55:0/8678430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650009420 con 0x7f4668159760 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466759e700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f4668153380 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f466000c5c0 tx=0x7f4660007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660005b30 con 0x7f4668159760 2023-10-06T11:14:28.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660005cb0 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466806cb50 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660007320 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.168+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466815aac0 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.169+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466805f230 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.169+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f466001b3b0 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.170+0000 7f465effd700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4648066f30 0x7f46480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.170+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4660083ce0 con 0x7f4668159760 2023-10-06T11:14:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.170+0000 7f4666d9d700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4648066f30 0x7f46480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.170+0000 7f4666d9d700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4648066f30 0x7f46480693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4658007fd0 tx=0x7f4658009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.174+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4660050cb0 con 0x7f4668159760 2023-10-06T11:14:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.414+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4668155690 con 0x7f4668159760 2023-10-06T11:14:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.414+0000 7f465effd700 1 -- 172.21.15.55:0/8678430 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4660017020 con 0x7f4668159760 2023-10-06T11:14:28.416 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:14:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4648066f30 msgr2=0x7f46480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4648066f30 0x7f46480693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4658007fd0 tx=0x7f4658009040 comp rx=0 tx=0).stop 2023-10-06T11:14:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 msgr2=0x7f4668153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f4668153380 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f466000c5c0 tx=0x7f4660007ef0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 shutdown_connections 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4648066f30 0x7f46480693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4668159760 0x7f4668153380 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f466806a120 0x7f466806c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 --2- 172.21.15.55:0/8678430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4668159390 0x7f4668154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 >> 172.21.15.55:0/8678430 conn(0x7f4668097410 msgr2=0x7f466814ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 shutdown_connections 2023-10-06T11:14:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:28.416+0000 7f466c83b700 1 -- 172.21.15.55:0/8678430 wait complete. 2023-10-06T11:14:28.429 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:14:28.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:14:28.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:14:28.430 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:14:28.430 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:28.430 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:14:28.430 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:14:28.430 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:14:28.430 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:28.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.430 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:14:28.446 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42424sec preferred_lft 42424sec 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:28.447 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:28.448 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:14:28.449 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:14:28.449 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:28.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.449 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:14:28.510 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:14:28.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.512 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:14:28.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.569 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:14:28.569 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:14:28.569 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:14:28.569 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:14:28.569 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:14:28.569 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:14:28.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.672 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:14:28.686 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:14:28.686 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:14:28.687 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:28.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:14:28.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:28.754 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:28.810 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:28.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:28.810 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:28.865 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:14:28.865 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:28.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:28.946 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:28.946 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:28.965 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:28.965 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:28.965 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:28.966 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:28.966 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:28.966 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:28.966 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:28.966 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:28.988 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:28.989 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:28.990 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:28.990 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:28.990 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:28.990 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:28.990 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:28.990 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:28.991 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:14:28.991 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:14:28.991 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:14:28.992 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:14:28.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:28.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:29.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T11:14:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":71,"msgr_send_messages":63,"msgr_recv_bytes":111981,"msgr_send_bytes":16491,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.007921723,"msgr_running_send_time":0.001314560,"msgr_running_recv_time":0.009430554,"msgr_running_fast_dispatch_time":0.000318865,"msgr_send_messages_queue_lat":{"avgcount":63,"sum":0.054342769,"avgtime":0.000862583},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":24,"msgr_send_messages":31,"msgr_recv_bytes":5365,"msgr_send_bytes":116731,"msgr_created_connections":9,"msgr_active_connections":4,"msgr_running_total_time":0.006112646,"msgr_running_send_time":0.000899868,"msgr_running_recv_time":0.004854110,"msgr_running_fast_dispatch_time":0.000278290,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.022803001,"avgtime":0.000760100},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000005199,"avgtime":0.000000577}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":28,"msgr_send_messages":29,"msgr_recv_bytes":7073,"msgr_send_bytes":14631,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.004528526,"msgr_running_send_time":0.000473890,"msgr_running_recv_time":0.003351859,"msgr_running_fast_dispatch_time":0.000580522,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.086285591,"avgtime":0.003081628},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000995,"avgtime":0.000000497}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.002589750,"avgtime":0.000047958}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012840,"avgtime":0.000006420}},"mds":{"request":5,"reply":5,"reply_latency":{"avgcount":5,"sum":0.000859846,"avgtime":0.000171969},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":9,"traverse_hit":9,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":187,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197217,"rdpos":0,"jlat":{"avgcount":6,"sum":0.010318475,"avgtime":0.001719745},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":34032,"heap":207104},"mds_server":{"dispatch_client_request":5,"dispatch_server_request":0,"handle_client_request":5,"handle_client_session":7,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":4,"sum":0.000565171,"avgtime":0.000141292},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000294675,"avgtime":0.000294675},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":4,"average_load":4,"avg_session_uptime":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":213438,"buffer_anon_items":56,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50464,"mds_co_items":205,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13857,"op_resend":37,"op_reply":44,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":43,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":118,"get_sum":109540,"get_or_fail_fail":0,"get_or_fail_success":118,"take":0,"take_sum":0,"put":118,"put_sum":109540,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13857,"put":44,"put_sum":13857,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x562337f1fe00":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2913,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":6,"put_sum":2913,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T11:14:29.237 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111981, "msgr_recv_messages": 71, "msgr_running_fast_dispatch_time": 0.000318865, "msgr_running_recv_time": 0.009430554, "msgr_running_send_time": 0.00131456, "msgr_running_total_time": 0.007921723, "msgr_send_bytes": 16491, "msgr_send_messages": 63, "msgr_send_messages_queue_lat": { "avgcount": 63, "avgtime": 0.000862583, "sum": 0.054342769 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 5.77e-07, "sum": 5.199e-06 }, "msgr_recv_bytes": 5365, "msgr_recv_messages": 24, "msgr_running_fast_dispatch_time": 0.00027829, "msgr_running_recv_time": 0.00485411, "msgr_running_send_time": 0.000899868, "msgr_running_total_time": 0.006112646, "msgr_send_bytes": 116731, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.0007601, "sum": 0.022803001 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 4.97e-07, "sum": 9.95e-07 }, "msgr_recv_bytes": 7073, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.000580522, "msgr_running_recv_time": 0.003351859, "msgr_running_send_time": 0.00047389, "msgr_running_total_time": 0.004528526, "msgr_send_bytes": 14631, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.003081628, "sum": 0.086285591 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 4.7958e-05, "sum": 0.00258975 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.42e-06, "sum": 1.284e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 187, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 5, "reply_latency": { "avgcount": 5, "avgtime": 0.000171969, "sum": 0.000859846 }, "request": 5, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 9, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 9, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.001719745, "sum": 0.010318475 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197217 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34032 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 5, "dispatch_server_request": 0, "handle_client_request": 5, "handle_client_session": 7, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 4, "avgtime": 0.000141292, "sum": 0.000565171 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000294675, "sum": 0.000294675 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 4, "avg_session_uptime": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 4 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 213438, "buffer_anon_items": 56, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50464, "mds_co_items": 205, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 43, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13857, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 118, "get_or_fail_fail": 0, "get_or_fail_success": 118, "get_started": 0, "get_sum": 109540, "max": 104857600, "put": 118, "put_sum": 109540, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13857, "take": 44, "take_sum": 13857, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x562337f1fe00": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2913, "max": 3758096384, "put": 6, "put_sum": 2913, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T11:14:29.239 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:14:29.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:29.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:29.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:14:29.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:29.282 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:14:29.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T11:14:29.515 INFO:teuthology.orchestra.run.smithi055.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":71,"msgr_send_messages":63,"msgr_recv_bytes":111981,"msgr_send_bytes":16491,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.007934614,"msgr_running_send_time":0.001314560,"msgr_running_recv_time":0.009430554,"msgr_running_fast_dispatch_time":0.000318865,"msgr_send_messages_queue_lat":{"avgcount":63,"sum":0.054342769,"avgtime":0.000862583},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":26,"msgr_send_messages":32,"msgr_recv_bytes":5569,"msgr_send_bytes":116834,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.006296915,"msgr_running_send_time":0.000958747,"msgr_running_recv_time":0.005018376,"msgr_running_fast_dispatch_time":0.000278290,"msgr_send_messages_queue_lat":{"avgcount":31,"sum":0.022814869,"avgtime":0.000735963},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000005199,"avgtime":0.000000577}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":29,"msgr_send_messages":30,"msgr_recv_bytes":7319,"msgr_send_bytes":15083,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.004601590,"msgr_running_send_time":0.000496979,"msgr_running_recv_time":0.003368254,"msgr_running_fast_dispatch_time":0.000606350,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.086301989,"avgtime":0.002975930},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000995,"avgtime":0.000000497}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":56,"sum":0.002649946,"avgtime":0.000047320}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012840,"avgtime":0.000006420}},"mds":{"request":5,"reply":5,"reply_latency":{"avgcount":5,"sum":0.000859846,"avgtime":0.000171969},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":9,"traverse_hit":9,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":187,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197358,"rdpos":0,"jlat":{"avgcount":7,"sum":0.012295546,"avgtime":0.001756506},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":34032,"heap":207104},"mds_server":{"dispatch_client_request":5,"dispatch_server_request":0,"handle_client_request":5,"handle_client_session":9,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":4,"sum":0.000565171,"avgtime":0.000141292},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000294675,"avgtime":0.000294675},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":4,"average_load":4,"avg_session_uptime":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":205965,"buffer_anon_items":62,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50512,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":13998,"op_resend":37,"op_reply":45,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":43,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":121,"get_sum":109752,"get_or_fail_fail":0,"get_or_fail_success":121,"take":0,"take_sum":0,"put":121,"put_sum":109752,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":13998,"put":45,"put_sum":13998,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x562337f1fe00":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":3054,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":7,"put_sum":3054,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T11:14:29.517 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111981, "msgr_recv_messages": 71, "msgr_running_fast_dispatch_time": 0.000318865, "msgr_running_recv_time": 0.009430554, "msgr_running_send_time": 0.00131456, "msgr_running_total_time": 0.007934614, "msgr_send_bytes": 16491, "msgr_send_messages": 63, "msgr_send_messages_queue_lat": { "avgcount": 63, "avgtime": 0.000862583, "sum": 0.054342769 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 5.77e-07, "sum": 5.199e-06 }, "msgr_recv_bytes": 5569, "msgr_recv_messages": 26, "msgr_running_fast_dispatch_time": 0.00027829, "msgr_running_recv_time": 0.005018376, "msgr_running_send_time": 0.000958747, "msgr_running_total_time": 0.006296915, "msgr_send_bytes": 116834, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 31, "avgtime": 0.000735963, "sum": 0.022814869 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 4.97e-07, "sum": 9.95e-07 }, "msgr_recv_bytes": 7319, "msgr_recv_messages": 29, "msgr_running_fast_dispatch_time": 0.00060635, "msgr_running_recv_time": 0.003368254, "msgr_running_send_time": 0.000496979, "msgr_running_total_time": 0.00460159, "msgr_send_bytes": 15083, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.00297593, "sum": 0.086301989 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 56, "avgtime": 4.732e-05, "sum": 0.002649946 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.42e-06, "sum": 1.284e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 187, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 5, "reply_latency": { "avgcount": 5, "avgtime": 0.000171969, "sum": 0.000859846 }, "request": 5, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 9, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 9, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.001756506, "sum": 0.012295546 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4197358 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34032 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 5, "dispatch_server_request": 0, "handle_client_request": 5, "handle_client_session": 9, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 4, "avgtime": 0.000141292, "sum": 0.000565171 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000294675, "sum": 0.000294675 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 4, "avg_session_uptime": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 4 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 205965, "buffer_anon_items": 62, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50512, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 43, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 13998, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 121, "get_or_fail_fail": 0, "get_or_fail_success": 121, "get_started": 0, "get_sum": 109752, "max": 104857600, "put": 121, "put_sum": 109752, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 13998, "take": 45, "take_sum": 13998, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x562337f1fe00": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 3054, "max": 3758096384, "put": 7, "put_sum": 3054, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T11:14:29.519 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T11:14:29.519 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:14:29.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:29.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:29.616 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:14:29.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.734+0000 7fc2aecf2700 1 Processor -- start 2023-10-06T11:14:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.734+0000 7fc2aecf2700 1 -- start start 2023-10-06T11:14:29.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2aecf2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2a80cbc30 0x7fc2a80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2aecf2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2a80b2100 0x7fc2a80b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2aecf2700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80cb7a0 con 0x7fc2a8159440 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2aecf2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80b0860 con 0x7fc2a80b2100 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2aecf2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80cb150 con 0x7fc2a80cbc30 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2ae4f1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2a80b2100 0x7fc2a80b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2adcf0700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2a8159440 0x7fc2a80b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41292/0 (socket says 172.21.15.55:41292) 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.735+0000 7fc2adcf0700 1 -- 172.21.15.55:0/3110101086 learned_addr learned my addr 172.21.15.55:0/3110101086 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2ae4f1700 1 -- 172.21.15.55:0/3110101086 >> v2:172.21.15.142:3300/0 conn(0x7fc2a80cbc30 msgr2=0x7fc2a80cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2ae4f1700 1 --2- 172.21.15.55:0/3110101086 >> v2:172.21.15.142:3300/0 conn(0x7fc2a80cbc30 0x7fc2a80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2ae4f1700 1 -- 172.21.15.55:0/3110101086 >> v1:172.21.15.55:6789/0 conn(0x7fc2a8159440 legacy=0x7fc2a80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2ae4f1700 1 -- 172.21.15.55:0/3110101086 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80cb430 con 0x7fc2a80b2100 2023-10-06T11:14:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2ae4f1700 1 --2- 172.21.15.55:0/3110101086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80b2100 0x7fc2a80b2520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80d0220 tx=0x7fc2a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d911f52cf03e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2accee700 1 -- 172.21.15.55:0/3110101086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000b6b0 con 0x7fc2a80b2100 2023-10-06T11:14:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2accee700 1 -- 172.21.15.55:0/3110101086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000b810 con 0x7fc2a80b2100 2023-10-06T11:14:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2accee700 1 -- 172.21.15.55:0/3110101086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000bbb0 con 0x7fc2a80b2100 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2aecf2700 1 -- 172.21.15.55:0/3110101086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80b2100 msgr2=0x7fc2a80b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/3110101086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80b2100 0x7fc2a80b2520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80d0220 tx=0x7fc2a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2aecf2700 1 -- 172.21.15.55:0/3110101086 shutdown_connections 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/3110101086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80b2100 0x7fc2a80b2520 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/3110101086 >> v2:172.21.15.142:3300/0 conn(0x7fc2a80cbc30 0x7fc2a80cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.736+0000 7fc2aecf2700 1 -- 172.21.15.55:0/3110101086 >> 172.21.15.55:0/3110101086 conn(0x7fc2a806ece0 msgr2=0x7fc2a806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.737+0000 7fc2aecf2700 1 -- 172.21.15.55:0/3110101086 shutdown_connections 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.737+0000 7fc2aecf2700 1 -- 172.21.15.55:0/3110101086 wait complete. 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 Processor -- start 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 -- start start 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2a80b2100 0x7fc2a8154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 0x7fc2a80c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2a8159440 0x7fc2a80ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80c5e10 con 0x7fc2a80cbc30 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8154e60 con 0x7fc2a80b2100 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.738+0000 7fc2aecf2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a815d740 con 0x7fc2a8159440 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 0x7fc2a80c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 0x7fc2a80c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51774/0 (socket says 172.21.15.55:51774) 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 -- 172.21.15.55:0/2581417079 learned_addr learned my addr 172.21.15.55:0/2581417079 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2adcf0700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2a80b2100 0x7fc2a8154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ae4f1700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2a8159440 0x7fc2a80ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 -- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2a8159440 msgr2=0x7fc2a80ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2a8159440 0x7fc2a80ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 -- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2a80b2100 msgr2=0x7fc2a8154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2a80b2100 0x7fc2a8154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 -- 172.21.15.55:0/2581417079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009420 con 0x7fc2a80cbc30 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2adcf0700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2a80b2100 0x7fc2a8154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2ad4ef700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 0x7fc2a80c6090 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00b840 tx=0x7fc29c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00f590 con 0x7fc2a80cbc30 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00f6f0 con 0x7fc2a80cbc30 2023-10-06T11:14:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80c48d0 con 0x7fc2a80cbc30 2023-10-06T11:14:29.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00fab0 con 0x7fc2a80cbc30 2023-10-06T11:14:29.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.739+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a80c4310 con 0x7fc2a80cbc30 2023-10-06T11:14:29.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.740+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a805f230 con 0x7fc2a80cbc30 2023-10-06T11:14:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.741+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc29c01a460 con 0x7fc2a80cbc30 2023-10-06T11:14:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.741+0000 7fc2a5ffb700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc294066f30 0x7fc2940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.741+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc29c084560 con 0x7fc2a80cbc30 2023-10-06T11:14:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.741+0000 7fc2adcf0700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc294066f30 0x7fc2940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.742+0000 7fc2adcf0700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc294066f30 0x7fc2940693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e160 tx=0x7fc298009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:29.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.745+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc29c0515b0 con 0x7fc2a80cbc30 2023-10-06T11:14:29.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.984+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2a8159810 con 0x7fc2a80cbc30 2023-10-06T11:14:29.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.984+0000 7fc2a5ffb700 1 -- 172.21.15.55:0/2581417079 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fc29c054bd0 con 0x7fc2a80cbc30 2023-10-06T11:14:29.986 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:29.986 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:29.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc294066f30 msgr2=0x7fc2940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:29.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc294066f30 0x7fc2940693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e160 tx=0x7fc298009040 comp rx=0 tx=0).stop 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 msgr2=0x7fc2a80c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 0x7fc2a80c6090 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00b840 tx=0x7fc29c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 shutdown_connections 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc294066f30 0x7fc2940693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2a8159440 0x7fc2a80ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2a80b2100 0x7fc2a8154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 --2- 172.21.15.55:0/2581417079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a80cbc30 0x7fc2a80c6090 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.986+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 >> 172.21.15.55:0/2581417079 conn(0x7fc2a806ece0 msgr2=0x7fc2a8157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.987+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 shutdown_connections 2023-10-06T11:14:29.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:29.987+0000 7fc2aecf2700 1 -- 172.21.15.55:0/2581417079 wait complete. 2023-10-06T11:14:29.990 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:30.000 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:30.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.118+0000 7f722156e700 1 Processor -- start 2023-10-06T11:14:30.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.119+0000 7f722156e700 1 -- start start 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.119+0000 7f722156e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 0x7f721c0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.119+0000 7f722156e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f721c0b0760 0x7f721c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.119+0000 7f722156e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0b0c60 con 0x7f721c159560 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.119+0000 7f722156e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0b0f40 con 0x7f721c0b0760 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.119+0000 7f722156e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0b1220 con 0x7f721c0b49a0 2023-10-06T11:14:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721a7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 0x7f721c0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f721c0b0760 0x7f721c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721a7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 0x7f721c0aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:43302/0 (socket says 172.21.15.55:43302) 2023-10-06T11:14:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721affd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f721c159560 0x7f721c0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:36330/0 (socket says 172.21.15.55:36330) 2023-10-06T11:14:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f721c0b0760 0x7f721c0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:57304/0 (socket says 172.21.15.55:57304) 2023-10-06T11:14:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721a7fc700 1 -- 172.21.15.55:0/390240886 learned_addr learned my addr 172.21.15.55:0/390240886 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 -- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 msgr2=0x7f721c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 --2- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 0x7f721c0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 -- 172.21.15.55:0/390240886 >> v1:172.21.15.142:6789/0 conn(0x7f721c159560 legacy=0x7f721c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f7219ffb700 1 -- 172.21.15.55:0/390240886 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403412797 0 0) 0x7f721c0b0c60 con 0x7f721c159560 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 -- 172.21.15.55:0/390240886 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0b1500 con 0x7f721c0b0760 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721a7fc700 1 --2- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 0x7f721c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.120+0000 7f721b7fe700 1 --2- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c0b0760 0x7f721c0b1bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f720c009e60 tx=0x7f720c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cafa4d96c21b4eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f7219ffb700 1 -- 172.21.15.55:0/390240886 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00e070 con 0x7f721c0b0760 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f7219ffb700 1 -- 172.21.15.55:0/390240886 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c00bb60 con 0x7f721c0b0760 2023-10-06T11:14:30.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f7219ffb700 1 -- 172.21.15.55:0/390240886 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c012430 con 0x7f721c0b0760 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 -- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c0b0760 msgr2=0x7f721c0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 --2- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c0b0760 0x7f721c0b1bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f720c009e60 tx=0x7f720c009780 comp rx=0 tx=0).stop 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 -- 172.21.15.55:0/390240886 shutdown_connections 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 --2- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c0b0760 0x7f721c0b1bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 --2- 172.21.15.55:0/390240886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b49a0 0x7f721c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 -- 172.21.15.55:0/390240886 >> 172.21.15.55:0/390240886 conn(0x7f721c0997f0 msgr2=0x7f721c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 -- 172.21.15.55:0/390240886 shutdown_connections 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.121+0000 7f722156e700 1 -- 172.21.15.55:0/390240886 wait complete. 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.122+0000 7f722156e700 1 Processor -- start 2023-10-06T11:14:30.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.122+0000 7f722156e700 1 -- start start 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f722156e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b0760 0x7f721c155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f722156e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 0x7f721c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f722156e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c159560 0x7f721c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f722156e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c15b0f0 con 0x7f721c0b49a0 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f722156e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c169bd0 con 0x7f721c159560 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f722156e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c169e70 con 0x7f721c0b0760 2023-10-06T11:14:30.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f721a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 0x7f721c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f721a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 0x7f721c159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51790/0 (socket says 172.21.15.55:51790) 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f721a7fc700 1 -- 172.21.15.55:0/237228183 learned_addr learned my addr 172.21.15.55:0/237228183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f721affd700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b0760 0x7f721c155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.123+0000 7f721b7fe700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c159560 0x7f721c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f721a7fc700 1 -- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b0760 msgr2=0x7f721c155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f721a7fc700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b0760 0x7f721c155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f721a7fc700 1 -- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c159560 msgr2=0x7f721c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f721a7fc700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c159560 0x7f721c0cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f721a7fc700 1 -- 172.21.15.55:0/237228183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040094f0 con 0x7f721c0b49a0 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f721a7fc700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 0x7f721c159e00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f720400ec50 tx=0x7f7204009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720400c7f0 con 0x7f721c0b49a0 2023-10-06T11:14:30.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400c950 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c009a20 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720400ccf0 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.124+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c15a8d0 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.125+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c064a90 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.125+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7204013680 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.126+0000 7f7212ffd700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f71fc066f30 0x7f71fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.126+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7204084ab0 con 0x7f721c0b49a0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.126+0000 7f721affd700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f71fc066f30 0x7f71fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.127+0000 7f721affd700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f71fc066f30 0x7f71fc0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7214007fd0 tx=0x7f7214007f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.130+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72040519e0 con 0x7f721c0b49a0 2023-10-06T11:14:30.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.325+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f721c0b17e0 con 0x7f721c0b49a0 2023-10-06T11:14:30.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.326+0000 7f7212ffd700 1 -- 172.21.15.55:0/237228183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f7204055000 con 0x7f721c0b49a0 2023-10-06T11:14:30.328 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:30.328 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:19.948485+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.621851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.333304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f71fc066f30 msgr2=0x7f71fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f71fc066f30 0x7f71fc0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7214007fd0 tx=0x7f7214007f40 comp rx=0 tx=0).stop 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 msgr2=0x7f721c159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 0x7f721c159e00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f720400ec50 tx=0x7f7204009250 comp rx=0 tx=0).stop 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 shutdown_connections 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f71fc066f30 0x7f71fc0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f721c159560 0x7f721c0cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f721c0b0760 0x7f721c155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 --2- 172.21.15.55:0/237228183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f721c0b49a0 0x7f721c159e00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 >> 172.21.15.55:0/237228183 conn(0x7f721c0997f0 msgr2=0x7f721c158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:30.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 shutdown_connections 2023-10-06T11:14:30.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.328+0000 7f722156e700 1 -- 172.21.15.55:0/237228183 wait complete. 2023-10-06T11:14:30.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:14:16.621851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:14:17.333304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:14:30.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.462+0000 7fa9626ca700 1 Processor -- start 2023-10-06T11:14:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.462+0000 7fa9626ca700 1 -- start start 2023-10-06T11:14:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa9626ca700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa9626ca700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa95c06dbd0 0x7fa95c06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa9626ca700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95c068500 con 0x7fa95c1593e0 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa9626ca700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95c0af300 con 0x7fa95c06dbd0 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa9626ca700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c06e560 con 0x7fa95c1597b0 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa960c67700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa95c06dbd0 0x7fa95c06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa95bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa95c1593e0 0x7fa95c0af840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41296/0 (socket says 172.21.15.55:41296) 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa95bfff700 1 -- 172.21.15.55:0/583591058 learned_addr learned my addr 172.21.15.55:0/583591058 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa960c67700 1 -- 172.21.15.55:0/583591058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 msgr2=0x7fa95c067fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa960c67700 1 --2- 172.21.15.55:0/583591058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa960c67700 1 -- 172.21.15.55:0/583591058 >> v1:172.21.15.55:6789/0 conn(0x7fa95c1593e0 legacy=0x7fa95c0af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.463+0000 7fa960c67700 1 -- 172.21.15.55:0/583591058 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c0ac340 con 0x7fa95c06dbd0 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa960c67700 1 --2- 172.21.15.55:0/583591058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c06e020 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa954009e60 tx=0x7fa954009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514d85f6abf736bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa95affd700 1 -- 172.21.15.55:0/583591058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95400e070 con 0x7fa95c06dbd0 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa95affd700 1 -- 172.21.15.55:0/583591058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95400bc30 con 0x7fa95c06dbd0 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa95affd700 1 -- 172.21.15.55:0/583591058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954012430 con 0x7fa95c06dbd0 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 -- 172.21.15.55:0/583591058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 msgr2=0x7fa95c06e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 --2- 172.21.15.55:0/583591058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c06e020 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa954009e60 tx=0x7fa954009780 comp rx=0 tx=0).stop 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 -- 172.21.15.55:0/583591058 shutdown_connections 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 --2- 172.21.15.55:0/583591058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c06e020 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 --2- 172.21.15.55:0/583591058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c067fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 -- 172.21.15.55:0/583591058 >> 172.21.15.55:0/583591058 conn(0x7fa95c0cd390 msgr2=0x7fa95c0ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 -- 172.21.15.55:0/583591058 shutdown_connections 2023-10-06T11:14:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.464+0000 7fa9626ca700 1 -- 172.21.15.55:0/583591058 wait complete. 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.465+0000 7fa9626ca700 1 Processor -- start 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 -- start start 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c1593e0 0x7fa95c151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c151540 con 0x7fa95c06dbd0 2023-10-06T11:14:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c0b1120 con 0x7fa95c1593e0 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa9626ca700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c0b1400 con 0x7fa95c1597b0 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa95bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c0b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51806/0 (socket says 172.21.15.55:51806) 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.466+0000 7fa95bfff700 1 -- 172.21.15.55:0/307979996 learned_addr learned my addr 172.21.15.55:0/307979996 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa960c67700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95bfff700 1 -- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 msgr2=0x7fa95c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95b7fe700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c1593e0 0x7fa95c151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95bfff700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c14f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95bfff700 1 -- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c1593e0 msgr2=0x7fa95c151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95bfff700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c1593e0 0x7fa95c151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95bfff700 1 -- 172.21.15.55:0/307979996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954009a20 con 0x7fa95c06dbd0 2023-10-06T11:14:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa95bfff700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c0b0a90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c7c0 tx=0x7fa94c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c005b30 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c005cb0 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c004a80 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c0b16e0 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.467+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c0b1ca0 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.468+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c064a90 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.468+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa94c0070f0 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.469+0000 7fa953fff700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa93c066f30 0x7fa93c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.469+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa94c083a80 con 0x7fa95c06dbd0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.469+0000 7fa95b7fe700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa93c066f30 0x7fa93c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.469+0000 7fa95b7fe700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa93c066f30 0x7fa93c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa944006fd0 tx=0x7fa944008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.473+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa94c050ad0 con 0x7fa95c06dbd0 2023-10-06T11:14:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.662+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa95c068500 con 0x7fa95c06dbd0 2023-10-06T11:14:30.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.663+0000 7fa953fff700 1 -- 172.21.15.55:0/307979996 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa95c068500 con 0x7fa95c06dbd0 2023-10-06T11:14:30.664 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:14:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa93c066f30 msgr2=0x7fa93c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa93c066f30 0x7fa93c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa944006fd0 tx=0x7fa944008040 comp rx=0 tx=0).stop 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 msgr2=0x7fa95c0b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c0b0a90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c7c0 tx=0x7fa94c007f70 comp rx=0 tx=0).stop 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 shutdown_connections 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa93c066f30 0x7fa93c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa95c06dbd0 0x7fa95c0b0a90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa95c1597b0 0x7fa95c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 --2- 172.21.15.55:0/307979996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa95c1593e0 0x7fa95c151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.664+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 >> 172.21.15.55:0/307979996 conn(0x7fa95c0cd390 msgr2=0x7fa95c0ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.665+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 shutdown_connections 2023-10-06T11:14:30.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.665+0000 7fa9626ca700 1 -- 172.21.15.55:0/307979996 wait complete. 2023-10-06T11:14:30.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:30.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 Processor -- start 2023-10-06T11:14:30.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 -- start start 2023-10-06T11:14:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47301594d0 0x7f47300cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47301598a0 0x7f47300cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47300ce7e0 0x7f47300cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47300cf5d0 con 0x7f47301594d0 2023-10-06T11:14:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47300cf8b0 con 0x7f47300ce7e0 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.798+0000 7f47354fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300cfb90 con 0x7f47301598a0 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47301594d0 0x7f47300cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47301594d0 0x7f47300cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51818/0 (socket says 172.21.15.55:51818) 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 -- 172.21.15.55:0/980246235 learned_addr learned my addr 172.21.15.55:0/980246235 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472e7fc700 1 --2- 172.21.15.55:0/980246235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47301598a0 0x7f47300cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472f7fe700 1 --2- 172.21.15.55:0/980246235 >> v2:172.21.15.142:3300/0 conn(0x7f47300ce7e0 0x7f47300cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 -- 172.21.15.55:0/980246235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47301598a0 msgr2=0x7f47300cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 --2- 172.21.15.55:0/980246235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47301598a0 0x7f47300cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 -- 172.21.15.55:0/980246235 >> v2:172.21.15.142:3300/0 conn(0x7f47300ce7e0 msgr2=0x7f47300cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 --2- 172.21.15.55:0/980246235 >> v2:172.21.15.142:3300/0 conn(0x7f47300ce7e0 0x7f47300cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 -- 172.21.15.55:0/980246235 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300cfe70 con 0x7f47301594d0 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472effd700 1 --2- 172.21.15.55:0/980246235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301594d0 0x7f47300cb560 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f473008ac70 tx=0x7f4720009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5191e6a33fcca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472dffb700 1 -- 172.21.15.55:0/980246235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000e070 con 0x7f47301594d0 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472dffb700 1 -- 172.21.15.55:0/980246235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000ba50 con 0x7f47301594d0 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.799+0000 7f472dffb700 1 -- 172.21.15.55:0/980246235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200092e0 con 0x7f47301594d0 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 -- 172.21.15.55:0/980246235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301594d0 msgr2=0x7f47300cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 --2- 172.21.15.55:0/980246235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301594d0 0x7f47300cb560 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f473008ac70 tx=0x7f4720009840 comp rx=0 tx=0).stop 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 -- 172.21.15.55:0/980246235 shutdown_connections 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 --2- 172.21.15.55:0/980246235 >> v2:172.21.15.142:3300/0 conn(0x7f47300ce7e0 0x7f47300cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 --2- 172.21.15.55:0/980246235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301594d0 0x7f47300cb560 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 --2- 172.21.15.55:0/980246235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47301598a0 0x7f47300cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 -- 172.21.15.55:0/980246235 >> 172.21.15.55:0/980246235 conn(0x7f4730089e50 msgr2=0x7f4730099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 -- 172.21.15.55:0/980246235 shutdown_connections 2023-10-06T11:14:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.800+0000 7f47354fb700 1 -- 172.21.15.55:0/980246235 wait complete. 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.801+0000 7f47354fb700 1 Processor -- start 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.801+0000 7f47354fb700 1 -- start start 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f47354fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47300ce7e0 0x7f473014d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f47354fb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47301594d0 0x7f47300ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f47354fb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 0x7f47300c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f47354fb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4730169fe0 con 0x7f47301598a0 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f47354fb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c84c0 con 0x7f47301594d0 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f47354fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c8740 con 0x7f47300ce7e0 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 0x7f47300c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 0x7f47300c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51830/0 (socket says 172.21.15.55:51830) 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 -- 172.21.15.55:0/3686010977 learned_addr learned my addr 172.21.15.55:0/3686010977 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472effd700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47300ce7e0 0x7f473014d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472e7fc700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47301594d0 0x7f47300ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 -- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47300ce7e0 msgr2=0x7f473014d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47300ce7e0 0x7f473014d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 -- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47301594d0 msgr2=0x7f47300ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47301594d0 0x7f47300ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 -- 172.21.15.55:0/3686010977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009ae0 con 0x7f47301598a0 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f472f7fe700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 0x7f47300c7f80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f472800d860 tx=0x7f4728008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.802+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47280125f0 con 0x7f47301598a0 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.803+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4728012790 con 0x7f47301598a0 2023-10-06T11:14:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.803+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728012b50 con 0x7f47301598a0 2023-10-06T11:14:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.803+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300c8a20 con 0x7f47301598a0 2023-10-06T11:14:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.803+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47300c8fe0 con 0x7f47301598a0 2023-10-06T11:14:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.804+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473016a150 con 0x7f47301598a0 2023-10-06T11:14:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.804+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4728013480 con 0x7f47301598a0 2023-10-06T11:14:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.804+0000 7f4726ffd700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.804+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4728084ad0 con 0x7f47301598a0 2023-10-06T11:14:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.805+0000 7f472effd700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.805+0000 7f472effd700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4710066f30 0x7f47100693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4720009880 tx=0x7f4720018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:30.809+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4728051aa0 con 0x7f47301598a0 2023-10-06T11:14:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.002+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4730064a90 con 0x7f47301598a0 2023-10-06T11:14:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.003+0000 7f4726ffd700 1 -- 172.21.15.55:0/3686010977 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4728084070 con 0x7f47301598a0 2023-10-06T11:14:31.005 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4710066f30 msgr2=0x7f47100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4710066f30 0x7f47100693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4720009880 tx=0x7f4720018000 comp rx=0 tx=0).stop 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 msgr2=0x7f47300c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 0x7f47300c7f80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f472800d860 tx=0x7f4728008040 comp rx=0 tx=0).stop 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 shutdown_connections 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4710066f30 0x7f47100693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47301598a0 0x7f47300c7f80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47300ce7e0 0x7f473014d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 --2- 172.21.15.55:0/3686010977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47301594d0 0x7f47300ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 >> 172.21.15.55:0/3686010977 conn(0x7f4730089e50 msgr2=0x7f473015bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:31.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 shutdown_connections 2023-10-06T11:14:31.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.005+0000 7f47354fb700 1 -- 172.21.15.55:0/3686010977 wait complete. 2023-10-06T11:14:31.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:14:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.139+0000 7f3a9292c700 1 Processor -- start 2023-10-06T11:14:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.139+0000 7f3a9292c700 1 -- start start 2023-10-06T11:14:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a9292c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a8c159840 0x7f3a8c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a9292c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a8c0cf090 0x7f3a8c0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a9292c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c0cbb80 con 0x7f3a8c159470 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a9292c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0c6f00 con 0x7f3a8c159840 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a9292c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0cb530 con 0x7f3a8c0cf090 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a8b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a8c159840 0x7f3a8c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a8b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a8c159840 0x7f3a8c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51834/0 (socket says 172.21.15.55:51834) 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a8b7fe700 1 -- 172.21.15.55:0/3528157100 learned_addr learned my addr 172.21.15.55:0/3528157100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a90ec9700 1 --2- 172.21.15.55:0/3528157100 >> v2:172.21.15.142:3300/0 conn(0x7f3a8c0cf090 0x7f3a8c0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a8b7fe700 1 -- 172.21.15.55:0/3528157100 >> v2:172.21.15.142:3300/0 conn(0x7f3a8c0cf090 msgr2=0x7f3a8c0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a8b7fe700 1 --2- 172.21.15.55:0/3528157100 >> v2:172.21.15.142:3300/0 conn(0x7f3a8c0cf090 0x7f3a8c0c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.140+0000 7f3a8b7fe700 1 -- 172.21.15.55:0/3528157100 >> v1:172.21.15.142:6789/0 conn(0x7f3a8c159470 legacy=0x7f3a8c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a8b7fe700 1 -- 172.21.15.55:0/3528157100 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0cb810 con 0x7f3a8c159840 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a8b7fe700 1 --2- 172.21.15.55:0/3528157100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c159840 0x7f3a8c0c6170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c15d0c0 tx=0x7f3a74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5439f3fa009ad142 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a8affd700 1 -- 172.21.15.55:0/3528157100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400b820 con 0x7f3a8c159840 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a8affd700 1 -- 172.21.15.55:0/3528157100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400b980 con 0x7f3a8c159840 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a8affd700 1 -- 172.21.15.55:0/3528157100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400bd20 con 0x7f3a8c159840 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 -- 172.21.15.55:0/3528157100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c159840 msgr2=0x7f3a8c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 --2- 172.21.15.55:0/3528157100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c159840 0x7f3a8c0c6170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c15d0c0 tx=0x7f3a74009250 comp rx=0 tx=0).stop 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 -- 172.21.15.55:0/3528157100 shutdown_connections 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 --2- 172.21.15.55:0/3528157100 >> v2:172.21.15.142:3300/0 conn(0x7f3a8c0cf090 0x7f3a8c0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 --2- 172.21.15.55:0/3528157100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c159840 0x7f3a8c0c6170 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 -- 172.21.15.55:0/3528157100 >> 172.21.15.55:0/3528157100 conn(0x7f3a8c0996e0 msgr2=0x7f3a8c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 -- 172.21.15.55:0/3528157100 shutdown_connections 2023-10-06T11:14:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.141+0000 7f3a9292c700 1 -- 172.21.15.55:0/3528157100 wait complete. 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.142+0000 7f3a9292c700 1 Processor -- start 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 -- start start 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 0x7f3a8c15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a8c159470 0x7f3a8c169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a8c159840 0x7f3a8c16a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c1457d0 con 0x7f3a8c0cf090 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c15a400 con 0x7f3a8c159840 2023-10-06T11:14:31.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a9292c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0c9210 con 0x7f3a8c159470 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.143+0000 7f3a8bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 0x7f3a8c15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 0x7f3a8c15c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51838/0 (socket says 172.21.15.55:51838) 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 -- 172.21.15.55:0/1694329005 learned_addr learned my addr 172.21.15.55:0/1694329005 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a90ec9700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a8c159840 0x7f3a8c16a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8b7fe700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a8c159470 0x7f3a8c169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 -- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a8c159470 msgr2=0x7f3a8c169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a8c159470 0x7f3a8c169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 -- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a8c159840 msgr2=0x7f3a8c16a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a8c159840 0x7f3a8c16a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 -- 172.21.15.55:0/1694329005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740094f0 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a8bfff700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 0x7f3a8c15c8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b7e0 tx=0x7f3a7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00f510 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00f690 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00fa50 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c0c94f0 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.144+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c0c8ee0 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.145+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c064a90 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.146+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a7c01a400 con 0x7f3a8c0cf090 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.146+0000 7f3a83fff700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3a6c066f30 0x7f3a6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.146+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3a7c0840b0 con 0x7f3a8c0cf090 2023-10-06T11:14:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.147+0000 7f3a8b7fe700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3a6c066f30 0x7f3a6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.147+0000 7f3a8b7fe700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3a6c066f30 0x7f3a6c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c15d0c0 tx=0x7f3a74016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.151+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a7c051100 con 0x7f3a8c0cf090 2023-10-06T11:14:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.346+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a8c0c6bf0 con 0x7f3a8c0cf090 2023-10-06T11:14:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.346+0000 7f3a83fff700 1 -- 172.21.15.55:0/1694329005 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a7c054720 con 0x7f3a8c0cf090 2023-10-06T11:14:31.348 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.348+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3a6c066f30 msgr2=0x7f3a6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.348+0000 7f3a9292c700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3a6c066f30 0x7f3a6c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c15d0c0 tx=0x7f3a74016000 comp rx=0 tx=0).stop 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.348+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 msgr2=0x7f3a8c15c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.348+0000 7f3a9292c700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 0x7f3a8c15c8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b7e0 tx=0x7f3a7c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.348+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 shutdown_connections 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.348+0000 7f3a9292c700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3a6c066f30 0x7f3a6c0693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.349+0000 7f3a9292c700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a8c0cf090 0x7f3a8c15c8a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.349+0000 7f3a9292c700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a8c159840 0x7f3a8c16a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.349+0000 7f3a9292c700 1 --2- 172.21.15.55:0/1694329005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a8c159470 0x7f3a8c169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.349+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 >> 172.21.15.55:0/1694329005 conn(0x7f3a8c0996e0 msgr2=0x7f3a8c0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.349+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 shutdown_connections 2023-10-06T11:14:31.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.349+0000 7f3a9292c700 1 -- 172.21.15.55:0/1694329005 wait complete. 2023-10-06T11:14:31.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:14:31.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.482+0000 7f542f279700 1 Processor -- start 2023-10-06T11:14:31.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.482+0000 7f542f279700 1 -- start start 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542f279700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5428159470 0x7f54280ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542f279700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5428159840 0x7f54280ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542f279700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280cbb80 con 0x7f54280c6170 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542f279700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280c6ce0 con 0x7f5428159470 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542f279700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280c6f00 con 0x7f5428159840 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d015700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5428159470 0x7f54280ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d816700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f54280c6170 0x7f54280c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41300/0 (socket says 172.21.15.55:41300) 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d816700 1 -- 172.21.15.55:0/1147103193 learned_addr learned my addr 172.21.15.55:0/1147103193 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d015700 1 -- 172.21.15.55:0/1147103193 >> v2:172.21.15.142:3300/0 conn(0x7f5428159840 msgr2=0x7f54280ceec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d015700 1 --2- 172.21.15.55:0/1147103193 >> v2:172.21.15.142:3300/0 conn(0x7f5428159840 0x7f54280ceec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d015700 1 -- 172.21.15.55:0/1147103193 >> v1:172.21.15.55:6789/0 conn(0x7f54280c6170 legacy=0x7f54280c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d015700 1 -- 172.21.15.55:0/1147103193 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280cb530 con 0x7f5428159470 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f541ffff700 1 -- 172.21.15.55:0/1147103193 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702823097 0 0) 0x7f54280cbb80 con 0x7f54280c6170 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.483+0000 7f542d015700 1 --2- 172.21.15.55:0/1147103193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159470 0x7f54280ce980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5428089680 tx=0x7f5424009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b1cd1a835a800c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f541ffff700 1 -- 172.21.15.55:0/1147103193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424005c10 con 0x7f5428159470 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f541ffff700 1 -- 172.21.15.55:0/1147103193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424005d70 con 0x7f5428159470 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f541ffff700 1 -- 172.21.15.55:0/1147103193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424006260 con 0x7f5428159470 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 -- 172.21.15.55:0/1147103193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159470 msgr2=0x7f54280ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 --2- 172.21.15.55:0/1147103193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159470 0x7f54280ce980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5428089680 tx=0x7f5424009120 comp rx=0 tx=0).stop 2023-10-06T11:14:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 -- 172.21.15.55:0/1147103193 shutdown_connections 2023-10-06T11:14:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 --2- 172.21.15.55:0/1147103193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159470 0x7f54280ce980 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 --2- 172.21.15.55:0/1147103193 >> v2:172.21.15.142:3300/0 conn(0x7f5428159840 0x7f54280ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 -- 172.21.15.55:0/1147103193 >> 172.21.15.55:0/1147103193 conn(0x7f54280996e0 msgr2=0x7f542806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 -- 172.21.15.55:0/1147103193 shutdown_connections 2023-10-06T11:14:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.484+0000 7f542f279700 1 -- 172.21.15.55:0/1147103193 wait complete. 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.485+0000 7f542f279700 1 Processor -- start 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.485+0000 7f542f279700 1 -- start start 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542f279700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54280c6170 0x7f542814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542f279700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5428159470 0x7f542814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542f279700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 0x7f54280b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542f279700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542814e9a0 con 0x7f5428159840 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542f279700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542816d130 con 0x7f54280c6170 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542f279700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542814e6c0 con 0x7f5428159470 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542d816700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 0x7f54280b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542d816700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 0x7f54280b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51856/0 (socket says 172.21.15.55:51856) 2023-10-06T11:14:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.486+0000 7f542d816700 1 -- 172.21.15.55:0/2012768748 learned_addr learned my addr 172.21.15.55:0/2012768748 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542c814700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5428159470 0x7f542814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542d816700 1 -- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5428159470 msgr2=0x7f542814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542d816700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5428159470 0x7f542814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542d816700 1 -- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54280c6170 msgr2=0x7f542814d960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542d816700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54280c6170 0x7f542814d960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542d816700 1 -- 172.21.15.55:0/2012768748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240093c0 con 0x7f5428159840 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542d816700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 0x7f54280b4270 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f542000cc90 tx=0x7f5420001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542000cea0 con 0x7f5428159840 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542000ab70 con 0x7f5428159840 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280b3790 con 0x7f5428159840 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200070f0 con 0x7f5428159840 2023-10-06T11:14:31.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.487+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54280b3d50 con 0x7f5428159840 2023-10-06T11:14:31.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.488+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428064a90 con 0x7f5428159840 2023-10-06T11:14:31.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.488+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54200074a0 con 0x7f5428159840 2023-10-06T11:14:31.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.489+0000 7f541d7fa700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f540c066f30 0x7f540c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.489+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5420084d20 con 0x7f5428159840 2023-10-06T11:14:31.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.489+0000 7f542d015700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f540c066f30 0x7f540c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.490+0000 7f542d015700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f540c066f30 0x7f540c0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54280caa40 tx=0x7f5424016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.493+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5420051cd0 con 0x7f5428159840 2023-10-06T11:14:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.687+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54280cb810 con 0x7f5428159840 2023-10-06T11:14:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.688+0000 7f541d7fa700 1 -- 172.21.15.55:0/2012768748 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54200552f0 con 0x7f5428159840 2023-10-06T11:14:31.689 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:14:31.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.689+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f540c066f30 msgr2=0x7f540c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.689+0000 7f542f279700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f540c066f30 0x7f540c0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54280caa40 tx=0x7f5424016000 comp rx=0 tx=0).stop 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 msgr2=0x7f54280b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 0x7f54280b4270 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f542000cc90 tx=0x7f5420001a80 comp rx=0 tx=0).stop 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 shutdown_connections 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f540c066f30 0x7f540c0693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5428159840 0x7f54280b4270 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54280c6170 0x7f542814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 --2- 172.21.15.55:0/2012768748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5428159470 0x7f542814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 >> 172.21.15.55:0/2012768748 conn(0x7f54280996e0 msgr2=0x7f542815bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 shutdown_connections 2023-10-06T11:14:31.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.690+0000 7f542f279700 1 -- 172.21.15.55:0/2012768748 wait complete. 2023-10-06T11:14:31.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:31.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.820+0000 7f5de44ac700 1 Processor -- start 2023-10-06T11:14:31.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.820+0000 7f5de44ac700 1 -- start start 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de44ac700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ddc0b49a0 0x7f5ddc0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de44ac700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc0b0c60 con 0x7f5ddc159560 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de44ac700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc0b0f40 con 0x7f5ddc0b0760 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de44ac700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0b1220 con 0x7f5ddc0b49a0 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de2248700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ddc159560 0x7f5ddc0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41308/0 (socket says 172.21.15.55:41308) 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de2248700 1 -- 172.21.15.55:0/1867650798 learned_addr learned my addr 172.21.15.55:0/1867650798 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.821+0000 7f5de1a47700 1 --2- 172.21.15.55:0/1867650798 >> v2:172.21.15.142:3300/0 conn(0x7f5ddc0b49a0 0x7f5ddc0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1246700 1 -- 172.21.15.55:0/1867650798 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360908907 0 0) 0x7f5ddc0b0c60 con 0x7f5ddc159560 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1246700 1 -- 172.21.15.55:0/1867650798 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc4003570 con 0x7f5ddc159560 2023-10-06T11:14:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1a47700 1 -- 172.21.15.55:0/1867650798 >> v1:172.21.15.142:6789/0 conn(0x7f5ddc0b0760 legacy=0x7f5ddc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1246700 1 -- 172.21.15.55:0/1867650798 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206228950 0 0) 0x7f5dc4003570 con 0x7f5ddc159560 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1a47700 1 -- 172.21.15.55:0/1867650798 >> v1:172.21.15.55:6789/0 conn(0x7f5ddc159560 legacy=0x7f5ddc0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1a47700 1 -- 172.21.15.55:0/1867650798 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0b1500 con 0x7f5ddc0b49a0 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1a47700 1 --2- 172.21.15.55:0/1867650798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc0aac40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009910 tx=0x7f5dd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155520923a46b962 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1246700 1 -- 172.21.15.55:0/1867650798 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40015f0 con 0x7f5ddc0b49a0 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1246700 1 -- 172.21.15.55:0/1867650798 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd0011420 con 0x7f5ddc0b49a0 2023-10-06T11:14:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.822+0000 7f5de1246700 1 -- 172.21.15.55:0/1867650798 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00117c0 con 0x7f5ddc0b49a0 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 -- 172.21.15.55:0/1867650798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 msgr2=0x7f5ddc0aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 --2- 172.21.15.55:0/1867650798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc0aac40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009910 tx=0x7f5dd00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 -- 172.21.15.55:0/1867650798 shutdown_connections 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 --2- 172.21.15.55:0/1867650798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc0aac40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 -- 172.21.15.55:0/1867650798 >> 172.21.15.55:0/1867650798 conn(0x7f5ddc0997f0 msgr2=0x7f5ddc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 -- 172.21.15.55:0/1867650798 shutdown_connections 2023-10-06T11:14:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.823+0000 7f5de44ac700 1 -- 172.21.15.55:0/1867650798 wait complete. 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.824+0000 7f5de44ac700 1 Processor -- start 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.824+0000 7f5de44ac700 1 -- start start 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ddc0b0760 0x7f5ddc09a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 0x7f5ddc09aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0aedb0 con 0x7f5ddc159560 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0ae4f0 con 0x7f5ddc0b49a0 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0aadc0 con 0x7f5ddc0b0760 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 0x7f5ddc09aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 0x7f5ddc09aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51866/0 (socket says 172.21.15.55:51866) 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 -- 172.21.15.55:0/842085055 learned_addr learned my addr 172.21.15.55:0/842085055 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2248700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ddc0b0760 0x7f5ddc09a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de1a47700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 -- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ddc0b0760 msgr2=0x7f5ddc09a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ddc0b0760 0x7f5ddc09a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 -- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 msgr2=0x7f5ddc157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 -- 172.21.15.55:0/842085055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009420 con 0x7f5ddc159560 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de2a49700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 0x7f5ddc09aa20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c910 tx=0x7f5dcc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00a7a0 con 0x7f5ddc159560 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00a900 con 0x7f5ddc159560 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc0ae760 con 0x7f5ddc159560 2023-10-06T11:14:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00acc0 con 0x7f5ddc159560 2023-10-06T11:14:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.825+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc0ad770 con 0x7f5ddc159560 2023-10-06T11:14:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.826+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc0aef60 con 0x7f5ddc159560 2023-10-06T11:14:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.827+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dcc012630 con 0x7f5ddc159560 2023-10-06T11:14:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.827+0000 7f5dda7fc700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5dc8066f30 0x7f5dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.827+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5dcc084b40 con 0x7f5ddc159560 2023-10-06T11:14:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.827+0000 7f5de2248700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5dc8066f30 0x7f5dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.828+0000 7f5de2248700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5dc8066f30 0x7f5dc80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4000c00 tx=0x7f5dd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:31.832+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ddc0aef60 con 0x7f5ddc159560 2023-10-06T11:14:32.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.067+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ddc0aef60 con 0x7f5ddc159560 2023-10-06T11:14:32.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.067+0000 7f5dda7fc700 1 -- 172.21.15.55:0/842085055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f5ddc0aef60 con 0x7f5ddc159560 2023-10-06T11:14:32.069 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:32.069 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.069+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5dc8066f30 msgr2=0x7f5dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.069+0000 7f5de44ac700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5dc8066f30 0x7f5dc80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4000c00 tx=0x7f5dd4009040 comp rx=0 tx=0).stop 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.069+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 msgr2=0x7f5ddc09aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.069+0000 7f5de44ac700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 0x7f5ddc09aa20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c910 tx=0x7f5dcc001710 comp rx=0 tx=0).stop 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 shutdown_connections 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5dc8066f30 0x7f5dc80693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ddc159560 0x7f5ddc09aa20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ddc0b0760 0x7f5ddc09a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 --2- 172.21.15.55:0/842085055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc0b49a0 0x7f5ddc157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 >> 172.21.15.55:0/842085055 conn(0x7f5ddc0997f0 msgr2=0x7f5ddc0cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 shutdown_connections 2023-10-06T11:14:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.070+0000 7f5de44ac700 1 -- 172.21.15.55:0/842085055 wait complete. 2023-10-06T11:14:32.073 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:32.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:32.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 Processor -- start 2023-10-06T11:14:32.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 -- start start 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad210 0x7f9e180cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e180ad5e0 0x7f9e1815d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e1815d940 0x7f9e180686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1815ddc0 con 0x7f9e180ad5e0 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e180cecf0 con 0x7f9e1815d940 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.201+0000 7f9e1fa0b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180cefd0 con 0x7f9e180ad210 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e180ad5e0 0x7f9e1815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e180ad5e0 0x7f9e1815d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51878/0 (socket says 172.21.15.55:51878) 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 -- 172.21.15.55:0/2640476730 learned_addr learned my addr 172.21.15.55:0/2640476730 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1d7a7700 1 --2- 172.21.15.55:0/2640476730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad210 0x7f9e180cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1dfa8700 1 --2- 172.21.15.55:0/2640476730 >> v2:172.21.15.142:3300/0 conn(0x7f9e1815d940 0x7f9e180686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 -- 172.21.15.55:0/2640476730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad210 msgr2=0x7f9e180cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 --2- 172.21.15.55:0/2640476730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad210 0x7f9e180cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 -- 172.21.15.55:0/2640476730 >> v2:172.21.15.142:3300/0 conn(0x7f9e1815d940 msgr2=0x7f9e180686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 --2- 172.21.15.55:0/2640476730 >> v2:172.21.15.142:3300/0 conn(0x7f9e1815d940 0x7f9e180686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 -- 172.21.15.55:0/2640476730 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180cca90 con 0x7f9e180ad5e0 2023-10-06T11:14:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e1cfa6700 1 --2- 172.21.15.55:0/2640476730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad5e0 0x7f9e1815d400 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e180cbd50 tx=0x7f9e0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c62a2d88e02fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e17fff700 1 -- 172.21.15.55:0/2640476730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00b860 con 0x7f9e180ad5e0 2023-10-06T11:14:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e17fff700 1 -- 172.21.15.55:0/2640476730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c00b9c0 con 0x7f9e180ad5e0 2023-10-06T11:14:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.202+0000 7f9e17fff700 1 -- 172.21.15.55:0/2640476730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00bd60 con 0x7f9e180ad5e0 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2640476730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad5e0 msgr2=0x7f9e1815d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2640476730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad5e0 0x7f9e1815d400 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e180cbd50 tx=0x7f9e0c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2640476730 shutdown_connections 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2640476730 >> v2:172.21.15.142:3300/0 conn(0x7f9e1815d940 0x7f9e180686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2640476730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad210 0x7f9e180cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2640476730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad5e0 0x7f9e1815d400 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2640476730 >> 172.21.15.55:0/2640476730 conn(0x7f9e18067d90 msgr2=0x7f9e180ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2640476730 shutdown_connections 2023-10-06T11:14:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.203+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2640476730 wait complete. 2023-10-06T11:14:32.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.204+0000 7f9e1fa0b700 1 Processor -- start 2023-10-06T11:14:32.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.204+0000 7f9e1fa0b700 1 -- start start 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1fa0b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 0x7f9e180c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1fa0b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad5e0 0x7f9e180c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1fa0b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1815d940 0x7f9e180c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1fa0b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180b16d0 con 0x7f9e180ad210 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1fa0b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1816a2b0 con 0x7f9e1815d940 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1fa0b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180c74b0 con 0x7f9e180ad5e0 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 0x7f9e180c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 0x7f9e180c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51894/0 (socket says 172.21.15.55:51894) 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 -- 172.21.15.55:0/2780812090 learned_addr learned my addr 172.21.15.55:0/2780812090 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1cfa6700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad5e0 0x7f9e180c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1dfa8700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1815d940 0x7f9e180c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 -- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad5e0 msgr2=0x7f9e180c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad5e0 0x7f9e180c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 -- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1815d940 msgr2=0x7f9e180c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1815d940 0x7f9e180c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.205+0000 7f9e1d7a7700 1 -- 172.21.15.55:0/2780812090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0094f0 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.206+0000 7f9e1d7a7700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 0x7f9e180c6c30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800e1c0 tx=0x7f9e08009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.206+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0800ed00 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.206+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0800ee80 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.206+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08014670 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.206+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e180c7790 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.206+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e180b1360 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.207+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e18064a90 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.207+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e080149e0 con 0x7f9e180ad210 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.208+0000 7f9e157fa700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e04066f30 0x7f9e040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.208+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9e08084f80 con 0x7f9e180ad210 2023-10-06T11:14:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.208+0000 7f9e1cfa6700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e04066f30 0x7f9e040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.208+0000 7f9e1cfa6700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e04066f30 0x7f9e040693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9e180cbd50 tx=0x7f9e0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.212+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e08051eb0 con 0x7f9e180ad210 2023-10-06T11:14:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.406+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e180ccd70 con 0x7f9e180ad210 2023-10-06T11:14:32.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.407+0000 7f9e157fa700 1 -- 172.21.15.55:0/2780812090 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f9e080554d0 con 0x7f9e180ad210 2023-10-06T11:14:32.409 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:32.409 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:19.948485+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.621851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.333304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e04066f30 msgr2=0x7f9e040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e04066f30 0x7f9e040693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9e180cbd50 tx=0x7f9e0c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 msgr2=0x7f9e180c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 0x7f9e180c6c30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800e1c0 tx=0x7f9e08009950 comp rx=0 tx=0).stop 2023-10-06T11:14:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 shutdown_connections 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e04066f30 0x7f9e040693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e180ad210 0x7f9e180c6c30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1815d940 0x7f9e180c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 --2- 172.21.15.55:0/2780812090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e180ad5e0 0x7f9e180c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 >> 172.21.15.55:0/2780812090 conn(0x7f9e18067d90 msgr2=0x7f9e180c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 shutdown_connections 2023-10-06T11:14:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.409+0000 7f9e1fa0b700 1 -- 172.21.15.55:0/2780812090 wait complete. 2023-10-06T11:14:32.424 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:14:32.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.541+0000 7fdedf309700 1 Processor -- start 2023-10-06T11:14:32.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.541+0000 7fdedf309700 1 -- start start 2023-10-06T11:14:32.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedf309700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fded8159560 0x7fded80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedf309700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fded80b49a0 0x7fded80aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedf309700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded80b0c60 con 0x7fded80b0760 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedf309700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded80b0f40 con 0x7fded8159560 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedf309700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded80b1220 con 0x7fded80b49a0 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedd0a5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fded8159560 0x7fded80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedd8a6700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fded80b0760 0x7fded80b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41322/0 (socket says 172.21.15.55:41322) 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.542+0000 7fdedd8a6700 1 -- 172.21.15.55:0/504280276 learned_addr learned my addr 172.21.15.55:0/504280276 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedc8a4700 1 --2- 172.21.15.55:0/504280276 >> v2:172.21.15.142:3300/0 conn(0x7fded80b49a0 0x7fded80aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedd0a5700 1 -- 172.21.15.55:0/504280276 >> v2:172.21.15.142:3300/0 conn(0x7fded80b49a0 msgr2=0x7fded80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedd0a5700 1 --2- 172.21.15.55:0/504280276 >> v2:172.21.15.142:3300/0 conn(0x7fded80b49a0 0x7fded80aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedd0a5700 1 -- 172.21.15.55:0/504280276 >> v1:172.21.15.55:6789/0 conn(0x7fded80b0760 legacy=0x7fded80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedd0a5700 1 -- 172.21.15.55:0/504280276 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80b1500 con 0x7fded8159560 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fded7fff700 1 -- 172.21.15.55:0/504280276 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136827753 0 0) 0x7fded80b0c60 con 0x7fded80b0760 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedc8a4700 1 --2- 172.21.15.55:0/504280276 >> v2:172.21.15.142:3300/0 conn(0x7fded80b49a0 0x7fded80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedd0a5700 1 --2- 172.21.15.55:0/504280276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded80aa530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fded00098d0 tx=0x7fded0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce651aff660df08e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fded7fff700 1 -- 172.21.15.55:0/504280276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0009e70 con 0x7fded8159560 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fded7fff700 1 -- 172.21.15.55:0/504280276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0005c10 con 0x7fded8159560 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fded7fff700 1 -- 172.21.15.55:0/504280276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000b610 con 0x7fded8159560 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedf309700 1 -- 172.21.15.55:0/504280276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 msgr2=0x7fded80aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.543+0000 7fdedf309700 1 --2- 172.21.15.55:0/504280276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded80aa530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fded00098d0 tx=0x7fded0009120 comp rx=0 tx=0).stop 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.544+0000 7fdedf309700 1 -- 172.21.15.55:0/504280276 shutdown_connections 2023-10-06T11:14:32.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.544+0000 7fdedf309700 1 --2- 172.21.15.55:0/504280276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded80aa530 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.544+0000 7fdedf309700 1 --2- 172.21.15.55:0/504280276 >> v2:172.21.15.142:3300/0 conn(0x7fded80b49a0 0x7fded80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.544+0000 7fdedf309700 1 -- 172.21.15.55:0/504280276 >> 172.21.15.55:0/504280276 conn(0x7fded80997f0 msgr2=0x7fded806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:32.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.544+0000 7fdedf309700 1 -- 172.21.15.55:0/504280276 shutdown_connections 2023-10-06T11:14:32.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.544+0000 7fdedf309700 1 -- 172.21.15.55:0/504280276 wait complete. 2023-10-06T11:14:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.545+0000 7fdedf309700 1 Processor -- start 2023-10-06T11:14:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.545+0000 7fdedf309700 1 -- start start 2023-10-06T11:14:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedf309700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fded80b0760 0x7fded80af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedf309700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fded80b49a0 0x7fded81442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedf309700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedf309700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded81599b0 con 0x7fded8159560 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedf309700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded815a4f0 con 0x7fded80b0760 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedf309700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded8159bc0 con 0x7fded80b49a0 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded815c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51904/0 (socket says 172.21.15.55:51904) 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 -- 172.21.15.55:0/4010483828 learned_addr learned my addr 172.21.15.55:0/4010483828 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedc8a4700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fded80b49a0 0x7fded81442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 -- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fded80b49a0 msgr2=0x7fded81442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fded80b49a0 0x7fded81442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 -- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fded80b0760 msgr2=0x7fded80af280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fded80b0760 0x7fded80af280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 -- 172.21.15.55:0/4010483828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00093c0 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedc8a4700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fded80b49a0 0x7fded81442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fdedd8a6700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded815c050 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdec800cc90 tx=0x7fdec8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.546+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec800cea0 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.547+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec800ab70 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.547+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded8159ea0 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.547+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80070f0 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.547+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded80af7c0 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.548+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded8064a90 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.548+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdec80074a0 con 0x7fded8159560 2023-10-06T11:14:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.548+0000 7fded57fa700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdec4066f30 0x7fdec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.549+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdec8084c50 con 0x7fded8159560 2023-10-06T11:14:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.550+0000 7fdedd0a5700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdec4066f30 0x7fdec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.551+0000 7fdedd0a5700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdec4066f30 0x7fdec40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fded00098d0 tx=0x7fded0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.553+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdec808a020 con 0x7fded8159560 2023-10-06T11:14:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.791+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fded80b17e0 con 0x7fded8159560 2023-10-06T11:14:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.791+0000 7fded57fa700 1 -- 172.21.15.55:0/4010483828 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fdec8051ca0 con 0x7fded8159560 2023-10-06T11:14:32.793 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:32.793 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdec4066f30 msgr2=0x7fdec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdec4066f30 0x7fdec40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fded00098d0 tx=0x7fded0016000 comp rx=0 tx=0).stop 2023-10-06T11:14:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 msgr2=0x7fded815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded815c050 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdec800cc90 tx=0x7fdec8001a80 comp rx=0 tx=0).stop 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 shutdown_connections 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdec4066f30 0x7fdec40693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fded8159560 0x7fded815c050 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fded80b0760 0x7fded80af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 --2- 172.21.15.55:0/4010483828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fded80b49a0 0x7fded81442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.793+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 >> 172.21.15.55:0/4010483828 conn(0x7fded80997f0 msgr2=0x7fded80683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.794+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 shutdown_connections 2023-10-06T11:14:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.794+0000 7fdedf309700 1 -- 172.21.15.55:0/4010483828 wait complete. 2023-10-06T11:14:32.797 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:32.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.925+0000 7f5fbc276700 1 Processor -- start 2023-10-06T11:14:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.925+0000 7f5fbc276700 1 -- start start 2023-10-06T11:14:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.926+0000 7f5fbc276700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fb4067cc0 0x7f5fb406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.926+0000 7f5fbc276700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb406ecd0 con 0x7f5fb40caa90 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.926+0000 7f5fbc276700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb40cb870 con 0x7f5fb415cab0 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.926+0000 7f5fbc276700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40cbb50 con 0x7f5fb4067cc0 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.926+0000 7f5fb9811700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5fb40caa90 0x7f5fb40675b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41334/0 (socket says 172.21.15.55:41334) 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.926+0000 7f5fb9811700 1 -- 172.21.15.55:0/3727990342 learned_addr learned my addr 172.21.15.55:0/3727990342 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fba813700 1 --2- 172.21.15.55:0/3727990342 >> v2:172.21.15.142:3300/0 conn(0x7f5fb4067cc0 0x7f5fb406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296104168 0 0) 0x7f5fb406ecd0 con 0x7f5fb40caa90 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f9c003570 con 0x7f5fb40caa90 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115762864 0 0) 0x7f5f9c003570 con 0x7f5fb40caa90 2023-10-06T11:14:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 >> v2:172.21.15.142:3300/0 conn(0x7f5fb4067cc0 msgr2=0x7f5fb406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 --2- 172.21.15.55:0/3727990342 >> v2:172.21.15.142:3300/0 conn(0x7f5fb4067cc0 0x7f5fb406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 >> v1:172.21.15.142:6789/0 conn(0x7f5fb415cab0 legacy=0x7f5fb40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb406e680 con 0x7f5fb40caa90 2023-10-06T11:14:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f5fa8001470 con 0x7f5fb40caa90 2023-10-06T11:14:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 >> v1:172.21.15.55:6789/0 conn(0x7f5fb40caa90 legacy=0x7f5fb40675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5f9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c004810 0x7f5f9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0051c0 0x7f5f9c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40cbb50 con 0x7f5f9c003a60 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c00c160 con 0x7f5f9c004810 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c00c320 con 0x7f5f9c0051c0 2023-10-06T11:14:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fba012700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5f9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fb9811700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c004810 0x7f5f9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fba813700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0051c0 0x7f5f9c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fba012700 1 -- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0051c0 msgr2=0x7f5f9c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.927+0000 7f5fba012700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0051c0 0x7f5f9c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fba012700 1 -- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c004810 msgr2=0x7f5f9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fba012700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c004810 0x7f5f9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fba813700 1 -- 172.21.15.55:0/3727990342 reap_dead start 2023-10-06T11:14:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fba012700 1 -- 172.21.15.55:0/3727990342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c003570 con 0x7f5f9c003a60 2023-10-06T11:14:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fba012700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5f9c003e70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0018b0 tx=0x7f5fac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e09468c0dca44f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac012420 con 0x7f5f9c003a60 2023-10-06T11:14:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac012580 con 0x7f5f9c003a60 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fb9010700 1 -- 172.21.15.55:0/3727990342 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac012920 con 0x7f5f9c003a60 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 -- 172.21.15.55:0/3727990342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 msgr2=0x7f5f9c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5f9c003e70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0018b0 tx=0x7f5fac007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 -- 172.21.15.55:0/3727990342 shutdown_connections 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3727990342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5f9c003e70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 -- 172.21.15.55:0/3727990342 >> 172.21.15.55:0/3727990342 conn(0x7f5fb40cdeb0 msgr2=0x7f5fb40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 -- 172.21.15.55:0/3727990342 shutdown_connections 2023-10-06T11:14:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.928+0000 7f5fbc276700 1 -- 172.21.15.55:0/3727990342 wait complete. 2023-10-06T11:14:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 Processor -- start 2023-10-06T11:14:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 -- start start 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5fb415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb415a980 0x7f5fb40b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fb4158cc0 0x7f5fb40b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb415bf50 con 0x7f5f9c003a60 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb415aeb0 con 0x7f5fb415a980 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fbc276700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb415b190 con 0x7f5fb4158cc0 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fba012700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5fb415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fba012700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5fb415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51922/0 (socket says 172.21.15.55:51922) 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.930+0000 7f5fba012700 1 -- 172.21.15.55:0/3043407294 learned_addr learned my addr 172.21.15.55:0/3043407294 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba813700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fb4158cc0 0x7f5fb40b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fb9811700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb415a980 0x7f5fb40b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba012700 1 -- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fb4158cc0 msgr2=0x7f5fb40b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba012700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fb4158cc0 0x7f5fb40b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba012700 1 -- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb415a980 msgr2=0x7f5fb40b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba012700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb415a980 0x7f5fb40b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba012700 1 -- 172.21.15.55:0/3043407294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb415b470 con 0x7f5f9c003a60 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fba012700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5fb415a440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c3f0 tx=0x7f5fac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac001200 con 0x7f5f9c003a60 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac012c90 con 0x7f5f9c003a60 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb415b750 con 0x7f5f9c003a60 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac012920 con 0x7f5f9c003a60 2023-10-06T11:14:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.931+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb40b2a40 con 0x7f5f9c003a60 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.932+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb415bbf0 con 0x7f5f9c003a60 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.932+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fac01f620 con 0x7f5f9c003a60 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.933+0000 7f5fb27fc700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.933+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5fac086210 con 0x7f5f9c003a60 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.933+0000 7f5fb9811700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.933+0000 7f5fb9811700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5fa0066f30 0x7f5fa00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8000e10 tx=0x7f5fa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:32.937+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fac0531e0 con 0x7f5f9c003a60 2023-10-06T11:14:33.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.180+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fb4064a90 con 0x7f5f9c003a60 2023-10-06T11:14:33.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.181+0000 7f5fb27fc700 1 -- 172.21.15.55:0/3043407294 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f5fac056800 con 0x7f5f9c003a60 2023-10-06T11:14:33.183 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:33.183 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.359436+0000","modified":"2023-10-06T11:14:21.977777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5106},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5106":{"gid":5106,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.55:6835/1585118360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1585118360},{"type":"v1","addr":"172.21.15.55:6835","nonce":1585118360}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:14:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5fa0066f30 msgr2=0x7f5fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5fa0066f30 0x7f5fa00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8000e10 tx=0x7f5fa8009040 comp rx=0 tx=0).stop 2023-10-06T11:14:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 msgr2=0x7f5fb415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5fb415a440 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c3f0 tx=0x7f5fac015000 comp rx=0 tx=0).stop 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 shutdown_connections 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f9c003a60 0x7f5fb415a440 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fb4158cc0 0x7f5fb40b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 --2- 172.21.15.55:0/3043407294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb415a980 0x7f5fb40b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 >> 172.21.15.55:0/3043407294 conn(0x7f5fb40cdeb0 msgr2=0x7f5fb406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 shutdown_connections 2023-10-06T11:14:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.183+0000 7f5fbc276700 1 -- 172.21.15.55:0/3043407294 wait complete. 2023-10-06T11:14:33.187 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2023-10-06T11:14:33.197 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.314+0000 7f16d2afc700 1 Processor -- start 2023-10-06T11:14:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.314+0000 7f16d2afc700 1 -- start start 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.315+0000 7f16d2afc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 0x7f16cc0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.315+0000 7f16d2afc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16cc0c8f20 0x7f16cc0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.315+0000 7f16d2afc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0cdb40 con 0x7f16cc15ac40 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.315+0000 7f16d2afc700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc0ccf30 con 0x7f16cc0c8f20 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.315+0000 7f16d2afc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0cd210 con 0x7f16cc15a870 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.315+0000 7f16d0898700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 0x7f16cc0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d1099700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16cc0c8f20 0x7f16cc0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 0x7f16cc0ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:43446/0 (socket says 172.21.15.55:43446) 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 -- 172.21.15.55:0/1041429574 learned_addr learned my addr 172.21.15.55:0/1041429574 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 -- 172.21.15.55:0/1041429574 >> v2:172.21.15.142:3300/0 conn(0x7f16cc0c8f20 msgr2=0x7f16cc0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 --2- 172.21.15.55:0/1041429574 >> v2:172.21.15.142:3300/0 conn(0x7f16cc0c8f20 0x7f16cc0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 -- 172.21.15.55:0/1041429574 >> v1:172.21.15.142:6789/0 conn(0x7f16cc15ac40 legacy=0x7f16cc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 -- 172.21.15.55:0/1041429574 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0cd4f0 con 0x7f16cc15a870 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16d0898700 1 --2- 172.21.15.55:0/1041429574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 0x7f16cc0ce980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009f70 tx=0x7f16c4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90acbd27b6bc43dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16cb7fe700 1 -- 172.21.15.55:0/1041429574 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400e070 con 0x7f16cc15a870 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16cb7fe700 1 -- 172.21.15.55:0/1041429574 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400ba20 con 0x7f16cc15a870 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.316+0000 7f16cb7fe700 1 -- 172.21.15.55:0/1041429574 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40092e0 con 0x7f16cc15a870 2023-10-06T11:14:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 -- 172.21.15.55:0/1041429574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 msgr2=0x7f16cc0ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 --2- 172.21.15.55:0/1041429574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 0x7f16cc0ce980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009f70 tx=0x7f16c4009840 comp rx=0 tx=0).stop 2023-10-06T11:14:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 -- 172.21.15.55:0/1041429574 shutdown_connections 2023-10-06T11:14:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 --2- 172.21.15.55:0/1041429574 >> v2:172.21.15.142:3300/0 conn(0x7f16cc0c8f20 0x7f16cc0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 --2- 172.21.15.55:0/1041429574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15a870 0x7f16cc0ce980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 -- 172.21.15.55:0/1041429574 >> 172.21.15.55:0/1041429574 conn(0x7f16cc067d90 msgr2=0x7f16cc0ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 -- 172.21.15.55:0/1041429574 shutdown_connections 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.317+0000 7f16d2afc700 1 -- 172.21.15.55:0/1041429574 wait complete. 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.318+0000 7f16d2afc700 1 Processor -- start 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.318+0000 7f16d2afc700 1 -- start start 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d2afc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16cc0c8f20 0x7f16cc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d2afc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 0x7f16cc16b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d2afc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15ac40 0x7f16cc16ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d2afc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0c5ab0 con 0x7f16cc15a870 2023-10-06T11:14:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d2afc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc155a60 con 0x7f16cc0c8f20 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d2afc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc155d40 con 0x7f16cc15ac40 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 0x7f16cc16b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 0x7f16cc16b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51934/0 (socket says 172.21.15.55:51934) 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 -- 172.21.15.55:0/3160293557 learned_addr learned my addr 172.21.15.55:0/3160293557 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d1099700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15ac40 0x7f16cc16ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16d0898700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16cc0c8f20 0x7f16cc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 -- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15ac40 msgr2=0x7f16cc16ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15ac40 0x7f16cc16ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 -- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16cc0c8f20 msgr2=0x7f16cc154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16cc0c8f20 0x7f16cc154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.319+0000 7f16cbfff700 1 -- 172.21.15.55:0/3160293557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4009ae0 con 0x7f16cc15a870 2023-10-06T11:14:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.320+0000 7f16cbfff700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 0x7f16cc16b4c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c4e0 tx=0x7f16bc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.320+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011590 con 0x7f16cc15a870 2023-10-06T11:14:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.320+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc011710 con 0x7f16cc15a870 2023-10-06T11:14:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.320+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0c5d50 con 0x7f16cc15a870 2023-10-06T11:14:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.320+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011ad0 con 0x7f16cc15a870 2023-10-06T11:14:33.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.320+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc0adee0 con 0x7f16cc15a870 2023-10-06T11:14:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.321+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc0c5f40 con 0x7f16cc15a870 2023-10-06T11:14:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.321+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16bc01b3b0 con 0x7f16cc15a870 2023-10-06T11:14:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.321+0000 7f16c8ff9700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.322+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16bc083bd0 con 0x7f16cc15a870 2023-10-06T11:14:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.322+0000 7f16d0898700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.322+0000 7f16d0898700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009880 tx=0x7f16c4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:33.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.326+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16bc050ba0 con 0x7f16cc15a870 2023-10-06T11:14:33.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.519+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16cc064a90 con 0x7f16cc15a870 2023-10-06T11:14:33.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.520+0000 7f16c8ff9700 1 -- 172.21.15.55:0/3160293557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f16bc017070 con 0x7f16cc15a870 2023-10-06T11:14:33.522 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:33.523 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:19.948485+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.621851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.333304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:33.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f16ac066f30 msgr2=0x7f16ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009880 tx=0x7f16c4018000 comp rx=0 tx=0).stop 2023-10-06T11:14:33.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 msgr2=0x7f16cc16b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 0x7f16cc16b4c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00c4e0 tx=0x7f16bc00c7f0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 shutdown_connections 2023-10-06T11:14:33.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16cc15ac40 0x7f16cc16ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16cc0c8f20 0x7f16cc154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.522+0000 7f16d2afc700 1 --2- 172.21.15.55:0/3160293557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16cc15a870 0x7f16cc16b4c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.523+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 >> 172.21.15.55:0/3160293557 conn(0x7f16cc067d90 msgr2=0x7f16cc15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:33.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.523+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 shutdown_connections 2023-10-06T11:14:33.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.523+0000 7f16d2afc700 1 -- 172.21.15.55:0/3160293557 wait complete. 2023-10-06T11:14:33.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:14:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.655+0000 7f9e84a8a700 1 Processor -- start 2023-10-06T11:14:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.655+0000 7f9e84a8a700 1 -- start start 2023-10-06T11:14:33.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.655+0000 7f9e84a8a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 0x7f9e800cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.655+0000 7f9e84a8a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e800ad5e0 0x7f9e8015d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e84a8a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800cecf0 con 0x7f9e8015d940 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e84a8a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8015ddc0 con 0x7f9e800ad5e0 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e84a8a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800cefd0 con 0x7f9e800ad210 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7ed9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9e8015d940 0x7f9e800686c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41338/0 (socket says 172.21.15.55:41338) 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7ed9d700 1 -- 172.21.15.55:0/4043775519 learned_addr learned my addr 172.21.15.55:0/4043775519 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272244344 0 0) 0x7f9e800cecf0 con 0x7f9e8015d940 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 0x7f9e800cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e6c003570 con 0x7f9e8015d940 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7dd9b700 1 --2- 172.21.15.55:0/4043775519 >> v2:172.21.15.142:3300/0 conn(0x7f9e800ad5e0 0x7f9e8015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454373884 0 0) 0x7f9e6c003570 con 0x7f9e8015d940 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 msgr2=0x7f9e800cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 0x7f9e800cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 >> v2:172.21.15.142:3300/0 conn(0x7f9e800ad5e0 msgr2=0x7f9e8015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 --2- 172.21.15.55:0/4043775519 >> v2:172.21.15.142:3300/0 conn(0x7f9e800ad5e0 0x7f9e8015d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800cca90 con 0x7f9e8015d940 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f9e780017f0 con 0x7f9e8015d940 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 >> v1:172.21.15.55:6789/0 conn(0x7f9e8015d940 legacy=0x7f9e800686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c003a60 0x7f9e6c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c004810 0x7f9e6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 0x7f9e6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8015ddc0 con 0x7f9e6c003a60 2023-10-06T11:14:33.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800cefd0 con 0x7f9e6c004810 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c00ba60 con 0x7f9e800ad210 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.656+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c003a60 0x7f9e6c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7dd9b700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c004810 0x7f9e6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7ed9d700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 0x7f9e6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7e59c700 1 -- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 msgr2=0x7f9e6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ad210 0x7f9e6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7e59c700 1 -- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c004810 msgr2=0x7f9e6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c004810 0x7f9e6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7e59c700 1 -- 172.21.15.55:0/4043775519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c003570 con 0x7f9e6c003a60 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c003a60 0x7f9e6c003e70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009c20 tx=0x7f9e70009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5784504d0157fda0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:33.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70005a00 con 0x7f9e6c003a60 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70005b60 con 0x7f9e6c003a60 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7d59a700 1 -- 172.21.15.55:0/4043775519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000e710 con 0x7f9e6c003a60 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e84a8a700 1 -- 172.21.15.55:0/4043775519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c003a60 msgr2=0x7f9e6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/4043775519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c003a60 0x7f9e6c003e70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009c20 tx=0x7f9e70009120 comp rx=0 tx=0).stop 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.657+0000 7f9e7ed9d700 1 -- 172.21.15.55:0/4043775519 reap_dead start 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.658+0000 7f9e84a8a700 1 -- 172.21.15.55:0/4043775519 shutdown_connections 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.658+0000 7f9e84a8a700 1 -- 172.21.15.55:0/4043775519 >> 172.21.15.55:0/4043775519 conn(0x7f9e80067d90 msgr2=0x7f9e800ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.658+0000 7f9e84a8a700 1 -- 172.21.15.55:0/4043775519 shutdown_connections 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.658+0000 7f9e84a8a700 1 -- 172.21.15.55:0/4043775519 wait complete. 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 Processor -- start 2023-10-06T11:14:33.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 -- start start 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c003a60 0x7f9e8014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 0x7f9e800c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800cd290 0x7f9e800c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801699b0 con 0x7f9e800abe60 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.659+0000 7f9e84a8a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80169ba0 con 0x7f9e6c003a60 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e84a8a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8016ad70 con 0x7f9e800cd290 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 0x7f9e800c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 0x7f9e800c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51952/0 (socket says 172.21.15.55:51952) 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 -- 172.21.15.55:0/1827763807 learned_addr learned my addr 172.21.15.55:0/1827763807 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7ed9d700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800cd290 0x7f9e800c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c003a60 0x7f9e8014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 -- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800cd290 msgr2=0x7f9e800c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800cd290 0x7f9e800c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 -- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c003a60 msgr2=0x7f9e8014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c003a60 0x7f9e8014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 -- 172.21.15.55:0/1827763807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8016b050 con 0x7f9e800abe60 2023-10-06T11:14:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c003a60 0x7f9e8014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e7dd9b700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 0x7f9e800c5c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9e68011990 tx=0x7f9e68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800f6d0 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800f830 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8016b330 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800fbf0 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.660+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e800c7f80 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.661+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8016b6a0 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.662+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e68015460 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.662+0000 7f9e767fc700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e60066f30 0x7f9e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.662+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9e68084f50 con 0x7f9e800abe60 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.662+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e60066f30 0x7f9e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.664+0000 7f9e7e59c700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e60066f30 0x7f9e600693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009160 tx=0x7f9e70019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:33.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.667+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e68051f20 con 0x7f9e800abe60 2023-10-06T11:14:33.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.904+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9e8016abd0 con 0x7f9e800abe60 2023-10-06T11:14:33.906 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:14:33.904+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:14:33.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.909+0000 7f9e767fc700 1 -- 172.21.15.55:0/1827763807 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9e8016abd0 con 0x7f9e800abe60 2023-10-06T11:14:33.911 INFO:tasks.ceph.mds.c.smithi055.stderr: -780> 2023-10-06T11:14:21.281+0000 7fccebfc6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e60066f30 msgr2=0x7f9e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e60066f30 0x7f9e600693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009160 tx=0x7f9e70019000 comp rx=0 tx=0).stop 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 msgr2=0x7f9e800c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 0x7f9e800c5c40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9e68011990 tx=0x7f9e68008040 comp rx=0 tx=0).stop 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 shutdown_connections 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9e60066f30 0x7f9e600693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800cd290 0x7f9e800c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c003a60 0x7f9e8014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 --2- 172.21.15.55:0/1827763807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e800abe60 0x7f9e800c5c40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 >> 172.21.15.55:0/1827763807 conn(0x7f9e80067d90 msgr2=0x7f9e8006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 shutdown_connections 2023-10-06T11:14:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:33.911+0000 7f9e84a8a700 1 -- 172.21.15.55:0/1827763807 wait complete. 2023-10-06T11:14:33.914 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:14:33.926 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:14:33.933 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:14:34.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.047+0000 7f56d9e5a700 1 Processor -- start 2023-10-06T11:14:34.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.047+0000 7f56d9e5a700 1 -- start start 2023-10-06T11:14:34.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d9e5a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f56d40689f0 0x7f56d41646f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d9e5a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d40cdc60 con 0x7f56d41597f0 2023-10-06T11:14:34.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d9e5a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d40cd050 con 0x7f56d4159420 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d9e5a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40cd330 con 0x7f56d40689f0 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d2ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56d41597f0 0x7f56d40682e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41346/0 (socket says 172.21.15.55:41346) 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d2ffd700 1 -- 172.21.15.55:0/134940057 learned_addr learned my addr 172.21.15.55:0/134940057 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d3fff700 1 --2- 172.21.15.55:0/134940057 >> v2:172.21.15.142:3300/0 conn(0x7f56d40689f0 0x7f56d41646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619326309 0 0) 0x7f56d40cdc60 con 0x7f56d41597f0 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56bc003570 con 0x7f56d41597f0 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4109679317 0 0) 0x7f56bc003570 con 0x7f56d41597f0 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 >> v2:172.21.15.142:3300/0 conn(0x7f56d40689f0 msgr2=0x7f56d41646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 --2- 172.21.15.55:0/134940057 >> v2:172.21.15.142:3300/0 conn(0x7f56d40689f0 0x7f56d41646f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 >> v1:172.21.15.142:6789/0 conn(0x7f56d4159420 legacy=0x7f56d40cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40cd610 con 0x7f56d41597f0 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f56c8001470 con 0x7f56d41597f0 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 >> v1:172.21.15.55:6789/0 conn(0x7f56d41597f0 legacy=0x7f56d40682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56bc003a60 0x7f56bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc004810 0x7f56bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc0051c0 0x7f56bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40cd330 con 0x7f56bc004810 2023-10-06T11:14:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc00c0d0 con 0x7f56bc003a60 2023-10-06T11:14:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.048+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc00c290 con 0x7f56bc0051c0 2023-10-06T11:14:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc004810 0x7f56bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d37fe700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56bc003a60 0x7f56bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d3fff700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc0051c0 0x7f56bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 -- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc0051c0 msgr2=0x7f56bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc0051c0 0x7f56bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 -- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56bc003a60 msgr2=0x7f56bc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56bc003a60 0x7f56bc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 -- 172.21.15.55:0/134940057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc003570 con 0x7f56bc004810 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d3fff700 1 -- 172.21.15.55:0/134940057 reap_dead start 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc004810 0x7f56bc004c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c3c0 tx=0x7f56c8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7a34674226dd9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800cc90 con 0x7f56bc004810 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c800cdf0 con 0x7f56bc004810 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.049+0000 7f56d27fc700 1 -- 172.21.15.55:0/134940057 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8005b50 con 0x7f56bc004810 2023-10-06T11:14:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 -- 172.21.15.55:0/134940057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc004810 msgr2=0x7f56bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc004810 0x7f56bc004c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c3c0 tx=0x7f56c8001e50 comp rx=0 tx=0).stop 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 -- 172.21.15.55:0/134940057 shutdown_connections 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/134940057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc004810 0x7f56bc004c80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 -- 172.21.15.55:0/134940057 >> 172.21.15.55:0/134940057 conn(0x7f56d406ece0 msgr2=0x7f56d406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 -- 172.21.15.55:0/134940057 shutdown_connections 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.050+0000 7f56d9e5a700 1 -- 172.21.15.55:0/134940057 wait complete. 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.051+0000 7f56d9e5a700 1 Processor -- start 2023-10-06T11:14:34.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.051+0000 7f56d9e5a700 1 -- start start 2023-10-06T11:14:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d9e5a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc004810 0x7f56d415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d9e5a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 0x7f56d40c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d9e5a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d40c8a40 0x7f56d40b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d9e5a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d415aa10 con 0x7f56d415b3e0 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d9e5a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d415ea30 con 0x7f56d40c8a40 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d9e5a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4159e40 con 0x7f56bc004810 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 0x7f56d40c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 0x7f56d40c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51982/0 (socket says 172.21.15.55:51982) 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 -- 172.21.15.55:0/598266756 learned_addr learned my addr 172.21.15.55:0/598266756 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d37fe700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc004810 0x7f56d415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d3fff700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d40c8a40 0x7f56d40b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 -- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc004810 msgr2=0x7f56d415aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc004810 0x7f56d415aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 -- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d40c8a40 msgr2=0x7f56d40b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d40c8a40 0x7f56d40b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 -- 172.21.15.55:0/598266756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d415a0e0 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56d2ffd700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 0x7f56d40c8500 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c9b0 tx=0x7f56c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8022070 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.052+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80070d0 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.053+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800cc90 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.053+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d415a3c0 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.053+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d40b41c0 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.054+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d415a860 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.054+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56c8007700 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.054+0000 7f56bb7fe700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f56c0066f30 0x7f56c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.055+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f56c8085bf0 con 0x7f56d415b3e0 2023-10-06T11:14:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.055+0000 7f56d37fe700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f56c0066f30 0x7f56c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.055+0000 7f56d37fe700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f56c0066f30 0x7f56c00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f56d415b9b0 tx=0x7f56c4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.059+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56c8052c20 con 0x7f56d415b3e0 2023-10-06T11:14:34.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.295+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f56d415abc0 con 0x7f56d415b3e0 2023-10-06T11:14:34.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.910+0000 7f56bb7fe700 1 -- 172.21.15.55:0/598266756 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f56d415abc0 con 0x7f56d415b3e0 2023-10-06T11:14:34.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f56c0066f30 msgr2=0x7f56c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f56c0066f30 0x7f56c00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f56d415b9b0 tx=0x7f56c4007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 msgr2=0x7f56d40c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 0x7f56d40c8500 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c9b0 tx=0x7f56c8015000 comp rx=0 tx=0).stop 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 shutdown_connections 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f56c0066f30 0x7f56c00693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d40c8a40 0x7f56d40b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56bc004810 0x7f56d415aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 --2- 172.21.15.55:0/598266756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d415b3e0 0x7f56d40c8500 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.912+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 >> 172.21.15.55:0/598266756 conn(0x7f56d406ece0 msgr2=0x7f56d40682e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.913+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 shutdown_connections 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:34.913+0000 7f56d9e5a700 1 -- 172.21.15.55:0/598266756 wait complete. 2023-10-06T11:14:34.927 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:14:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.094+0000 7fbae6efc700 1 Processor -- start 2023-10-06T11:14:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.094+0000 7fbae6efc700 1 -- start start 2023-10-06T11:14:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae6efc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbae0159360 0x7fbae00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae6efc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae6efc700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00ab1c0 con 0x7fbae0159730 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae6efc700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00b1620 con 0x7fbae0159360 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae6efc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00b0a10 con 0x7fbae00b4450 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae5efa700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbae0159360 0x7fbae00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae56f9700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbae0159730 0x7fbae00b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33820/0 (socket says 172.21.15.55:33820) 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae56f9700 1 -- 172.21.15.55:0/449029176 learned_addr learned my addr 172.21.15.55:0/449029176 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae66fb700 1 --2- 172.21.15.55:0/449029176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae5efa700 1 -- 172.21.15.55:0/449029176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 msgr2=0x7fbae00cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae5efa700 1 --2- 172.21.15.55:0/449029176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae5efa700 1 -- 172.21.15.55:0/449029176 >> v1:172.21.15.55:6789/0 conn(0x7fbae0159730 legacy=0x7fbae00b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae5efa700 1 -- 172.21.15.55:0/449029176 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00b0cf0 con 0x7fbae0159360 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.095+0000 7fbae4ef8700 1 -- 172.21.15.55:0/449029176 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561771395 0 0) 0x7fbad4001110 con 0x7fbae0159730 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae5efa700 1 --2- 172.21.15.55:0/449029176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159360 0x7fbae00b5d30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbad80098e0 tx=0x7fbad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850e149aaa9f582f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae4ef8700 1 -- 172.21.15.55:0/449029176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8009e80 con 0x7fbae0159360 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae4ef8700 1 -- 172.21.15.55:0/449029176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800b8f0 con 0x7fbae0159360 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae4ef8700 1 -- 172.21.15.55:0/449029176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800bc70 con 0x7fbae0159360 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 -- 172.21.15.55:0/449029176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159360 msgr2=0x7fbae00b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 --2- 172.21.15.55:0/449029176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159360 0x7fbae00b5d30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbad80098e0 tx=0x7fbad80091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 -- 172.21.15.55:0/449029176 shutdown_connections 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 --2- 172.21.15.55:0/449029176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 --2- 172.21.15.55:0/449029176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159360 0x7fbae00b5d30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 -- 172.21.15.55:0/449029176 >> 172.21.15.55:0/449029176 conn(0x7fbae0099580 msgr2=0x7fbae006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 -- 172.21.15.55:0/449029176 shutdown_connections 2023-10-06T11:14:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.096+0000 7fbae6efc700 1 -- 172.21.15.55:0/449029176 wait complete. 2023-10-06T11:14:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.097+0000 7fbae6efc700 1 Processor -- start 2023-10-06T11:14:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 -- start start 2023-10-06T11:14:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbae0159360 0x7fbae015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 0x7fbae015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015abe0 con 0x7fbae0159730 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00aec40 con 0x7fbae0159360 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae6efc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015a2b0 con 0x7fbae00b4450 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae66fb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 0x7fbae015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae66fb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 0x7fbae015d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60428/0 (socket says 172.21.15.55:60428) 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.098+0000 7fbae66fb700 1 -- 172.21.15.55:0/3045946352 learned_addr learned my addr 172.21.15.55:0/3045946352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae56f9700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbae0159360 0x7fbae015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae5efa700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae66fb700 1 -- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 msgr2=0x7fbae00a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae66fb700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00a9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae66fb700 1 -- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbae0159360 msgr2=0x7fbae015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae66fb700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbae0159360 0x7fbae015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae66fb700 1 -- 172.21.15.55:0/3045946352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009420 con 0x7fbae0159730 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae56f9700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbae0159360 0x7fbae015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae66fb700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 0x7fbae015d110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbad000cf00 tx=0x7fbad0007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000ae40 con 0x7fbae0159730 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0016430 con 0x7fbae0159730 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae015a590 con 0x7fbae0159730 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00167f0 con 0x7fbae0159730 2023-10-06T11:14:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.099+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00a9f90 con 0x7fbae0159730 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.100+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae005f230 con 0x7fbae0159730 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.101+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbad0003020 con 0x7fbae0159730 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.101+0000 7fbaddffb700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbacc066f30 0x7fbacc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.101+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbad0012070 con 0x7fbae0159730 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.101+0000 7fbae5efa700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbacc066f30 0x7fbacc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.102+0000 7fbae5efa700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbacc066f30 0x7fbacc0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbad8003080 tx=0x7fbad8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.105+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbad0052630 con 0x7fbae0159730 2023-10-06T11:14:35.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:35.298+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbae015ad20 con 0x7fbae0159730 2023-10-06T11:14:36.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.088+0000 7fbaddffb700 1 -- 172.21.15.55:0/3045946352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbad0055c50 con 0x7fbae0159730 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbacc066f30 msgr2=0x7fbacc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbacc066f30 0x7fbacc0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbad8003080 tx=0x7fbad8017000 comp rx=0 tx=0).stop 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 msgr2=0x7fbae015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 0x7fbae015d110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbad000cf00 tx=0x7fbad0007830 comp rx=0 tx=0).stop 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 shutdown_connections 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbacc066f30 0x7fbacc0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbae0159730 0x7fbae015d110 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbae00b4450 0x7fbae00a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 --2- 172.21.15.55:0/3045946352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbae0159360 0x7fbae015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 >> 172.21.15.55:0/3045946352 conn(0x7fbae0099580 msgr2=0x7fbae01588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 shutdown_connections 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.091+0000 7fbae6efc700 1 -- 172.21.15.55:0/3045946352 wait complete. 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:14:36.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:14:36.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.237+0000 7f22b0d09700 1 Processor -- start 2023-10-06T11:14:36.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 -- start start 2023-10-06T11:14:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22ac157180 0x7f22ac157550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f22ac0c4210 0x7f22ac0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac0ca890 0x7f22ac0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c99a0 con 0x7f22ac157180 2023-10-06T11:14:36.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c81b0 con 0x7f22ac0c4210 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.238+0000 7f22b0d09700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c8490 con 0x7f22ac0ca890 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22ac157180 0x7f22ac157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22ac157180 0x7f22ac157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60438/0 (socket says 172.21.15.55:60438) 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 -- 172.21.15.55:0/2166812313 learned_addr learned my addr 172.21.15.55:0/2166812313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22a9d9b700 1 --2- 172.21.15.55:0/2166812313 >> v2:172.21.15.142:3300/0 conn(0x7f22ac0c4210 0x7f22ac0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aad9d700 1 --2- 172.21.15.55:0/2166812313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac0ca890 0x7f22ac0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 -- 172.21.15.55:0/2166812313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac0ca890 msgr2=0x7f22ac0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 --2- 172.21.15.55:0/2166812313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac0ca890 0x7f22ac0675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 -- 172.21.15.55:0/2166812313 >> v2:172.21.15.142:3300/0 conn(0x7f22ac0c4210 msgr2=0x7f22ac0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 --2- 172.21.15.55:0/2166812313 >> v2:172.21.15.142:3300/0 conn(0x7f22ac0c4210 0x7f22ac0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 -- 172.21.15.55:0/2166812313 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac06b150 con 0x7f22ac157180 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22a9d9b700 1 --2- 172.21.15.55:0/2166812313 >> v2:172.21.15.142:3300/0 conn(0x7f22ac0c4210 0x7f22ac0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22aa59c700 1 --2- 172.21.15.55:0/2166812313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac157180 0x7f22ac157550 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06df20 tx=0x7f22a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa5bf6144db0354 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22a959a700 1 -- 172.21.15.55:0/2166812313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400b860 con 0x7f22ac157180 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22a959a700 1 -- 172.21.15.55:0/2166812313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a400b9c0 con 0x7f22ac157180 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.239+0000 7f22a959a700 1 -- 172.21.15.55:0/2166812313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400bd60 con 0x7f22ac157180 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 -- 172.21.15.55:0/2166812313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac157180 msgr2=0x7f22ac157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 --2- 172.21.15.55:0/2166812313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac157180 0x7f22ac157550 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06df20 tx=0x7f22a4009250 comp rx=0 tx=0).stop 2023-10-06T11:14:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 -- 172.21.15.55:0/2166812313 shutdown_connections 2023-10-06T11:14:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 --2- 172.21.15.55:0/2166812313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac0ca890 0x7f22ac0675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 --2- 172.21.15.55:0/2166812313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac157180 0x7f22ac157550 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 --2- 172.21.15.55:0/2166812313 >> v2:172.21.15.142:3300/0 conn(0x7f22ac0c4210 0x7f22ac0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 -- 172.21.15.55:0/2166812313 >> 172.21.15.55:0/2166812313 conn(0x7f22ac0cdbc0 msgr2=0x7f22ac0c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 -- 172.21.15.55:0/2166812313 shutdown_connections 2023-10-06T11:14:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.240+0000 7f22b0d09700 1 -- 172.21.15.55:0/2166812313 wait complete. 2023-10-06T11:14:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.241+0000 7f22b0d09700 1 Processor -- start 2023-10-06T11:14:36.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.241+0000 7f22b0d09700 1 -- start start 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22b0d09700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 0x7f22ac148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22b0d09700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0ca890 0x7f22ac0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22b0d09700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac157180 0x7f22ac0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22b0d09700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b0f30 con 0x7f22ac0c4210 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22b0d09700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b1160 con 0x7f22ac0ca890 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22b0d09700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b1440 con 0x7f22ac157180 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 0x7f22ac148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 0x7f22ac148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60452/0 (socket says 172.21.15.55:60452) 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 -- 172.21.15.55:0/3412075880 learned_addr learned my addr 172.21.15.55:0/3412075880 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aad9d700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac157180 0x7f22ac0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22a9d9b700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0ca890 0x7f22ac0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 -- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac157180 msgr2=0x7f22ac0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac157180 0x7f22ac0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 -- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0ca890 msgr2=0x7f22ac0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0ca890 0x7f22ac0b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 -- 172.21.15.55:0/3412075880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40094f0 con 0x7f22ac0c4210 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aad9d700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac157180 0x7f22ac0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22a9d9b700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0ca890 0x7f22ac0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22aa59c700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 0x7f22ac148e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009290 tx=0x7f22a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.242+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4026480 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.243+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a401f070 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.243+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0b1720 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.243+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4026830 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.243+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0b1ce0 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.244+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0b1f00 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.244+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22a4026ba0 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.244+0000 7f22a27fc700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f228c066f30 0x7f228c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.244+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6026+0+0 (secure 0 0 0) 0x7f22a4021070 con 0x7f22ac0c4210 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.245+0000 7f22a9d9b700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f228c066f30 0x7f228c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.245+0000 7f22a9d9b700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f228c066f30 0x7f228c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2294006f00 tx=0x7f2294008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.249+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a4053620 con 0x7f22ac0c4210 2023-10-06T11:14:36.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:36.440+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22ac064a90 con 0x7f22ac0c4210 2023-10-06T11:14:37.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.100+0000 7f22a27fc700 1 -- 172.21.15.55:0/3412075880 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f22a4056c40 con 0x7f22ac0c4210 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f228c066f30 msgr2=0x7f228c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f228c066f30 0x7f228c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2294006f00 tx=0x7f2294008040 comp rx=0 tx=0).stop 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 msgr2=0x7f22ac148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 0x7f22ac148e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009290 tx=0x7f22a4017000 comp rx=0 tx=0).stop 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 shutdown_connections 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f228c066f30 0x7f228c0693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ac0c4210 0x7f22ac148e70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ac157180 0x7f22ac0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 --2- 172.21.15.55:0/3412075880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ac0ca890 0x7f22ac0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 >> 172.21.15.55:0/3412075880 conn(0x7f22ac0cdbc0 msgr2=0x7f22ac152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:37.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 shutdown_connections 2023-10-06T11:14:37.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.105+0000 7f22b0d09700 1 -- 172.21.15.55:0/3412075880 wait complete. 2023-10-06T11:14:37.108 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:14:37.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:14:37.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.249+0000 7f4145df7700 1 Processor -- start 2023-10-06T11:14:37.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.249+0000 7f4145df7700 1 -- start start 2023-10-06T11:14:37.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f4145df7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414015a250 0x7f41401640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f4145df7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400ca5b0 con 0x7f414013c430 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f4145df7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414015a8e0 con 0x7f41400cb060 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f4145df7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414006d500 con 0x7f414015a250 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f4144df5700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f414013c430 0x7f41400ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33826/0 (socket says 172.21.15.55:33826) 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f4144df5700 1 -- 172.21.15.55:0/3046302614 learned_addr learned my addr 172.21.15.55:0/3046302614 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f41455f6700 1 --2- 172.21.15.55:0/3046302614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414015a250 0x7f41401640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.250+0000 7f413f7fe700 1 -- 172.21.15.55:0/3046302614 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144489939 0 0) 0x7f41400ca5b0 con 0x7f414013c430 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f413f7fe700 1 -- 172.21.15.55:0/3046302614 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4128003570 con 0x7f414013c430 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f413f7fe700 1 -- 172.21.15.55:0/3046302614 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240636522 0 0) 0x7f414015a8e0 con 0x7f41400cb060 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f41455f6700 1 -- 172.21.15.55:0/3046302614 >> v1:172.21.15.142:6789/0 conn(0x7f41400cb060 legacy=0x7f4140159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f41455f6700 1 -- 172.21.15.55:0/3046302614 >> v1:172.21.15.55:6789/0 conn(0x7f414013c430 legacy=0x7f41400ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f41455f6700 1 -- 172.21.15.55:0/3046302614 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414015a670 con 0x7f414015a250 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f41455f6700 1 --2- 172.21.15.55:0/3046302614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414015a250 0x7f41401640d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4138009e90 tx=0x7f4138009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b651867eeb66a5ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f413f7fe700 1 -- 172.21.15.55:0/3046302614 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800e070 con 0x7f414015a250 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f413f7fe700 1 -- 172.21.15.55:0/3046302614 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800b920 con 0x7f414015a250 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.251+0000 7f413f7fe700 1 -- 172.21.15.55:0/3046302614 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130001470 con 0x7f414015a250 2023-10-06T11:14:37.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 -- 172.21.15.55:0/3046302614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414015a250 msgr2=0x7f41401640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 --2- 172.21.15.55:0/3046302614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414015a250 0x7f41401640d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4138009e90 tx=0x7f4138009780 comp rx=0 tx=0).stop 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 -- 172.21.15.55:0/3046302614 shutdown_connections 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 --2- 172.21.15.55:0/3046302614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414015a250 0x7f41401640d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 -- 172.21.15.55:0/3046302614 >> 172.21.15.55:0/3046302614 conn(0x7f414006b330 msgr2=0x7f414006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 -- 172.21.15.55:0/3046302614 shutdown_connections 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.252+0000 7f4145df7700 1 -- 172.21.15.55:0/3046302614 wait complete. 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.253+0000 7f4145df7700 1 Processor -- start 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.253+0000 7f4145df7700 1 -- start start 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4145df7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41400cb060 0x7f41400b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4145df7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414013c430 0x7f41400b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4145df7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 0x7f414015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4145df7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400b3960 con 0x7f414015a250 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4145df7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400b2d50 con 0x7f41400cb060 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4145df7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41400b3030 con 0x7f414013c430 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 0x7f414015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 0x7f414015c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60456/0 (socket says 172.21.15.55:60456) 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 -- 172.21.15.55:0/1763002706 learned_addr learned my addr 172.21.15.55:0/1763002706 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f413ffff700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414013c430 0x7f41400b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f4144df5700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41400cb060 0x7f41400b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 -- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414013c430 msgr2=0x7f41400b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414013c430 0x7f41400b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 -- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41400cb060 msgr2=0x7f41400b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41400cb060 0x7f41400b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 -- 172.21.15.55:0/1763002706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009a20 con 0x7f414015a250 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f413ffff700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414013c430 0x7f41400b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.254+0000 7f41455f6700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 0x7f414015c8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f41380097c0 tx=0x7f4138017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.255+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138012cc0 con 0x7f414015a250 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.255+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138012e40 con 0x7f414015a250 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.255+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413801e6a0 con 0x7f414015a250 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.255+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41400b3310 con 0x7f414015a250 2023-10-06T11:14:37.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.255+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41400b2a30 con 0x7f414015a250 2023-10-06T11:14:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.255+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414005f230 con 0x7f414015a250 2023-10-06T11:14:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.256+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f413801ead0 con 0x7f414015a250 2023-10-06T11:14:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.256+0000 7f413cff9700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.257+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4138086800 con 0x7f414015a250 2023-10-06T11:14:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.257+0000 7f4144df5700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.257+0000 7f4144df5700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41300015a0 tx=0x7f4130000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.261+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4138053b80 con 0x7f414015a250 2023-10-06T11:14:37.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.453+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f41400b3aa0 con 0x7f414015a250 2023-10-06T11:14:37.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.457+0000 7f413cff9700 1 -- 172.21.15.55:0/1763002706 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41400b3aa0 con 0x7f414015a250 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 msgr2=0x7f412c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41300015a0 tx=0x7f4130000bc0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 msgr2=0x7f414015c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 0x7f414015c8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f41380097c0 tx=0x7f4138017000 comp rx=0 tx=0).stop 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 shutdown_connections 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f414015a250 0x7f414015c8e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41400cb060 0x7f41400b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 --2- 172.21.15.55:0/1763002706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f414013c430 0x7f41400b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 >> 172.21.15.55:0/1763002706 conn(0x7f414006b330 msgr2=0x7f4140156610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:37.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 shutdown_connections 2023-10-06T11:14:37.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.459+0000 7f4145df7700 1 -- 172.21.15.55:0/1763002706 wait complete. 2023-10-06T11:14:37.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2023-10-06T11:14:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.592+0000 7f702ce44700 1 Processor -- start 2023-10-06T11:14:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.592+0000 7f702ce44700 1 -- start start 2023-10-06T11:14:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702ce44700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7028150940 0x7f7028159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702ce44700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70280cd4d0 0x7f70280b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702ce44700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702815ac30 con 0x7f702815a160 2023-10-06T11:14:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702ce44700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70280cb6a0 con 0x7f7028150940 2023-10-06T11:14:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702ce44700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70280cb090 con 0x7f70280cd4d0 2023-10-06T11:14:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7028150940 0x7f7028159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7028150940 0x7f7028159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60458/0 (socket says 172.21.15.55:60458) 2023-10-06T11:14:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 -- 172.21.15.55:0/3458419139 learned_addr learned my addr 172.21.15.55:0/3458419139 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 -- 172.21.15.55:0/3458419139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70280cd4d0 msgr2=0x7f70280b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 --2- 172.21.15.55:0/3458419139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70280cd4d0 0x7f70280b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 -- 172.21.15.55:0/3458419139 >> v1:172.21.15.142:6789/0 conn(0x7f702815a160 legacy=0x7f70280ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 -- 172.21.15.55:0/3458419139 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702815a670 con 0x7f7028150940 2023-10-06T11:14:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702659c700 1 --2- 172.21.15.55:0/3458419139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7028150940 0x7f7028159c20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7020009990 tx=0x7f7020009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390a0d8aa1d6c8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702559a700 1 -- 172.21.15.55:0/3458419139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020005c10 con 0x7f7028150940 2023-10-06T11:14:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702559a700 1 -- 172.21.15.55:0/3458419139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020005d70 con 0x7f7028150940 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.593+0000 7f702559a700 1 -- 172.21.15.55:0/3458419139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000b840 con 0x7f7028150940 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 -- 172.21.15.55:0/3458419139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7028150940 msgr2=0x7f7028159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 --2- 172.21.15.55:0/3458419139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7028150940 0x7f7028159c20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7020009990 tx=0x7f7020009220 comp rx=0 tx=0).stop 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 -- 172.21.15.55:0/3458419139 shutdown_connections 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 --2- 172.21.15.55:0/3458419139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70280cd4d0 0x7f70280b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 --2- 172.21.15.55:0/3458419139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7028150940 0x7f7028159c20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 -- 172.21.15.55:0/3458419139 >> 172.21.15.55:0/3458419139 conn(0x7f7028099700 msgr2=0x7f702806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 -- 172.21.15.55:0/3458419139 shutdown_connections 2023-10-06T11:14:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.594+0000 7f702ce44700 1 -- 172.21.15.55:0/3458419139 wait complete. 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.595+0000 7f702ce44700 1 Processor -- start 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.595+0000 7f702ce44700 1 -- start start 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702ce44700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 0x7f7028150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702ce44700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f702815a160 0x7f702816b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702ce44700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f702816a370 0x7f70280b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702ce44700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702815cf70 con 0x7f70280cd4d0 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702ce44700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7028151310 con 0x7f702816a370 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702ce44700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702815c640 con 0x7f702815a160 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 0x7f7028150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 0x7f7028150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60468/0 (socket says 172.21.15.55:60468) 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 -- 172.21.15.55:0/3693412568 learned_addr learned my addr 172.21.15.55:0/3693412568 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f7025d9b700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f702815a160 0x7f702816b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f7026d9d700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f702816a370 0x7f70280b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 -- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f702815a160 msgr2=0x7f702816b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f702815a160 0x7f702816b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 -- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f702816a370 msgr2=0x7f70280b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f702816a370 0x7f70280b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 -- 172.21.15.55:0/3693412568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020009480 con 0x7f70280cd4d0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.596+0000 7f702659c700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 0x7f7028150dd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7020003080 tx=0x7f7020015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.597+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020000d10 con 0x7f70280cd4d0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.597+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020011b20 con 0x7f70280cd4d0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.597+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702815c920 con 0x7f70280cd4d0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.597+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702001d430 con 0x7f70280cd4d0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.597+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028151570 con 0x7f70280cd4d0 2023-10-06T11:14:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.597+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7028064a90 con 0x7f70280cd4d0 2023-10-06T11:14:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.598+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f702001d860 con 0x7f70280cd4d0 2023-10-06T11:14:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.598+0000 7f701e7fc700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7008066f30 0x7f70080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.598+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f70200863a0 con 0x7f70280cd4d0 2023-10-06T11:14:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.599+0000 7f7025d9b700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7008066f30 0x7f70080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.599+0000 7f7025d9b700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7008066f30 0x7f70080693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f702815eec0 tx=0x7f7010009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.603+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7020053720 con 0x7f70280cd4d0 2023-10-06T11:14:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.797+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7f702815ac30 con 0x7f70280cd4d0 2023-10-06T11:14:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.805+0000 7f701e7fc700 1 -- 172.21.15.55:0/3693412568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v13) v1 ==== 106+0+0 (secure 0 0 0) 0x7f702815ac30 con 0x7f70280cd4d0 2023-10-06T11:14:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.807+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7008066f30 msgr2=0x7f70080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.807+0000 7f702ce44700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7008066f30 0x7f70080693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f702815eec0 tx=0x7f7010009060 comp rx=0 tx=0).stop 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.807+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 msgr2=0x7f7028150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 0x7f7028150dd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7020003080 tx=0x7f7020015000 comp rx=0 tx=0).stop 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 shutdown_connections 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7008066f30 0x7f70080693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70280cd4d0 0x7f7028150dd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f702816a370 0x7f70280b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 --2- 172.21.15.55:0/3693412568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f702815a160 0x7f702816b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 >> 172.21.15.55:0/3693412568 conn(0x7f7028099700 msgr2=0x7f7028069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 shutdown_connections 2023-10-06T11:14:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.808+0000 7f702ce44700 1 -- 172.21.15.55:0/3693412568 wait complete. 2023-10-06T11:14:37.821 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2023-10-06T11:14:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.938+0000 7f82c42de700 1 Processor -- start 2023-10-06T11:14:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.938+0000 7f82c42de700 1 -- start start 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.939+0000 7f82c42de700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc0b25e0 0x7f82bc0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.939+0000 7f82c42de700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0cbfa0 con 0x7f82bc0b29b0 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.939+0000 7f82c42de700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0cb390 con 0x7f82bc159830 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.939+0000 7f82c42de700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0cb670 con 0x7f82bc0b25e0 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.939+0000 7f82c1879700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f82bc0b29b0 0x7f82bc159120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33834/0 (socket says 172.21.15.55:33834) 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1879700 1 -- 172.21.15.55:0/2619405314 learned_addr learned my addr 172.21.15.55:0/2619405314 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c207a700 1 --2- 172.21.15.55:0/2619405314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc0b25e0 0x7f82bc0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517513965 0 0) 0x7f82bc0cbfa0 con 0x7f82bc0b29b0 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a4003570 con 0x7f82bc0b29b0 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461574563 0 0) 0x7f82bc0cb390 con 0x7f82bc159830 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82bc0cbfa0 con 0x7f82bc159830 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4218778492 0 0) 0x7f82a4003570 con 0x7f82bc0b29b0 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c207a700 1 -- 172.21.15.55:0/2619405314 >> v1:172.21.15.142:6789/0 conn(0x7f82bc159830 legacy=0x7f82bc0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c207a700 1 -- 172.21.15.55:0/2619405314 >> v1:172.21.15.55:6789/0 conn(0x7f82bc0b29b0 legacy=0x7f82bc159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c207a700 1 -- 172.21.15.55:0/2619405314 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0cb950 con 0x7f82bc0b25e0 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c207a700 1 --2- 172.21.15.55:0/2619405314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc0b25e0 0x7f82bc0b0690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009900 tx=0x7f82b4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd32d1f672254823 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0001470 con 0x7f82bc0b25e0 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b4011420 con 0x7f82bc0b25e0 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.940+0000 7f82c1078700 1 -- 172.21.15.55:0/2619405314 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40117c0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 -- 172.21.15.55:0/2619405314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc0b25e0 msgr2=0x7f82bc0b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 --2- 172.21.15.55:0/2619405314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc0b25e0 0x7f82bc0b0690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009900 tx=0x7f82b4009120 comp rx=0 tx=0).stop 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 -- 172.21.15.55:0/2619405314 shutdown_connections 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 --2- 172.21.15.55:0/2619405314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc0b25e0 0x7f82bc0b0690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 -- 172.21.15.55:0/2619405314 >> 172.21.15.55:0/2619405314 conn(0x7f82bc06ece0 msgr2=0x7f82bc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 -- 172.21.15.55:0/2619405314 shutdown_connections 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.941+0000 7f82c42de700 1 -- 172.21.15.55:0/2619405314 wait complete. 2023-10-06T11:14:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.942+0000 7f82c42de700 1 Processor -- start 2023-10-06T11:14:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.942+0000 7f82c42de700 1 -- start start 2023-10-06T11:14:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c42de700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 0x7f82bc15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c42de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82bc0b29b0 0x7f82bc151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c42de700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc159830 0x7f82bc151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c42de700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0b3f10 con 0x7f82bc0b25e0 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c42de700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0b41f0 con 0x7f82bc0b29b0 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c42de700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0b44d0 con 0x7f82bc159830 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 0x7f82bc15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 0x7f82bc15e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60470/0 (socket says 172.21.15.55:60470) 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 -- 172.21.15.55:0/2304604304 learned_addr learned my addr 172.21.15.55:0/2304604304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c1879700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82bc0b29b0 0x7f82bc151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c287b700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc159830 0x7f82bc151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 -- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc159830 msgr2=0x7f82bc151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc159830 0x7f82bc151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 -- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82bc0b29b0 msgr2=0x7f82bc151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82bc0b29b0 0x7f82bc151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.943+0000 7f82c207a700 1 -- 172.21.15.55:0/2304604304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40093c0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.944+0000 7f82c207a700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 0x7f82bc15e8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009160 tx=0x7f82b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.944+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b401cb30 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.944+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b401cc90 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.944+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc0b47b0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.944+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b401a6a0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.944+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc0b4fb0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.945+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc0b4cb0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.945+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82b401aa90 con 0x7f82bc0b25e0 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.946+0000 7f82ba7fc700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f82a8066f30 0x7f82a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.946+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f82b4085dc0 con 0x7f82bc0b25e0 2023-10-06T11:14:37.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.946+0000 7f82c1879700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f82a8066f30 0x7f82a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:37.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.946+0000 7f82c1879700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f82a8066f30 0x7f82a80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f82b00015a0 tx=0x7f82b0000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:37.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:37.950+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82b4053090 con 0x7f82bc0b25e0 2023-10-06T11:14:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:38.220+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7f82bc064a90 con 0x7f82bc0b25e0 2023-10-06T11:14:38.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:38.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:39.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.106+0000 7f82ba7fc700 1 -- 172.21.15.55:0/2304604304 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v106) v1 ==== 144+0+0 (secure 0 0 0) 0x7f82b40566b0 con 0x7f82bc0b25e0 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f82a8066f30 msgr2=0x7f82a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f82a8066f30 0x7f82a80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f82b00015a0 tx=0x7f82b0000bc0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 msgr2=0x7f82bc15e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 0x7f82bc15e8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009160 tx=0x7f82b4016000 comp rx=0 tx=0).stop 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 shutdown_connections 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f82a8066f30 0x7f82a80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82bc0b25e0 0x7f82bc15e8f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82bc159830 0x7f82bc151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 --2- 172.21.15.55:0/2304604304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82bc0b29b0 0x7f82bc151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 >> 172.21.15.55:0/2304604304 conn(0x7f82bc06ece0 msgr2=0x7f82bc153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:39.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 shutdown_connections 2023-10-06T11:14:39.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.109+0000 7f82c42de700 1 -- 172.21.15.55:0/2304604304 wait complete. 2023-10-06T11:14:39.125 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2023-10-06T11:14:39.125 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2023-10-06T11:14:39.126 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T11:14:39.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2023-10-06T11:14:39.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.250+0000 7fad236c9700 1 Processor -- start 2023-10-06T11:14:39.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.250+0000 7fad236c9700 1 -- start start 2023-10-06T11:14:39.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad236c9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad1c157460 0x7fad1c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:39.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad236c9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad1c067cc0 0x7fad1c0ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:39.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad236c9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0aec90 con 0x7fad1c0cdb00 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad236c9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0c4030 con 0x7fad1c067cc0 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad236c9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c06f3b0 con 0x7fad1c157460 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad1c067cc0 0x7fad1c0ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad1c067cc0 0x7fad1c0ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60482/0 (socket says 172.21.15.55:60482) 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 -- 172.21.15.55:0/3742835687 learned_addr learned my addr 172.21.15.55:0/3742835687 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21465700 1 --2- 172.21.15.55:0/3742835687 >> v2:172.21.15.142:3300/0 conn(0x7fad1c157460 0x7fad1c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 -- 172.21.15.55:0/3742835687 >> v2:172.21.15.142:3300/0 conn(0x7fad1c157460 msgr2=0x7fad1c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:39.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 --2- 172.21.15.55:0/3742835687 >> v2:172.21.15.142:3300/0 conn(0x7fad1c157460 0x7fad1c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 -- 172.21.15.55:0/3742835687 >> v1:172.21.15.142:6789/0 conn(0x7fad1c0cdb00 legacy=0x7fad1c0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:39.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21c66700 1 -- 172.21.15.55:0/3742835687 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0aef70 con 0x7fad1c067cc0 2023-10-06T11:14:39.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.251+0000 7fad21465700 1 --2- 172.21.15.55:0/3742835687 >> v2:172.21.15.142:3300/0 conn(0x7fad1c157460 0x7fad1c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:39.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad21c66700 1 --2- 172.21.15.55:0/3742835687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c067cc0 0x7fad1c0ac5a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad1c06a450 tx=0x7fad14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a6c4dfa6f399d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:39.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad13fff700 1 -- 172.21.15.55:0/3742835687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400e070 con 0x7fad1c067cc0 2023-10-06T11:14:39.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad13fff700 1 -- 172.21.15.55:0/3742835687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400ba50 con 0x7fad1c067cc0 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad13fff700 1 -- 172.21.15.55:0/3742835687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad140092e0 con 0x7fad1c067cc0 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 -- 172.21.15.55:0/3742835687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c067cc0 msgr2=0x7fad1c0ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 --2- 172.21.15.55:0/3742835687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c067cc0 0x7fad1c0ac5a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad1c06a450 tx=0x7fad14009840 comp rx=0 tx=0).stop 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 -- 172.21.15.55:0/3742835687 shutdown_connections 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 --2- 172.21.15.55:0/3742835687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c067cc0 0x7fad1c0ac5a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 --2- 172.21.15.55:0/3742835687 >> v2:172.21.15.142:3300/0 conn(0x7fad1c157460 0x7fad1c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 -- 172.21.15.55:0/3742835687 >> 172.21.15.55:0/3742835687 conn(0x7fad1c069140 msgr2=0x7fad1c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:39.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 -- 172.21.15.55:0/3742835687 shutdown_connections 2023-10-06T11:14:39.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.252+0000 7fad236c9700 1 -- 172.21.15.55:0/3742835687 wait complete. 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 Processor -- start 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 -- start start 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad1c067cc0 0x7fad1c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 0x7fad1c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c157460 0x7fad1c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c155ee0 con 0x7fad1c0cdb00 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c159b90 con 0x7fad1c157460 2023-10-06T11:14:39.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.254+0000 7fad236c9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c159e70 con 0x7fad1c067cc0 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 0x7fad1c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 0x7fad1c0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60496/0 (socket says 172.21.15.55:60496) 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 -- 172.21.15.55:0/3277903352 learned_addr learned my addr 172.21.15.55:0/3277903352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad21465700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad1c067cc0 0x7fad1c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad21c66700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c157460 0x7fad1c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 -- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad1c067cc0 msgr2=0x7fad1c1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad1c067cc0 0x7fad1c1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 -- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c157460 msgr2=0x7fad1c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:39.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c157460 0x7fad1c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 -- 172.21.15.55:0/3277903352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14009ae0 con 0x7fad1c0cdb00 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad21465700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad1c067cc0 0x7fad1c1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad21c66700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c157460 0x7fad1c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad20c64700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 0x7fad1c0acf30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c590 tx=0x7fad0c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011590 con 0x7fad1c0cdb00 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c0116f0 con 0x7fad1c0cdb00 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c15a150 con 0x7fad1c0cdb00 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011ab0 con 0x7fad1c0cdb00 2023-10-06T11:14:39.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.255+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c15a710 con 0x7fad1c0cdb00 2023-10-06T11:14:39.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.256+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c064a90 con 0x7fad1c0cdb00 2023-10-06T11:14:39.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.257+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad0c01b3b0 con 0x7fad1c0cdb00 2023-10-06T11:14:39.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.257+0000 7fad117fa700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:39.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.257+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fad0c083a60 con 0x7fad1c0cdb00 2023-10-06T11:14:39.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.258+0000 7fad21465700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:39.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.258+0000 7fad21465700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad00066f30 0x7fad000693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad18006f00 tx=0x7fad18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:39.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.262+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad0c050d30 con 0x7fad1c0cdb00 2023-10-06T11:14:39.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:39.534+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7fad1c0af250 con 0x7fad1c0cdb00 2023-10-06T11:14:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.113+0000 7fad117fa700 1 -- 172.21.15.55:0/3277903352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v107) v1 ==== 156+0+0 (secure 0 0 0) 0x7fad0c017070 con 0x7fad1c0cdb00 2023-10-06T11:14:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad00066f30 msgr2=0x7fad000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad00066f30 0x7fad000693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad18006f00 tx=0x7fad18008040 comp rx=0 tx=0).stop 2023-10-06T11:14:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 msgr2=0x7fad1c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 0x7fad1c0acf30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c590 tx=0x7fad0c00c950 comp rx=0 tx=0).stop 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 shutdown_connections 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad00066f30 0x7fad000693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c157460 0x7fad1c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad1c067cc0 0x7fad1c1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 --2- 172.21.15.55:0/3277903352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad1c0cdb00 0x7fad1c0acf30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 >> 172.21.15.55:0/3277903352 conn(0x7fad1c069140 msgr2=0x7fad1c0cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 shutdown_connections 2023-10-06T11:14:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.115+0000 7fad236c9700 1 -- 172.21.15.55:0/3277903352 wait complete. 2023-10-06T11:14:40.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:14:40.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.253+0000 7f047fa91700 1 Processor -- start 2023-10-06T11:14:40.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.253+0000 7f047fa91700 1 -- start start 2023-10-06T11:14:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.254+0000 7f047fa91700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 0x7f04780c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.254+0000 7f047fa91700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 0x7f04780c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.254+0000 7f047fa91700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0478069ab0 con 0x7f0478068160 2023-10-06T11:14:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.254+0000 7f047fa91700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780c3220 con 0x7f0478159610 2023-10-06T11:14:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.254+0000 7f047fa91700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c3500 con 0x7f04781599e0 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047d82d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 0x7f04780c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 0x7f04780c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047d82d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 0x7f04780c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:52234/0 (socket says 172.21.15.55:52234) 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047d82d700 1 -- 172.21.15.55:0/1438501440 learned_addr learned my addr 172.21.15.55:0/1438501440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 --2- 172.21.15.55:0/1438501440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 0x7f04780c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:35100/0 (socket says 172.21.15.55:35100) 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047d02c700 1 --1- 172.21.15.55:0/1438501440 >> v1:172.21.15.142:6789/0 conn(0x7f0478068160 0x7f04780cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:60120/0 (socket says 172.21.15.55:60120) 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 -- 172.21.15.55:0/1438501440 >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 msgr2=0x7f04780c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 --2- 172.21.15.55:0/1438501440 >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 0x7f04780c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 -- 172.21.15.55:0/1438501440 >> v1:172.21.15.142:6789/0 conn(0x7f0478068160 legacy=0x7f04780cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 -- 172.21.15.55:0/1438501440 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780c37e0 con 0x7f04781599e0 2023-10-06T11:14:40.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047d82d700 1 --2- 172.21.15.55:0/1438501440 >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 0x7f04780c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:40.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047e02e700 1 --2- 172.21.15.55:0/1438501440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 0x7f04780c3d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0468009e60 tx=0x7f0468009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6ec76c1e14544 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:40.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.255+0000 7f047c82b700 1 -- 172.21.15.55:0/1438501440 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800e070 con 0x7f04781599e0 2023-10-06T11:14:40.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047c82b700 1 -- 172.21.15.55:0/1438501440 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800ba60 con 0x7f04781599e0 2023-10-06T11:14:40.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047c82b700 1 -- 172.21.15.55:0/1438501440 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800be00 con 0x7f04781599e0 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 -- 172.21.15.55:0/1438501440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 msgr2=0x7f04780c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 --2- 172.21.15.55:0/1438501440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 0x7f04780c3d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0468009e60 tx=0x7f0468009780 comp rx=0 tx=0).stop 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 -- 172.21.15.55:0/1438501440 shutdown_connections 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 --2- 172.21.15.55:0/1438501440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04781599e0 0x7f04780c3d00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 --2- 172.21.15.55:0/1438501440 >> v2:172.21.15.142:3300/0 conn(0x7f0478159610 0x7f04780c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 -- 172.21.15.55:0/1438501440 >> 172.21.15.55:0/1438501440 conn(0x7f0478067d90 msgr2=0x7f04780ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 -- 172.21.15.55:0/1438501440 shutdown_connections 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.256+0000 7f047fa91700 1 -- 172.21.15.55:0/1438501440 wait complete. 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.257+0000 7f047fa91700 1 Processor -- start 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.257+0000 7f047fa91700 1 -- start start 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047fa91700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0478068160 0x7f0478147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047fa91700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 0x7f04780c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047fa91700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04781599e0 0x7f04780c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047fa91700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b1d00 con 0x7f0478159610 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047fa91700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b10f0 con 0x7f04781599e0 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047fa91700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b13d0 con 0x7f0478068160 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 0x7f04780c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d82d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0478068160 0x7f0478147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 0x7f04780c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60498/0 (socket says 172.21.15.55:60498) 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 -- 172.21.15.55:0/3731383226 learned_addr learned my addr 172.21.15.55:0/3731383226 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047e02e700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04781599e0 0x7f04780c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 -- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0478068160 msgr2=0x7f0478147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0478068160 0x7f0478147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 -- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04781599e0 msgr2=0x7f04780c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04781599e0 0x7f04780c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.258+0000 7f047d02c700 1 -- 172.21.15.55:0/3731383226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009480 con 0x7f0478159610 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.259+0000 7f047d02c700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 0x7f04780c3c00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c810 tx=0x7f046c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.259+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c005a70 con 0x7f0478159610 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.259+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c005bd0 con 0x7f0478159610 2023-10-06T11:14:40.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.259+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0070d0 con 0x7f0478159610 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.259+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0468009a20 con 0x7f0478159610 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.259+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780b1990 con 0x7f0478159610 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.260+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478064a90 con 0x7f0478159610 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.260+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f046c007480 con 0x7f0478159610 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.261+0000 7f0475ffb700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0464066f30 0x7f04640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.261+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f046c083aa0 con 0x7f0478159610 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.261+0000 7f047d82d700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0464066f30 0x7f04640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.261+0000 7f047d82d700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0464066f30 0x7f04640693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0478158fb0 tx=0x7f0470009220 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:40.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.265+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f046c050d70 con 0x7f0478159610 2023-10-06T11:14:40.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.458+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f04780b1e40 con 0x7f0478159610 2023-10-06T11:14:40.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.466+0000 7f0475ffb700 1 -- 172.21.15.55:0/3731383226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f046c017020 con 0x7f0478159610 2023-10-06T11:14:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0464066f30 msgr2=0x7f04640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0464066f30 0x7f04640693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0478158fb0 tx=0x7f0470009220 comp rx=0 tx=0).stop 2023-10-06T11:14:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 msgr2=0x7f04780c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 0x7f04780c3c00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c810 tx=0x7f046c007f30 comp rx=0 tx=0).stop 2023-10-06T11:14:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 shutdown_connections 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0464066f30 0x7f04640693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04781599e0 0x7f04780c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0478068160 0x7f0478147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 --2- 172.21.15.55:0/3731383226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0478159610 0x7f04780c3c00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 >> 172.21.15.55:0/3731383226 conn(0x7f0478067d90 msgr2=0x7f04780cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 shutdown_connections 2023-10-06T11:14:40.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.468+0000 7f047fa91700 1 -- 172.21.15.55:0/3731383226 wait complete. 2023-10-06T11:14:40.482 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:14:40.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:40.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:40.563 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:14:40.564 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:14:40.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:40.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.681+0000 7f4b25b07700 1 Processor -- start 2023-10-06T11:14:40.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.681+0000 7f4b25b07700 1 -- start start 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25b07700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b20159440 0x7f4b200b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25b07700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b200cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25b07700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b200cb7a0 con 0x7f4b200cc170 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25b07700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200b0860 con 0x7f4b20159440 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25b07700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200cb150 con 0x7f4b200b35d0 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25306700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4b200cc170 0x7f4b200b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33850/0 (socket says 172.21.15.55:33850) 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b25306700 1 -- 172.21.15.55:0/3817396628 learned_addr learned my addr 172.21.15.55:0/3817396628 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762439334 0 0) 0x7f4b200cb7a0 con 0x7f4b200cc170 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c003570 con 0x7f4b200cc170 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b200cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.682+0000 7f4b24b05700 1 --2- 172.21.15.55:0/3817396628 >> v2:172.21.15.142:3300/0 conn(0x7f4b20159440 0x7f4b200b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731391047 0 0) 0x7f4b0c003570 con 0x7f4b200cc170 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 msgr2=0x7f4b200cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b200cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 >> v2:172.21.15.142:3300/0 conn(0x7f4b20159440 msgr2=0x7f4b200b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 --2- 172.21.15.55:0/3817396628 >> v2:172.21.15.142:3300/0 conn(0x7f4b20159440 0x7f4b200b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200cb430 con 0x7f4b200cc170 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f4b18001470 con 0x7f4b200cc170 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 >> v1:172.21.15.55:6789/0 conn(0x7f4b200cc170 legacy=0x7f4b200b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b0c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b0c004d50 0x7f4b0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200b0860 con 0x7f4b0c003fe0 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200cb150 con 0x7f4b0c004d50 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c00ba90 con 0x7f4b200b35d0 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b24b05700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b0c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b25306700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b0c004d50 0x7f4b0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 -- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 msgr2=0x7f4b0c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b0c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 -- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b0c004d50 msgr2=0x7f4b0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b0c004d50 0x7f4b0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 -- 172.21.15.55:0/3817396628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c003570 con 0x7f4b0c003fe0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b24b05700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b200b35d0 0x7f4b0c003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b0c004810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000e210 tx=0x7f4b1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd74d99ecf3f56e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000ea60 con 0x7f4b0c003fe0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000f040 con 0x7f4b0c003fe0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.683+0000 7f4b1f7fe700 1 -- 172.21.15.55:0/3817396628 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000ee10 con 0x7f4b0c003fe0 2023-10-06T11:14:40.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25b07700 1 -- 172.21.15.55:0/3817396628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 msgr2=0x7f4b0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3817396628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b0c004810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000e210 tx=0x7f4b1000b040 comp rx=0 tx=0).stop 2023-10-06T11:14:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25306700 1 -- 172.21.15.55:0/3817396628 reap_dead start 2023-10-06T11:14:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25b07700 1 -- 172.21.15.55:0/3817396628 shutdown_connections 2023-10-06T11:14:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25b07700 1 -- 172.21.15.55:0/3817396628 >> 172.21.15.55:0/3817396628 conn(0x7f4b2006ece0 msgr2=0x7f4b2006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25b07700 1 -- 172.21.15.55:0/3817396628 shutdown_connections 2023-10-06T11:14:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.684+0000 7f4b25b07700 1 -- 172.21.15.55:0/3817396628 wait complete. 2023-10-06T11:14:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.685+0000 7f4b25b07700 1 Processor -- start 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.685+0000 7f4b25b07700 1 -- start start 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25b07700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b20154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25b07700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200c72d0 0x7f4b200c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25b07700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2015b760 0x7f4b2015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25b07700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20169930 con 0x7f4b0c003fe0 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25b07700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20169c10 con 0x7f4b200c72d0 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25b07700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015af60 con 0x7f4b2015b760 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b20154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b20154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60514/0 (socket says 172.21.15.55:60514) 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 -- 172.21.15.55:0/3724842292 learned_addr learned my addr 172.21.15.55:0/3724842292 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b25306700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2015b760 0x7f4b2015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200c72d0 0x7f4b200c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 -- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2015b760 msgr2=0x7f4b2015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2015b760 0x7f4b2015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 -- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200c72d0 msgr2=0x7f4b200c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200c72d0 0x7f4b200c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b24b05700 1 -- 172.21.15.55:0/3724842292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2015b240 con 0x7f4b0c003fe0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.686+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200c72d0 0x7f4b200c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.687+0000 7f4b24b05700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b20154940 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b080118e0 tx=0x7f4b08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.687+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800f700 con 0x7f4b0c003fe0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.687+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0800f860 con 0x7f4b0c003fe0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.687+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800fc00 con 0x7f4b0c003fe0 2023-10-06T11:14:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.687+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b200c9eb0 con 0x7f4b0c003fe0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.687+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b20168e00 con 0x7f4b0c003fe0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.688+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2015add0 con 0x7f4b0c003fe0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.688+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b08015460 con 0x7f4b0c003fe0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.688+0000 7f4b1cff9700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.688+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4b08084d00 con 0x7f4b0c003fe0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.689+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.689+0000 7f4b1ffff700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b00066f30 0x7f4b000693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000afd0 tx=0x7f4b1001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:40.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.693+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b08051fd0 con 0x7f4b0c003fe0 2023-10-06T11:14:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.929+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b2015b5b0 con 0x7f4b0c003fe0 2023-10-06T11:14:40.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.930+0000 7f4b1cff9700 1 -- 172.21.15.55:0/3724842292 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f4b080555f0 con 0x7f4b0c003fe0 2023-10-06T11:14:40.932 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:40.932 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3749325635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3749325635},{"type":"v1","addr":"172.21.15.142:6835","nonce":3749325635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1823969217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1823969217},{"type":"v1","addr":"172.21.15.142:6837","nonce":1823969217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2644931720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2644931720},{"type":"v1","addr":"172.21.15.55:6834","nonce":2644931720}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1565735980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1565735980},{"type":"v1","addr":"172.21.15.55:6835","nonce":1565735980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b00066f30 msgr2=0x7f4b000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b00066f30 0x7f4b000693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000afd0 tx=0x7f4b1001a000 comp rx=0 tx=0).stop 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 msgr2=0x7f4b20154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b20154940 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b080118e0 tx=0x7f4b08008040 comp rx=0 tx=0).stop 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 shutdown_connections 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b00066f30 0x7f4b000693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b0c003fe0 0x7f4b20154940 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b2015b760 0x7f4b2015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 --2- 172.21.15.55:0/3724842292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b200c72d0 0x7f4b200c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:40.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 >> 172.21.15.55:0/3724842292 conn(0x7f4b2006ece0 msgr2=0x7f4b20155040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:40.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 shutdown_connections 2023-10-06T11:14:40.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:40.932+0000 7f4b25b07700 1 -- 172.21.15.55:0/3724842292 wait complete. 2023-10-06T11:14:40.935 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 21 2023-10-06T11:14:40.946 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:14:40.946 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:14:40.946 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:14:40.946 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:40.947 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:14:40.947 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:14:40.947 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:14:40.947 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:40.947 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:14:40.947 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:14:40.948 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:14:40.948 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:40.948 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:14:40.948 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:14:40.948 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:14:40.948 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:40.955 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:14:40.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:14:40.957 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:14:40.957 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:14:40.959 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:14:40.959 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:14:40.960 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:14:40.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:14:40.999 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:14:41.000 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:41.001 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:14:41.001 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:41.002 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:14:41.002 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:41.003 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:14:41.003 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:41.003 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:14:41.074 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:14:41.074 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:14:41.086 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:14:41.087 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:14:41.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.129+0000 7f4dbf488700 1 Processor -- start 2023-10-06T11:14:41.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.129+0000 7f4dbf488700 1 -- start start 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbf488700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 0x7f4db80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbf488700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 0x7f4db80b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbf488700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db80cb7a0 con 0x7f4db80b35d0 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbf488700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80b0860 con 0x7f4db80b2100 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbf488700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80cb150 con 0x7f4db8159440 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 0x7f4db80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbec87700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 0x7f4db80b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 0x7f4db80b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:35164/0 (socket says 172.21.15.55:35164) 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbec87700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 0x7f4db80b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:52318/0 (socket says 172.21.15.55:52318) 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 -- 172.21.15.55:0/2880368260 learned_addr learned my addr 172.21.15.55:0/2880368260 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbdc85700 1 --1- 172.21.15.55:0/2880368260 >> v1:172.21.15.142:6789/0 conn(0x7f4db80b35d0 0x7f4db80cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:60140/0 (socket says 172.21.15.55:60140) 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 -- 172.21.15.55:0/2880368260 >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 msgr2=0x7f4db80b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 --2- 172.21.15.55:0/2880368260 >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 0x7f4db80b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 -- 172.21.15.55:0/2880368260 >> v1:172.21.15.142:6789/0 conn(0x7f4db80b35d0 legacy=0x7f4db80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbe486700 1 -- 172.21.15.55:0/2880368260 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80cb430 con 0x7f4db8159440 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.130+0000 7f4dbec87700 1 --2- 172.21.15.55:0/2880368260 >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 0x7f4db80b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:41.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.131+0000 7f4dbe486700 1 --2- 172.21.15.55:0/2880368260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 0x7f4db80b3090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4db40099b0 tx=0x7f4db4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b2ad74ea6b66e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.132+0000 7f4dbd484700 1 -- 172.21.15.55:0/2880368260 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4009ea0 con 0x7f4db8159440 2023-10-06T11:14:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.132+0000 7f4dbd484700 1 -- 172.21.15.55:0/2880368260 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400b860 con 0x7f4db8159440 2023-10-06T11:14:41.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbd484700 1 -- 172.21.15.55:0/2880368260 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400bc00 con 0x7f4db8159440 2023-10-06T11:14:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 -- 172.21.15.55:0/2880368260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 msgr2=0x7f4db80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 --2- 172.21.15.55:0/2880368260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 0x7f4db80b3090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4db40099b0 tx=0x7f4db4009250 comp rx=0 tx=0).stop 2023-10-06T11:14:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 -- 172.21.15.55:0/2880368260 shutdown_connections 2023-10-06T11:14:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 --2- 172.21.15.55:0/2880368260 >> v2:172.21.15.142:3300/0 conn(0x7f4db80b2100 0x7f4db80b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 --2- 172.21.15.55:0/2880368260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db8159440 0x7f4db80b3090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 -- 172.21.15.55:0/2880368260 >> 172.21.15.55:0/2880368260 conn(0x7f4db806ece0 msgr2=0x7f4db806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 -- 172.21.15.55:0/2880368260 shutdown_connections 2023-10-06T11:14:41.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.133+0000 7f4dbf488700 1 -- 172.21.15.55:0/2880368260 wait complete. 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.134+0000 7f4dbf488700 1 Processor -- start 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.134+0000 7f4dbf488700 1 -- start start 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbf488700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db80b2100 0x7f4db81496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbf488700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4db80b35d0 0x7f4db80c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbf488700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 0x7f4db80c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbf488700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c55c0 con 0x7f4db8159440 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbf488700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db8155c50 con 0x7f4db80b35d0 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbf488700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c4520 con 0x7f4db80b2100 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbec87700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 0x7f4db80c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbec87700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 0x7f4db80c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60538/0 (socket says 172.21.15.55:60538) 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbec87700 1 -- 172.21.15.55:0/1345262352 learned_addr learned my addr 172.21.15.55:0/1345262352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbdc85700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4db80b35d0 0x7f4db80c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.135+0000 7f4dbe486700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db80b2100 0x7f4db81496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbec87700 1 -- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db80b2100 msgr2=0x7f4db81496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbec87700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db80b2100 0x7f4db81496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbec87700 1 -- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4db80b35d0 msgr2=0x7f4db80c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbec87700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4db80b35d0 0x7f4db80c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbec87700 1 -- 172.21.15.55:0/1345262352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009a20 con 0x7f4db8159440 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbec87700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 0x7f4db80c3ec0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009fc0 tx=0x7f4db000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000cbd0 con 0x7f4db8159440 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000f040 con 0x7f4db8159440 2023-10-06T11:14:41.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db40094f0 con 0x7f4db8159440 2023-10-06T11:14:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0014480 con 0x7f4db8159440 2023-10-06T11:14:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.136+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db80c4ae0 con 0x7f4db8159440 2023-10-06T11:14:41.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.137+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db805f230 con 0x7f4db8159440 2023-10-06T11:14:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.137+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4db0003020 con 0x7f4db8159440 2023-10-06T11:14:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.138+0000 7f4dae7fc700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d9c066f30 0x7f4d9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.138+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4db0084ee0 con 0x7f4db8159440 2023-10-06T11:14:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.138+0000 7f4dbe486700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d9c066f30 0x7f4d9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.138+0000 7f4dbe486700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d9c066f30 0x7f4d9c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4db40099b0 tx=0x7f4db4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.142+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4db0052110 con 0x7f4db8159440 2023-10-06T11:14:41.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:41.353+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4db80b2ac0 con 0x7f4db8159440 2023-10-06T11:14:42.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.132+0000 7f4dae7fc700 1 -- 172.21.15.55:0/1345262352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4db0055730 con 0x7f4db8159440 2023-10-06T11:14:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d9c066f30 msgr2=0x7f4d9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d9c066f30 0x7f4d9c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4db40099b0 tx=0x7f4db4017000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 msgr2=0x7f4db80c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 0x7f4db80c3ec0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009fc0 tx=0x7f4db000b040 comp rx=0 tx=0).stop 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 shutdown_connections 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d9c066f30 0x7f4d9c0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4db8159440 0x7f4db80c3ec0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4db80b2100 0x7f4db81496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 --2- 172.21.15.55:0/1345262352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4db80b35d0 0x7f4db80c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.134+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 >> 172.21.15.55:0/1345262352 conn(0x7f4db806ece0 msgr2=0x7f4db80b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.135+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 shutdown_connections 2023-10-06T11:14:42.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.135+0000 7f4dbf488700 1 -- 172.21.15.55:0/1345262352 wait complete. 2023-10-06T11:14:42.138 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-10-06T11:14:42.151 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:14:42.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.275+0000 7f52661b5700 1 Processor -- start 2023-10-06T11:14:42.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.275+0000 7f52661b5700 1 -- start start 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f52661b5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52600b49a0 0x7f52600aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f52661b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f52600b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f52661b5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600b0c60 con 0x7f5260159560 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f52661b5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600b0f40 con 0x7f52600b49a0 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f52661b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600b1220 con 0x7f52600b0760 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52600b49a0 0x7f52600aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52600b49a0 0x7f52600aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60544/0 (socket says 172.21.15.55:60544) 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 -- 172.21.15.55:0/1178745769 learned_addr learned my addr 172.21.15.55:0/1178745769 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525ffff700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f52600b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 -- 172.21.15.55:0/1178745769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 msgr2=0x7f52600b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f52600b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 -- 172.21.15.55:0/1178745769 >> v1:172.21.15.142:6789/0 conn(0x7f5260159560 legacy=0x7f52600aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525effd700 1 -- 172.21.15.55:0/1178745769 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600b1500 con 0x7f52600b49a0 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.276+0000 7f525ffff700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f52600b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f525effd700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aac40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f52540099e0 tx=0x7f5254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a4e1c17933315 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f525e7fc700 1 -- 172.21.15.55:0/1178745769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400b7e0 con 0x7f52600b49a0 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f525e7fc700 1 -- 172.21.15.55:0/1178745769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525400b940 con 0x7f52600b49a0 2023-10-06T11:14:42.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f525e7fc700 1 -- 172.21.15.55:0/1178745769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400bce0 con 0x7f52600b49a0 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 -- 172.21.15.55:0/1178745769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 msgr2=0x7f52600aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aac40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f52540099e0 tx=0x7f5254009250 comp rx=0 tx=0).stop 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 -- 172.21.15.55:0/1178745769 shutdown_connections 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f52600b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 --2- 172.21.15.55:0/1178745769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aac40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 -- 172.21.15.55:0/1178745769 >> 172.21.15.55:0/1178745769 conn(0x7f52600997f0 msgr2=0x7f526006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 -- 172.21.15.55:0/1178745769 shutdown_connections 2023-10-06T11:14:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.277+0000 7f52661b5700 1 -- 172.21.15.55:0/1178745769 wait complete. 2023-10-06T11:14:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 Processor -- start 2023-10-06T11:14:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 -- start start 2023-10-06T11:14:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f5260157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260159560 0x7f52600b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526016e0c0 con 0x7f52600b49a0 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260158210 con 0x7f5260159560 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f52661b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526016d4b0 con 0x7f52600b0760 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f525effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f525effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60552/0 (socket says 172.21.15.55:60552) 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.279+0000 7f525effd700 1 -- 172.21.15.55:0/2132027575 learned_addr learned my addr 172.21.15.55:0/2132027575 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525ffff700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260159560 0x7f52600b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525effd700 1 -- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 msgr2=0x7f5260157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525f7fe700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f5260157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525effd700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f5260157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525effd700 1 -- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260159560 msgr2=0x7f52600b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525effd700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260159560 0x7f52600b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525effd700 1 -- 172.21.15.55:0/2132027575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540094f0 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525ffff700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260159560 0x7f52600b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525f7fe700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f5260157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f525effd700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aa740 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5260067c20 tx=0x7f5254016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254011d90 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254020070 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526016d790 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525401b6a0 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.280+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526016dd50 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.281+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5260064a90 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.282+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5254022030 con 0x7f52600b49a0 2023-10-06T11:14:42.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.282+0000 7f52477fe700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f524c066f30 0x7f524c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.282+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5254086390 con 0x7f52600b49a0 2023-10-06T11:14:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.282+0000 7f525f7fe700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f524c066f30 0x7f524c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.283+0000 7f525f7fe700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f524c066f30 0x7f524c0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f525000a920 tx=0x7f5250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.286+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52540536b0 con 0x7f52600b49a0 2023-10-06T11:14:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.555+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5260064a90 con 0x7f52600b49a0 2023-10-06T11:14:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.556+0000 7f52477fe700 1 -- 172.21.15.55:0/2132027575 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5254056cd0 con 0x7f52600b49a0 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ==", 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.558 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg==", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:42.559 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q==", 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.560 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag==", 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-10-06T11:14:42.561 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw==", 2023-10-06T11:14:42.562 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.562 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.562 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.562 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.562 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw==", 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.563 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA==", 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-10-06T11:14:42.564 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA==", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ==", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.565 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug==", 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.566 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw==", 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.567 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg==", 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.568 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w==", 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.569 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg==", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ==", 2023-10-06T11:14:42.570 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA==", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:14:42.571 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9loAeQDxAAHRWvLBSoBR/HeRdtrvbGCw==", 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.572 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA==", 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.573 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g==", 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:42.574 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:14:42.575 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:14:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f524c066f30 msgr2=0x7f524c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f524c066f30 0x7f524c0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f525000a920 tx=0x7f5250008040 comp rx=0 tx=0).stop 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 msgr2=0x7f52600aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aa740 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5260067c20 tx=0x7f5254016000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 shutdown_connections 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f524c066f30 0x7f524c0693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260159560 0x7f52600b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600b0760 0x7f5260157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 --2- 172.21.15.55:0/2132027575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52600b49a0 0x7f52600aa740 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 >> 172.21.15.55:0/2132027575 conn(0x7f52600997f0 msgr2=0x7f5260069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 shutdown_connections 2023-10-06T11:14:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.558+0000 7f52661b5700 1 -- 172.21.15.55:0/2132027575 wait complete. 2023-10-06T11:14:42.578 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:42.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.695+0000 7f80a65b1700 1 Processor -- start 2023-10-06T11:14:42.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.695+0000 7f80a65b1700 1 -- start start 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a65b1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80a006f310 0x7f80a00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a65b1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a01598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a65b1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a0159df0 con 0x7f80a00cb5a0 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a65b1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a006ebc0 con 0x7f80a006f310 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a65b1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a006e040 con 0x7f80a0159450 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a55af700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f80a00cb5a0 0x7f80a006d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33874/0 (socket says 172.21.15.55:33874) 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a55af700 1 -- 172.21.15.55:0/2274087240 learned_addr learned my addr 172.21.15.55:0/2274087240 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a4dae700 1 --2- 172.21.15.55:0/2274087240 >> v2:172.21.15.142:3300/0 conn(0x7f80a006f310 0x7f80a00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f80a5db0700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a01598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.696+0000 7f809ffff700 1 -- 172.21.15.55:0/2274087240 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674310067 0 0) 0x7f8098001490 con 0x7f80a00cb5a0 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f809ffff700 1 -- 172.21.15.55:0/2274087240 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8088003570 con 0x7f80a00cb5a0 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f809ffff700 1 -- 172.21.15.55:0/2274087240 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2493793641 0 0) 0x7f8088003570 con 0x7f80a00cb5a0 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f80a4dae700 1 -- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 msgr2=0x7f80a01598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f80a4dae700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a01598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f80a4dae700 1 -- 172.21.15.55:0/2274087240 >> v1:172.21.15.55:6789/0 conn(0x7f80a00cb5a0 legacy=0x7f80a006d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f80a4dae700 1 -- 172.21.15.55:0/2274087240 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a006e320 con 0x7f80a006f310 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f80a5db0700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a01598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f80a4dae700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a006f310 0x7f80a00cb970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80940098e0 tx=0x7f80940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d64e5e680d1c4b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f809ffff700 1 -- 172.21.15.55:0/2274087240 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098001980 con 0x7f80a006f310 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f809ffff700 1 -- 172.21.15.55:0/2274087240 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094011420 con 0x7f80a006f310 2023-10-06T11:14:42.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.697+0000 7f809ffff700 1 -- 172.21.15.55:0/2274087240 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940117c0 con 0x7f80a006f310 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 -- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a006f310 msgr2=0x7f80a00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a006f310 0x7f80a00cb970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f80940098e0 tx=0x7f80940091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 -- 172.21.15.55:0/2274087240 shutdown_connections 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a01598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2274087240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a006f310 0x7f80a00cb970 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 -- 172.21.15.55:0/2274087240 >> 172.21.15.55:0/2274087240 conn(0x7f80a0068080 msgr2=0x7f80a00cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 -- 172.21.15.55:0/2274087240 shutdown_connections 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.698+0000 7f80a65b1700 1 -- 172.21.15.55:0/2274087240 wait complete. 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.699+0000 7f80a65b1700 1 Processor -- start 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.699+0000 7f80a65b1700 1 -- start start 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a65b1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 0x7f80a0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a65b1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a016dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a65b1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a01437c0 0x7f80a016a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a65b1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0157410 con 0x7f80a00cb5a0 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a65b1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a016e240 con 0x7f80a01437c0 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a65b1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0169c90 con 0x7f80a0159450 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 0x7f80a0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 0x7f80a0156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60558/0 (socket says 172.21.15.55:60558) 2023-10-06T11:14:42.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 -- 172.21.15.55:0/2938091163 learned_addr learned my addr 172.21.15.55:0/2938091163 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a5db0700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a01437c0 0x7f80a016a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a4dae700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a016dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 -- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 msgr2=0x7f80a016dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a016dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 -- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a01437c0 msgr2=0x7f80a016a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a01437c0 0x7f80a016a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 -- 172.21.15.55:0/2938091163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090009420 con 0x7f80a00cb5a0 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a5db0700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a01437c0 0x7f80a016a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:42.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.700+0000 7f80a55af700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 0x7f80a0156ed0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f809800cd80 tx=0x7f8098007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.701+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098004dc0 con 0x7f80a00cb5a0 2023-10-06T11:14:42.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.701+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800a900 con 0x7f80a00cb5a0 2023-10-06T11:14:42.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.701+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8094009420 con 0x7f80a00cb5a0 2023-10-06T11:14:42.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.701+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800acc0 con 0x7f80a00cb5a0 2023-10-06T11:14:42.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.701+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0169f50 con 0x7f80a00cb5a0 2023-10-06T11:14:42.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.702+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a005f230 con 0x7f80a00cb5a0 2023-10-06T11:14:42.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.702+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8098007360 con 0x7f80a00cb5a0 2023-10-06T11:14:42.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.702+0000 7f809d7fa700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f808c066f30 0x7f808c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.702+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8098083e30 con 0x7f80a00cb5a0 2023-10-06T11:14:42.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.703+0000 7f80a4dae700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f808c066f30 0x7f808c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.704+0000 7f80a4dae700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f808c066f30 0x7f808c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f80a00c5fe0 tx=0x7f8094016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.707+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f809804c5a0 con 0x7f80a00cb5a0 2023-10-06T11:14:42.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.899+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80a0159df0 con 0x7f80a00cb5a0 2023-10-06T11:14:42.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.900+0000 7f809d7fa700 1 -- 172.21.15.55:0/2938091163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13855 (secure 0 0 0) 0x7f80a0159df0 con 0x7f80a00cb5a0 2023-10-06T11:14:42.902 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:42.902 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:42.129461+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f808c066f30 msgr2=0x7f808c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f808c066f30 0x7f808c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f80a00c5fe0 tx=0x7f8094016000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 msgr2=0x7f80a0156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 0x7f80a0156ed0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f809800cd80 tx=0x7f8098007c70 comp rx=0 tx=0).stop 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 shutdown_connections 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f808c066f30 0x7f808c0693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80a00cb5a0 0x7f80a0156ed0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80a01437c0 0x7f80a016a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 --2- 172.21.15.55:0/2938091163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80a0159450 0x7f80a016dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 >> 172.21.15.55:0/2938091163 conn(0x7f80a0068080 msgr2=0x7f80a0147930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 shutdown_connections 2023-10-06T11:14:42.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:42.902+0000 7f80a65b1700 1 -- 172.21.15.55:0/2938091163 wait complete. 2023-10-06T11:14:42.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:14:42.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:43.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.036+0000 7fc29c872700 1 Processor -- start 2023-10-06T11:14:43.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.036+0000 7fc29c872700 1 -- start start 2023-10-06T11:14:43.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc29c872700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc298159470 0x7fc2980ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc29c872700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc2980c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc29c872700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2980cbb80 con 0x7fc298159840 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc29c872700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2980c6f00 con 0x7fc298159470 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc29c872700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980cb530 con 0x7fc2980cd020 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc295d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc298159840 0x7fc2980c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33882/0 (socket says 172.21.15.55:33882) 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc295d9b700 1 -- 172.21.15.55:0/1166387158 learned_addr learned my addr 172.21.15.55:0/1166387158 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc29659c700 1 --2- 172.21.15.55:0/1166387158 >> v2:172.21.15.142:3300/0 conn(0x7fc298159470 0x7fc2980ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.037+0000 7fc296d9d700 1 --2- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc2980c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29559a700 1 -- 172.21.15.55:0/1166387158 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121068707 0 0) 0x7fc2980cbb80 con 0x7fc298159840 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29559a700 1 -- 172.21.15.55:0/1166387158 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc280003570 con 0x7fc298159840 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29659c700 1 -- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 msgr2=0x7fc2980c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:43.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29659c700 1 --2- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc2980c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29659c700 1 -- 172.21.15.55:0/1166387158 >> v1:172.21.15.55:6789/0 conn(0x7fc298159840 legacy=0x7fc2980c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29659c700 1 -- 172.21.15.55:0/1166387158 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980cb810 con 0x7fc298159470 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29659c700 1 --2- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc2980ce980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2880098d0 tx=0x7fc288009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c93e0724ed3387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29559a700 1 -- 172.21.15.55:0/1166387158 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288005c10 con 0x7fc298159470 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29559a700 1 -- 172.21.15.55:0/1166387158 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc288005d70 con 0x7fc298159470 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.038+0000 7fc29559a700 1 -- 172.21.15.55:0/1166387158 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288006260 con 0x7fc298159470 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 -- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 msgr2=0x7fc2980ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 --2- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc2980ce980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc2880098d0 tx=0x7fc288009120 comp rx=0 tx=0).stop 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 -- 172.21.15.55:0/1166387158 shutdown_connections 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 --2- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc2980c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 --2- 172.21.15.55:0/1166387158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc2980ce980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 -- 172.21.15.55:0/1166387158 >> 172.21.15.55:0/1166387158 conn(0x7fc2980996e0 msgr2=0x7fc29806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:43.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 -- 172.21.15.55:0/1166387158 shutdown_connections 2023-10-06T11:14:43.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.039+0000 7fc29c872700 1 -- 172.21.15.55:0/1166387158 wait complete. 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.040+0000 7fc29c872700 1 Processor -- start 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.040+0000 7fc29c872700 1 -- start start 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc29814de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc29815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 0x7fc29815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29815d130 con 0x7fc298159840 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc298157e30 con 0x7fc298159470 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc298157500 con 0x7fc2980cd020 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 0x7fc29815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 0x7fc29815da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60566/0 (socket says 172.21.15.55:60566) 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 -- 172.21.15.55:0/3225241149 learned_addr learned my addr 172.21.15.55:0/3225241149 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc295d9b700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc29815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29659c700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc29814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 -- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 msgr2=0x7fc29814de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc29814de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 -- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 msgr2=0x7fc29815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc29815d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 -- 172.21.15.55:0/3225241149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880093c0 con 0x7fc298159840 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc295d9b700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc29815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc296d9d700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 0x7fc29815da10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc290009e90 tx=0x7fc29000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000cc80 con 0x7fc298159840 2023-10-06T11:14:43.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000f040 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2981577e0 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290014480 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.041+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29814e3a0 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.042+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc298064a90 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.043+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc290014830 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.043+0000 7fc2867fc700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc278066f30 0x7fc2780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.043+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc290084fa0 con 0x7fc298159840 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.043+0000 7fc29659c700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc278066f30 0x7fc2780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.044+0000 7fc29659c700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc278066f30 0x7fc2780693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc288009160 tx=0x7fc288016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.047+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2900522c0 con 0x7fc298159840 2023-10-06T11:14:43.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.241+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2980cb1e0 con 0x7fc298159840 2023-10-06T11:14:43.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.241+0000 7fc2867fc700 1 -- 172.21.15.55:0/3225241149 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2900558e0 con 0x7fc298159840 2023-10-06T11:14:43.243 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:14:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc278066f30 msgr2=0x7fc2780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc278066f30 0x7fc2780693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc288009160 tx=0x7fc288016000 comp rx=0 tx=0).stop 2023-10-06T11:14:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 msgr2=0x7fc29815da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 0x7fc29815da10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc290009e90 tx=0x7fc29000b040 comp rx=0 tx=0).stop 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 shutdown_connections 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc278066f30 0x7fc2780693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc298159840 0x7fc29815da10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2980cd020 0x7fc29814de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 --2- 172.21.15.55:0/3225241149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc298159470 0x7fc29815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 >> 172.21.15.55:0/3225241149 conn(0x7fc2980996e0 msgr2=0x7fc298068b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 shutdown_connections 2023-10-06T11:14:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.243+0000 7fc29c872700 1 -- 172.21.15.55:0/3225241149 wait complete. 2023-10-06T11:14:43.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.377+0000 7fca7d6ab700 1 Processor -- start 2023-10-06T11:14:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.377+0000 7fca7d6ab700 1 -- start start 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca7d6ab700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca780b2620 0x7fca780cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca7d6ab700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cc970 con 0x7fca780b29f0 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca7d6ab700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cbd60 con 0x7fca780cf1b0 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca7d6ab700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780cc040 con 0x7fca780b2620 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca77fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca780b2620 0x7fca780cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca777fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca780b29f0 0x7fca780ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33892/0 (socket says 172.21.15.55:33892) 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca777fe700 1 -- 172.21.15.55:0/783648542 learned_addr learned my addr 172.21.15.55:0/783648542 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:43.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca77fff700 1 -- 172.21.15.55:0/783648542 >> v1:172.21.15.142:6789/0 conn(0x7fca780cf1b0 legacy=0x7fca780c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca77fff700 1 -- 172.21.15.55:0/783648542 >> v1:172.21.15.55:6789/0 conn(0x7fca780b29f0 legacy=0x7fca780ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.378+0000 7fca77fff700 1 -- 172.21.15.55:0/783648542 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780cc320 con 0x7fca780b2620 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca77fff700 1 --2- 172.21.15.55:0/783648542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780b2620 0x7fca780cccb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fca680098d0 tx=0x7fca68009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6cba611acf8c8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca76ffd700 1 -- 172.21.15.55:0/783648542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68009e70 con 0x7fca780b2620 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca76ffd700 1 -- 172.21.15.55:0/783648542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68005c10 con 0x7fca780b2620 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca76ffd700 1 -- 172.21.15.55:0/783648542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800b650 con 0x7fca780b2620 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 -- 172.21.15.55:0/783648542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780b2620 msgr2=0x7fca780cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/783648542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780b2620 0x7fca780cccb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fca680098d0 tx=0x7fca68009120 comp rx=0 tx=0).stop 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 -- 172.21.15.55:0/783648542 shutdown_connections 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/783648542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780b2620 0x7fca780cccb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 -- 172.21.15.55:0/783648542 >> 172.21.15.55:0/783648542 conn(0x7fca78099520 msgr2=0x7fca7806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 -- 172.21.15.55:0/783648542 shutdown_connections 2023-10-06T11:14:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.379+0000 7fca7d6ab700 1 -- 172.21.15.55:0/783648542 wait complete. 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.380+0000 7fca7d6ab700 1 Processor -- start 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 -- start start 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca780b2620 0x7fca7816cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca780b29f0 0x7fca78148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 0x7fca7816a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78169b00 con 0x7fca780cf1b0 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7816d840 con 0x7fca780b29f0 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7d6ab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7816db20 con 0x7fca780b2620 2023-10-06T11:14:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.381+0000 7fca7ceaa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 0x7fca7816a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 0x7fca7816a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60580/0 (socket says 172.21.15.55:60580) 2023-10-06T11:14:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 -- 172.21.15.55:0/2813144978 learned_addr learned my addr 172.21.15.55:0/2813144978 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca777fe700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca780b29f0 0x7fca78148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca77fff700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca780b2620 0x7fca7816cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 -- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca780b2620 msgr2=0x7fca7816cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca780b2620 0x7fca7816cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 -- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca780b29f0 msgr2=0x7fca78148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca780b29f0 0x7fca78148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 -- 172.21.15.55:0/2813144978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680093c0 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7ceaa700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 0x7fca7816a290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c8e0 tx=0x7fca70001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000ce80 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7000a7e0 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78169d70 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000ab80 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.382+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca78149180 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.383+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78169f60 con 0x7fca780cf1b0 2023-10-06T11:14:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.384+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca70012420 con 0x7fca780cf1b0 2023-10-06T11:14:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.384+0000 7fca5ffff700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.384+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fca70084770 con 0x7fca780cf1b0 2023-10-06T11:14:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.384+0000 7fca77fff700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.385+0000 7fca77fff700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca64066f30 0x7fca640693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca68009340 tx=0x7fca68016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.388+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca70051a90 con 0x7fca780cf1b0 2023-10-06T11:14:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.580+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fca7805f230 con 0x7fca780cf1b0 2023-10-06T11:14:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.580+0000 7fca5ffff700 1 -- 172.21.15.55:0/2813144978 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7fca700550b0 con 0x7fca780cf1b0 2023-10-06T11:14:43.582 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:14:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca64066f30 msgr2=0x7fca640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca64066f30 0x7fca640693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca68009340 tx=0x7fca68016000 comp rx=0 tx=0).stop 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 msgr2=0x7fca7816a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 0x7fca7816a290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c8e0 tx=0x7fca70001710 comp rx=0 tx=0).stop 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 shutdown_connections 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca780cf1b0 0x7fca7816a290 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca780b2620 0x7fca7816cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 --2- 172.21.15.55:0/2813144978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca780b29f0 0x7fca78148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.582+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 >> 172.21.15.55:0/2813144978 conn(0x7fca78099520 msgr2=0x7fca78158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.583+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 shutdown_connections 2023-10-06T11:14:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.583+0000 7fca7d6ab700 1 -- 172.21.15.55:0/2813144978 wait complete. 2023-10-06T11:14:43.596 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:14:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.714+0000 7fcfa9b59700 1 Processor -- start 2023-10-06T11:14:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.714+0000 7fcfa9b59700 1 -- start start 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa9b59700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfa4159560 0x7fcfa40aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa9b59700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa40b0c60 con 0x7fcfa40b0760 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa9b59700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa40b0f40 con 0x7fcfa40b49a0 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa9b59700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa40b1220 con 0x7fcfa4159560 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfa4159560 0x7fcfa40aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa3fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcfa40b0760 0x7fcfa40b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33896/0 (socket says 172.21.15.55:33896) 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa3fff700 1 -- 172.21.15.55:0/1530688214 learned_addr learned my addr 172.21.15.55:0/1530688214 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa37fe700 1 -- 172.21.15.55:0/1530688214 >> v1:172.21.15.142:6789/0 conn(0x7fcfa40b49a0 legacy=0x7fcfa40aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa37fe700 1 -- 172.21.15.55:0/1530688214 >> v1:172.21.15.55:6789/0 conn(0x7fcfa40b0760 legacy=0x7fcfa40b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa37fe700 1 -- 172.21.15.55:0/1530688214 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40b1500 con 0x7fcfa4159560 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa27fc700 1 -- 172.21.15.55:0/1530688214 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139590329 0 0) 0x7fcfa40b0c60 con 0x7fcfa40b0760 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa37fe700 1 --2- 172.21.15.55:0/1530688214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa4159560 0x7fcfa40aa530 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009900 tx=0x7fcf94009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef9300b17a044d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa27fc700 1 -- 172.21.15.55:0/1530688214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94009ea0 con 0x7fcfa4159560 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa27fc700 1 -- 172.21.15.55:0/1530688214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94005c10 con 0x7fcfa4159560 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.715+0000 7fcfa27fc700 1 -- 172.21.15.55:0/1530688214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400b5d0 con 0x7fcfa4159560 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 -- 172.21.15.55:0/1530688214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa4159560 msgr2=0x7fcfa40aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/1530688214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa4159560 0x7fcfa40aa530 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009900 tx=0x7fcf94009120 comp rx=0 tx=0).stop 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 -- 172.21.15.55:0/1530688214 shutdown_connections 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/1530688214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa4159560 0x7fcfa40aa530 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 -- 172.21.15.55:0/1530688214 >> 172.21.15.55:0/1530688214 conn(0x7fcfa40997f0 msgr2=0x7fcfa406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:43.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 -- 172.21.15.55:0/1530688214 shutdown_connections 2023-10-06T11:14:43.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.716+0000 7fcfa9b59700 1 -- 172.21.15.55:0/1530688214 wait complete. 2023-10-06T11:14:43.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.717+0000 7fcfa9b59700 1 Processor -- start 2023-10-06T11:14:43.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.717+0000 7fcfa9b59700 1 -- start start 2023-10-06T11:14:43.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa9b59700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfa40b0760 0x7fcfa4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa9b59700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 0x7fcfa415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa9b59700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfa4159560 0x7fcfa415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa9b59700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40af900 con 0x7fcfa40b49a0 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa9b59700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40ae860 con 0x7fcfa4159560 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa9b59700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40aeb40 con 0x7fcfa40b0760 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 0x7fcfa415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 0x7fcfa415ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60598/0 (socket says 172.21.15.55:60598) 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 -- 172.21.15.55:0/3978844831 learned_addr learned my addr 172.21.15.55:0/3978844831 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa3fff700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfa4159560 0x7fcfa415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa37fe700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfa40b0760 0x7fcfa4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 -- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfa40b0760 msgr2=0x7fcfa4146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfa40b0760 0x7fcfa4146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 -- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfa4159560 msgr2=0x7fcfa415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.718+0000 7fcfa2ffd700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfa4159560 0x7fcfa415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcfa2ffd700 1 -- 172.21.15.55:0/3978844831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940093c0 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcfa37fe700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfa40b0760 0x7fcfa4146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcfa2ffd700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 0x7fcfa415ba80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800b5e0 tx=0x7fcf980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800f510 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9800f670 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800fa30 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa40aee20 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.719+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa40af3e0 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.720+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40af600 con 0x7fcfa40b49a0 2023-10-06T11:14:43.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.720+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf9801a400 con 0x7fcfa40b49a0 2023-10-06T11:14:43.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.721+0000 7fcf8b7fe700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcf90066f30 0x7fcf900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:43.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.721+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fcf98083ee0 con 0x7fcfa40b49a0 2023-10-06T11:14:43.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.721+0000 7fcfa37fe700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcf90066f30 0x7fcf900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:43.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.721+0000 7fcfa37fe700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcf90066f30 0x7fcf900693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcf940098d0 tx=0x7fcf94015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:43.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.725+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf98051280 con 0x7fcfa40b49a0 2023-10-06T11:14:43.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.920+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcfa4064a90 con 0x7fcfa40b49a0 2023-10-06T11:14:43.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.920+0000 7fcf8b7fe700 1 -- 172.21.15.55:0/3978844831 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+126 (secure 0 0 0) 0x7fcf980548a0 con 0x7fcfa40b49a0 2023-10-06T11:14:43.922 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:43.922 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:14:43.922 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:43.922 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:14:43.923 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:14:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcf90066f30 msgr2=0x7fcf900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcf90066f30 0x7fcf900693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcf940098d0 tx=0x7fcf94015000 comp rx=0 tx=0).stop 2023-10-06T11:14:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 msgr2=0x7fcfa415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 0x7fcfa415ba80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800b5e0 tx=0x7fcf980091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 shutdown_connections 2023-10-06T11:14:43.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcf90066f30 0x7fcf900693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfa4159560 0x7fcfa415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfa40b0760 0x7fcfa4146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 --2- 172.21.15.55:0/3978844831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfa40b49a0 0x7fcfa415ba80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 >> 172.21.15.55:0/3978844831 conn(0x7fcfa40997f0 msgr2=0x7fcfa41588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 shutdown_connections 2023-10-06T11:14:43.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:43.922+0000 7fcfa9b59700 1 -- 172.21.15.55:0/3978844831 wait complete. 2023-10-06T11:14:43.936 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:14:43.936 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:14:44.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.058+0000 7fc00cc86700 1 Processor -- start 2023-10-06T11:14:44.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.059+0000 7fc00cc86700 1 -- start start 2023-10-06T11:14:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.059+0000 7fc00cc86700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 0x7fc0080b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.059+0000 7fc00cc86700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0080aede0 0x7fc0080af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.059+0000 7fc00cc86700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080b2ce0 con 0x7fc00806f0b0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00cc86700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00806fb40 con 0x7fc0080aede0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00cc86700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b0410 con 0x7fc00806ece0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc005d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc00806f0b0 0x7fc0080b08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33902/0 (socket says 172.21.15.55:33902) 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc005d9b700 1 -- 172.21.15.55:0/2423601897 learned_addr learned my addr 172.21.15.55:0/2423601897 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc006d9d700 1 --2- 172.21.15.55:0/2423601897 >> v2:172.21.15.142:3300/0 conn(0x7fc0080aede0 0x7fc0080af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968795409 0 0) 0x7fc0080b2ce0 con 0x7fc00806f0b0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00659c700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 0x7fc0080b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0003570 con 0x7fc00806f0b0 2023-10-06T11:14:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3679110447 0 0) 0x7fbff0003570 con 0x7fc00806f0b0 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 msgr2=0x7fc0080b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 0x7fc0080b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 >> v2:172.21.15.142:3300/0 conn(0x7fc0080aede0 msgr2=0x7fc0080af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 --2- 172.21.15.55:0/2423601897 >> v2:172.21.15.142:3300/0 conn(0x7fc0080aede0 0x7fc0080af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080af780 con 0x7fc00806f0b0 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fbffc001470 con 0x7fc00806f0b0 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 >> v1:172.21.15.55:6789/0 conn(0x7fc00806f0b0 legacy=0x7fc0080b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 0x7fbff0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fbff0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d50 0x7fbff00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b0410 con 0x7fbff0003fe0 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff000ba60 con 0x7fbff0004d50 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.060+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff000bbd0 con 0x7fc00806ece0 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fbff0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc00659c700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 0x7fbff0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc006d9d700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d50 0x7fbff00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 -- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 msgr2=0x7fbff0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc00806ece0 0x7fbff0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 -- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d50 msgr2=0x7fbff00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d50 0x7fbff00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 -- 172.21.15.55:0/2423601897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0003570 con 0x7fbff0003fe0 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc006d9d700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d50 0x7fbff00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc005d9b700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fbff0004810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c3c0 tx=0x7fbffc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1082b077a6147ba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00cc30 con 0x7fbff0003fe0 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00cdb0 con 0x7fbff0003fe0 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.061+0000 7fc00559a700 1 -- 172.21.15.55:0/2423601897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc005b70 con 0x7fbff0003fe0 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc00cc86700 1 -- 172.21.15.55:0/2423601897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 msgr2=0x7fbff0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc00cc86700 1 --2- 172.21.15.55:0/2423601897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fbff0004810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c3c0 tx=0x7fbffc001e90 comp rx=0 tx=0).stop 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc006d9d700 1 -- 172.21.15.55:0/2423601897 reap_dead start 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc00cc86700 1 -- 172.21.15.55:0/2423601897 shutdown_connections 2023-10-06T11:14:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc00cc86700 1 -- 172.21.15.55:0/2423601897 >> 172.21.15.55:0/2423601897 conn(0x7fc0080682f0 msgr2=0x7fc0080686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:44.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc00cc86700 1 -- 172.21.15.55:0/2423601897 shutdown_connections 2023-10-06T11:14:44.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.062+0000 7fc00cc86700 1 -- 172.21.15.55:0/2423601897 wait complete. 2023-10-06T11:14:44.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.063+0000 7fc00cc86700 1 Processor -- start 2023-10-06T11:14:44.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.063+0000 7fc00cc86700 1 -- start start 2023-10-06T11:14:44.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fc00815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008148780 0x7fc00815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00815af90 0x7fc0081576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00815edd0 con 0x7fbff0003fe0 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00815e400 con 0x7fc00815af90 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00815d7f0 con 0x7fc008148780 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fc00815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fc00815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60610/0 (socket says 172.21.15.55:60610) 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 -- 172.21.15.55:0/1549509965 learned_addr learned my addr 172.21.15.55:0/1549509965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc005d9b700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008148780 0x7fc00815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc006d9d700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00815af90 0x7fc0081576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 -- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008148780 msgr2=0x7fc00815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008148780 0x7fc00815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 -- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00815af90 msgr2=0x7fc0081576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00815af90 0x7fc0081576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 -- 172.21.15.55:0/1549509965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00815dad0 con 0x7fbff0003fe0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00659c700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fc00815e890 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbff8011d40 tx=0x7fbff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800f990 con 0x7fbff0003fe0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800faf0 con 0x7fbff0003fe0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00815ddb0 con 0x7fbff0003fe0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800fe70 con 0x7fbff0003fe0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.064+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00815d3a0 con 0x7fbff0003fe0 2023-10-06T11:14:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.065+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008064a90 con 0x7fbff0003fe0 2023-10-06T11:14:44.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.066+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbff8014650 con 0x7fbff0003fe0 2023-10-06T11:14:44.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.066+0000 7fbff67fc700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.066+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fbff8018030 con 0x7fbff0003fe0 2023-10-06T11:14:44.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.066+0000 7fc005d9b700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.067+0000 7fc005d9b700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbfe8066f30 0x7fbfe80693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbffc001ed0 tx=0x7fbffc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.070+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbff8052060 con 0x7fbff0003fe0 2023-10-06T11:14:44.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:44.264+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc00804bb40 con 0x7fbff0003fe0 2023-10-06T11:14:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.147+0000 7fbff67fc700 1 -- 172.21.15.55:0/1549509965 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbff80220b0 con 0x7fbff0003fe0 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbfe8066f30 msgr2=0x7fbfe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbfe8066f30 0x7fbfe80693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbffc001ed0 tx=0x7fbffc015000 comp rx=0 tx=0).stop 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 msgr2=0x7fc00815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fc00815e890 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbff8011d40 tx=0x7fbff80091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 shutdown_connections 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbfe8066f30 0x7fbfe80693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbff0003fe0 0x7fc00815e890 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc00815af90 0x7fc0081576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 --2- 172.21.15.55:0/1549509965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008148780 0x7fc00815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 >> 172.21.15.55:0/1549509965 conn(0x7fc0080682f0 msgr2=0x7fc0080cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.152+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 shutdown_connections 2023-10-06T11:14:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.153+0000 7fc00cc86700 1 -- 172.21.15.55:0/1549509965 wait complete. 2023-10-06T11:14:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:14:45.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:14:45.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.304+0000 7fad3c4df700 1 Processor -- start 2023-10-06T11:14:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.304+0000 7fad3c4df700 1 -- start start 2023-10-06T11:14:45.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad3c4df700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad341594d0 0x7fad340cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad3c4df700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad341598a0 0x7fad340cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad3c4df700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad340cf310 con 0x7fad340ce7e0 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad3c4df700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad340cf5d0 con 0x7fad341598a0 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad3c4df700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340cf8b0 con 0x7fad341594d0 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad341598a0 0x7fad340cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad341598a0 0x7fad340cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48146/0 (socket says 172.21.15.55:48146) 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 -- 172.21.15.55:0/3471851533 learned_addr learned my addr 172.21.15.55:0/3471851533 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad3a27b700 1 --2- 172.21.15.55:0/3471851533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad341594d0 0x7fad340cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 -- 172.21.15.55:0/3471851533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad341594d0 msgr2=0x7fad340cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 --2- 172.21.15.55:0/3471851533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad341594d0 0x7fad340cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 -- 172.21.15.55:0/3471851533 >> v1:172.21.15.142:6789/0 conn(0x7fad340ce7e0 legacy=0x7fad340cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.305+0000 7fad39a7a700 1 -- 172.21.15.55:0/3471851533 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340cfb90 con 0x7fad341598a0 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad39a7a700 1 --2- 172.21.15.55:0/3471851533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341598a0 0x7fad340cbaa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fad280099b0 tx=0x7fad28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cf607ca0534c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad39279700 1 -- 172.21.15.55:0/3471851533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28009ea0 con 0x7fad341598a0 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad39279700 1 -- 172.21.15.55:0/3471851533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2800b860 con 0x7fad341598a0 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad39279700 1 -- 172.21.15.55:0/3471851533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800bc00 con 0x7fad341598a0 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 -- 172.21.15.55:0/3471851533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341598a0 msgr2=0x7fad340cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 --2- 172.21.15.55:0/3471851533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341598a0 0x7fad340cbaa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fad280099b0 tx=0x7fad28009250 comp rx=0 tx=0).stop 2023-10-06T11:14:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 -- 172.21.15.55:0/3471851533 shutdown_connections 2023-10-06T11:14:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 --2- 172.21.15.55:0/3471851533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad341594d0 0x7fad340cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 --2- 172.21.15.55:0/3471851533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341598a0 0x7fad340cbaa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 -- 172.21.15.55:0/3471851533 >> 172.21.15.55:0/3471851533 conn(0x7fad34089e50 msgr2=0x7fad34099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 -- 172.21.15.55:0/3471851533 shutdown_connections 2023-10-06T11:14:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.306+0000 7fad3c4df700 1 -- 172.21.15.55:0/3471851533 wait complete. 2023-10-06T11:14:45.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.307+0000 7fad3c4df700 1 Processor -- start 2023-10-06T11:14:45.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.307+0000 7fad3c4df700 1 -- start start 2023-10-06T11:14:45.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3c4df700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad340ce7e0 0x7fad3415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3c4df700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 0x7fad34146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3c4df700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad341598a0 0x7fad340b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3c4df700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34158970 con 0x7fad341594d0 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3c4df700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340c8390 con 0x7fad341598a0 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3c4df700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340c8670 con 0x7fad340ce7e0 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad39a7a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 0x7fad34146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad39a7a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 0x7fad34146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48152/0 (socket says 172.21.15.55:48152) 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad39a7a700 1 -- 172.21.15.55:0/2016420726 learned_addr learned my addr 172.21.15.55:0/2016420726 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3aa7c700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad341598a0 0x7fad340b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.308+0000 7fad3a27b700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad340ce7e0 0x7fad3415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad39a7a700 1 -- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad340ce7e0 msgr2=0x7fad3415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad39a7a700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad340ce7e0 0x7fad3415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad39a7a700 1 -- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad341598a0 msgr2=0x7fad340b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad39a7a700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad341598a0 0x7fad340b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad39a7a700 1 -- 172.21.15.55:0/2016420726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280094f0 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad39a7a700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 0x7fad34146f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fad34067c20 tx=0x7fad28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800bbe0 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28011420 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad340c8950 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280117c0 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.309+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad340c8f10 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.310+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad340c9100 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.310+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad28011bf0 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.311+0000 7fad327fc700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad20066f30 0x7fad200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.311+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fad28085ee0 con 0x7fad341594d0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.311+0000 7fad3a27b700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad20066f30 0x7fad200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.312+0000 7fad3a27b700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad20066f30 0x7fad200693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fad24007680 tx=0x7fad2400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:45.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.315+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad28053090 con 0x7fad341594d0 2023-10-06T11:14:45.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:45.508+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fad34064ac0 con 0x7fad341594d0 2023-10-06T11:14:46.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.149+0000 7fad327fc700 1 -- 172.21.15.55:0/2016420726 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7fad280566b0 con 0x7fad341594d0 2023-10-06T11:14:46.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.154+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad20066f30 msgr2=0x7fad200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.154+0000 7fad3c4df700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad20066f30 0x7fad200693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fad24007680 tx=0x7fad2400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.154+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 msgr2=0x7fad34146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.154+0000 7fad3c4df700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 0x7fad34146f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fad34067c20 tx=0x7fad28017000 comp rx=0 tx=0).stop 2023-10-06T11:14:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.168+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 shutdown_connections 2023-10-06T11:14:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.168+0000 7fad3c4df700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad20066f30 0x7fad200693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.168+0000 7fad3c4df700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad341598a0 0x7fad340b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.168+0000 7fad3c4df700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad340ce7e0 0x7fad3415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.168+0000 7fad3c4df700 1 --2- 172.21.15.55:0/2016420726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad341594d0 0x7fad34146f00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.168+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 >> 172.21.15.55:0/2016420726 conn(0x7fad34089e50 msgr2=0x7fad340d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.169+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 shutdown_connections 2023-10-06T11:14:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.169+0000 7fad3c4df700 1 -- 172.21.15.55:0/2016420726 wait complete. 2023-10-06T11:14:46.172 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:14:46.185 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:14:46.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.307+0000 7fbef9d30700 1 Processor -- start 2023-10-06T11:14:46.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.307+0000 7fbef9d30700 1 -- start start 2023-10-06T11:14:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef9d30700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbef41594d0 0x7fbef40cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef9d30700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbef41598a0 0x7fbef40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef9d30700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ce7e0 0x7fbef40cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef9d30700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef40cf5d0 con 0x7fbef41598a0 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef9d30700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef40cf8b0 con 0x7fbef41594d0 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef9d30700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef40cfb90 con 0x7fbef40ce7e0 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef2ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbef41598a0 0x7fbef40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef2ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbef41598a0 0x7fbef40cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48156/0 (socket says 172.21.15.55:48156) 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.308+0000 7fbef2ffd700 1 -- 172.21.15.55:0/1389818644 learned_addr learned my addr 172.21.15.55:0/1389818644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef3fff700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ce7e0 0x7fbef40cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef37fe700 1 --2- 172.21.15.55:0/1389818644 >> v2:172.21.15.142:3300/0 conn(0x7fbef41594d0 0x7fbef40cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef2ffd700 1 -- 172.21.15.55:0/1389818644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ce7e0 msgr2=0x7fbef40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ce7e0 0x7fbef40cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef2ffd700 1 -- 172.21.15.55:0/1389818644 >> v2:172.21.15.142:3300/0 conn(0x7fbef41594d0 msgr2=0x7fbef40cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/1389818644 >> v2:172.21.15.142:3300/0 conn(0x7fbef41594d0 0x7fbef40cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef2ffd700 1 -- 172.21.15.55:0/1389818644 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40cfe70 con 0x7fbef41598a0 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef3fff700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ce7e0 0x7fbef40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef37fe700 1 --2- 172.21.15.55:0/1389818644 >> v2:172.21.15.142:3300/0 conn(0x7fbef41594d0 0x7fbef40cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef41598a0 0x7fbef40cbaa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbef4088f70 tx=0x7fbee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a6a721a7b68705 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef27fc700 1 -- 172.21.15.55:0/1389818644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800b860 con 0x7fbef41598a0 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef27fc700 1 -- 172.21.15.55:0/1389818644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800b9c0 con 0x7fbef41598a0 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef27fc700 1 -- 172.21.15.55:0/1389818644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800bd60 con 0x7fbef41598a0 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.309+0000 7fbef9d30700 1 -- 172.21.15.55:0/1389818644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef41598a0 msgr2=0x7fbef40cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef41598a0 0x7fbef40cbaa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbef4088f70 tx=0x7fbee8009250 comp rx=0 tx=0).stop 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 -- 172.21.15.55:0/1389818644 shutdown_connections 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef40ce7e0 0x7fbef40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 --2- 172.21.15.55:0/1389818644 >> v2:172.21.15.142:3300/0 conn(0x7fbef41594d0 0x7fbef40cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 --2- 172.21.15.55:0/1389818644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef41598a0 0x7fbef40cbaa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 -- 172.21.15.55:0/1389818644 >> 172.21.15.55:0/1389818644 conn(0x7fbef4089e50 msgr2=0x7fbef4099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 -- 172.21.15.55:0/1389818644 shutdown_connections 2023-10-06T11:14:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.310+0000 7fbef9d30700 1 -- 172.21.15.55:0/1389818644 wait complete. 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.311+0000 7fbef9d30700 1 Processor -- start 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.311+0000 7fbef9d30700 1 -- start start 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef9d30700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 0x7fbef414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef9d30700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef41594d0 0x7fbef4149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef9d30700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef41598a0 0x7fbef40d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef9d30700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef414e1b0 con 0x7fbef40ce7e0 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef9d30700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef41571d0 con 0x7fbef41598a0 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef9d30700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef41574b0 con 0x7fbef41594d0 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 0x7fbef414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 0x7fbef414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48172/0 (socket says 172.21.15.55:48172) 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 -- 172.21.15.55:0/4253361183 learned_addr learned my addr 172.21.15.55:0/4253361183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef41594d0 0x7fbef4149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef3fff700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef41598a0 0x7fbef40d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 -- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef41594d0 msgr2=0x7fbef4149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef41594d0 0x7fbef4149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 -- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef41598a0 msgr2=0x7fbef40d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef41598a0 0x7fbef40d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 -- 172.21.15.55:0/4253361183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80094f0 con 0x7fbef40ce7e0 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef41594d0 0x7fbef4149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef3fff700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef41598a0 0x7fbef40d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbef37fe700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 0x7fbef414ffb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbee400e850 tx=0x7fbee4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4013410 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.312+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4013570 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.313+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef4157790 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.313+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4013910 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.313+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef4157d50 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.314+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef41580c0 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.314+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbee4013d00 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.314+0000 7fbedb7fe700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbee0066f30 0x7fbee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.314+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fbee40845e0 con 0x7fbef40ce7e0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.315+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbee0066f30 0x7fbee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.315+0000 7fbef2ffd700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbee0066f30 0x7fbee00693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbef408a830 tx=0x7fbee8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.319+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbee4051570 con 0x7fbef40ce7e0 2023-10-06T11:14:46.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:46.559+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbef4064a90 con 0x7fbef40ce7e0 2023-10-06T11:14:47.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.170+0000 7fbedb7fe700 1 -- 172.21.15.55:0/4253361183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbee4054b90 con 0x7fbef40ce7e0 2023-10-06T11:14:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.175+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbee0066f30 msgr2=0x7fbee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.175+0000 7fbef9d30700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbee0066f30 0x7fbee00693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbef408a830 tx=0x7fbee8017000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.175+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 msgr2=0x7fbef414ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.175+0000 7fbef9d30700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 0x7fbef414ffb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbee400e850 tx=0x7fbee4008040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 shutdown_connections 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbee0066f30 0x7fbee00693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbef40ce7e0 0x7fbef414ffb0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbef41598a0 0x7fbef40d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 --2- 172.21.15.55:0/4253361183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbef41594d0 0x7fbef4149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 >> 172.21.15.55:0/4253361183 conn(0x7fbef4089e50 msgr2=0x7fbef40c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 shutdown_connections 2023-10-06T11:14:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.176+0000 7fbef9d30700 1 -- 172.21.15.55:0/4253361183 wait complete. 2023-10-06T11:14:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 8 and data pool 9 2023-10-06T11:14:47.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:47.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.309+0000 7f0adf078700 1 Processor -- start 2023-10-06T11:14:47.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.309+0000 7f0adf078700 1 -- start start 2023-10-06T11:14:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adf078700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ad80b49a0 0x7f0ad80aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adf078700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ad80b0760 0x7f0ad80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adf078700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad80b0c60 con 0x7f0ad8159560 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adf078700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80b0f40 con 0x7f0ad80b49a0 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adf078700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80b1220 con 0x7f0ad80b0760 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad7fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ad80b49a0 0x7f0ad80aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adce14700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0ad8159560 0x7f0ad80aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45732/0 (socket says 172.21.15.55:45732) 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad7fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ad80b49a0 0x7f0ad80aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48180/0 (socket says 172.21.15.55:48180) 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0adce14700 1 -- 172.21.15.55:0/1481141523 learned_addr learned my addr 172.21.15.55:0/1481141523 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0add615700 1 --2- 172.21.15.55:0/1481141523 >> v2:172.21.15.142:3300/0 conn(0x7f0ad80b0760 0x7f0ad80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad7fff700 1 -- 172.21.15.55:0/1481141523 >> v2:172.21.15.142:3300/0 conn(0x7f0ad80b0760 msgr2=0x7f0ad80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad7fff700 1 --2- 172.21.15.55:0/1481141523 >> v2:172.21.15.142:3300/0 conn(0x7f0ad80b0760 0x7f0ad80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad7fff700 1 -- 172.21.15.55:0/1481141523 >> v1:172.21.15.55:6789/0 conn(0x7f0ad8159560 legacy=0x7f0ad80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad7fff700 1 -- 172.21.15.55:0/1481141523 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80b1500 con 0x7f0ad80b49a0 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.310+0000 7f0ad77fe700 1 -- 172.21.15.55:0/1481141523 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349344439 0 0) 0x7f0ad80b0c60 con 0x7f0ad8159560 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0ad7fff700 1 --2- 172.21.15.55:0/1481141523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b49a0 0x7f0ad80aac40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009e60 tx=0x7f0ac8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354fa80cac05f4be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0ad77fe700 1 -- 172.21.15.55:0/1481141523 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800e070 con 0x7f0ad80b49a0 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0ad77fe700 1 -- 172.21.15.55:0/1481141523 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac800bbf0 con 0x7f0ad80b49a0 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0ad77fe700 1 -- 172.21.15.55:0/1481141523 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8012430 con 0x7f0ad80b49a0 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 -- 172.21.15.55:0/1481141523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b49a0 msgr2=0x7f0ad80aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 --2- 172.21.15.55:0/1481141523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b49a0 0x7f0ad80aac40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009e60 tx=0x7f0ac8009780 comp rx=0 tx=0).stop 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 -- 172.21.15.55:0/1481141523 shutdown_connections 2023-10-06T11:14:47.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 --2- 172.21.15.55:0/1481141523 >> v2:172.21.15.142:3300/0 conn(0x7f0ad80b0760 0x7f0ad80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 --2- 172.21.15.55:0/1481141523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b49a0 0x7f0ad80aac40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 -- 172.21.15.55:0/1481141523 >> 172.21.15.55:0/1481141523 conn(0x7f0ad80997f0 msgr2=0x7f0ad806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 -- 172.21.15.55:0/1481141523 shutdown_connections 2023-10-06T11:14:47.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.311+0000 7f0adf078700 1 -- 172.21.15.55:0/1481141523 wait complete. 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.312+0000 7f0adf078700 1 Processor -- start 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 -- start start 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 0x7f0ad80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80b49a0 0x7f0ad809be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad8159560 0x7f0ad809c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8157f50 con 0x7f0ad80b0760 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad809ca10 con 0x7f0ad8159560 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adf078700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad816d940 con 0x7f0ad80b49a0 2023-10-06T11:14:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adce14700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 0x7f0ad80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adce14700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 0x7f0ad80b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48192/0 (socket says 172.21.15.55:48192) 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0adce14700 1 -- 172.21.15.55:0/936391468 learned_addr learned my addr 172.21.15.55:0/936391468 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0ad7fff700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80b49a0 0x7f0ad809be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.313+0000 7f0add615700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad8159560 0x7f0ad809c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adce14700 1 -- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80b49a0 msgr2=0x7f0ad809be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adce14700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80b49a0 0x7f0ad809be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adce14700 1 -- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad8159560 msgr2=0x7f0ad809c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adce14700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad8159560 0x7f0ad809c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adce14700 1 -- 172.21.15.55:0/936391468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8009a20 con 0x7f0ad80b0760 2023-10-06T11:14:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adce14700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 0x7f0ad80b3480 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c5e0 tx=0x7f0ad0007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00072e0 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0007460 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad816ddd0 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00057f0 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.314+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad816d2f0 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.315+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad816dc20 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.315+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ad0005c00 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.316+0000 7f0ad4ff9700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.316+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0ad0083c50 con 0x7f0ad80b0760 2023-10-06T11:14:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.316+0000 7f0ad7fff700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.316+0000 7f0ad7fff700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ab8066f30 0x7f0ab80693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009e60 tx=0x7f0ac8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.320+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ad0089020 con 0x7f0ad80b0760 2023-10-06T11:14:47.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.515+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ad8064a90 con 0x7f0ad80b0760 2023-10-06T11:14:47.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.516+0000 7f0ad4ff9700 1 -- 172.21.15.55:0/936391468 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f0ad0017070 con 0x7f0ad80b0760 2023-10-06T11:14:47.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:47.519 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:46.560506+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:44.294407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:45.538885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:47.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ab8066f30 msgr2=0x7f0ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ab8066f30 0x7f0ab80693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009e60 tx=0x7f0ac8019000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 msgr2=0x7f0ad80b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 0x7f0ad80b3480 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c5e0 tx=0x7f0ad0007e80 comp rx=0 tx=0).stop 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 shutdown_connections 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ad80b0760 0x7f0ad80b3480 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad8159560 0x7f0ad809c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 --2- 172.21.15.55:0/936391468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80b49a0 0x7f0ad809be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 >> 172.21.15.55:0/936391468 conn(0x7f0ad80997f0 msgr2=0x7f0ad8069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 shutdown_connections 2023-10-06T11:14:47.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.518+0000 7f0adf078700 1 -- 172.21.15.55:0/936391468 wait complete. 2023-10-06T11:14:47.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:47.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 Processor -- start 2023-10-06T11:14:47.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 -- start start 2023-10-06T11:14:47.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68a00b49a0 0x7f68a00aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68a00b0760 0x7f68a00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00b0c60 con 0x7f68a0159560 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00b0f40 con 0x7f68a00b0760 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.650+0000 7f68a606b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00b1220 con 0x7f68a00b49a0 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68a00b0760 0x7f68a00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68a00b0760 0x7f68a00b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48198/0 (socket says 172.21.15.55:48198) 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 -- 172.21.15.55:0/81918038 learned_addr learned my addr 172.21.15.55:0/81918038 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689effd700 1 --2- 172.21.15.55:0/81918038 >> v2:172.21.15.142:3300/0 conn(0x7f68a00b49a0 0x7f68a00aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 -- 172.21.15.55:0/81918038 >> v2:172.21.15.142:3300/0 conn(0x7f68a00b49a0 msgr2=0x7f68a00aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 --2- 172.21.15.55:0/81918038 >> v2:172.21.15.142:3300/0 conn(0x7f68a00b49a0 0x7f68a00aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 -- 172.21.15.55:0/81918038 >> v1:172.21.15.142:6789/0 conn(0x7f68a0159560 legacy=0x7f68a00aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 -- 172.21.15.55:0/81918038 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00b1500 con 0x7f68a00b0760 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689effd700 1 --2- 172.21.15.55:0/81918038 >> v2:172.21.15.142:3300/0 conn(0x7f68a00b49a0 0x7f68a00aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689ffff700 1 --2- 172.21.15.55:0/81918038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b0760 0x7f68a00b1bc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68980099b0 tx=0x7f6898009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f963964f0cb7b1c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689e7fc700 1 -- 172.21.15.55:0/81918038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800b820 con 0x7f68a00b0760 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689e7fc700 1 -- 172.21.15.55:0/81918038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689800b980 con 0x7f68a00b0760 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.651+0000 7f689e7fc700 1 -- 172.21.15.55:0/81918038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800bd20 con 0x7f68a00b0760 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 -- 172.21.15.55:0/81918038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b0760 msgr2=0x7f68a00b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 --2- 172.21.15.55:0/81918038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b0760 0x7f68a00b1bc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68980099b0 tx=0x7f6898009250 comp rx=0 tx=0).stop 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 -- 172.21.15.55:0/81918038 shutdown_connections 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 --2- 172.21.15.55:0/81918038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b0760 0x7f68a00b1bc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 --2- 172.21.15.55:0/81918038 >> v2:172.21.15.142:3300/0 conn(0x7f68a00b49a0 0x7f68a00aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 -- 172.21.15.55:0/81918038 >> 172.21.15.55:0/81918038 conn(0x7f68a00997f0 msgr2=0x7f68a006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 -- 172.21.15.55:0/81918038 shutdown_connections 2023-10-06T11:14:47.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.652+0000 7f68a606b700 1 -- 172.21.15.55:0/81918038 wait complete. 2023-10-06T11:14:47.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.653+0000 7f68a606b700 1 Processor -- start 2023-10-06T11:14:47.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.653+0000 7f68a606b700 1 -- start start 2023-10-06T11:14:47.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f68a606b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68a00b0760 0x7f68a015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f68a606b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 0x7f68a015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f68a606b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68a0159560 0x7f68a0169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f68a606b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a016a440 con 0x7f68a00b49a0 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f68a606b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a009c2d0 con 0x7f68a00b0760 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f68a606b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a015cd80 con 0x7f68a0159560 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 0x7f68a015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 0x7f68a015c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48210/0 (socket says 172.21.15.55:48210) 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 -- 172.21.15.55:0/4167238743 learned_addr learned my addr 172.21.15.55:0/4167238743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689f7fe700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68a00b0760 0x7f68a015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689ffff700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68a0159560 0x7f68a0169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 -- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68a0159560 msgr2=0x7f68a0169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68a0159560 0x7f68a0169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 -- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68a00b0760 msgr2=0x7f68a015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68a00b0760 0x7f68a015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.654+0000 7f689effd700 1 -- 172.21.15.55:0/4167238743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68980094f0 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.655+0000 7f689effd700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 0x7f68a015c6a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f688800e8a0 tx=0x7f6888008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.655+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888013410 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.655+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888013570 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.655+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a009b9a0 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.655+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888013910 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.655+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a009bf60 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.656+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a009c440 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.656+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6888013cc0 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.656+0000 7f68977fe700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6880066f30 0x7f68800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.657+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f68880844d0 con 0x7f68a00b49a0 2023-10-06T11:14:47.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.657+0000 7f689f7fe700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6880066f30 0x7f68800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.657+0000 7f689f7fe700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6880066f30 0x7f68800693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f689000c580 tx=0x7f6890001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.661+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6888054f30 con 0x7f68a00b49a0 2023-10-06T11:14:47.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.857+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68a0064a90 con 0x7f68a00b49a0 2023-10-06T11:14:47.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.858+0000 7f68977fe700 1 -- 172.21.15.55:0/4167238743 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f6888054ac0 con 0x7f68a00b49a0 2023-10-06T11:14:47.860 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:47.860 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:46.560506+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:44.294407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:45.538885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6880066f30 msgr2=0x7f68800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6880066f30 0x7f68800693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f689000c580 tx=0x7f6890001a80 comp rx=0 tx=0).stop 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 msgr2=0x7f68a015c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 0x7f68a015c6a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f688800e8a0 tx=0x7f6888008040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 shutdown_connections 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6880066f30 0x7f68800693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68a0159560 0x7f68a0169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68a00b0760 0x7f68a015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 --2- 172.21.15.55:0/4167238743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68a00b49a0 0x7f68a015c6a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 >> 172.21.15.55:0/4167238743 conn(0x7f68a00997f0 msgr2=0x7f68a00cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 shutdown_connections 2023-10-06T11:14:47.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.860+0000 7f68a606b700 1 -- 172.21.15.55:0/4167238743 wait complete. 2023-10-06T11:14:47.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:14:47.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.996+0000 7ff483c75700 1 Processor -- start 2023-10-06T11:14:47.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.996+0000 7ff483c75700 1 -- start start 2023-10-06T11:14:48.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff483c75700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 0x7ff47c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff483c75700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff47c15d650 0x7ff47c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff483c75700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c069c60 con 0x7ff47c1539c0 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff483c75700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c15ab70 con 0x7ff47c15d650 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff483c75700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c15db90 con 0x7ff47c153d90 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff481a11700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff47c1539c0 0x7ff47c069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45742/0 (socket says 172.21.15.55:45742) 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff481a11700 1 -- 172.21.15.55:0/1557462136 learned_addr learned my addr 172.21.15.55:0/1557462136 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff482212700 1 --2- 172.21.15.55:0/1557462136 >> v2:172.21.15.142:3300/0 conn(0x7ff47c15d650 0x7ff47c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff481210700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 0x7ff47c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761396241 0 0) 0x7ff47c069c60 con 0x7ff47c1539c0 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.997+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff464003570 con 0x7ff47c1539c0 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217938639 0 0) 0x7ff464003570 con 0x7ff47c1539c0 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 msgr2=0x7ff47c15d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 0x7ff47c15d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 >> v2:172.21.15.142:3300/0 conn(0x7ff47c15d650 msgr2=0x7ff47c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 --2- 172.21.15.55:0/1557462136 >> v2:172.21.15.142:3300/0 conn(0x7ff47c15d650 0x7ff47c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c15de70 con 0x7ff47c1539c0 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7ff46c0017f0 con 0x7ff47c1539c0 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 >> v1:172.21.15.55:6789/0 conn(0x7ff47c1539c0 legacy=0x7ff47c069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 0x7ff464003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff464003fe0 0x7ff464004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c15db90 con 0x7ff464004d50 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400ba60 con 0x7ff464003fe0 2023-10-06T11:14:48.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400bbd0 con 0x7ff47c153d90 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 --2- 172.21.15.55:0/1557462136 >> v2:172.21.15.142:3300/0 conn(0x7ff47c15d650 0x7ff47c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff481a11700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 0x7ff464003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff481210700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff464003fe0 0x7ff464004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 -- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 msgr2=0x7ff464003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c153d90 0x7ff464003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 -- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff464003fe0 msgr2=0x7ff464004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff464003fe0 0x7ff464004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 -- 172.21.15.55:0/1557462136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464003570 con 0x7ff464004d50 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff481210700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff464003fe0 0x7ff464004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:48.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff482212700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff474009db0 tx=0x7ff4740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870e1b55c212fd4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.998+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474009740 con 0x7ff464004d50 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47400e8c0 con 0x7ff464004d50 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff480a0f700 1 -- 172.21.15.55:0/1557462136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400ec40 con 0x7ff464004d50 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff483c75700 1 -- 172.21.15.55:0/1557462136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 msgr2=0x7ff4640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff483c75700 1 --2- 172.21.15.55:0/1557462136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff4640051c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff474009db0 tx=0x7ff4740091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff482212700 1 -- 172.21.15.55:0/1557462136 reap_dead start 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff483c75700 1 -- 172.21.15.55:0/1557462136 shutdown_connections 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff483c75700 1 -- 172.21.15.55:0/1557462136 >> 172.21.15.55:0/1557462136 conn(0x7ff47c06b610 msgr2=0x7ff47c06ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff483c75700 1 -- 172.21.15.55:0/1557462136 shutdown_connections 2023-10-06T11:14:48.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:47.999+0000 7ff483c75700 1 -- 172.21.15.55:0/1557462136 wait complete. 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.000+0000 7ff483c75700 1 Processor -- start 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.000+0000 7ff483c75700 1 -- start start 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff483c75700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff47c16d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff483c75700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c169a30 0x7ff47c0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff483c75700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c169ea0 0x7ff47c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff483c75700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c16d470 con 0x7ff464004d50 2023-10-06T11:14:48.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff483c75700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c16a340 con 0x7ff47c169a30 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff483c75700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c16a620 con 0x7ff47c169ea0 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff47c16d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff47c16d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48220/0 (socket says 172.21.15.55:48220) 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 -- 172.21.15.55:0/1170835422 learned_addr learned my addr 172.21.15.55:0/1170835422 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481210700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c169a30 0x7ff47c0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff482212700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c169ea0 0x7ff47c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 -- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c169ea0 msgr2=0x7ff47c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c169ea0 0x7ff47c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 -- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c169a30 msgr2=0x7ff47c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c169a30 0x7ff47c0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481a11700 1 -- 172.21.15.55:0/1170835422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c16a900 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.001+0000 7ff481210700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c169a30 0x7ff47c0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.002+0000 7ff481a11700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff47c16d900 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0020a0 tx=0x7ff46c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.002+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00ae00 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.002+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0133f0 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.002+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c16d100 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.002+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0137b0 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.002+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c16ab70 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.003+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c064a90 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.003+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff46c013ba0 con 0x7ff464004d50 2023-10-06T11:14:48.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.003+0000 7ff479ffb700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.004+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff46c085690 con 0x7ff464004d50 2023-10-06T11:14:48.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.004+0000 7ff481210700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.004+0000 7ff481210700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff468066f30 0x7ff4680693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff47c158cc0 tx=0x7ff470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.008+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff46c052660 con 0x7ff464004d50 2023-10-06T11:14:48.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:48.247+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff47c04bb40 con 0x7ff464004d50 2023-10-06T11:14:49.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.186+0000 7ff479ffb700 1 -- 172.21.15.55:0/1170835422 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff46c055c80 con 0x7ff464004d50 2023-10-06T11:14:49.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff468066f30 msgr2=0x7ff4680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff468066f30 0x7ff4680693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff47c158cc0 tx=0x7ff470008040 comp rx=0 tx=0).stop 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 msgr2=0x7ff47c16d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff47c16d900 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0020a0 tx=0x7ff46c002210 comp rx=0 tx=0).stop 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 shutdown_connections 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff468066f30 0x7ff4680693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff464004d50 0x7ff47c16d900 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff47c169ea0 0x7ff47c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 --2- 172.21.15.55:0/1170835422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c169a30 0x7ff47c0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 >> 172.21.15.55:0/1170835422 conn(0x7ff47c06b610 msgr2=0x7ff47c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 shutdown_connections 2023-10-06T11:14:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.190+0000 7ff483c75700 1 -- 172.21.15.55:0/1170835422 wait complete. 2023-10-06T11:14:49.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:14:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.333+0000 7f7e3d2ab700 1 Processor -- start 2023-10-06T11:14:49.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.333+0000 7f7e3d2ab700 1 -- start start 2023-10-06T11:14:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e3d2ab700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e380cd940 0x7f7e380cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e3d2ab700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e38159520 0x7f7e380cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e3d2ab700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380cbab0 con 0x7f7e38159150 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e3d2ab700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3815cd50 con 0x7f7e38159520 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e3d2ab700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3815b8b0 con 0x7f7e380cd940 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e377fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e38159520 0x7f7e380cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e36ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e38159150 0x7f7e380cb3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45748/0 (socket says 172.21.15.55:45748) 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e36ffd700 1 -- 172.21.15.55:0/2507562233 learned_addr learned my addr 172.21.15.55:0/2507562233 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e367fc700 1 --2- 172.21.15.55:0/2507562233 >> v2:172.21.15.142:3300/0 conn(0x7f7e380cd940 0x7f7e380cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e377fe700 1 -- 172.21.15.55:0/2507562233 >> v2:172.21.15.142:3300/0 conn(0x7f7e380cd940 msgr2=0x7f7e380cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e377fe700 1 --2- 172.21.15.55:0/2507562233 >> v2:172.21.15.142:3300/0 conn(0x7f7e380cd940 0x7f7e380cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e377fe700 1 -- 172.21.15.55:0/2507562233 >> v1:172.21.15.55:6789/0 conn(0x7f7e38159150 legacy=0x7f7e380cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e35ffb700 1 -- 172.21.15.55:0/2507562233 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764909011 0 0) 0x7f7e28001490 con 0x7f7e38159150 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.334+0000 7f7e377fe700 1 -- 172.21.15.55:0/2507562233 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3815aca0 con 0x7f7e38159520 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e367fc700 1 --2- 172.21.15.55:0/2507562233 >> v2:172.21.15.142:3300/0 conn(0x7f7e380cd940 0x7f7e380cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e377fe700 1 --2- 172.21.15.55:0/2507562233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380cd200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009910 tx=0x7f7e300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d5d5674a03f957 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e35ffb700 1 -- 172.21.15.55:0/2507562233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000b7e0 con 0x7f7e38159520 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e35ffb700 1 -- 172.21.15.55:0/2507562233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3000b940 con 0x7f7e38159520 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e35ffb700 1 -- 172.21.15.55:0/2507562233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000bce0 con 0x7f7e38159520 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/2507562233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 msgr2=0x7f7e380cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/2507562233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380cd200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009910 tx=0x7f7e300091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/2507562233 shutdown_connections 2023-10-06T11:14:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/2507562233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380cd200 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/2507562233 >> v2:172.21.15.142:3300/0 conn(0x7f7e380cd940 0x7f7e380cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/2507562233 >> 172.21.15.55:0/2507562233 conn(0x7f7e3806ece0 msgr2=0x7f7e3806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/2507562233 shutdown_connections 2023-10-06T11:14:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.335+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/2507562233 wait complete. 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 Processor -- start 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 -- start start 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e380cd940 0x7f7e38145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e38159150 0x7f7e380b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c7390 con 0x7f7e38159520 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c7670 con 0x7f7e38159150 2023-10-06T11:14:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.337+0000 7f7e3d2ab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381584c0 con 0x7f7e380cd940 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48238/0 (socket says 172.21.15.55:48238) 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 -- 172.21.15.55:0/3700642651 learned_addr learned my addr 172.21.15.55:0/3700642651 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e367fc700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e38159150 0x7f7e380b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e36ffd700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e380cd940 0x7f7e38145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 -- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e380cd940 msgr2=0x7f7e38145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e380cd940 0x7f7e38145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 -- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e38159150 msgr2=0x7f7e380b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e38159150 0x7f7e380b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 -- 172.21.15.55:0/3700642651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009420 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e367fc700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e38159150 0x7f7e380b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e377fe700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380b5220 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7e38067a00 tx=0x7f7e30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3001a630 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3001a790 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380b5850 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3001ab50 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.338+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e380b5e10 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.339+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3805f230 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.340+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e3002e430 con 0x7f7e38159520 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.340+0000 7f7e2effd700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e18066f30 0x7f7e180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.340+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7e30086440 con 0x7f7e38159520 2023-10-06T11:14:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.340+0000 7f7e36ffd700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e18066f30 0x7f7e180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.341+0000 7f7e36ffd700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e18066f30 0x7f7e180693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e380afa60 tx=0x7f7e28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.344+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e30053410 con 0x7f7e38159520 2023-10-06T11:14:49.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:49.584+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7e380ce0f0 con 0x7f7e38159520 2023-10-06T11:14:50.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.184+0000 7f7e2effd700 1 -- 172.21.15.55:0/3700642651 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e30056a30 con 0x7f7e38159520 2023-10-06T11:14:50.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e18066f30 msgr2=0x7f7e180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e18066f30 0x7f7e180693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e380afa60 tx=0x7f7e28009040 comp rx=0 tx=0).stop 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 msgr2=0x7f7e380b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380b5220 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7e38067a00 tx=0x7f7e30017000 comp rx=0 tx=0).stop 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 shutdown_connections 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e18066f30 0x7f7e180693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e38159520 0x7f7e380b5220 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e380cd940 0x7f7e38145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 --2- 172.21.15.55:0/3700642651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e38159150 0x7f7e380b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 >> 172.21.15.55:0/3700642651 conn(0x7f7e3806ece0 msgr2=0x7f7e38068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 shutdown_connections 2023-10-06T11:14:50.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.186+0000 7f7e3d2ab700 1 -- 172.21.15.55:0/3700642651 wait complete. 2023-10-06T11:14:50.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:50.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.327+0000 7fba18ef6700 1 Processor -- start 2023-10-06T11:14:50.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.327+0000 7fba18ef6700 1 -- start start 2023-10-06T11:14:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba18ef6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba140ad210 0x7fba140cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba18ef6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140cecf0 con 0x7fba1415db10 2023-10-06T11:14:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba18ef6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140cefd0 con 0x7fba140ad5e0 2023-10-06T11:14:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba18ef6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140cca90 con 0x7fba140ad210 2023-10-06T11:14:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba1259c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba140ad210 0x7fba140cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba12d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fba1415db10 0x7fba140ca0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45754/0 (socket says 172.21.15.55:45754) 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba12d9d700 1 -- 172.21.15.55:0/3090205021 learned_addr learned my addr 172.21.15.55:0/3090205021 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba1259c700 1 -- 172.21.15.55:0/3090205021 >> v1:172.21.15.142:6789/0 conn(0x7fba140ad5e0 legacy=0x7fba1415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba1259c700 1 -- 172.21.15.55:0/3090205021 >> v1:172.21.15.55:6789/0 conn(0x7fba1415db10 legacy=0x7fba140ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba1259c700 1 -- 172.21.15.55:0/3090205021 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140ccd70 con 0x7fba140ad210 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba1159a700 1 -- 172.21.15.55:0/3090205021 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888454219 0 0) 0x7fba140cecf0 con 0x7fba1415db10 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.328+0000 7fba1259c700 1 --2- 172.21.15.55:0/3090205021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba140ad210 0x7fba140cd290 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba04009eb0 tx=0x7fba04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4a0bfbef89cc97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba1159a700 1 -- 172.21.15.55:0/3090205021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400e070 con 0x7fba140ad210 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba1159a700 1 -- 172.21.15.55:0/3090205021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0400bc50 con 0x7fba140ad210 2023-10-06T11:14:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba1159a700 1 -- 172.21.15.55:0/3090205021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04012430 con 0x7fba140ad210 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 -- 172.21.15.55:0/3090205021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba140ad210 msgr2=0x7fba140cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 --2- 172.21.15.55:0/3090205021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba140ad210 0x7fba140cd290 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fba04009eb0 tx=0x7fba04009780 comp rx=0 tx=0).stop 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 -- 172.21.15.55:0/3090205021 shutdown_connections 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 --2- 172.21.15.55:0/3090205021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba140ad210 0x7fba140cd290 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 -- 172.21.15.55:0/3090205021 >> 172.21.15.55:0/3090205021 conn(0x7fba14067d90 msgr2=0x7fba140ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 -- 172.21.15.55:0/3090205021 shutdown_connections 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.329+0000 7fba18ef6700 1 -- 172.21.15.55:0/3090205021 wait complete. 2023-10-06T11:14:50.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.330+0000 7fba18ef6700 1 Processor -- start 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.330+0000 7fba18ef6700 1 -- start start 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba18ef6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140ad210 0x7fba140c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba18ef6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140ad5e0 0x7fba14145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba18ef6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 0x7fba1416e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba18ef6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c3680 con 0x7fba1415db10 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba18ef6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c44c0 con 0x7fba140ad210 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba18ef6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140c38b0 con 0x7fba140ad5e0 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 0x7fba1416e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 0x7fba1416e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48256/0 (socket says 172.21.15.55:48256) 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 -- 172.21.15.55:0/2116047070 learned_addr learned my addr 172.21.15.55:0/2116047070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba1259c700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140ad210 0x7fba140c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba11d9b700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140ad5e0 0x7fba14145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 -- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140ad5e0 msgr2=0x7fba14145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140ad5e0 0x7fba14145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 -- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140ad210 msgr2=0x7fba140c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140ad210 0x7fba140c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba12d9d700 1 -- 172.21.15.55:0/2116047070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04009a20 con 0x7fba1415db10 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.331+0000 7fba1259c700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140ad210 0x7fba140c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.332+0000 7fba12d9d700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 0x7fba1416e140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c4e0 tx=0x7fba0c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.332+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c005b30 con 0x7fba1415db10 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.332+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c005c90 con 0x7fba1415db10 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.332+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba140c3b90 con 0x7fba1415db10 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.332+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c007320 con 0x7fba1415db10 2023-10-06T11:14:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.332+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba140c4150 con 0x7fba1415db10 2023-10-06T11:14:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.333+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14064a90 con 0x7fba1415db10 2023-10-06T11:14:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.333+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba0c01b3b0 con 0x7fba1415db10 2023-10-06T11:14:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.334+0000 7fba0a7fc700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f4066f30 0x7fb9f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.334+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fba0c083bb0 con 0x7fba1415db10 2023-10-06T11:14:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.334+0000 7fba1259c700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f4066f30 0x7fb9f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.334+0000 7fba1259c700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f4066f30 0x7fb9f40693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba040099f0 tx=0x7fba04016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.338+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba0c050b80 con 0x7fba1415db10 2023-10-06T11:14:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.577+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba140c4600 con 0x7fba1415db10 2023-10-06T11:14:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.578+0000 7fba0a7fc700 1 -- 172.21.15.55:0/2116047070 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fba0c017020 con 0x7fba1415db10 2023-10-06T11:14:50.580 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:50.580 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:46.560821+0000","modified":"2023-10-06T11:14:50.181274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/173974006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":173974006},{"type":"v1","addr":"172.21.15.55:6835","nonce":173974006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:14:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f4066f30 msgr2=0x7fb9f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f4066f30 0x7fb9f40693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba040099f0 tx=0x7fba04016000 comp rx=0 tx=0).stop 2023-10-06T11:14:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 msgr2=0x7fba1416e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 0x7fba1416e140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c4e0 tx=0x7fba0c007f00 comp rx=0 tx=0).stop 2023-10-06T11:14:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 shutdown_connections 2023-10-06T11:14:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f4066f30 0x7fb9f40693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba1415db10 0x7fba1416e140 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba140ad210 0x7fba140c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 --2- 172.21.15.55:0/2116047070 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba140ad5e0 0x7fba14145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 >> 172.21.15.55:0/2116047070 conn(0x7fba14067d90 msgr2=0x7fba140cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 shutdown_connections 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.580+0000 7fba18ef6700 1 -- 172.21.15.55:0/2116047070 wait complete. 2023-10-06T11:14:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2023-10-06T11:14:50.594 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.711+0000 7f065359e700 1 Processor -- start 2023-10-06T11:14:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.711+0000 7f065359e700 1 -- start start 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f065359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06540cbc30 0x7f06540cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f065359e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540cb7a0 con 0x7f06540b2100 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f065359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540b0860 con 0x7f0654159440 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f065359e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540cb150 con 0x7f06540cbc30 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f0651d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06540cbc30 0x7f06540cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f0652d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f06540b2100 0x7f06540b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45764/0 (socket says 172.21.15.55:45764) 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f0652d9d700 1 -- 172.21.15.55:0/3784610264 learned_addr learned my addr 172.21.15.55:0/3784610264 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f0651d9b700 1 -- 172.21.15.55:0/3784610264 >> v1:172.21.15.142:6789/0 conn(0x7f0654159440 legacy=0x7f06540b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f0651d9b700 1 -- 172.21.15.55:0/3784610264 >> v1:172.21.15.55:6789/0 conn(0x7f06540b2100 legacy=0x7f06540b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f0651d9b700 1 -- 172.21.15.55:0/3784610264 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540cb430 con 0x7f06540cbc30 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.712+0000 7f065159a700 1 -- 172.21.15.55:0/3784610264 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967028807 0 0) 0x7f06540cb7a0 con 0x7f06540b2100 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f0651d9b700 1 --2- 172.21.15.55:0/3784610264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540cbc30 0x7f06540cc080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f06480098e0 tx=0x7f06480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aef5f6d4739c1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065159a700 1 -- 172.21.15.55:0/3784610264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648009e80 con 0x7f06540cbc30 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065159a700 1 -- 172.21.15.55:0/3784610264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800b860 con 0x7f06540cbc30 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065159a700 1 -- 172.21.15.55:0/3784610264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800bbe0 con 0x7f06540cbc30 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 -- 172.21.15.55:0/3784610264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540cbc30 msgr2=0x7f06540cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 --2- 172.21.15.55:0/3784610264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540cbc30 0x7f06540cc080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f06480098e0 tx=0x7f06480091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 -- 172.21.15.55:0/3784610264 shutdown_connections 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 --2- 172.21.15.55:0/3784610264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540cbc30 0x7f06540cc080 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 -- 172.21.15.55:0/3784610264 >> 172.21.15.55:0/3784610264 conn(0x7f065406ece0 msgr2=0x7f065406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 -- 172.21.15.55:0/3784610264 shutdown_connections 2023-10-06T11:14:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.713+0000 7f065359e700 1 -- 172.21.15.55:0/3784610264 wait complete. 2023-10-06T11:14:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.714+0000 7f065359e700 1 Processor -- start 2023-10-06T11:14:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.714+0000 7f065359e700 1 -- start start 2023-10-06T11:14:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 0x7f0654148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06540cbc30 0x7f06541559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654159440 0x7f06540c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0654148c90 con 0x7f06540b2100 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0654155f00 con 0x7f0654159440 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540cdf00 con 0x7f06540cbc30 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 0x7f0654148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 0x7f0654148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48282/0 (socket says 172.21.15.55:48282) 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 -- 172.21.15.55:0/1373989214 learned_addr learned my addr 172.21.15.55:0/1373989214 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f0651d9b700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06540cbc30 0x7f06541559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f0652d9d700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654159440 0x7f06540c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 -- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06540cbc30 msgr2=0x7f06541559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06540cbc30 0x7f06541559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 -- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654159440 msgr2=0x7f06540c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.715+0000 7f065259c700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654159440 0x7f06540c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f065259c700 1 -- 172.21.15.55:0/1373989214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0648009420 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f065259c700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 0x7f0654148750 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b5e0 tx=0x7f064c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00f510 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c00f670 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06540ce1e0 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00fa30 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.716+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0654155650 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.717+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06540ce420 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.717+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f064c01a400 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.717+0000 7f06427fc700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0634066f30 0x7f06340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.718+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f064c084350 con 0x7f06540b2100 2023-10-06T11:14:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.718+0000 7f0651d9b700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0634066f30 0x7f06340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.718+0000 7f0651d9b700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0634066f30 0x7f06340693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06480091e0 tx=0x7f0648016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.722+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06540ce420 con 0x7f06540b2100 2023-10-06T11:14:50.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.916+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06540c4d10 con 0x7f06540b2100 2023-10-06T11:14:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.917+0000 7f06427fc700 1 -- 172.21.15.55:0/1373989214 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f06540c4d10 con 0x7f06540b2100 2023-10-06T11:14:50.919 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:50.919 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":55,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:48.027215+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:44.294407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:45.538885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0634066f30 msgr2=0x7f06340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0634066f30 0x7f06340693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06480091e0 tx=0x7f0648016000 comp rx=0 tx=0).stop 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 msgr2=0x7f0654148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 0x7f0654148750 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b5e0 tx=0x7f064c009120 comp rx=0 tx=0).stop 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 shutdown_connections 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0634066f30 0x7f06340693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06540b2100 0x7f0654148750 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654159440 0x7f06540c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 --2- 172.21.15.55:0/1373989214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06540cbc30 0x7f06541559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 >> 172.21.15.55:0/1373989214 conn(0x7f065406ece0 msgr2=0x7f06540cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 shutdown_connections 2023-10-06T11:14:50.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:50.919+0000 7f065359e700 1 -- 172.21.15.55:0/1373989214 wait complete. 2023-10-06T11:14:50.933 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:14:50.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:14:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.051+0000 7f25080cf700 1 Processor -- start 2023-10-06T11:14:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.051+0000 7f25080cf700 1 -- start start 2023-10-06T11:14:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f25080cf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 0x7f25000691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f25080cf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25000696e0 0x7f2500159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f25080cf700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2500068d10 con 0x7f250015a010 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f25080cf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2500154020 con 0x7f25000696e0 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f25080cf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250015a450 con 0x7f25000cb5f0 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f250666c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f250015a010 0x7f25000ca670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45772/0 (socket says 172.21.15.55:45772) 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.052+0000 7f250666c700 1 -- 172.21.15.55:0/58574108 learned_addr learned my addr 172.21.15.55:0/58574108 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2505e6b700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 0x7f25000691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 --2- 172.21.15.55:0/58574108 >> v2:172.21.15.142:3300/0 conn(0x7f25000696e0 0x7f2500159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24083643 0 0) 0x7f2500068d10 con 0x7f250015a010 2023-10-06T11:14:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e8003570 con 0x7f250015a010 2023-10-06T11:14:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3452944103 0 0) 0x7f24e8003570 con 0x7f250015a010 2023-10-06T11:14:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 msgr2=0x7f25000691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 0x7f25000691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 >> v2:172.21.15.142:3300/0 conn(0x7f25000696e0 msgr2=0x7f2500159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 --2- 172.21.15.55:0/58574108 >> v2:172.21.15.142:3300/0 conn(0x7f25000696e0 0x7f2500159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250015a670 con 0x7f250015a010 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f24f0001470 con 0x7f250015a010 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 >> v1:172.21.15.55:6789/0 conn(0x7f250015a010 legacy=0x7f25000ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24e8003a60 0x7f24e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f24e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 0x7f24e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500154020 con 0x7f24e8004810 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250015a450 con 0x7f24e8003a60 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e800ba60 con 0x7f25000cb5f0 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f24e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2505e6b700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24e8003a60 0x7f24e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250666c700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 0x7f24e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 -- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 msgr2=0x7f24e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000cb5f0 0x7f24e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 -- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24e8003a60 msgr2=0x7f24e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24e8003a60 0x7f24e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f250566a700 1 -- 172.21.15.55:0/58574108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8003570 con 0x7f24e8004810 2023-10-06T11:14:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.053+0000 7f2505e6b700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24e8003a60 0x7f24e8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f250566a700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f24e8004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009c30 tx=0x7f24f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37b41dc9458383e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400e710 con 0x7f24e8004810 2023-10-06T11:14:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400e870 con 0x7f24e8004810 2023-10-06T11:14:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f2504e69700 1 -- 172.21.15.55:0/58574108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400ec30 con 0x7f24e8004810 2023-10-06T11:14:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f25080cf700 1 -- 172.21.15.55:0/58574108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 msgr2=0x7f24e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f25080cf700 1 --2- 172.21.15.55:0/58574108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f24e8004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009c30 tx=0x7f24f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f250666c700 1 -- 172.21.15.55:0/58574108 reap_dead start 2023-10-06T11:14:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f25080cf700 1 -- 172.21.15.55:0/58574108 shutdown_connections 2023-10-06T11:14:51.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.054+0000 7f25080cf700 1 -- 172.21.15.55:0/58574108 >> 172.21.15.55:0/58574108 conn(0x7f25000707d0 msgr2=0x7f2500070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.055+0000 7f25080cf700 1 -- 172.21.15.55:0/58574108 shutdown_connections 2023-10-06T11:14:51.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.055+0000 7f25080cf700 1 -- 172.21.15.55:0/58574108 wait complete. 2023-10-06T11:14:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 Processor -- start 2023-10-06T11:14:51.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 -- start start 2023-10-06T11:14:51.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f25000c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000c2d00 0x7f250016d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25000c3170 0x7f250016d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c4780 con 0x7f24e8004810 2023-10-06T11:14:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c36e0 con 0x7f25000c3170 2023-10-06T11:14:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f25080cf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c39c0 con 0x7f25000c2d00 2023-10-06T11:14:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f2505e6b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f25000c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f2505e6b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f25000c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48296/0 (socket says 172.21.15.55:48296) 2023-10-06T11:14:51.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.056+0000 7f2505e6b700 1 -- 172.21.15.55:0/4277833292 learned_addr learned my addr 172.21.15.55:0/4277833292 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f250666c700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25000c3170 0x7f250016d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f250566a700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000c2d00 0x7f250016d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f2505e6b700 1 -- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000c2d00 msgr2=0x7f250016d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f2505e6b700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000c2d00 0x7f250016d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f2505e6b700 1 -- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25000c3170 msgr2=0x7f250016d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f2505e6b700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25000c3170 0x7f250016d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f2505e6b700 1 -- 172.21.15.55:0/4277833292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000c3ca0 con 0x7f24e8004810 2023-10-06T11:14:51.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f2505e6b700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f25000c7a30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f24f8010570 tx=0x7f24f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800e050 con 0x7f24e8004810 2023-10-06T11:14:51.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800f040 con 0x7f24e8004810 2023-10-06T11:14:51.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000c3f80 con 0x7f24e8004810 2023-10-06T11:14:51.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8015880 con 0x7f24e8004810 2023-10-06T11:14:51.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.057+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250016df40 con 0x7f24e8004810 2023-10-06T11:14:51.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.058+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000c45d0 con 0x7f24e8004810 2023-10-06T11:14:51.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.059+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24f8003020 con 0x7f24e8004810 2023-10-06T11:14:51.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.059+0000 7f24fdffb700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.059+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f24f80853a0 con 0x7f24e8004810 2023-10-06T11:14:51.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.059+0000 7f250566a700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.060+0000 7f250566a700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24ec066f30 0x7f24ec0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25000ce990 tx=0x7f24f401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.063+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24f8052370 con 0x7f24e8004810 2023-10-06T11:14:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.255+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25000caec0 con 0x7f24ec066f30 2023-10-06T11:14:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.264+0000 7f24fdffb700 1 -- 172.21.15.55:0/4277833292 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311255 (secure 0 0 0) 0x7f25000caec0 con 0x7f24ec066f30 2023-10-06T11:14:51.269 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24ec066f30 msgr2=0x7f24ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24ec066f30 0x7f24ec0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25000ce990 tx=0x7f24f401a000 comp rx=0 tx=0).stop 2023-10-06T11:14:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 msgr2=0x7f25000c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f25000c7a30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f24f8010570 tx=0x7f24f800b040 comp rx=0 tx=0).stop 2023-10-06T11:14:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 shutdown_connections 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24e8004810 0x7f25000c7a30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25000c3170 0x7f250016d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 --2- 172.21.15.55:0/4277833292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25000c2d00 0x7f250016d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 >> 172.21.15.55:0/4277833292 conn(0x7f25000707d0 msgr2=0x7f25000cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 shutdown_connections 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.267+0000 7f25080cf700 1 -- 172.21.15.55:0/4277833292 wait complete. 2023-10-06T11:14:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:14:51.282 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-06T11:14:50.864512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384636,"kb_used_data":6332,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590084,"statfs":{"total":773094113280,"available":770652246016,"internally_reserved":0,"allocated":6483968,"data_stored":3571923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.718954"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041584+0000","last_change":"2023-10-06T11:14:47.038975+0000","last_active":"2023-10-06T11:14:47.041584+0000","last_peered":"2023-10-06T11:14:47.041584+0000","last_clean":"2023-10-06T11:14:47.041584+0000","last_became_active":"2023-10-06T11:14:47.038691+0000","last_became_peered":"2023-10-06T11:14:47.038691+0000","last_unstale":"2023-10-06T11:14:47.041584+0000","last_undegraded":"2023-10-06T11:14:47.041584+0000","last_fullsized":"2023-10-06T11:14:47.041584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:24.561257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055146+0000","last_change":"2023-10-06T11:14:47.052182+0000","last_active":"2023-10-06T11:14:47.055146+0000","last_peered":"2023-10-06T11:14:47.055146+0000","last_clean":"2023-10-06T11:14:47.055146+0000","last_became_active":"2023-10-06T11:14:47.051832+0000","last_became_peered":"2023-10-06T11:14:47.051832+0000","last_unstale":"2023-10-06T11:14:47.055146+0000","last_undegraded":"2023-10-06T11:14:47.055146+0000","last_fullsized":"2023-10-06T11:14:47.055146+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:21.803331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051545+0000","last_change":"2023-10-06T11:14:47.047566+0000","last_active":"2023-10-06T11:14:47.051545+0000","last_peered":"2023-10-06T11:14:47.051545+0000","last_clean":"2023-10-06T11:14:47.051545+0000","last_became_active":"2023-10-06T11:14:47.047251+0000","last_became_peered":"2023-10-06T11:14:47.047251+0000","last_unstale":"2023-10-06T11:14:47.051545+0000","last_undegraded":"2023-10-06T11:14:47.051545+0000","last_fullsized":"2023-10-06T11:14:47.051545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:57.097421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048611+0000","last_change":"2023-10-06T11:14:47.044664+0000","last_active":"2023-10-06T11:14:47.048611+0000","last_peered":"2023-10-06T11:14:47.048611+0000","last_clean":"2023-10-06T11:14:47.048611+0000","last_became_active":"2023-10-06T11:14:47.044199+0000","last_became_peered":"2023-10-06T11:14:47.044199+0000","last_unstale":"2023-10-06T11:14:47.048611+0000","last_undegraded":"2023-10-06T11:14:47.048611+0000","last_fullsized":"2023-10-06T11:14:47.048611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:55.843131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041411+0000","last_change":"2023-10-06T11:14:47.037534+0000","last_active":"2023-10-06T11:14:47.041411+0000","last_peered":"2023-10-06T11:14:47.041411+0000","last_clean":"2023-10-06T11:14:47.041411+0000","last_became_active":"2023-10-06T11:14:47.037330+0000","last_became_peered":"2023-10-06T11:14:47.037330+0000","last_unstale":"2023-10-06T11:14:47.041411+0000","last_undegraded":"2023-10-06T11:14:47.041411+0000","last_fullsized":"2023-10-06T11:14:47.041411+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:24:59.806562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049615+0000","last_change":"2023-10-06T11:14:47.043447+0000","last_active":"2023-10-06T11:14:47.049615+0000","last_peered":"2023-10-06T11:14:47.049615+0000","last_clean":"2023-10-06T11:14:47.049615+0000","last_became_active":"2023-10-06T11:14:47.043195+0000","last_became_peered":"2023-10-06T11:14:47.043195+0000","last_unstale":"2023-10-06T11:14:47.049615+0000","last_undegraded":"2023-10-06T11:14:47.049615+0000","last_fullsized":"2023-10-06T11:14:47.049615+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:33.368638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.043202+0000","last_change":"2023-10-06T11:14:47.037567+0000","last_active":"2023-10-06T11:14:47.043202+0000","last_peered":"2023-10-06T11:14:47.043202+0000","last_clean":"2023-10-06T11:14:47.043202+0000","last_became_active":"2023-10-06T11:14:47.037258+0000","last_became_peered":"2023-10-06T11:14:47.037258+0000","last_unstale":"2023-10-06T11:14:47.043202+0000","last_undegraded":"2023-10-06T11:14:47.043202+0000","last_fullsized":"2023-10-06T11:14:47.043202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:39.073317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041431+0000","last_change":"2023-10-06T11:14:47.036954+0000","last_active":"2023-10-06T11:14:47.041431+0000","last_peered":"2023-10-06T11:14:47.041431+0000","last_clean":"2023-10-06T11:14:47.041431+0000","last_became_active":"2023-10-06T11:14:47.036672+0000","last_became_peered":"2023-10-06T11:14:47.036672+0000","last_unstale":"2023-10-06T11:14:47.041431+0000","last_undegraded":"2023-10-06T11:14:47.041431+0000","last_fullsized":"2023-10-06T11:14:47.041431+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:21.514067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048015+0000","last_change":"2023-10-06T11:14:47.042284+0000","last_active":"2023-10-06T11:14:47.048015+0000","last_peered":"2023-10-06T11:14:47.048015+0000","last_clean":"2023-10-06T11:14:47.048015+0000","last_became_active":"2023-10-06T11:14:47.042010+0000","last_became_peered":"2023-10-06T11:14:47.042010+0000","last_unstale":"2023-10-06T11:14:47.048015+0000","last_undegraded":"2023-10-06T11:14:47.048015+0000","last_fullsized":"2023-10-06T11:14:47.048015+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:23.774194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.056023+0000","last_change":"2023-10-06T11:14:47.051830+0000","last_active":"2023-10-06T11:14:47.056023+0000","last_peered":"2023-10-06T11:14:47.056023+0000","last_clean":"2023-10-06T11:14:47.056023+0000","last_became_active":"2023-10-06T11:14:47.051497+0000","last_became_peered":"2023-10-06T11:14:47.051497+0000","last_unstale":"2023-10-06T11:14:47.056023+0000","last_undegraded":"2023-10-06T11:14:47.056023+0000","last_fullsized":"2023-10-06T11:14:47.056023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:20.711854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.054226+0000","last_change":"2023-10-06T11:14:47.049797+0000","last_active":"2023-10-06T11:14:47.054226+0000","last_peered":"2023-10-06T11:14:47.054226+0000","last_clean":"2023-10-06T11:14:47.054226+0000","last_became_active":"2023-10-06T11:14:47.049558+0000","last_became_peered":"2023-10-06T11:14:47.049558+0000","last_unstale":"2023-10-06T11:14:47.054226+0000","last_undegraded":"2023-10-06T11:14:47.054226+0000","last_fullsized":"2023-10-06T11:14:47.054226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:38:09.165086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.045027+0000","last_change":"2023-10-06T11:14:47.041172+0000","last_active":"2023-10-06T11:14:47.045027+0000","last_peered":"2023-10-06T11:14:47.045027+0000","last_clean":"2023-10-06T11:14:47.045027+0000","last_became_active":"2023-10-06T11:14:47.040895+0000","last_became_peered":"2023-10-06T11:14:47.040895+0000","last_unstale":"2023-10-06T11:14:47.045027+0000","last_undegraded":"2023-10-06T11:14:47.045027+0000","last_fullsized":"2023-10-06T11:14:47.045027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:57.097421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047231+0000","last_change":"2023-10-06T11:14:47.043958+0000","last_active":"2023-10-06T11:14:47.047231+0000","last_peered":"2023-10-06T11:14:47.047231+0000","last_clean":"2023-10-06T11:14:47.047231+0000","last_became_active":"2023-10-06T11:14:47.043674+0000","last_became_peered":"2023-10-06T11:14:47.043674+0000","last_unstale":"2023-10-06T11:14:47.047231+0000","last_undegraded":"2023-10-06T11:14:47.047231+0000","last_fullsized":"2023-10-06T11:14:47.047231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.150038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051090+0000","last_change":"2023-10-06T11:14:47.043459+0000","last_active":"2023-10-06T11:14:47.051090+0000","last_peered":"2023-10-06T11:14:47.051090+0000","last_clean":"2023-10-06T11:14:47.051090+0000","last_became_active":"2023-10-06T11:14:47.043204+0000","last_became_peered":"2023-10-06T11:14:47.043204+0000","last_unstale":"2023-10-06T11:14:47.051090+0000","last_undegraded":"2023-10-06T11:14:47.051090+0000","last_fullsized":"2023-10-06T11:14:47.051090+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:01.857324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.057056+0000","last_change":"2023-10-06T11:14:47.052307+0000","last_active":"2023-10-06T11:14:47.057056+0000","last_peered":"2023-10-06T11:14:47.057056+0000","last_clean":"2023-10-06T11:14:47.057056+0000","last_became_active":"2023-10-06T11:14:47.052007+0000","last_became_peered":"2023-10-06T11:14:47.052007+0000","last_unstale":"2023-10-06T11:14:47.057056+0000","last_undegraded":"2023-10-06T11:14:47.057056+0000","last_fullsized":"2023-10-06T11:14:47.057056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:59.192722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050257+0000","last_change":"2023-10-06T11:14:47.046167+0000","last_active":"2023-10-06T11:14:47.050257+0000","last_peered":"2023-10-06T11:14:47.050257+0000","last_clean":"2023-10-06T11:14:47.050257+0000","last_became_active":"2023-10-06T11:14:47.045788+0000","last_became_peered":"2023-10-06T11:14:47.045788+0000","last_unstale":"2023-10-06T11:14:47.050257+0000","last_undegraded":"2023-10-06T11:14:47.050257+0000","last_fullsized":"2023-10-06T11:14:47.050257+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:05.137727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049926+0000","last_change":"2023-10-06T11:14:47.045141+0000","last_active":"2023-10-06T11:14:47.049926+0000","last_peered":"2023-10-06T11:14:47.049926+0000","last_clean":"2023-10-06T11:14:47.049926+0000","last_became_active":"2023-10-06T11:14:47.044853+0000","last_became_peered":"2023-10-06T11:14:47.044853+0000","last_unstale":"2023-10-06T11:14:47.049926+0000","last_undegraded":"2023-10-06T11:14:47.049926+0000","last_fullsized":"2023-10-06T11:14:47.049926+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:40.605938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.052025+0000","last_change":"2023-10-06T11:14:47.050729+0000","last_active":"2023-10-06T11:14:47.052025+0000","last_peered":"2023-10-06T11:14:47.052025+0000","last_clean":"2023-10-06T11:14:47.052025+0000","last_became_active":"2023-10-06T11:14:47.050519+0000","last_became_peered":"2023-10-06T11:14:47.050519+0000","last_unstale":"2023-10-06T11:14:47.052025+0000","last_undegraded":"2023-10-06T11:14:47.052025+0000","last_fullsized":"2023-10-06T11:14:47.052025+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:22.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.042216+0000","last_change":"2023-10-06T11:14:47.039057+0000","last_active":"2023-10-06T11:14:47.042216+0000","last_peered":"2023-10-06T11:14:47.042216+0000","last_clean":"2023-10-06T11:14:47.042216+0000","last_became_active":"2023-10-06T11:14:47.038700+0000","last_became_peered":"2023-10-06T11:14:47.038700+0000","last_unstale":"2023-10-06T11:14:47.042216+0000","last_undegraded":"2023-10-06T11:14:47.042216+0000","last_fullsized":"2023-10-06T11:14:47.042216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:33.528929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048937+0000","last_change":"2023-10-06T11:14:47.042988+0000","last_active":"2023-10-06T11:14:47.048937+0000","last_peered":"2023-10-06T11:14:47.048937+0000","last_clean":"2023-10-06T11:14:47.048937+0000","last_became_active":"2023-10-06T11:14:47.042713+0000","last_became_peered":"2023-10-06T11:14:47.042713+0000","last_unstale":"2023-10-06T11:14:47.048937+0000","last_undegraded":"2023-10-06T11:14:47.048937+0000","last_fullsized":"2023-10-06T11:14:47.048937+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:19.960724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048280+0000","last_change":"2023-10-06T11:14:47.043225+0000","last_active":"2023-10-06T11:14:47.048280+0000","last_peered":"2023-10-06T11:14:47.048280+0000","last_clean":"2023-10-06T11:14:47.048280+0000","last_became_active":"2023-10-06T11:14:47.042909+0000","last_became_peered":"2023-10-06T11:14:47.042909+0000","last_unstale":"2023-10-06T11:14:47.048280+0000","last_undegraded":"2023-10-06T11:14:47.048280+0000","last_fullsized":"2023-10-06T11:14:47.048280+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:37.055193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048993+0000","last_change":"2023-10-06T11:14:47.044467+0000","last_active":"2023-10-06T11:14:47.048993+0000","last_peered":"2023-10-06T11:14:47.048993+0000","last_clean":"2023-10-06T11:14:47.048993+0000","last_became_active":"2023-10-06T11:14:47.044146+0000","last_became_peered":"2023-10-06T11:14:47.044146+0000","last_unstale":"2023-10-06T11:14:47.048993+0000","last_undegraded":"2023-10-06T11:14:47.048993+0000","last_fullsized":"2023-10-06T11:14:47.048993+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:34.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048530+0000","last_change":"2023-10-06T11:14:47.044658+0000","last_active":"2023-10-06T11:14:47.048530+0000","last_peered":"2023-10-06T11:14:47.048530+0000","last_clean":"2023-10-06T11:14:47.048530+0000","last_became_active":"2023-10-06T11:14:47.044056+0000","last_became_peered":"2023-10-06T11:14:47.044056+0000","last_unstale":"2023-10-06T11:14:47.048530+0000","last_undegraded":"2023-10-06T11:14:47.048530+0000","last_fullsized":"2023-10-06T11:14:47.048530+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:20.285847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048903+0000","last_change":"2023-10-06T11:14:47.044245+0000","last_active":"2023-10-06T11:14:47.048903+0000","last_peered":"2023-10-06T11:14:47.048903+0000","last_clean":"2023-10-06T11:14:47.048903+0000","last_became_active":"2023-10-06T11:14:47.043903+0000","last_became_peered":"2023-10-06T11:14:47.043903+0000","last_unstale":"2023-10-06T11:14:47.048903+0000","last_undegraded":"2023-10-06T11:14:47.048903+0000","last_fullsized":"2023-10-06T11:14:47.048903+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:10.586573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055736+0000","last_change":"2023-10-06T11:14:47.053936+0000","last_active":"2023-10-06T11:14:47.055736+0000","last_peered":"2023-10-06T11:14:47.055736+0000","last_clean":"2023-10-06T11:14:47.055736+0000","last_became_active":"2023-10-06T11:14:47.053668+0000","last_became_peered":"2023-10-06T11:14:47.053668+0000","last_unstale":"2023-10-06T11:14:47.055736+0000","last_undegraded":"2023-10-06T11:14:47.055736+0000","last_fullsized":"2023-10-06T11:14:47.055736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:36.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.042433+0000","last_change":"2023-10-06T11:14:47.035418+0000","last_active":"2023-10-06T11:14:47.042433+0000","last_peered":"2023-10-06T11:14:47.042433+0000","last_clean":"2023-10-06T11:14:47.042433+0000","last_became_active":"2023-10-06T11:14:47.035146+0000","last_became_peered":"2023-10-06T11:14:47.035146+0000","last_unstale":"2023-10-06T11:14:47.042433+0000","last_undegraded":"2023-10-06T11:14:47.042433+0000","last_fullsized":"2023-10-06T11:14:47.042433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:38.331008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050227+0000","last_change":"2023-10-06T11:14:47.046382+0000","last_active":"2023-10-06T11:14:47.050227+0000","last_peered":"2023-10-06T11:14:47.050227+0000","last_clean":"2023-10-06T11:14:47.050227+0000","last_became_active":"2023-10-06T11:14:47.045422+0000","last_became_peered":"2023-10-06T11:14:47.045422+0000","last_unstale":"2023-10-06T11:14:47.050227+0000","last_undegraded":"2023-10-06T11:14:47.050227+0000","last_fullsized":"2023-10-06T11:14:47.050227+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:05.888783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.043401+0000","last_change":"2023-10-06T11:14:47.038252+0000","last_active":"2023-10-06T11:14:47.043401+0000","last_peered":"2023-10-06T11:14:47.043401+0000","last_clean":"2023-10-06T11:14:47.043401+0000","last_became_active":"2023-10-06T11:14:47.038010+0000","last_became_peered":"2023-10-06T11:14:47.038010+0000","last_unstale":"2023-10-06T11:14:47.043401+0000","last_undegraded":"2023-10-06T11:14:47.043401+0000","last_fullsized":"2023-10-06T11:14:47.043401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:03.438347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049018+0000","last_change":"2023-10-06T11:14:47.043128+0000","last_active":"2023-10-06T11:14:47.049018+0000","last_peered":"2023-10-06T11:14:47.049018+0000","last_clean":"2023-10-06T11:14:47.049018+0000","last_became_active":"2023-10-06T11:14:47.042620+0000","last_became_peered":"2023-10-06T11:14:47.042620+0000","last_unstale":"2023-10-06T11:14:47.049018+0000","last_undegraded":"2023-10-06T11:14:47.049018+0000","last_fullsized":"2023-10-06T11:14:47.049018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:59.192722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048712+0000","last_change":"2023-10-06T11:14:47.044205+0000","last_active":"2023-10-06T11:14:47.048712+0000","last_peered":"2023-10-06T11:14:47.048712+0000","last_clean":"2023-10-06T11:14:47.048712+0000","last_became_active":"2023-10-06T11:14:47.043948+0000","last_became_peered":"2023-10-06T11:14:47.043948+0000","last_unstale":"2023-10-06T11:14:47.048712+0000","last_undegraded":"2023-10-06T11:14:47.048712+0000","last_fullsized":"2023-10-06T11:14:47.048712+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:01.642027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055097+0000","last_change":"2023-10-06T11:14:47.052527+0000","last_active":"2023-10-06T11:14:47.055097+0000","last_peered":"2023-10-06T11:14:47.055097+0000","last_clean":"2023-10-06T11:14:47.055097+0000","last_became_active":"2023-10-06T11:14:47.052205+0000","last_became_peered":"2023-10-06T11:14:47.052205+0000","last_unstale":"2023-10-06T11:14:47.055097+0000","last_undegraded":"2023-10-06T11:14:47.055097+0000","last_fullsized":"2023-10-06T11:14:47.055097+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:52.517718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050266+0000","last_change":"2023-10-06T11:14:47.048377+0000","last_active":"2023-10-06T11:14:47.050266+0000","last_peered":"2023-10-06T11:14:47.050266+0000","last_clean":"2023-10-06T11:14:47.050266+0000","last_became_active":"2023-10-06T11:14:47.047983+0000","last_became_peered":"2023-10-06T11:14:47.047983+0000","last_unstale":"2023-10-06T11:14:47.050266+0000","last_undegraded":"2023-10-06T11:14:47.050266+0000","last_fullsized":"2023-10-06T11:14:47.050266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:21.514067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050190+0000","last_change":"2023-10-06T11:14:47.044899+0000","last_active":"2023-10-06T11:14:47.050190+0000","last_peered":"2023-10-06T11:14:47.050190+0000","last_clean":"2023-10-06T11:14:47.050190+0000","last_became_active":"2023-10-06T11:14:47.044645+0000","last_became_peered":"2023-10-06T11:14:47.044645+0000","last_unstale":"2023-10-06T11:14:47.050190+0000","last_undegraded":"2023-10-06T11:14:47.050190+0000","last_fullsized":"2023-10-06T11:14:47.050190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:36.976572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.179358+0000","last_change":"2023-10-06T11:14:46.166988+0000","last_active":"2023-10-06T11:14:47.179358+0000","last_peered":"2023-10-06T11:14:47.179358+0000","last_clean":"2023-10-06T11:14:47.179358+0000","last_became_active":"2023-10-06T11:14:46.166368+0000","last_became_peered":"2023-10-06T11:14:46.166368+0000","last_unstale":"2023-10-06T11:14:47.179358+0000","last_undegraded":"2023-10-06T11:14:47.179358+0000","last_fullsized":"2023-10-06T11:14:47.179358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:56.091368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.056044+0000","last_change":"2023-10-06T11:14:47.051911+0000","last_active":"2023-10-06T11:14:47.056044+0000","last_peered":"2023-10-06T11:14:47.056044+0000","last_clean":"2023-10-06T11:14:47.056044+0000","last_became_active":"2023-10-06T11:14:47.051385+0000","last_became_peered":"2023-10-06T11:14:47.051385+0000","last_unstale":"2023-10-06T11:14:47.056044+0000","last_undegraded":"2023-10-06T11:14:47.056044+0000","last_fullsized":"2023-10-06T11:14:47.056044+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:46.489821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176108+0000","last_change":"2023-10-06T11:14:46.166095+0000","last_active":"2023-10-06T11:14:47.176108+0000","last_peered":"2023-10-06T11:14:47.176108+0000","last_clean":"2023-10-06T11:14:47.176108+0000","last_became_active":"2023-10-06T11:14:46.165770+0000","last_became_peered":"2023-10-06T11:14:46.165770+0000","last_unstale":"2023-10-06T11:14:47.176108+0000","last_undegraded":"2023-10-06T11:14:47.176108+0000","last_fullsized":"2023-10-06T11:14:47.176108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:00.635974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055656+0000","last_change":"2023-10-06T11:14:47.054956+0000","last_active":"2023-10-06T11:14:47.055656+0000","last_peered":"2023-10-06T11:14:47.055656+0000","last_clean":"2023-10-06T11:14:47.055656+0000","last_became_active":"2023-10-06T11:14:47.054512+0000","last_became_peered":"2023-10-06T11:14:47.054512+0000","last_unstale":"2023-10-06T11:14:47.055656+0000","last_undegraded":"2023-10-06T11:14:47.055656+0000","last_fullsized":"2023-10-06T11:14:47.055656+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:39.824169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176256+0000","last_change":"2023-10-06T11:14:46.167866+0000","last_active":"2023-10-06T11:14:47.176256+0000","last_peered":"2023-10-06T11:14:47.176256+0000","last_clean":"2023-10-06T11:14:47.176256+0000","last_became_active":"2023-10-06T11:14:46.167226+0000","last_became_peered":"2023-10-06T11:14:46.167226+0000","last_unstale":"2023-10-06T11:14:47.176256+0000","last_undegraded":"2023-10-06T11:14:47.176256+0000","last_fullsized":"2023-10-06T11:14:47.176256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:54.837078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050249+0000","last_change":"2023-10-06T11:14:47.046758+0000","last_active":"2023-10-06T11:14:47.050249+0000","last_peered":"2023-10-06T11:14:47.050249+0000","last_clean":"2023-10-06T11:14:47.050249+0000","last_became_active":"2023-10-06T11:14:47.046486+0000","last_became_peered":"2023-10-06T11:14:47.046486+0000","last_unstale":"2023-10-06T11:14:47.050249+0000","last_undegraded":"2023-10-06T11:14:47.050249+0000","last_fullsized":"2023-10-06T11:14:47.050249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:34.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.178348+0000","last_change":"2023-10-06T11:14:46.163111+0000","last_active":"2023-10-06T11:14:47.178348+0000","last_peered":"2023-10-06T11:14:47.178348+0000","last_clean":"2023-10-06T11:14:47.178348+0000","last_became_active":"2023-10-06T11:14:46.162823+0000","last_became_peered":"2023-10-06T11:14:46.162823+0000","last_unstale":"2023-10-06T11:14:47.178348+0000","last_undegraded":"2023-10-06T11:14:47.178348+0000","last_fullsized":"2023-10-06T11:14:47.178348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:23.135289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048973+0000","last_change":"2023-10-06T11:14:47.044184+0000","last_active":"2023-10-06T11:14:47.048973+0000","last_peered":"2023-10-06T11:14:47.048973+0000","last_clean":"2023-10-06T11:14:47.048973+0000","last_became_active":"2023-10-06T11:14:47.043928+0000","last_became_peered":"2023-10-06T11:14:47.043928+0000","last_unstale":"2023-10-06T11:14:47.048973+0000","last_undegraded":"2023-10-06T11:14:47.048973+0000","last_fullsized":"2023-10-06T11:14:47.048973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:39.824169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.179152+0000","last_change":"2023-10-06T11:14:46.157732+0000","last_active":"2023-10-06T11:14:47.179152+0000","last_peered":"2023-10-06T11:14:47.179152+0000","last_clean":"2023-10-06T11:14:47.179152+0000","last_became_active":"2023-10-06T11:14:46.157430+0000","last_became_peered":"2023-10-06T11:14:46.157430+0000","last_unstale":"2023-10-06T11:14:47.179152+0000","last_undegraded":"2023-10-06T11:14:47.179152+0000","last_fullsized":"2023-10-06T11:14:47.179152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:59.960801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049035+0000","last_change":"2023-10-06T11:14:47.043299+0000","last_active":"2023-10-06T11:14:47.049035+0000","last_peered":"2023-10-06T11:14:47.049035+0000","last_clean":"2023-10-06T11:14:47.049035+0000","last_became_active":"2023-10-06T11:14:47.042985+0000","last_became_peered":"2023-10-06T11:14:47.042985+0000","last_unstale":"2023-10-06T11:14:47.049035+0000","last_undegraded":"2023-10-06T11:14:47.049035+0000","last_fullsized":"2023-10-06T11:14:47.049035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:12.425423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.175968+0000","last_change":"2023-10-06T11:14:46.168760+0000","last_active":"2023-10-06T11:14:47.175968+0000","last_peered":"2023-10-06T11:14:47.175968+0000","last_clean":"2023-10-06T11:14:47.175968+0000","last_became_active":"2023-10-06T11:14:46.168471+0000","last_became_peered":"2023-10-06T11:14:46.168471+0000","last_unstale":"2023-10-06T11:14:47.175968+0000","last_undegraded":"2023-10-06T11:14:47.175968+0000","last_fullsized":"2023-10-06T11:14:47.175968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:09.331136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.043736+0000","last_change":"2023-10-06T11:14:47.041176+0000","last_active":"2023-10-06T11:14:47.043736+0000","last_peered":"2023-10-06T11:14:47.043736+0000","last_clean":"2023-10-06T11:14:47.043736+0000","last_became_active":"2023-10-06T11:14:47.040901+0000","last_became_peered":"2023-10-06T11:14:47.040901+0000","last_unstale":"2023-10-06T11:14:47.043736+0000","last_undegraded":"2023-10-06T11:14:47.043736+0000","last_fullsized":"2023-10-06T11:14:47.043736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:59.171440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033854+0000","last_change":"2023-10-06T11:14:46.159975+0000","last_active":"2023-10-06T11:14:47.033854+0000","last_peered":"2023-10-06T11:14:47.033854+0000","last_clean":"2023-10-06T11:14:47.033854+0000","last_became_active":"2023-10-06T11:14:46.159655+0000","last_became_peered":"2023-10-06T11:14:46.159655+0000","last_unstale":"2023-10-06T11:14:47.033854+0000","last_undegraded":"2023-10-06T11:14:47.033854+0000","last_fullsized":"2023-10-06T11:14:47.033854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:00.169363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049962+0000","last_change":"2023-10-06T11:14:47.045170+0000","last_active":"2023-10-06T11:14:47.049962+0000","last_peered":"2023-10-06T11:14:47.049962+0000","last_clean":"2023-10-06T11:14:47.049962+0000","last_became_active":"2023-10-06T11:14:47.044900+0000","last_became_peered":"2023-10-06T11:14:47.044900+0000","last_unstale":"2023-10-06T11:14:47.049962+0000","last_undegraded":"2023-10-06T11:14:47.049962+0000","last_fullsized":"2023-10-06T11:14:47.049962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:01.027798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.030682+0000","last_change":"2023-10-06T11:14:46.169480+0000","last_active":"2023-10-06T11:14:47.030682+0000","last_peered":"2023-10-06T11:14:47.030682+0000","last_clean":"2023-10-06T11:14:47.030682+0000","last_became_active":"2023-10-06T11:14:46.169138+0000","last_became_peered":"2023-10-06T11:14:46.169138+0000","last_unstale":"2023-10-06T11:14:47.030682+0000","last_undegraded":"2023-10-06T11:14:47.030682+0000","last_fullsized":"2023-10-06T11:14:47.030682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:36.049140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059470+0000","last_change":"2023-10-06T11:14:47.054786+0000","last_active":"2023-10-06T11:14:47.059470+0000","last_peered":"2023-10-06T11:14:47.059470+0000","last_clean":"2023-10-06T11:14:47.059470+0000","last_became_active":"2023-10-06T11:14:47.054571+0000","last_became_peered":"2023-10-06T11:14:47.054571+0000","last_unstale":"2023-10-06T11:14:47.059470+0000","last_undegraded":"2023-10-06T11:14:47.059470+0000","last_fullsized":"2023-10-06T11:14:47.059470+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:36.425321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039366+0000","last_change":"2023-10-06T11:14:46.168779+0000","last_active":"2023-10-06T11:14:47.039366+0000","last_peered":"2023-10-06T11:14:47.039366+0000","last_clean":"2023-10-06T11:14:47.039366+0000","last_became_active":"2023-10-06T11:14:46.168517+0000","last_became_peered":"2023-10-06T11:14:46.168517+0000","last_unstale":"2023-10-06T11:14:47.039366+0000","last_undegraded":"2023-10-06T11:14:47.039366+0000","last_fullsized":"2023-10-06T11:14:47.039366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:29.838661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059631+0000","last_change":"2023-10-06T11:14:47.054917+0000","last_active":"2023-10-06T11:14:47.059631+0000","last_peered":"2023-10-06T11:14:47.059631+0000","last_clean":"2023-10-06T11:14:47.059631+0000","last_became_active":"2023-10-06T11:14:47.054617+0000","last_became_peered":"2023-10-06T11:14:47.054617+0000","last_unstale":"2023-10-06T11:14:47.059631+0000","last_undegraded":"2023-10-06T11:14:47.059631+0000","last_fullsized":"2023-10-06T11:14:47.059631+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:55.843131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033786+0000","last_change":"2023-10-06T11:14:46.163277+0000","last_active":"2023-10-06T11:14:47.033786+0000","last_peered":"2023-10-06T11:14:47.033786+0000","last_clean":"2023-10-06T11:14:47.033786+0000","last_became_active":"2023-10-06T11:14:46.162993+0000","last_became_peered":"2023-10-06T11:14:46.162993+0000","last_unstale":"2023-10-06T11:14:47.033786+0000","last_undegraded":"2023-10-06T11:14:47.033786+0000","last_fullsized":"2023-10-06T11:14:47.033786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:36.049140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055687+0000","last_change":"2023-10-06T11:14:47.051716+0000","last_active":"2023-10-06T11:14:47.055687+0000","last_peered":"2023-10-06T11:14:47.055687+0000","last_clean":"2023-10-06T11:14:47.055687+0000","last_became_active":"2023-10-06T11:14:47.051389+0000","last_became_peered":"2023-10-06T11:14:47.051389+0000","last_unstale":"2023-10-06T11:14:47.055687+0000","last_undegraded":"2023-10-06T11:14:47.055687+0000","last_fullsized":"2023-10-06T11:14:47.055687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:56:22.428439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.178979+0000","last_change":"2023-10-06T11:14:46.168155+0000","last_active":"2023-10-06T11:14:47.178979+0000","last_peered":"2023-10-06T11:14:47.178979+0000","last_clean":"2023-10-06T11:14:47.178979+0000","last_became_active":"2023-10-06T11:14:46.167909+0000","last_became_peered":"2023-10-06T11:14:46.167909+0000","last_unstale":"2023-10-06T11:14:47.178979+0000","last_undegraded":"2023-10-06T11:14:47.178979+0000","last_fullsized":"2023-10-06T11:14:47.178979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:45.483768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059633+0000","last_change":"2023-10-06T11:14:47.055110+0000","last_active":"2023-10-06T11:14:47.059633+0000","last_peered":"2023-10-06T11:14:47.059633+0000","last_clean":"2023-10-06T11:14:47.059633+0000","last_became_active":"2023-10-06T11:14:47.054841+0000","last_became_peered":"2023-10-06T11:14:47.054841+0000","last_unstale":"2023-10-06T11:14:47.059633+0000","last_undegraded":"2023-10-06T11:14:47.059633+0000","last_fullsized":"2023-10-06T11:14:47.059633+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:07:00.966854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.184831+0000","last_change":"2023-10-06T11:14:46.158684+0000","last_active":"2023-10-06T11:14:47.184831+0000","last_peered":"2023-10-06T11:14:47.184831+0000","last_clean":"2023-10-06T11:14:47.184831+0000","last_became_active":"2023-10-06T11:14:46.158379+0000","last_became_peered":"2023-10-06T11:14:46.158379+0000","last_unstale":"2023-10-06T11:14:47.184831+0000","last_undegraded":"2023-10-06T11:14:47.184831+0000","last_fullsized":"2023-10-06T11:14:47.184831+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:00.635974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.057147+0000","last_change":"2023-10-06T11:14:47.052189+0000","last_active":"2023-10-06T11:14:47.057147+0000","last_peered":"2023-10-06T11:14:47.057147+0000","last_clean":"2023-10-06T11:14:47.057147+0000","last_became_active":"2023-10-06T11:14:47.051893+0000","last_became_peered":"2023-10-06T11:14:47.051893+0000","last_unstale":"2023-10-06T11:14:47.057147+0000","last_undegraded":"2023-10-06T11:14:47.057147+0000","last_fullsized":"2023-10-06T11:14:47.057147+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:20.285847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.177194+0000","last_change":"2023-10-06T11:14:46.162085+0000","last_active":"2023-10-06T11:14:47.177194+0000","last_peered":"2023-10-06T11:14:47.177194+0000","last_clean":"2023-10-06T11:14:47.177194+0000","last_became_active":"2023-10-06T11:14:46.161834+0000","last_became_peered":"2023-10-06T11:14:46.161834+0000","last_unstale":"2023-10-06T11:14:47.177194+0000","last_undegraded":"2023-10-06T11:14:47.177194+0000","last_fullsized":"2023-10-06T11:14:47.177194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:37.324955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051269+0000","last_change":"2023-10-06T11:14:47.045876+0000","last_active":"2023-10-06T11:14:47.051269+0000","last_peered":"2023-10-06T11:14:47.051269+0000","last_clean":"2023-10-06T11:14:47.051269+0000","last_became_active":"2023-10-06T11:14:47.045612+0000","last_became_peered":"2023-10-06T11:14:47.045612+0000","last_unstale":"2023-10-06T11:14:47.051269+0000","last_undegraded":"2023-10-06T11:14:47.051269+0000","last_fullsized":"2023-10-06T11:14:47.051269+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:51.004842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.034993+0000","last_change":"2023-10-06T11:14:46.163346+0000","last_active":"2023-10-06T11:14:47.034993+0000","last_peered":"2023-10-06T11:14:47.034993+0000","last_clean":"2023-10-06T11:14:47.034993+0000","last_became_active":"2023-10-06T11:14:46.163097+0000","last_became_peered":"2023-10-06T11:14:46.163097+0000","last_unstale":"2023-10-06T11:14:47.034993+0000","last_undegraded":"2023-10-06T11:14:47.034993+0000","last_fullsized":"2023-10-06T11:14:47.034993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:23.555204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051122+0000","last_change":"2023-10-06T11:14:47.045163+0000","last_active":"2023-10-06T11:14:47.051122+0000","last_peered":"2023-10-06T11:14:47.051122+0000","last_clean":"2023-10-06T11:14:47.051122+0000","last_became_active":"2023-10-06T11:14:47.044829+0000","last_became_peered":"2023-10-06T11:14:47.044829+0000","last_unstale":"2023-10-06T11:14:47.051122+0000","last_undegraded":"2023-10-06T11:14:47.051122+0000","last_fullsized":"2023-10-06T11:14:47.051122+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:58.846738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033814+0000","last_change":"2023-10-06T11:14:46.163210+0000","last_active":"2023-10-06T11:14:47.033814+0000","last_peered":"2023-10-06T11:14:47.033814+0000","last_clean":"2023-10-06T11:14:47.033814+0000","last_became_active":"2023-10-06T11:14:46.162939+0000","last_became_peered":"2023-10-06T11:14:46.162939+0000","last_unstale":"2023-10-06T11:14:47.033814+0000","last_undegraded":"2023-10-06T11:14:47.033814+0000","last_fullsized":"2023-10-06T11:14:47.033814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:28.135342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048541+0000","last_change":"2023-10-06T11:14:47.044849+0000","last_active":"2023-10-06T11:14:47.048541+0000","last_peered":"2023-10-06T11:14:47.048541+0000","last_clean":"2023-10-06T11:14:47.048541+0000","last_became_active":"2023-10-06T11:14:47.044410+0000","last_became_peered":"2023-10-06T11:14:47.044410+0000","last_unstale":"2023-10-06T11:14:47.048541+0000","last_undegraded":"2023-10-06T11:14:47.048541+0000","last_fullsized":"2023-10-06T11:14:47.048541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:10.337189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.181880+0000","last_change":"2023-10-06T11:14:46.164999+0000","last_active":"2023-10-06T11:14:47.181880+0000","last_peered":"2023-10-06T11:14:47.181880+0000","last_clean":"2023-10-06T11:14:47.181880+0000","last_became_active":"2023-10-06T11:14:46.164708+0000","last_became_peered":"2023-10-06T11:14:46.164708+0000","last_unstale":"2023-10-06T11:14:47.181880+0000","last_undegraded":"2023-10-06T11:14:47.181880+0000","last_fullsized":"2023-10-06T11:14:47.181880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:19.705801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048439+0000","last_change":"2023-10-06T11:14:47.044539+0000","last_active":"2023-10-06T11:14:47.048439+0000","last_peered":"2023-10-06T11:14:47.048439+0000","last_clean":"2023-10-06T11:14:47.048439+0000","last_became_active":"2023-10-06T11:14:47.044126+0000","last_became_peered":"2023-10-06T11:14:47.044126+0000","last_unstale":"2023-10-06T11:14:47.048439+0000","last_undegraded":"2023-10-06T11:14:47.048439+0000","last_fullsized":"2023-10-06T11:14:47.048439+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:25.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.177344+0000","last_change":"2023-10-06T11:14:46.165906+0000","last_active":"2023-10-06T11:14:47.177344+0000","last_peered":"2023-10-06T11:14:47.177344+0000","last_clean":"2023-10-06T11:14:47.177344+0000","last_became_active":"2023-10-06T11:14:46.165630+0000","last_became_peered":"2023-10-06T11:14:46.165630+0000","last_unstale":"2023-10-06T11:14:47.177344+0000","last_undegraded":"2023-10-06T11:14:47.177344+0000","last_fullsized":"2023-10-06T11:14:47.177344+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:51.511665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051172+0000","last_change":"2023-10-06T11:14:47.045903+0000","last_active":"2023-10-06T11:14:47.051172+0000","last_peered":"2023-10-06T11:14:47.051172+0000","last_clean":"2023-10-06T11:14:47.051172+0000","last_became_active":"2023-10-06T11:14:47.045599+0000","last_became_peered":"2023-10-06T11:14:47.045599+0000","last_unstale":"2023-10-06T11:14:47.051172+0000","last_undegraded":"2023-10-06T11:14:47.051172+0000","last_fullsized":"2023-10-06T11:14:47.051172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:01.642027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039736+0000","last_change":"2023-10-06T11:14:46.168661+0000","last_active":"2023-10-06T11:14:47.039736+0000","last_peered":"2023-10-06T11:14:47.039736+0000","last_clean":"2023-10-06T11:14:47.039736+0000","last_became_active":"2023-10-06T11:14:46.168404+0000","last_became_peered":"2023-10-06T11:14:46.168404+0000","last_unstale":"2023-10-06T11:14:47.039736+0000","last_undegraded":"2023-10-06T11:14:47.039736+0000","last_fullsized":"2023-10-06T11:14:47.039736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:09.118951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.056054+0000","last_change":"2023-10-06T11:14:47.052247+0000","last_active":"2023-10-06T11:14:47.056054+0000","last_peered":"2023-10-06T11:14:47.056054+0000","last_clean":"2023-10-06T11:14:47.056054+0000","last_became_active":"2023-10-06T11:14:47.052005+0000","last_became_peered":"2023-10-06T11:14:47.052005+0000","last_unstale":"2023-10-06T11:14:47.056054+0000","last_undegraded":"2023-10-06T11:14:47.056054+0000","last_fullsized":"2023-10-06T11:14:47.056054+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:04.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.035117+0000","last_change":"2023-10-06T11:14:46.162680+0000","last_active":"2023-10-06T11:14:47.035117+0000","last_peered":"2023-10-06T11:14:47.035117+0000","last_clean":"2023-10-06T11:14:47.035117+0000","last_became_active":"2023-10-06T11:14:46.162430+0000","last_became_peered":"2023-10-06T11:14:46.162430+0000","last_unstale":"2023-10-06T11:14:47.035117+0000","last_undegraded":"2023-10-06T11:14:47.035117+0000","last_fullsized":"2023-10-06T11:14:47.035117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:51.511665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050152+0000","last_change":"2023-10-06T11:14:47.044306+0000","last_active":"2023-10-06T11:14:47.050152+0000","last_peered":"2023-10-06T11:14:47.050152+0000","last_clean":"2023-10-06T11:14:47.050152+0000","last_became_active":"2023-10-06T11:14:47.044054+0000","last_became_peered":"2023-10-06T11:14:47.044054+0000","last_unstale":"2023-10-06T11:14:47.050152+0000","last_undegraded":"2023-10-06T11:14:47.050152+0000","last_fullsized":"2023-10-06T11:14:47.050152+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:21.803331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.034178+0000","last_change":"2023-10-06T11:14:46.160847+0000","last_active":"2023-10-06T11:14:47.034178+0000","last_peered":"2023-10-06T11:14:47.034178+0000","last_clean":"2023-10-06T11:14:47.034178+0000","last_became_active":"2023-10-06T11:14:46.160603+0000","last_became_peered":"2023-10-06T11:14:46.160603+0000","last_unstale":"2023-10-06T11:14:47.034178+0000","last_undegraded":"2023-10-06T11:14:47.034178+0000","last_fullsized":"2023-10-06T11:14:47.034178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:38:08.159033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055134+0000","last_change":"2023-10-06T11:14:47.052383+0000","last_active":"2023-10-06T11:14:47.055134+0000","last_peered":"2023-10-06T11:14:47.055134+0000","last_clean":"2023-10-06T11:14:47.055134+0000","last_became_active":"2023-10-06T11:14:47.052187+0000","last_became_peered":"2023-10-06T11:14:47.052187+0000","last_unstale":"2023-10-06T11:14:47.055134+0000","last_undegraded":"2023-10-06T11:14:47.055134+0000","last_fullsized":"2023-10-06T11:14:47.055134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:33.368638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047095+0000","last_change":"2023-10-06T11:14:46.163772+0000","last_active":"2023-10-06T11:14:47.047095+0000","last_peered":"2023-10-06T11:14:47.047095+0000","last_clean":"2023-10-06T11:14:47.047095+0000","last_became_active":"2023-10-06T11:14:46.163493+0000","last_became_peered":"2023-10-06T11:14:46.163493+0000","last_unstale":"2023-10-06T11:14:47.047095+0000","last_undegraded":"2023-10-06T11:14:47.047095+0000","last_fullsized":"2023-10-06T11:14:47.047095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:55.774969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048321+0000","last_change":"2023-10-06T11:14:47.043914+0000","last_active":"2023-10-06T11:14:47.048321+0000","last_peered":"2023-10-06T11:14:47.048321+0000","last_clean":"2023-10-06T11:14:47.048321+0000","last_became_active":"2023-10-06T11:14:47.043640+0000","last_became_peered":"2023-10-06T11:14:47.043640+0000","last_unstale":"2023-10-06T11:14:47.048321+0000","last_undegraded":"2023-10-06T11:14:47.048321+0000","last_fullsized":"2023-10-06T11:14:47.048321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:10.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.031105+0000","last_change":"2023-10-06T11:14:46.158615+0000","last_active":"2023-10-06T11:14:47.031105+0000","last_peered":"2023-10-06T11:14:47.031105+0000","last_clean":"2023-10-06T11:14:47.031105+0000","last_became_active":"2023-10-06T11:14:46.158336+0000","last_became_peered":"2023-10-06T11:14:46.158336+0000","last_unstale":"2023-10-06T11:14:47.031105+0000","last_undegraded":"2023-10-06T11:14:47.031105+0000","last_fullsized":"2023-10-06T11:14:47.031105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:24.025599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055700+0000","last_change":"2023-10-06T11:14:47.051783+0000","last_active":"2023-10-06T11:14:47.055700+0000","last_peered":"2023-10-06T11:14:47.055700+0000","last_clean":"2023-10-06T11:14:47.055700+0000","last_became_active":"2023-10-06T11:14:47.051486+0000","last_became_peered":"2023-10-06T11:14:47.051486+0000","last_unstale":"2023-10-06T11:14:47.055700+0000","last_undegraded":"2023-10-06T11:14:47.055700+0000","last_fullsized":"2023-10-06T11:14:47.055700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:30.844714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047034+0000","last_change":"2023-10-06T11:14:46.169843+0000","last_active":"2023-10-06T11:14:47.047034+0000","last_peered":"2023-10-06T11:14:47.047034+0000","last_clean":"2023-10-06T11:14:47.047034+0000","last_became_active":"2023-10-06T11:14:46.169574+0000","last_became_peered":"2023-10-06T11:14:46.169574+0000","last_unstale":"2023-10-06T11:14:47.047034+0000","last_undegraded":"2023-10-06T11:14:47.047034+0000","last_fullsized":"2023-10-06T11:14:47.047034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:23.555204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049941+0000","last_change":"2023-10-06T11:14:47.045163+0000","last_active":"2023-10-06T11:14:47.049941+0000","last_peered":"2023-10-06T11:14:47.049941+0000","last_clean":"2023-10-06T11:14:47.049941+0000","last_became_active":"2023-10-06T11:14:47.044890+0000","last_became_peered":"2023-10-06T11:14:47.044890+0000","last_unstale":"2023-10-06T11:14:47.049941+0000","last_undegraded":"2023-10-06T11:14:47.049941+0000","last_fullsized":"2023-10-06T11:14:47.049941+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:36.976572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033370+0000","last_change":"2023-10-06T11:14:46.170735+0000","last_active":"2023-10-06T11:14:47.033370+0000","last_peered":"2023-10-06T11:14:47.033370+0000","last_clean":"2023-10-06T11:14:47.033370+0000","last_became_active":"2023-10-06T11:14:46.170385+0000","last_became_peered":"2023-10-06T11:14:46.170385+0000","last_unstale":"2023-10-06T11:14:47.033370+0000","last_undegraded":"2023-10-06T11:14:47.033370+0000","last_fullsized":"2023-10-06T11:14:47.033370+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:24.025599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059554+0000","last_change":"2023-10-06T11:14:47.053565+0000","last_active":"2023-10-06T11:14:47.059554+0000","last_peered":"2023-10-06T11:14:47.059554+0000","last_clean":"2023-10-06T11:14:47.059554+0000","last_became_active":"2023-10-06T11:14:47.053298+0000","last_became_peered":"2023-10-06T11:14:47.053298+0000","last_unstale":"2023-10-06T11:14:47.059554+0000","last_undegraded":"2023-10-06T11:14:47.059554+0000","last_fullsized":"2023-10-06T11:14:47.059554+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:10.337189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.177722+0000","last_change":"2023-10-06T11:14:46.159023+0000","last_active":"2023-10-06T11:14:47.177722+0000","last_peered":"2023-10-06T11:14:47.177722+0000","last_clean":"2023-10-06T11:14:47.177722+0000","last_became_active":"2023-10-06T11:14:46.158740+0000","last_became_peered":"2023-10-06T11:14:46.158740+0000","last_unstale":"2023-10-06T11:14:47.177722+0000","last_undegraded":"2023-10-06T11:14:47.177722+0000","last_fullsized":"2023-10-06T11:14:47.177722+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:37.324955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047399+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:14:47.047399+0000","last_peered":"2023-10-06T11:14:47.047399+0000","last_clean":"2023-10-06T11:14:47.047399+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:14:47.047399+0000","last_undegraded":"2023-10-06T11:14:47.047399+0000","last_fullsized":"2023-10-06T11:14:47.047399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050033+0000","last_change":"2023-10-06T11:14:47.044333+0000","last_active":"2023-10-06T11:14:47.050033+0000","last_peered":"2023-10-06T11:14:47.050033+0000","last_clean":"2023-10-06T11:14:47.050033+0000","last_became_active":"2023-10-06T11:14:47.044051+0000","last_became_peered":"2023-10-06T11:14:47.044051+0000","last_unstale":"2023-10-06T11:14:47.050033+0000","last_undegraded":"2023-10-06T11:14:47.050033+0000","last_fullsized":"2023-10-06T11:14:47.050033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:40.605938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033634+0000","last_change":"2023-10-06T11:14:46.169439+0000","last_active":"2023-10-06T11:14:47.033634+0000","last_peered":"2023-10-06T11:14:47.033634+0000","last_clean":"2023-10-06T11:14:47.033634+0000","last_became_active":"2023-10-06T11:14:46.169183+0000","last_became_peered":"2023-10-06T11:14:46.169183+0000","last_unstale":"2023-10-06T11:14:47.033634+0000","last_undegraded":"2023-10-06T11:14:47.033634+0000","last_fullsized":"2023-10-06T11:14:47.033634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:07.585414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033979+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:14:47.033979+0000","last_peered":"2023-10-06T11:14:47.033979+0000","last_clean":"2023-10-06T11:14:47.033979+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:14:47.033979+0000","last_undegraded":"2023-10-06T11:14:47.033979+0000","last_fullsized":"2023-10-06T11:14:47.033979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059549+0000","last_change":"2023-10-06T11:14:47.053428+0000","last_active":"2023-10-06T11:14:47.059549+0000","last_peered":"2023-10-06T11:14:47.059549+0000","last_clean":"2023-10-06T11:14:47.059549+0000","last_became_active":"2023-10-06T11:14:47.053167+0000","last_became_peered":"2023-10-06T11:14:47.053167+0000","last_unstale":"2023-10-06T11:14:47.059549+0000","last_undegraded":"2023-10-06T11:14:47.059549+0000","last_fullsized":"2023-10-06T11:14:47.059549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:10.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.179238+0000","last_change":"2023-10-06T11:14:46.167127+0000","last_active":"2023-10-06T11:14:47.179238+0000","last_peered":"2023-10-06T11:14:47.179238+0000","last_clean":"2023-10-06T11:14:47.179238+0000","last_became_active":"2023-10-06T11:14:46.166650+0000","last_became_peered":"2023-10-06T11:14:46.166650+0000","last_unstale":"2023-10-06T11:14:47.179238+0000","last_undegraded":"2023-10-06T11:14:47.179238+0000","last_fullsized":"2023-10-06T11:14:47.179238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:59.960801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.028906+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:14:47.028906+0000","last_peered":"2023-10-06T11:14:47.028906+0000","last_clean":"2023-10-06T11:14:47.028906+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:14:47.028906+0000","last_undegraded":"2023-10-06T11:14:47.028906+0000","last_fullsized":"2023-10-06T11:14:47.028906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048874+0000","last_change":"2023-10-06T11:14:47.042928+0000","last_active":"2023-10-06T11:14:47.048874+0000","last_peered":"2023-10-06T11:14:47.048874+0000","last_clean":"2023-10-06T11:14:47.048874+0000","last_became_active":"2023-10-06T11:14:47.042678+0000","last_became_peered":"2023-10-06T11:14:47.042678+0000","last_unstale":"2023-10-06T11:14:47.048874+0000","last_undegraded":"2023-10-06T11:14:47.048874+0000","last_fullsized":"2023-10-06T11:14:47.048874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:05.888783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.036569+0000","last_change":"2023-10-06T11:14:46.161086+0000","last_active":"2023-10-06T11:14:47.036569+0000","last_peered":"2023-10-06T11:14:47.036569+0000","last_clean":"2023-10-06T11:14:47.036569+0000","last_became_active":"2023-10-06T11:14:46.160841+0000","last_became_peered":"2023-10-06T11:14:46.160841+0000","last_unstale":"2023-10-06T11:14:47.036569+0000","last_undegraded":"2023-10-06T11:14:47.036569+0000","last_fullsized":"2023-10-06T11:14:47.036569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:35.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.034283+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:14:47.034283+0000","last_peered":"2023-10-06T11:14:47.034283+0000","last_clean":"2023-10-06T11:14:47.034283+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:14:47.034283+0000","last_undegraded":"2023-10-06T11:14:47.034283+0000","last_fullsized":"2023-10-06T11:14:47.034283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.036413+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:14:47.036413+0000","last_peered":"2023-10-06T11:14:47.036413+0000","last_clean":"2023-10-06T11:14:47.036413+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:14:47.036413+0000","last_undegraded":"2023-10-06T11:14:47.036413+0000","last_fullsized":"2023-10-06T11:14:47.036413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050210+0000","last_change":"2023-10-06T11:14:47.046258+0000","last_active":"2023-10-06T11:14:47.050210+0000","last_peered":"2023-10-06T11:14:47.050210+0000","last_clean":"2023-10-06T11:14:47.050210+0000","last_became_active":"2023-10-06T11:14:47.045913+0000","last_became_peered":"2023-10-06T11:14:47.045913+0000","last_unstale":"2023-10-06T11:14:47.050210+0000","last_undegraded":"2023-10-06T11:14:47.050210+0000","last_fullsized":"2023-10-06T11:14:47.050210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:01.027798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047134+0000","last_change":"2023-10-06T11:14:46.162110+0000","last_active":"2023-10-06T11:14:47.047134+0000","last_peered":"2023-10-06T11:14:47.047134+0000","last_clean":"2023-10-06T11:14:47.047134+0000","last_became_active":"2023-10-06T11:14:46.161764+0000","last_became_peered":"2023-10-06T11:14:46.161764+0000","last_unstale":"2023-10-06T11:14:47.047134+0000","last_undegraded":"2023-10-06T11:14:47.047134+0000","last_fullsized":"2023-10-06T11:14:47.047134+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:09.202602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.036522+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:14:47.036522+0000","last_peered":"2023-10-06T11:14:47.036522+0000","last_clean":"2023-10-06T11:14:47.036522+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:14:47.036522+0000","last_undegraded":"2023-10-06T11:14:47.036522+0000","last_fullsized":"2023-10-06T11:14:47.036522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.054043+0000","last_change":"2023-10-06T11:14:47.051893+0000","last_active":"2023-10-06T11:14:47.054043+0000","last_peered":"2023-10-06T11:14:47.054043+0000","last_clean":"2023-10-06T11:14:47.054043+0000","last_became_active":"2023-10-06T11:14:47.051636+0000","last_became_peered":"2023-10-06T11:14:47.051636+0000","last_unstale":"2023-10-06T11:14:47.054043+0000","last_undegraded":"2023-10-06T11:14:47.054043+0000","last_fullsized":"2023-10-06T11:14:47.054043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:25.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176786+0000","last_change":"2023-10-06T11:14:46.163349+0000","last_active":"2023-10-06T11:14:47.176786+0000","last_peered":"2023-10-06T11:14:47.176786+0000","last_clean":"2023-10-06T11:14:47.176786+0000","last_became_active":"2023-10-06T11:14:46.163096+0000","last_became_peered":"2023-10-06T11:14:46.163096+0000","last_unstale":"2023-10-06T11:14:47.176786+0000","last_undegraded":"2023-10-06T11:14:47.176786+0000","last_fullsized":"2023-10-06T11:14:47.176786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:56.091368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039041+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:14:47.039041+0000","last_peered":"2023-10-06T11:14:47.039041+0000","last_clean":"2023-10-06T11:14:47.039041+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:14:47.039041+0000","last_undegraded":"2023-10-06T11:14:47.039041+0000","last_fullsized":"2023-10-06T11:14:47.039041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059609+0000","last_change":"2023-10-06T11:14:47.054783+0000","last_active":"2023-10-06T11:14:47.059609+0000","last_peered":"2023-10-06T11:14:47.059609+0000","last_clean":"2023-10-06T11:14:47.059609+0000","last_became_active":"2023-10-06T11:14:47.054520+0000","last_became_peered":"2023-10-06T11:14:47.054520+0000","last_unstale":"2023-10-06T11:14:47.059609+0000","last_undegraded":"2023-10-06T11:14:47.059609+0000","last_fullsized":"2023-10-06T11:14:47.059609+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:38.331008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039837+0000","last_change":"2023-10-06T11:14:46.171147+0000","last_active":"2023-10-06T11:14:47.039837+0000","last_peered":"2023-10-06T11:14:47.039837+0000","last_clean":"2023-10-06T11:14:47.039837+0000","last_became_active":"2023-10-06T11:14:46.170891+0000","last_became_peered":"2023-10-06T11:14:46.170891+0000","last_unstale":"2023-10-06T11:14:47.039837+0000","last_undegraded":"2023-10-06T11:14:47.039837+0000","last_fullsized":"2023-10-06T11:14:47.039837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:24.025599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048077+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:14:47.048077+0000","last_peered":"2023-10-06T11:14:47.048077+0000","last_clean":"2023-10-06T11:14:47.048077+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:14:47.048077+0000","last_undegraded":"2023-10-06T11:14:47.048077+0000","last_fullsized":"2023-10-06T11:14:47.048077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041906+0000","last_change":"2023-10-06T11:14:47.039809+0000","last_active":"2023-10-06T11:14:47.041906+0000","last_peered":"2023-10-06T11:14:47.041906+0000","last_clean":"2023-10-06T11:14:47.041906+0000","last_became_active":"2023-10-06T11:14:47.039535+0000","last_became_peered":"2023-10-06T11:14:47.039535+0000","last_unstale":"2023-10-06T11:14:47.041906+0000","last_undegraded":"2023-10-06T11:14:47.041906+0000","last_fullsized":"2023-10-06T11:14:47.041906+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:05.137727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176884+0000","last_change":"2023-10-06T11:14:46.163149+0000","last_active":"2023-10-06T11:14:47.176884+0000","last_peered":"2023-10-06T11:14:47.176884+0000","last_clean":"2023-10-06T11:14:47.176884+0000","last_became_active":"2023-10-06T11:14:46.162891+0000","last_became_peered":"2023-10-06T11:14:46.162891+0000","last_unstale":"2023-10-06T11:14:47.176884+0000","last_undegraded":"2023-10-06T11:14:47.176884+0000","last_fullsized":"2023-10-06T11:14:47.176884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:59:56.866109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.035557+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:14:47.035557+0000","last_peered":"2023-10-06T11:14:47.035557+0000","last_clean":"2023-10-06T11:14:47.035557+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:14:47.035557+0000","last_undegraded":"2023-10-06T11:14:47.035557+0000","last_fullsized":"2023-10-06T11:14:47.035557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":889720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.6850000000000005,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":299192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.623}]},{"osd":4,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":299282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.27600000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.435},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":891650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.379},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073904,"statfs":{"total":96636764160,"available":96331677696,"internally_reserved":0,"allocated":663552,"data_stored":299248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.74299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073904,"statfs":{"total":96636764160,"available":96331677696,"internally_reserved":0,"allocated":663552,"data_stored":299248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":300728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.504},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.436},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":292855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:14:51.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:14:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.440+0000 7f0e99154700 1 Processor -- start 2023-10-06T11:14:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.440+0000 7f0e99154700 1 -- start start 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e99154700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e940b0760 0x7f0e940ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e99154700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940b0c60 con 0x7f0e94159560 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e99154700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940b0f40 con 0x7f0e940b49a0 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e99154700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940ab350 con 0x7f0e940b0760 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e92d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0e94159560 0x7f0e940aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45780/0 (socket says 172.21.15.55:45780) 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e92d9d700 1 -- 172.21.15.55:0/2901784497 learned_addr learned my addr 172.21.15.55:0/2901784497 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5394663 0 0) 0x7f0e940b0c60 con 0x7f0e94159560 2023-10-06T11:14:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e7c003570 con 0x7f0e94159560 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e9359e700 1 --2- 172.21.15.55:0/2901784497 >> v2:172.21.15.142:3300/0 conn(0x7f0e940b0760 0x7f0e940ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325281403 0 0) 0x7f0e7c003570 con 0x7f0e94159560 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 >> v2:172.21.15.142:3300/0 conn(0x7f0e940b0760 msgr2=0x7f0e940ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 --2- 172.21.15.55:0/2901784497 >> v2:172.21.15.142:3300/0 conn(0x7f0e940b0760 0x7f0e940ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 >> v1:172.21.15.142:6789/0 conn(0x7f0e940b49a0 legacy=0x7f0e940aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940b1220 con 0x7f0e94159560 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f0e840015f0 con 0x7f0e94159560 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 >> v1:172.21.15.55:6789/0 conn(0x7f0e94159560 legacy=0x7f0e940aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e7c003a60 0x7f0e7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7c004810 0x7f0e7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c0052e0 0x7f0e7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940ab350 con 0x7f0e7c003a60 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c00c190 con 0x7f0e7c004810 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.441+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c00c350 con 0x7f0e7c0052e0 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e7c003a60 0x7f0e7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e9259c700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7c004810 0x7f0e7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e9359e700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c0052e0 0x7f0e7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 -- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c0052e0 msgr2=0x7f0e7c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c0052e0 0x7f0e7c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 -- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7c004810 msgr2=0x7f0e7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e7c004810 0x7f0e7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 -- 172.21.15.55:0/2901784497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c003570 con 0x7f0e7c003a60 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e9359e700 1 -- 172.21.15.55:0/2901784497 reap_dead start 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e7c003a60 0x7f0e7c003e70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c3c0 tx=0x7f0e84007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60502e3cdf09bde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400cc90 con 0x7f0e7c003a60 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400ce10 con 0x7f0e7c003a60 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e91d9b700 1 -- 172.21.15.55:0/2901784497 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84007320 con 0x7f0e7c003a60 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e99154700 1 -- 172.21.15.55:0/2901784497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e7c003a60 msgr2=0x7f0e7c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.442+0000 7f0e99154700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e7c003a60 0x7f0e7c003e70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c3c0 tx=0x7f0e84007920 comp rx=0 tx=0).stop 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.443+0000 7f0e99154700 1 -- 172.21.15.55:0/2901784497 shutdown_connections 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.443+0000 7f0e99154700 1 --2- 172.21.15.55:0/2901784497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e7c003a60 0x7f0e7c003e70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.443+0000 7f0e99154700 1 -- 172.21.15.55:0/2901784497 >> 172.21.15.55:0/2901784497 conn(0x7f0e940997f0 msgr2=0x7f0e9406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.443+0000 7f0e99154700 1 -- 172.21.15.55:0/2901784497 shutdown_connections 2023-10-06T11:14:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.443+0000 7f0e99154700 1 -- 172.21.15.55:0/2901784497 wait complete. 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.444+0000 7f0e99154700 1 Processor -- start 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.444+0000 7f0e99154700 1 -- start start 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.444+0000 7f0e99154700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c003a60 0x7f0e9409d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 0x7f0e9414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e940acdf0 0x7f0e940ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9409df30 con 0x7f0e9409a930 2023-10-06T11:14:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9409c0a0 con 0x7f0e940acdf0 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9409b7a0 con 0x7f0e7c003a60 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 0x7f0e9414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 0x7f0e9414d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48310/0 (socket says 172.21.15.55:48310) 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 -- 172.21.15.55:0/931684345 learned_addr learned my addr 172.21.15.55:0/931684345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c003a60 0x7f0e9409d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9359e700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e940acdf0 0x7f0e940ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 -- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c003a60 msgr2=0x7f0e9409d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c003a60 0x7f0e9409d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 -- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e940acdf0 msgr2=0x7f0e940ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e940acdf0 0x7f0e940ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 -- 172.21.15.55:0/931684345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9409ba90 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e9259c700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 0x7f0e9414d890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e640 tx=0x7f0e88009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88012590 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880126f0 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9409aed0 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88012ab0 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.445+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9414ddd0 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.446+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e94064a90 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.447+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e8801d460 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.447+0000 7f0e7affd700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.447+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0e880847f0 con 0x7f0e9409a930 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.448+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.448+0000 7f0e92d9d700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000ef0 tx=0x7f0e84015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.451+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e880517c0 con 0x7f0e9409a930 2023-10-06T11:14:51.475 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-10-06T11:14:51.473+0000 7f501fa90700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:14:51.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.640+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e940b1500 con 0x7f0e80066f30 2023-10-06T11:14:51.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.650+0000 7f0e7affd700 1 -- 172.21.15.55:0/931684345 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311255 (secure 0 0 0) 0x7f0e940b1500 con 0x7f0e80066f30 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e80066f30 msgr2=0x7f0e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000ef0 tx=0x7f0e84015000 comp rx=0 tx=0).stop 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 msgr2=0x7f0e9414d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 0x7f0e9414d890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e640 tx=0x7f0e88009040 comp rx=0 tx=0).stop 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 shutdown_connections 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e940acdf0 0x7f0e940ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e7c003a60 0x7f0e9409d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 --2- 172.21.15.55:0/931684345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9409a930 0x7f0e9414d890 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 >> 172.21.15.55:0/931684345 conn(0x7f0e940997f0 msgr2=0x7f0e94158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 shutdown_connections 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.653+0000 7f0e99154700 1 -- 172.21.15.55:0/931684345 wait complete. 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:14:51.668 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-06T11:14:50.864512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384636,"kb_used_data":6332,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590084,"statfs":{"total":773094113280,"available":770652246016,"internally_reserved":0,"allocated":6483968,"data_stored":3571923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.718954"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041584+0000","last_change":"2023-10-06T11:14:47.038975+0000","last_active":"2023-10-06T11:14:47.041584+0000","last_peered":"2023-10-06T11:14:47.041584+0000","last_clean":"2023-10-06T11:14:47.041584+0000","last_became_active":"2023-10-06T11:14:47.038691+0000","last_became_peered":"2023-10-06T11:14:47.038691+0000","last_unstale":"2023-10-06T11:14:47.041584+0000","last_undegraded":"2023-10-06T11:14:47.041584+0000","last_fullsized":"2023-10-06T11:14:47.041584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:24.561257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055146+0000","last_change":"2023-10-06T11:14:47.052182+0000","last_active":"2023-10-06T11:14:47.055146+0000","last_peered":"2023-10-06T11:14:47.055146+0000","last_clean":"2023-10-06T11:14:47.055146+0000","last_became_active":"2023-10-06T11:14:47.051832+0000","last_became_peered":"2023-10-06T11:14:47.051832+0000","last_unstale":"2023-10-06T11:14:47.055146+0000","last_undegraded":"2023-10-06T11:14:47.055146+0000","last_fullsized":"2023-10-06T11:14:47.055146+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:21.803331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051545+0000","last_change":"2023-10-06T11:14:47.047566+0000","last_active":"2023-10-06T11:14:47.051545+0000","last_peered":"2023-10-06T11:14:47.051545+0000","last_clean":"2023-10-06T11:14:47.051545+0000","last_became_active":"2023-10-06T11:14:47.047251+0000","last_became_peered":"2023-10-06T11:14:47.047251+0000","last_unstale":"2023-10-06T11:14:47.051545+0000","last_undegraded":"2023-10-06T11:14:47.051545+0000","last_fullsized":"2023-10-06T11:14:47.051545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:57.097421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048611+0000","last_change":"2023-10-06T11:14:47.044664+0000","last_active":"2023-10-06T11:14:47.048611+0000","last_peered":"2023-10-06T11:14:47.048611+0000","last_clean":"2023-10-06T11:14:47.048611+0000","last_became_active":"2023-10-06T11:14:47.044199+0000","last_became_peered":"2023-10-06T11:14:47.044199+0000","last_unstale":"2023-10-06T11:14:47.048611+0000","last_undegraded":"2023-10-06T11:14:47.048611+0000","last_fullsized":"2023-10-06T11:14:47.048611+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:55.843131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041411+0000","last_change":"2023-10-06T11:14:47.037534+0000","last_active":"2023-10-06T11:14:47.041411+0000","last_peered":"2023-10-06T11:14:47.041411+0000","last_clean":"2023-10-06T11:14:47.041411+0000","last_became_active":"2023-10-06T11:14:47.037330+0000","last_became_peered":"2023-10-06T11:14:47.037330+0000","last_unstale":"2023-10-06T11:14:47.041411+0000","last_undegraded":"2023-10-06T11:14:47.041411+0000","last_fullsized":"2023-10-06T11:14:47.041411+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:24:59.806562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049615+0000","last_change":"2023-10-06T11:14:47.043447+0000","last_active":"2023-10-06T11:14:47.049615+0000","last_peered":"2023-10-06T11:14:47.049615+0000","last_clean":"2023-10-06T11:14:47.049615+0000","last_became_active":"2023-10-06T11:14:47.043195+0000","last_became_peered":"2023-10-06T11:14:47.043195+0000","last_unstale":"2023-10-06T11:14:47.049615+0000","last_undegraded":"2023-10-06T11:14:47.049615+0000","last_fullsized":"2023-10-06T11:14:47.049615+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:33.368638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.043202+0000","last_change":"2023-10-06T11:14:47.037567+0000","last_active":"2023-10-06T11:14:47.043202+0000","last_peered":"2023-10-06T11:14:47.043202+0000","last_clean":"2023-10-06T11:14:47.043202+0000","last_became_active":"2023-10-06T11:14:47.037258+0000","last_became_peered":"2023-10-06T11:14:47.037258+0000","last_unstale":"2023-10-06T11:14:47.043202+0000","last_undegraded":"2023-10-06T11:14:47.043202+0000","last_fullsized":"2023-10-06T11:14:47.043202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:39.073317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041431+0000","last_change":"2023-10-06T11:14:47.036954+0000","last_active":"2023-10-06T11:14:47.041431+0000","last_peered":"2023-10-06T11:14:47.041431+0000","last_clean":"2023-10-06T11:14:47.041431+0000","last_became_active":"2023-10-06T11:14:47.036672+0000","last_became_peered":"2023-10-06T11:14:47.036672+0000","last_unstale":"2023-10-06T11:14:47.041431+0000","last_undegraded":"2023-10-06T11:14:47.041431+0000","last_fullsized":"2023-10-06T11:14:47.041431+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:21.514067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048015+0000","last_change":"2023-10-06T11:14:47.042284+0000","last_active":"2023-10-06T11:14:47.048015+0000","last_peered":"2023-10-06T11:14:47.048015+0000","last_clean":"2023-10-06T11:14:47.048015+0000","last_became_active":"2023-10-06T11:14:47.042010+0000","last_became_peered":"2023-10-06T11:14:47.042010+0000","last_unstale":"2023-10-06T11:14:47.048015+0000","last_undegraded":"2023-10-06T11:14:47.048015+0000","last_fullsized":"2023-10-06T11:14:47.048015+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:23.774194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.056023+0000","last_change":"2023-10-06T11:14:47.051830+0000","last_active":"2023-10-06T11:14:47.056023+0000","last_peered":"2023-10-06T11:14:47.056023+0000","last_clean":"2023-10-06T11:14:47.056023+0000","last_became_active":"2023-10-06T11:14:47.051497+0000","last_became_peered":"2023-10-06T11:14:47.051497+0000","last_unstale":"2023-10-06T11:14:47.056023+0000","last_undegraded":"2023-10-06T11:14:47.056023+0000","last_fullsized":"2023-10-06T11:14:47.056023+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:20.711854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.054226+0000","last_change":"2023-10-06T11:14:47.049797+0000","last_active":"2023-10-06T11:14:47.054226+0000","last_peered":"2023-10-06T11:14:47.054226+0000","last_clean":"2023-10-06T11:14:47.054226+0000","last_became_active":"2023-10-06T11:14:47.049558+0000","last_became_peered":"2023-10-06T11:14:47.049558+0000","last_unstale":"2023-10-06T11:14:47.054226+0000","last_undegraded":"2023-10-06T11:14:47.054226+0000","last_fullsized":"2023-10-06T11:14:47.054226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:38:09.165086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.045027+0000","last_change":"2023-10-06T11:14:47.041172+0000","last_active":"2023-10-06T11:14:47.045027+0000","last_peered":"2023-10-06T11:14:47.045027+0000","last_clean":"2023-10-06T11:14:47.045027+0000","last_became_active":"2023-10-06T11:14:47.040895+0000","last_became_peered":"2023-10-06T11:14:47.040895+0000","last_unstale":"2023-10-06T11:14:47.045027+0000","last_undegraded":"2023-10-06T11:14:47.045027+0000","last_fullsized":"2023-10-06T11:14:47.045027+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:57.097421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047231+0000","last_change":"2023-10-06T11:14:47.043958+0000","last_active":"2023-10-06T11:14:47.047231+0000","last_peered":"2023-10-06T11:14:47.047231+0000","last_clean":"2023-10-06T11:14:47.047231+0000","last_became_active":"2023-10-06T11:14:47.043674+0000","last_became_peered":"2023-10-06T11:14:47.043674+0000","last_unstale":"2023-10-06T11:14:47.047231+0000","last_undegraded":"2023-10-06T11:14:47.047231+0000","last_fullsized":"2023-10-06T11:14:47.047231+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.150038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051090+0000","last_change":"2023-10-06T11:14:47.043459+0000","last_active":"2023-10-06T11:14:47.051090+0000","last_peered":"2023-10-06T11:14:47.051090+0000","last_clean":"2023-10-06T11:14:47.051090+0000","last_became_active":"2023-10-06T11:14:47.043204+0000","last_became_peered":"2023-10-06T11:14:47.043204+0000","last_unstale":"2023-10-06T11:14:47.051090+0000","last_undegraded":"2023-10-06T11:14:47.051090+0000","last_fullsized":"2023-10-06T11:14:47.051090+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:01.857324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.057056+0000","last_change":"2023-10-06T11:14:47.052307+0000","last_active":"2023-10-06T11:14:47.057056+0000","last_peered":"2023-10-06T11:14:47.057056+0000","last_clean":"2023-10-06T11:14:47.057056+0000","last_became_active":"2023-10-06T11:14:47.052007+0000","last_became_peered":"2023-10-06T11:14:47.052007+0000","last_unstale":"2023-10-06T11:14:47.057056+0000","last_undegraded":"2023-10-06T11:14:47.057056+0000","last_fullsized":"2023-10-06T11:14:47.057056+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:59.192722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050257+0000","last_change":"2023-10-06T11:14:47.046167+0000","last_active":"2023-10-06T11:14:47.050257+0000","last_peered":"2023-10-06T11:14:47.050257+0000","last_clean":"2023-10-06T11:14:47.050257+0000","last_became_active":"2023-10-06T11:14:47.045788+0000","last_became_peered":"2023-10-06T11:14:47.045788+0000","last_unstale":"2023-10-06T11:14:47.050257+0000","last_undegraded":"2023-10-06T11:14:47.050257+0000","last_fullsized":"2023-10-06T11:14:47.050257+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:05.137727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049926+0000","last_change":"2023-10-06T11:14:47.045141+0000","last_active":"2023-10-06T11:14:47.049926+0000","last_peered":"2023-10-06T11:14:47.049926+0000","last_clean":"2023-10-06T11:14:47.049926+0000","last_became_active":"2023-10-06T11:14:47.044853+0000","last_became_peered":"2023-10-06T11:14:47.044853+0000","last_unstale":"2023-10-06T11:14:47.049926+0000","last_undegraded":"2023-10-06T11:14:47.049926+0000","last_fullsized":"2023-10-06T11:14:47.049926+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:40.605938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.052025+0000","last_change":"2023-10-06T11:14:47.050729+0000","last_active":"2023-10-06T11:14:47.052025+0000","last_peered":"2023-10-06T11:14:47.052025+0000","last_clean":"2023-10-06T11:14:47.052025+0000","last_became_active":"2023-10-06T11:14:47.050519+0000","last_became_peered":"2023-10-06T11:14:47.050519+0000","last_unstale":"2023-10-06T11:14:47.052025+0000","last_undegraded":"2023-10-06T11:14:47.052025+0000","last_fullsized":"2023-10-06T11:14:47.052025+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:25:22.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.042216+0000","last_change":"2023-10-06T11:14:47.039057+0000","last_active":"2023-10-06T11:14:47.042216+0000","last_peered":"2023-10-06T11:14:47.042216+0000","last_clean":"2023-10-06T11:14:47.042216+0000","last_became_active":"2023-10-06T11:14:47.038700+0000","last_became_peered":"2023-10-06T11:14:47.038700+0000","last_unstale":"2023-10-06T11:14:47.042216+0000","last_undegraded":"2023-10-06T11:14:47.042216+0000","last_fullsized":"2023-10-06T11:14:47.042216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:33.528929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048937+0000","last_change":"2023-10-06T11:14:47.042988+0000","last_active":"2023-10-06T11:14:47.048937+0000","last_peered":"2023-10-06T11:14:47.048937+0000","last_clean":"2023-10-06T11:14:47.048937+0000","last_became_active":"2023-10-06T11:14:47.042713+0000","last_became_peered":"2023-10-06T11:14:47.042713+0000","last_unstale":"2023-10-06T11:14:47.048937+0000","last_undegraded":"2023-10-06T11:14:47.048937+0000","last_fullsized":"2023-10-06T11:14:47.048937+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:19.960724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048280+0000","last_change":"2023-10-06T11:14:47.043225+0000","last_active":"2023-10-06T11:14:47.048280+0000","last_peered":"2023-10-06T11:14:47.048280+0000","last_clean":"2023-10-06T11:14:47.048280+0000","last_became_active":"2023-10-06T11:14:47.042909+0000","last_became_peered":"2023-10-06T11:14:47.042909+0000","last_unstale":"2023-10-06T11:14:47.048280+0000","last_undegraded":"2023-10-06T11:14:47.048280+0000","last_fullsized":"2023-10-06T11:14:47.048280+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:37.055193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048993+0000","last_change":"2023-10-06T11:14:47.044467+0000","last_active":"2023-10-06T11:14:47.048993+0000","last_peered":"2023-10-06T11:14:47.048993+0000","last_clean":"2023-10-06T11:14:47.048993+0000","last_became_active":"2023-10-06T11:14:47.044146+0000","last_became_peered":"2023-10-06T11:14:47.044146+0000","last_unstale":"2023-10-06T11:14:47.048993+0000","last_undegraded":"2023-10-06T11:14:47.048993+0000","last_fullsized":"2023-10-06T11:14:47.048993+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:34.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048530+0000","last_change":"2023-10-06T11:14:47.044658+0000","last_active":"2023-10-06T11:14:47.048530+0000","last_peered":"2023-10-06T11:14:47.048530+0000","last_clean":"2023-10-06T11:14:47.048530+0000","last_became_active":"2023-10-06T11:14:47.044056+0000","last_became_peered":"2023-10-06T11:14:47.044056+0000","last_unstale":"2023-10-06T11:14:47.048530+0000","last_undegraded":"2023-10-06T11:14:47.048530+0000","last_fullsized":"2023-10-06T11:14:47.048530+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:20.285847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048903+0000","last_change":"2023-10-06T11:14:47.044245+0000","last_active":"2023-10-06T11:14:47.048903+0000","last_peered":"2023-10-06T11:14:47.048903+0000","last_clean":"2023-10-06T11:14:47.048903+0000","last_became_active":"2023-10-06T11:14:47.043903+0000","last_became_peered":"2023-10-06T11:14:47.043903+0000","last_unstale":"2023-10-06T11:14:47.048903+0000","last_undegraded":"2023-10-06T11:14:47.048903+0000","last_fullsized":"2023-10-06T11:14:47.048903+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:10.586573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055736+0000","last_change":"2023-10-06T11:14:47.053936+0000","last_active":"2023-10-06T11:14:47.055736+0000","last_peered":"2023-10-06T11:14:47.055736+0000","last_clean":"2023-10-06T11:14:47.055736+0000","last_became_active":"2023-10-06T11:14:47.053668+0000","last_became_peered":"2023-10-06T11:14:47.053668+0000","last_unstale":"2023-10-06T11:14:47.055736+0000","last_undegraded":"2023-10-06T11:14:47.055736+0000","last_fullsized":"2023-10-06T11:14:47.055736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:36.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.042433+0000","last_change":"2023-10-06T11:14:47.035418+0000","last_active":"2023-10-06T11:14:47.042433+0000","last_peered":"2023-10-06T11:14:47.042433+0000","last_clean":"2023-10-06T11:14:47.042433+0000","last_became_active":"2023-10-06T11:14:47.035146+0000","last_became_peered":"2023-10-06T11:14:47.035146+0000","last_unstale":"2023-10-06T11:14:47.042433+0000","last_undegraded":"2023-10-06T11:14:47.042433+0000","last_fullsized":"2023-10-06T11:14:47.042433+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:38.331008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050227+0000","last_change":"2023-10-06T11:14:47.046382+0000","last_active":"2023-10-06T11:14:47.050227+0000","last_peered":"2023-10-06T11:14:47.050227+0000","last_clean":"2023-10-06T11:14:47.050227+0000","last_became_active":"2023-10-06T11:14:47.045422+0000","last_became_peered":"2023-10-06T11:14:47.045422+0000","last_unstale":"2023-10-06T11:14:47.050227+0000","last_undegraded":"2023-10-06T11:14:47.050227+0000","last_fullsized":"2023-10-06T11:14:47.050227+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:05.888783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.043401+0000","last_change":"2023-10-06T11:14:47.038252+0000","last_active":"2023-10-06T11:14:47.043401+0000","last_peered":"2023-10-06T11:14:47.043401+0000","last_clean":"2023-10-06T11:14:47.043401+0000","last_became_active":"2023-10-06T11:14:47.038010+0000","last_became_peered":"2023-10-06T11:14:47.038010+0000","last_unstale":"2023-10-06T11:14:47.043401+0000","last_undegraded":"2023-10-06T11:14:47.043401+0000","last_fullsized":"2023-10-06T11:14:47.043401+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:03.438347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049018+0000","last_change":"2023-10-06T11:14:47.043128+0000","last_active":"2023-10-06T11:14:47.049018+0000","last_peered":"2023-10-06T11:14:47.049018+0000","last_clean":"2023-10-06T11:14:47.049018+0000","last_became_active":"2023-10-06T11:14:47.042620+0000","last_became_peered":"2023-10-06T11:14:47.042620+0000","last_unstale":"2023-10-06T11:14:47.049018+0000","last_undegraded":"2023-10-06T11:14:47.049018+0000","last_fullsized":"2023-10-06T11:14:47.049018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:59.192722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048712+0000","last_change":"2023-10-06T11:14:47.044205+0000","last_active":"2023-10-06T11:14:47.048712+0000","last_peered":"2023-10-06T11:14:47.048712+0000","last_clean":"2023-10-06T11:14:47.048712+0000","last_became_active":"2023-10-06T11:14:47.043948+0000","last_became_peered":"2023-10-06T11:14:47.043948+0000","last_unstale":"2023-10-06T11:14:47.048712+0000","last_undegraded":"2023-10-06T11:14:47.048712+0000","last_fullsized":"2023-10-06T11:14:47.048712+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:01.642027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055097+0000","last_change":"2023-10-06T11:14:47.052527+0000","last_active":"2023-10-06T11:14:47.055097+0000","last_peered":"2023-10-06T11:14:47.055097+0000","last_clean":"2023-10-06T11:14:47.055097+0000","last_became_active":"2023-10-06T11:14:47.052205+0000","last_became_peered":"2023-10-06T11:14:47.052205+0000","last_unstale":"2023-10-06T11:14:47.055097+0000","last_undegraded":"2023-10-06T11:14:47.055097+0000","last_fullsized":"2023-10-06T11:14:47.055097+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:52.517718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050266+0000","last_change":"2023-10-06T11:14:47.048377+0000","last_active":"2023-10-06T11:14:47.050266+0000","last_peered":"2023-10-06T11:14:47.050266+0000","last_clean":"2023-10-06T11:14:47.050266+0000","last_became_active":"2023-10-06T11:14:47.047983+0000","last_became_peered":"2023-10-06T11:14:47.047983+0000","last_unstale":"2023-10-06T11:14:47.050266+0000","last_undegraded":"2023-10-06T11:14:47.050266+0000","last_fullsized":"2023-10-06T11:14:47.050266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:21.514067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050190+0000","last_change":"2023-10-06T11:14:47.044899+0000","last_active":"2023-10-06T11:14:47.050190+0000","last_peered":"2023-10-06T11:14:47.050190+0000","last_clean":"2023-10-06T11:14:47.050190+0000","last_became_active":"2023-10-06T11:14:47.044645+0000","last_became_peered":"2023-10-06T11:14:47.044645+0000","last_unstale":"2023-10-06T11:14:47.050190+0000","last_undegraded":"2023-10-06T11:14:47.050190+0000","last_fullsized":"2023-10-06T11:14:47.050190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:36.976572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.179358+0000","last_change":"2023-10-06T11:14:46.166988+0000","last_active":"2023-10-06T11:14:47.179358+0000","last_peered":"2023-10-06T11:14:47.179358+0000","last_clean":"2023-10-06T11:14:47.179358+0000","last_became_active":"2023-10-06T11:14:46.166368+0000","last_became_peered":"2023-10-06T11:14:46.166368+0000","last_unstale":"2023-10-06T11:14:47.179358+0000","last_undegraded":"2023-10-06T11:14:47.179358+0000","last_fullsized":"2023-10-06T11:14:47.179358+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:56.091368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.056044+0000","last_change":"2023-10-06T11:14:47.051911+0000","last_active":"2023-10-06T11:14:47.056044+0000","last_peered":"2023-10-06T11:14:47.056044+0000","last_clean":"2023-10-06T11:14:47.056044+0000","last_became_active":"2023-10-06T11:14:47.051385+0000","last_became_peered":"2023-10-06T11:14:47.051385+0000","last_unstale":"2023-10-06T11:14:47.056044+0000","last_undegraded":"2023-10-06T11:14:47.056044+0000","last_fullsized":"2023-10-06T11:14:47.056044+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:46.489821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176108+0000","last_change":"2023-10-06T11:14:46.166095+0000","last_active":"2023-10-06T11:14:47.176108+0000","last_peered":"2023-10-06T11:14:47.176108+0000","last_clean":"2023-10-06T11:14:47.176108+0000","last_became_active":"2023-10-06T11:14:46.165770+0000","last_became_peered":"2023-10-06T11:14:46.165770+0000","last_unstale":"2023-10-06T11:14:47.176108+0000","last_undegraded":"2023-10-06T11:14:47.176108+0000","last_fullsized":"2023-10-06T11:14:47.176108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:00.635974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055656+0000","last_change":"2023-10-06T11:14:47.054956+0000","last_active":"2023-10-06T11:14:47.055656+0000","last_peered":"2023-10-06T11:14:47.055656+0000","last_clean":"2023-10-06T11:14:47.055656+0000","last_became_active":"2023-10-06T11:14:47.054512+0000","last_became_peered":"2023-10-06T11:14:47.054512+0000","last_unstale":"2023-10-06T11:14:47.055656+0000","last_undegraded":"2023-10-06T11:14:47.055656+0000","last_fullsized":"2023-10-06T11:14:47.055656+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:39.824169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176256+0000","last_change":"2023-10-06T11:14:46.167866+0000","last_active":"2023-10-06T11:14:47.176256+0000","last_peered":"2023-10-06T11:14:47.176256+0000","last_clean":"2023-10-06T11:14:47.176256+0000","last_became_active":"2023-10-06T11:14:46.167226+0000","last_became_peered":"2023-10-06T11:14:46.167226+0000","last_unstale":"2023-10-06T11:14:47.176256+0000","last_undegraded":"2023-10-06T11:14:47.176256+0000","last_fullsized":"2023-10-06T11:14:47.176256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:54.837078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050249+0000","last_change":"2023-10-06T11:14:47.046758+0000","last_active":"2023-10-06T11:14:47.050249+0000","last_peered":"2023-10-06T11:14:47.050249+0000","last_clean":"2023-10-06T11:14:47.050249+0000","last_became_active":"2023-10-06T11:14:47.046486+0000","last_became_peered":"2023-10-06T11:14:47.046486+0000","last_unstale":"2023-10-06T11:14:47.050249+0000","last_undegraded":"2023-10-06T11:14:47.050249+0000","last_fullsized":"2023-10-06T11:14:47.050249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:34.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.178348+0000","last_change":"2023-10-06T11:14:46.163111+0000","last_active":"2023-10-06T11:14:47.178348+0000","last_peered":"2023-10-06T11:14:47.178348+0000","last_clean":"2023-10-06T11:14:47.178348+0000","last_became_active":"2023-10-06T11:14:46.162823+0000","last_became_peered":"2023-10-06T11:14:46.162823+0000","last_unstale":"2023-10-06T11:14:47.178348+0000","last_undegraded":"2023-10-06T11:14:47.178348+0000","last_fullsized":"2023-10-06T11:14:47.178348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:23.135289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048973+0000","last_change":"2023-10-06T11:14:47.044184+0000","last_active":"2023-10-06T11:14:47.048973+0000","last_peered":"2023-10-06T11:14:47.048973+0000","last_clean":"2023-10-06T11:14:47.048973+0000","last_became_active":"2023-10-06T11:14:47.043928+0000","last_became_peered":"2023-10-06T11:14:47.043928+0000","last_unstale":"2023-10-06T11:14:47.048973+0000","last_undegraded":"2023-10-06T11:14:47.048973+0000","last_fullsized":"2023-10-06T11:14:47.048973+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:39.824169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.179152+0000","last_change":"2023-10-06T11:14:46.157732+0000","last_active":"2023-10-06T11:14:47.179152+0000","last_peered":"2023-10-06T11:14:47.179152+0000","last_clean":"2023-10-06T11:14:47.179152+0000","last_became_active":"2023-10-06T11:14:46.157430+0000","last_became_peered":"2023-10-06T11:14:46.157430+0000","last_unstale":"2023-10-06T11:14:47.179152+0000","last_undegraded":"2023-10-06T11:14:47.179152+0000","last_fullsized":"2023-10-06T11:14:47.179152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:59.960801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049035+0000","last_change":"2023-10-06T11:14:47.043299+0000","last_active":"2023-10-06T11:14:47.049035+0000","last_peered":"2023-10-06T11:14:47.049035+0000","last_clean":"2023-10-06T11:14:47.049035+0000","last_became_active":"2023-10-06T11:14:47.042985+0000","last_became_peered":"2023-10-06T11:14:47.042985+0000","last_unstale":"2023-10-06T11:14:47.049035+0000","last_undegraded":"2023-10-06T11:14:47.049035+0000","last_fullsized":"2023-10-06T11:14:47.049035+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:12.425423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.175968+0000","last_change":"2023-10-06T11:14:46.168760+0000","last_active":"2023-10-06T11:14:47.175968+0000","last_peered":"2023-10-06T11:14:47.175968+0000","last_clean":"2023-10-06T11:14:47.175968+0000","last_became_active":"2023-10-06T11:14:46.168471+0000","last_became_peered":"2023-10-06T11:14:46.168471+0000","last_unstale":"2023-10-06T11:14:47.175968+0000","last_undegraded":"2023-10-06T11:14:47.175968+0000","last_fullsized":"2023-10-06T11:14:47.175968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:09.331136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.043736+0000","last_change":"2023-10-06T11:14:47.041176+0000","last_active":"2023-10-06T11:14:47.043736+0000","last_peered":"2023-10-06T11:14:47.043736+0000","last_clean":"2023-10-06T11:14:47.043736+0000","last_became_active":"2023-10-06T11:14:47.040901+0000","last_became_peered":"2023-10-06T11:14:47.040901+0000","last_unstale":"2023-10-06T11:14:47.043736+0000","last_undegraded":"2023-10-06T11:14:47.043736+0000","last_fullsized":"2023-10-06T11:14:47.043736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:59.171440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033854+0000","last_change":"2023-10-06T11:14:46.159975+0000","last_active":"2023-10-06T11:14:47.033854+0000","last_peered":"2023-10-06T11:14:47.033854+0000","last_clean":"2023-10-06T11:14:47.033854+0000","last_became_active":"2023-10-06T11:14:46.159655+0000","last_became_peered":"2023-10-06T11:14:46.159655+0000","last_unstale":"2023-10-06T11:14:47.033854+0000","last_undegraded":"2023-10-06T11:14:47.033854+0000","last_fullsized":"2023-10-06T11:14:47.033854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:00.169363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049962+0000","last_change":"2023-10-06T11:14:47.045170+0000","last_active":"2023-10-06T11:14:47.049962+0000","last_peered":"2023-10-06T11:14:47.049962+0000","last_clean":"2023-10-06T11:14:47.049962+0000","last_became_active":"2023-10-06T11:14:47.044900+0000","last_became_peered":"2023-10-06T11:14:47.044900+0000","last_unstale":"2023-10-06T11:14:47.049962+0000","last_undegraded":"2023-10-06T11:14:47.049962+0000","last_fullsized":"2023-10-06T11:14:47.049962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:01.027798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.030682+0000","last_change":"2023-10-06T11:14:46.169480+0000","last_active":"2023-10-06T11:14:47.030682+0000","last_peered":"2023-10-06T11:14:47.030682+0000","last_clean":"2023-10-06T11:14:47.030682+0000","last_became_active":"2023-10-06T11:14:46.169138+0000","last_became_peered":"2023-10-06T11:14:46.169138+0000","last_unstale":"2023-10-06T11:14:47.030682+0000","last_undegraded":"2023-10-06T11:14:47.030682+0000","last_fullsized":"2023-10-06T11:14:47.030682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:36.049140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059470+0000","last_change":"2023-10-06T11:14:47.054786+0000","last_active":"2023-10-06T11:14:47.059470+0000","last_peered":"2023-10-06T11:14:47.059470+0000","last_clean":"2023-10-06T11:14:47.059470+0000","last_became_active":"2023-10-06T11:14:47.054571+0000","last_became_peered":"2023-10-06T11:14:47.054571+0000","last_unstale":"2023-10-06T11:14:47.059470+0000","last_undegraded":"2023-10-06T11:14:47.059470+0000","last_fullsized":"2023-10-06T11:14:47.059470+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:36.425321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039366+0000","last_change":"2023-10-06T11:14:46.168779+0000","last_active":"2023-10-06T11:14:47.039366+0000","last_peered":"2023-10-06T11:14:47.039366+0000","last_clean":"2023-10-06T11:14:47.039366+0000","last_became_active":"2023-10-06T11:14:46.168517+0000","last_became_peered":"2023-10-06T11:14:46.168517+0000","last_unstale":"2023-10-06T11:14:47.039366+0000","last_undegraded":"2023-10-06T11:14:47.039366+0000","last_fullsized":"2023-10-06T11:14:47.039366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:29.838661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059631+0000","last_change":"2023-10-06T11:14:47.054917+0000","last_active":"2023-10-06T11:14:47.059631+0000","last_peered":"2023-10-06T11:14:47.059631+0000","last_clean":"2023-10-06T11:14:47.059631+0000","last_became_active":"2023-10-06T11:14:47.054617+0000","last_became_peered":"2023-10-06T11:14:47.054617+0000","last_unstale":"2023-10-06T11:14:47.059631+0000","last_undegraded":"2023-10-06T11:14:47.059631+0000","last_fullsized":"2023-10-06T11:14:47.059631+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:55.843131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033786+0000","last_change":"2023-10-06T11:14:46.163277+0000","last_active":"2023-10-06T11:14:47.033786+0000","last_peered":"2023-10-06T11:14:47.033786+0000","last_clean":"2023-10-06T11:14:47.033786+0000","last_became_active":"2023-10-06T11:14:46.162993+0000","last_became_peered":"2023-10-06T11:14:46.162993+0000","last_unstale":"2023-10-06T11:14:47.033786+0000","last_undegraded":"2023-10-06T11:14:47.033786+0000","last_fullsized":"2023-10-06T11:14:47.033786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:36.049140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055687+0000","last_change":"2023-10-06T11:14:47.051716+0000","last_active":"2023-10-06T11:14:47.055687+0000","last_peered":"2023-10-06T11:14:47.055687+0000","last_clean":"2023-10-06T11:14:47.055687+0000","last_became_active":"2023-10-06T11:14:47.051389+0000","last_became_peered":"2023-10-06T11:14:47.051389+0000","last_unstale":"2023-10-06T11:14:47.055687+0000","last_undegraded":"2023-10-06T11:14:47.055687+0000","last_fullsized":"2023-10-06T11:14:47.055687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:56:22.428439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.178979+0000","last_change":"2023-10-06T11:14:46.168155+0000","last_active":"2023-10-06T11:14:47.178979+0000","last_peered":"2023-10-06T11:14:47.178979+0000","last_clean":"2023-10-06T11:14:47.178979+0000","last_became_active":"2023-10-06T11:14:46.167909+0000","last_became_peered":"2023-10-06T11:14:46.167909+0000","last_unstale":"2023-10-06T11:14:47.178979+0000","last_undegraded":"2023-10-06T11:14:47.178979+0000","last_fullsized":"2023-10-06T11:14:47.178979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:45.483768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059633+0000","last_change":"2023-10-06T11:14:47.055110+0000","last_active":"2023-10-06T11:14:47.059633+0000","last_peered":"2023-10-06T11:14:47.059633+0000","last_clean":"2023-10-06T11:14:47.059633+0000","last_became_active":"2023-10-06T11:14:47.054841+0000","last_became_peered":"2023-10-06T11:14:47.054841+0000","last_unstale":"2023-10-06T11:14:47.059633+0000","last_undegraded":"2023-10-06T11:14:47.059633+0000","last_fullsized":"2023-10-06T11:14:47.059633+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:07:00.966854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.184831+0000","last_change":"2023-10-06T11:14:46.158684+0000","last_active":"2023-10-06T11:14:47.184831+0000","last_peered":"2023-10-06T11:14:47.184831+0000","last_clean":"2023-10-06T11:14:47.184831+0000","last_became_active":"2023-10-06T11:14:46.158379+0000","last_became_peered":"2023-10-06T11:14:46.158379+0000","last_unstale":"2023-10-06T11:14:47.184831+0000","last_undegraded":"2023-10-06T11:14:47.184831+0000","last_fullsized":"2023-10-06T11:14:47.184831+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:00.635974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.057147+0000","last_change":"2023-10-06T11:14:47.052189+0000","last_active":"2023-10-06T11:14:47.057147+0000","last_peered":"2023-10-06T11:14:47.057147+0000","last_clean":"2023-10-06T11:14:47.057147+0000","last_became_active":"2023-10-06T11:14:47.051893+0000","last_became_peered":"2023-10-06T11:14:47.051893+0000","last_unstale":"2023-10-06T11:14:47.057147+0000","last_undegraded":"2023-10-06T11:14:47.057147+0000","last_fullsized":"2023-10-06T11:14:47.057147+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:20.285847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.177194+0000","last_change":"2023-10-06T11:14:46.162085+0000","last_active":"2023-10-06T11:14:47.177194+0000","last_peered":"2023-10-06T11:14:47.177194+0000","last_clean":"2023-10-06T11:14:47.177194+0000","last_became_active":"2023-10-06T11:14:46.161834+0000","last_became_peered":"2023-10-06T11:14:46.161834+0000","last_unstale":"2023-10-06T11:14:47.177194+0000","last_undegraded":"2023-10-06T11:14:47.177194+0000","last_fullsized":"2023-10-06T11:14:47.177194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:37.324955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051269+0000","last_change":"2023-10-06T11:14:47.045876+0000","last_active":"2023-10-06T11:14:47.051269+0000","last_peered":"2023-10-06T11:14:47.051269+0000","last_clean":"2023-10-06T11:14:47.051269+0000","last_became_active":"2023-10-06T11:14:47.045612+0000","last_became_peered":"2023-10-06T11:14:47.045612+0000","last_unstale":"2023-10-06T11:14:47.051269+0000","last_undegraded":"2023-10-06T11:14:47.051269+0000","last_fullsized":"2023-10-06T11:14:47.051269+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:51.004842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.034993+0000","last_change":"2023-10-06T11:14:46.163346+0000","last_active":"2023-10-06T11:14:47.034993+0000","last_peered":"2023-10-06T11:14:47.034993+0000","last_clean":"2023-10-06T11:14:47.034993+0000","last_became_active":"2023-10-06T11:14:46.163097+0000","last_became_peered":"2023-10-06T11:14:46.163097+0000","last_unstale":"2023-10-06T11:14:47.034993+0000","last_undegraded":"2023-10-06T11:14:47.034993+0000","last_fullsized":"2023-10-06T11:14:47.034993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:23.555204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051122+0000","last_change":"2023-10-06T11:14:47.045163+0000","last_active":"2023-10-06T11:14:47.051122+0000","last_peered":"2023-10-06T11:14:47.051122+0000","last_clean":"2023-10-06T11:14:47.051122+0000","last_became_active":"2023-10-06T11:14:47.044829+0000","last_became_peered":"2023-10-06T11:14:47.044829+0000","last_unstale":"2023-10-06T11:14:47.051122+0000","last_undegraded":"2023-10-06T11:14:47.051122+0000","last_fullsized":"2023-10-06T11:14:47.051122+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:58.846738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033814+0000","last_change":"2023-10-06T11:14:46.163210+0000","last_active":"2023-10-06T11:14:47.033814+0000","last_peered":"2023-10-06T11:14:47.033814+0000","last_clean":"2023-10-06T11:14:47.033814+0000","last_became_active":"2023-10-06T11:14:46.162939+0000","last_became_peered":"2023-10-06T11:14:46.162939+0000","last_unstale":"2023-10-06T11:14:47.033814+0000","last_undegraded":"2023-10-06T11:14:47.033814+0000","last_fullsized":"2023-10-06T11:14:47.033814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:28.135342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048541+0000","last_change":"2023-10-06T11:14:47.044849+0000","last_active":"2023-10-06T11:14:47.048541+0000","last_peered":"2023-10-06T11:14:47.048541+0000","last_clean":"2023-10-06T11:14:47.048541+0000","last_became_active":"2023-10-06T11:14:47.044410+0000","last_became_peered":"2023-10-06T11:14:47.044410+0000","last_unstale":"2023-10-06T11:14:47.048541+0000","last_undegraded":"2023-10-06T11:14:47.048541+0000","last_fullsized":"2023-10-06T11:14:47.048541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:10.337189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.181880+0000","last_change":"2023-10-06T11:14:46.164999+0000","last_active":"2023-10-06T11:14:47.181880+0000","last_peered":"2023-10-06T11:14:47.181880+0000","last_clean":"2023-10-06T11:14:47.181880+0000","last_became_active":"2023-10-06T11:14:46.164708+0000","last_became_peered":"2023-10-06T11:14:46.164708+0000","last_unstale":"2023-10-06T11:14:47.181880+0000","last_undegraded":"2023-10-06T11:14:47.181880+0000","last_fullsized":"2023-10-06T11:14:47.181880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:19.705801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048439+0000","last_change":"2023-10-06T11:14:47.044539+0000","last_active":"2023-10-06T11:14:47.048439+0000","last_peered":"2023-10-06T11:14:47.048439+0000","last_clean":"2023-10-06T11:14:47.048439+0000","last_became_active":"2023-10-06T11:14:47.044126+0000","last_became_peered":"2023-10-06T11:14:47.044126+0000","last_unstale":"2023-10-06T11:14:47.048439+0000","last_undegraded":"2023-10-06T11:14:47.048439+0000","last_fullsized":"2023-10-06T11:14:47.048439+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:25.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.177344+0000","last_change":"2023-10-06T11:14:46.165906+0000","last_active":"2023-10-06T11:14:47.177344+0000","last_peered":"2023-10-06T11:14:47.177344+0000","last_clean":"2023-10-06T11:14:47.177344+0000","last_became_active":"2023-10-06T11:14:46.165630+0000","last_became_peered":"2023-10-06T11:14:46.165630+0000","last_unstale":"2023-10-06T11:14:47.177344+0000","last_undegraded":"2023-10-06T11:14:47.177344+0000","last_fullsized":"2023-10-06T11:14:47.177344+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:51.511665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.051172+0000","last_change":"2023-10-06T11:14:47.045903+0000","last_active":"2023-10-06T11:14:47.051172+0000","last_peered":"2023-10-06T11:14:47.051172+0000","last_clean":"2023-10-06T11:14:47.051172+0000","last_became_active":"2023-10-06T11:14:47.045599+0000","last_became_peered":"2023-10-06T11:14:47.045599+0000","last_unstale":"2023-10-06T11:14:47.051172+0000","last_undegraded":"2023-10-06T11:14:47.051172+0000","last_fullsized":"2023-10-06T11:14:47.051172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:09:01.642027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039736+0000","last_change":"2023-10-06T11:14:46.168661+0000","last_active":"2023-10-06T11:14:47.039736+0000","last_peered":"2023-10-06T11:14:47.039736+0000","last_clean":"2023-10-06T11:14:47.039736+0000","last_became_active":"2023-10-06T11:14:46.168404+0000","last_became_peered":"2023-10-06T11:14:46.168404+0000","last_unstale":"2023-10-06T11:14:47.039736+0000","last_undegraded":"2023-10-06T11:14:47.039736+0000","last_fullsized":"2023-10-06T11:14:47.039736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:09.118951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.056054+0000","last_change":"2023-10-06T11:14:47.052247+0000","last_active":"2023-10-06T11:14:47.056054+0000","last_peered":"2023-10-06T11:14:47.056054+0000","last_clean":"2023-10-06T11:14:47.056054+0000","last_became_active":"2023-10-06T11:14:47.052005+0000","last_became_peered":"2023-10-06T11:14:47.052005+0000","last_unstale":"2023-10-06T11:14:47.056054+0000","last_undegraded":"2023-10-06T11:14:47.056054+0000","last_fullsized":"2023-10-06T11:14:47.056054+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:04.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.035117+0000","last_change":"2023-10-06T11:14:46.162680+0000","last_active":"2023-10-06T11:14:47.035117+0000","last_peered":"2023-10-06T11:14:47.035117+0000","last_clean":"2023-10-06T11:14:47.035117+0000","last_became_active":"2023-10-06T11:14:46.162430+0000","last_became_peered":"2023-10-06T11:14:46.162430+0000","last_unstale":"2023-10-06T11:14:47.035117+0000","last_undegraded":"2023-10-06T11:14:47.035117+0000","last_fullsized":"2023-10-06T11:14:47.035117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:51.511665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050152+0000","last_change":"2023-10-06T11:14:47.044306+0000","last_active":"2023-10-06T11:14:47.050152+0000","last_peered":"2023-10-06T11:14:47.050152+0000","last_clean":"2023-10-06T11:14:47.050152+0000","last_became_active":"2023-10-06T11:14:47.044054+0000","last_became_peered":"2023-10-06T11:14:47.044054+0000","last_unstale":"2023-10-06T11:14:47.050152+0000","last_undegraded":"2023-10-06T11:14:47.050152+0000","last_fullsized":"2023-10-06T11:14:47.050152+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:21.803331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.034178+0000","last_change":"2023-10-06T11:14:46.160847+0000","last_active":"2023-10-06T11:14:47.034178+0000","last_peered":"2023-10-06T11:14:47.034178+0000","last_clean":"2023-10-06T11:14:47.034178+0000","last_became_active":"2023-10-06T11:14:46.160603+0000","last_became_peered":"2023-10-06T11:14:46.160603+0000","last_unstale":"2023-10-06T11:14:47.034178+0000","last_undegraded":"2023-10-06T11:14:47.034178+0000","last_fullsized":"2023-10-06T11:14:47.034178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:38:08.159033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055134+0000","last_change":"2023-10-06T11:14:47.052383+0000","last_active":"2023-10-06T11:14:47.055134+0000","last_peered":"2023-10-06T11:14:47.055134+0000","last_clean":"2023-10-06T11:14:47.055134+0000","last_became_active":"2023-10-06T11:14:47.052187+0000","last_became_peered":"2023-10-06T11:14:47.052187+0000","last_unstale":"2023-10-06T11:14:47.055134+0000","last_undegraded":"2023-10-06T11:14:47.055134+0000","last_fullsized":"2023-10-06T11:14:47.055134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:33.368638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047095+0000","last_change":"2023-10-06T11:14:46.163772+0000","last_active":"2023-10-06T11:14:47.047095+0000","last_peered":"2023-10-06T11:14:47.047095+0000","last_clean":"2023-10-06T11:14:47.047095+0000","last_became_active":"2023-10-06T11:14:46.163493+0000","last_became_peered":"2023-10-06T11:14:46.163493+0000","last_unstale":"2023-10-06T11:14:47.047095+0000","last_undegraded":"2023-10-06T11:14:47.047095+0000","last_fullsized":"2023-10-06T11:14:47.047095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:55.774969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048321+0000","last_change":"2023-10-06T11:14:47.043914+0000","last_active":"2023-10-06T11:14:47.048321+0000","last_peered":"2023-10-06T11:14:47.048321+0000","last_clean":"2023-10-06T11:14:47.048321+0000","last_became_active":"2023-10-06T11:14:47.043640+0000","last_became_peered":"2023-10-06T11:14:47.043640+0000","last_unstale":"2023-10-06T11:14:47.048321+0000","last_undegraded":"2023-10-06T11:14:47.048321+0000","last_fullsized":"2023-10-06T11:14:47.048321+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:10.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.031105+0000","last_change":"2023-10-06T11:14:46.158615+0000","last_active":"2023-10-06T11:14:47.031105+0000","last_peered":"2023-10-06T11:14:47.031105+0000","last_clean":"2023-10-06T11:14:47.031105+0000","last_became_active":"2023-10-06T11:14:46.158336+0000","last_became_peered":"2023-10-06T11:14:46.158336+0000","last_unstale":"2023-10-06T11:14:47.031105+0000","last_undegraded":"2023-10-06T11:14:47.031105+0000","last_fullsized":"2023-10-06T11:14:47.031105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:24.025599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.055700+0000","last_change":"2023-10-06T11:14:47.051783+0000","last_active":"2023-10-06T11:14:47.055700+0000","last_peered":"2023-10-06T11:14:47.055700+0000","last_clean":"2023-10-06T11:14:47.055700+0000","last_became_active":"2023-10-06T11:14:47.051486+0000","last_became_peered":"2023-10-06T11:14:47.051486+0000","last_unstale":"2023-10-06T11:14:47.055700+0000","last_undegraded":"2023-10-06T11:14:47.055700+0000","last_fullsized":"2023-10-06T11:14:47.055700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:30.844714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047034+0000","last_change":"2023-10-06T11:14:46.169843+0000","last_active":"2023-10-06T11:14:47.047034+0000","last_peered":"2023-10-06T11:14:47.047034+0000","last_clean":"2023-10-06T11:14:47.047034+0000","last_became_active":"2023-10-06T11:14:46.169574+0000","last_became_peered":"2023-10-06T11:14:46.169574+0000","last_unstale":"2023-10-06T11:14:47.047034+0000","last_undegraded":"2023-10-06T11:14:47.047034+0000","last_fullsized":"2023-10-06T11:14:47.047034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:23.555204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.049941+0000","last_change":"2023-10-06T11:14:47.045163+0000","last_active":"2023-10-06T11:14:47.049941+0000","last_peered":"2023-10-06T11:14:47.049941+0000","last_clean":"2023-10-06T11:14:47.049941+0000","last_became_active":"2023-10-06T11:14:47.044890+0000","last_became_peered":"2023-10-06T11:14:47.044890+0000","last_unstale":"2023-10-06T11:14:47.049941+0000","last_undegraded":"2023-10-06T11:14:47.049941+0000","last_fullsized":"2023-10-06T11:14:47.049941+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:36.976572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033370+0000","last_change":"2023-10-06T11:14:46.170735+0000","last_active":"2023-10-06T11:14:47.033370+0000","last_peered":"2023-10-06T11:14:47.033370+0000","last_clean":"2023-10-06T11:14:47.033370+0000","last_became_active":"2023-10-06T11:14:46.170385+0000","last_became_peered":"2023-10-06T11:14:46.170385+0000","last_unstale":"2023-10-06T11:14:47.033370+0000","last_undegraded":"2023-10-06T11:14:47.033370+0000","last_fullsized":"2023-10-06T11:14:47.033370+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:24.025599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059554+0000","last_change":"2023-10-06T11:14:47.053565+0000","last_active":"2023-10-06T11:14:47.059554+0000","last_peered":"2023-10-06T11:14:47.059554+0000","last_clean":"2023-10-06T11:14:47.059554+0000","last_became_active":"2023-10-06T11:14:47.053298+0000","last_became_peered":"2023-10-06T11:14:47.053298+0000","last_unstale":"2023-10-06T11:14:47.059554+0000","last_undegraded":"2023-10-06T11:14:47.059554+0000","last_fullsized":"2023-10-06T11:14:47.059554+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:10.337189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.177722+0000","last_change":"2023-10-06T11:14:46.159023+0000","last_active":"2023-10-06T11:14:47.177722+0000","last_peered":"2023-10-06T11:14:47.177722+0000","last_clean":"2023-10-06T11:14:47.177722+0000","last_became_active":"2023-10-06T11:14:46.158740+0000","last_became_peered":"2023-10-06T11:14:46.158740+0000","last_unstale":"2023-10-06T11:14:47.177722+0000","last_undegraded":"2023-10-06T11:14:47.177722+0000","last_fullsized":"2023-10-06T11:14:47.177722+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:37.324955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047399+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:14:47.047399+0000","last_peered":"2023-10-06T11:14:47.047399+0000","last_clean":"2023-10-06T11:14:47.047399+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:14:47.047399+0000","last_undegraded":"2023-10-06T11:14:47.047399+0000","last_fullsized":"2023-10-06T11:14:47.047399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050033+0000","last_change":"2023-10-06T11:14:47.044333+0000","last_active":"2023-10-06T11:14:47.050033+0000","last_peered":"2023-10-06T11:14:47.050033+0000","last_clean":"2023-10-06T11:14:47.050033+0000","last_became_active":"2023-10-06T11:14:47.044051+0000","last_became_peered":"2023-10-06T11:14:47.044051+0000","last_unstale":"2023-10-06T11:14:47.050033+0000","last_undegraded":"2023-10-06T11:14:47.050033+0000","last_fullsized":"2023-10-06T11:14:47.050033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:40.605938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033634+0000","last_change":"2023-10-06T11:14:46.169439+0000","last_active":"2023-10-06T11:14:47.033634+0000","last_peered":"2023-10-06T11:14:47.033634+0000","last_clean":"2023-10-06T11:14:47.033634+0000","last_became_active":"2023-10-06T11:14:46.169183+0000","last_became_peered":"2023-10-06T11:14:46.169183+0000","last_unstale":"2023-10-06T11:14:47.033634+0000","last_undegraded":"2023-10-06T11:14:47.033634+0000","last_fullsized":"2023-10-06T11:14:47.033634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:57:07.585414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.033979+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:14:47.033979+0000","last_peered":"2023-10-06T11:14:47.033979+0000","last_clean":"2023-10-06T11:14:47.033979+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:14:47.033979+0000","last_undegraded":"2023-10-06T11:14:47.033979+0000","last_fullsized":"2023-10-06T11:14:47.033979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059549+0000","last_change":"2023-10-06T11:14:47.053428+0000","last_active":"2023-10-06T11:14:47.059549+0000","last_peered":"2023-10-06T11:14:47.059549+0000","last_clean":"2023-10-06T11:14:47.059549+0000","last_became_active":"2023-10-06T11:14:47.053167+0000","last_became_peered":"2023-10-06T11:14:47.053167+0000","last_unstale":"2023-10-06T11:14:47.059549+0000","last_undegraded":"2023-10-06T11:14:47.059549+0000","last_fullsized":"2023-10-06T11:14:47.059549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:10.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.179238+0000","last_change":"2023-10-06T11:14:46.167127+0000","last_active":"2023-10-06T11:14:47.179238+0000","last_peered":"2023-10-06T11:14:47.179238+0000","last_clean":"2023-10-06T11:14:47.179238+0000","last_became_active":"2023-10-06T11:14:46.166650+0000","last_became_peered":"2023-10-06T11:14:46.166650+0000","last_unstale":"2023-10-06T11:14:47.179238+0000","last_undegraded":"2023-10-06T11:14:47.179238+0000","last_fullsized":"2023-10-06T11:14:47.179238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:59.960801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.028906+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:14:47.028906+0000","last_peered":"2023-10-06T11:14:47.028906+0000","last_clean":"2023-10-06T11:14:47.028906+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:14:47.028906+0000","last_undegraded":"2023-10-06T11:14:47.028906+0000","last_fullsized":"2023-10-06T11:14:47.028906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048874+0000","last_change":"2023-10-06T11:14:47.042928+0000","last_active":"2023-10-06T11:14:47.048874+0000","last_peered":"2023-10-06T11:14:47.048874+0000","last_clean":"2023-10-06T11:14:47.048874+0000","last_became_active":"2023-10-06T11:14:47.042678+0000","last_became_peered":"2023-10-06T11:14:47.042678+0000","last_unstale":"2023-10-06T11:14:47.048874+0000","last_undegraded":"2023-10-06T11:14:47.048874+0000","last_fullsized":"2023-10-06T11:14:47.048874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:05.888783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.036569+0000","last_change":"2023-10-06T11:14:46.161086+0000","last_active":"2023-10-06T11:14:47.036569+0000","last_peered":"2023-10-06T11:14:47.036569+0000","last_clean":"2023-10-06T11:14:47.036569+0000","last_became_active":"2023-10-06T11:14:46.160841+0000","last_became_peered":"2023-10-06T11:14:46.160841+0000","last_unstale":"2023-10-06T11:14:47.036569+0000","last_undegraded":"2023-10-06T11:14:47.036569+0000","last_fullsized":"2023-10-06T11:14:47.036569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:35.428991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.034283+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:14:47.034283+0000","last_peered":"2023-10-06T11:14:47.034283+0000","last_clean":"2023-10-06T11:14:47.034283+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:14:47.034283+0000","last_undegraded":"2023-10-06T11:14:47.034283+0000","last_fullsized":"2023-10-06T11:14:47.034283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.036413+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:14:47.036413+0000","last_peered":"2023-10-06T11:14:47.036413+0000","last_clean":"2023-10-06T11:14:47.036413+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:14:47.036413+0000","last_undegraded":"2023-10-06T11:14:47.036413+0000","last_fullsized":"2023-10-06T11:14:47.036413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.050210+0000","last_change":"2023-10-06T11:14:47.046258+0000","last_active":"2023-10-06T11:14:47.050210+0000","last_peered":"2023-10-06T11:14:47.050210+0000","last_clean":"2023-10-06T11:14:47.050210+0000","last_became_active":"2023-10-06T11:14:47.045913+0000","last_became_peered":"2023-10-06T11:14:47.045913+0000","last_unstale":"2023-10-06T11:14:47.050210+0000","last_undegraded":"2023-10-06T11:14:47.050210+0000","last_fullsized":"2023-10-06T11:14:47.050210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:01.027798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.047134+0000","last_change":"2023-10-06T11:14:46.162110+0000","last_active":"2023-10-06T11:14:47.047134+0000","last_peered":"2023-10-06T11:14:47.047134+0000","last_clean":"2023-10-06T11:14:47.047134+0000","last_became_active":"2023-10-06T11:14:46.161764+0000","last_became_peered":"2023-10-06T11:14:46.161764+0000","last_unstale":"2023-10-06T11:14:47.047134+0000","last_undegraded":"2023-10-06T11:14:47.047134+0000","last_fullsized":"2023-10-06T11:14:47.047134+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:09.202602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.036522+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:14:47.036522+0000","last_peered":"2023-10-06T11:14:47.036522+0000","last_clean":"2023-10-06T11:14:47.036522+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:14:47.036522+0000","last_undegraded":"2023-10-06T11:14:47.036522+0000","last_fullsized":"2023-10-06T11:14:47.036522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.054043+0000","last_change":"2023-10-06T11:14:47.051893+0000","last_active":"2023-10-06T11:14:47.054043+0000","last_peered":"2023-10-06T11:14:47.054043+0000","last_clean":"2023-10-06T11:14:47.054043+0000","last_became_active":"2023-10-06T11:14:47.051636+0000","last_became_peered":"2023-10-06T11:14:47.051636+0000","last_unstale":"2023-10-06T11:14:47.054043+0000","last_undegraded":"2023-10-06T11:14:47.054043+0000","last_fullsized":"2023-10-06T11:14:47.054043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:25.031652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176786+0000","last_change":"2023-10-06T11:14:46.163349+0000","last_active":"2023-10-06T11:14:47.176786+0000","last_peered":"2023-10-06T11:14:47.176786+0000","last_clean":"2023-10-06T11:14:47.176786+0000","last_became_active":"2023-10-06T11:14:46.163096+0000","last_became_peered":"2023-10-06T11:14:46.163096+0000","last_unstale":"2023-10-06T11:14:47.176786+0000","last_undegraded":"2023-10-06T11:14:47.176786+0000","last_fullsized":"2023-10-06T11:14:47.176786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:56.091368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039041+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:14:47.039041+0000","last_peered":"2023-10-06T11:14:47.039041+0000","last_clean":"2023-10-06T11:14:47.039041+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:14:47.039041+0000","last_undegraded":"2023-10-06T11:14:47.039041+0000","last_fullsized":"2023-10-06T11:14:47.039041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.059609+0000","last_change":"2023-10-06T11:14:47.054783+0000","last_active":"2023-10-06T11:14:47.059609+0000","last_peered":"2023-10-06T11:14:47.059609+0000","last_clean":"2023-10-06T11:14:47.059609+0000","last_became_active":"2023-10-06T11:14:47.054520+0000","last_became_peered":"2023-10-06T11:14:47.054520+0000","last_unstale":"2023-10-06T11:14:47.059609+0000","last_undegraded":"2023-10-06T11:14:47.059609+0000","last_fullsized":"2023-10-06T11:14:47.059609+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:38.331008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.039837+0000","last_change":"2023-10-06T11:14:46.171147+0000","last_active":"2023-10-06T11:14:47.039837+0000","last_peered":"2023-10-06T11:14:47.039837+0000","last_clean":"2023-10-06T11:14:47.039837+0000","last_became_active":"2023-10-06T11:14:46.170891+0000","last_became_peered":"2023-10-06T11:14:46.170891+0000","last_unstale":"2023-10-06T11:14:47.039837+0000","last_undegraded":"2023-10-06T11:14:47.039837+0000","last_fullsized":"2023-10-06T11:14:47.039837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:24.025599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.048077+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:14:47.048077+0000","last_peered":"2023-10-06T11:14:47.048077+0000","last_clean":"2023-10-06T11:14:47.048077+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:14:47.048077+0000","last_undegraded":"2023-10-06T11:14:47.048077+0000","last_fullsized":"2023-10-06T11:14:47.048077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.041906+0000","last_change":"2023-10-06T11:14:47.039809+0000","last_active":"2023-10-06T11:14:47.041906+0000","last_peered":"2023-10-06T11:14:47.041906+0000","last_clean":"2023-10-06T11:14:47.041906+0000","last_became_active":"2023-10-06T11:14:47.039535+0000","last_became_peered":"2023-10-06T11:14:47.039535+0000","last_unstale":"2023-10-06T11:14:47.041906+0000","last_undegraded":"2023-10-06T11:14:47.041906+0000","last_fullsized":"2023-10-06T11:14:47.041906+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:46.143837+0000","last_clean_scrub_stamp":"2023-10-06T11:14:46.143837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:05.137727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.176884+0000","last_change":"2023-10-06T11:14:46.163149+0000","last_active":"2023-10-06T11:14:47.176884+0000","last_peered":"2023-10-06T11:14:47.176884+0000","last_clean":"2023-10-06T11:14:47.176884+0000","last_became_active":"2023-10-06T11:14:46.162891+0000","last_became_peered":"2023-10-06T11:14:46.162891+0000","last_unstale":"2023-10-06T11:14:47.176884+0000","last_undegraded":"2023-10-06T11:14:47.176884+0000","last_fullsized":"2023-10-06T11:14:47.176884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:45.137784+0000","last_clean_scrub_stamp":"2023-10-06T11:14:45.137784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:59:56.866109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T11:14:47.035557+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:14:47.035557+0000","last_peered":"2023-10-06T11:14:47.035557+0000","last_clean":"2023-10-06T11:14:47.035557+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:14:47.035557+0000","last_undegraded":"2023-10-06T11:14:47.035557+0000","last_fullsized":"2023-10-06T11:14:47.035557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":889720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.502}]},{"osd":1,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.6850000000000005,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.622}]},{"osd":4,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":299192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.623}]},{"osd":4,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":299282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.27600000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.435},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":891650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.379},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073904,"statfs":{"total":96636764160,"available":96331677696,"internally_reserved":0,"allocated":663552,"data_stored":299248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.74299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073904,"statfs":{"total":96636764160,"available":96331677696,"internally_reserved":0,"allocated":663552,"data_stored":299248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":300728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.504},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.436},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":292855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:14:51.676 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:14:51.677 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:14:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.832+0000 7f9b5b781700 1 Processor -- start 2023-10-06T11:14:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.832+0000 7f9b5b781700 1 -- start start 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5b781700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b54159470 0x7f9b540ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5b781700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b540ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5b781700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540cbb80 con 0x7f9b540c6170 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5b781700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540c6d00 con 0x7f9b54159470 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5b781700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540c6f00 con 0x7f9b54159840 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b54159470 0x7f9b540ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b54159470 0x7f9b540ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48326/0 (socket says 172.21.15.55:48326) 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 -- 172.21.15.55:0/260965168 learned_addr learned my addr 172.21.15.55:0/260965168 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 -- 172.21.15.55:0/260965168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 msgr2=0x7f9b540ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 --2- 172.21.15.55:0/260965168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b540ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 -- 172.21.15.55:0/260965168 >> v1:172.21.15.142:6789/0 conn(0x7f9b540c6170 legacy=0x7f9b540c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 -- 172.21.15.55:0/260965168 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540cb530 con 0x7f9b54159470 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.833+0000 7f9b5951d700 1 --2- 172.21.15.55:0/260965168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b54159470 0x7f9b540ce980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009990 tx=0x7f9b4c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287ef3122b15260a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b53fff700 1 -- 172.21.15.55:0/260965168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c005c10 con 0x7f9b54159470 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b53fff700 1 -- 172.21.15.55:0/260965168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c005d70 con 0x7f9b54159470 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b53fff700 1 -- 172.21.15.55:0/260965168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00b840 con 0x7f9b54159470 2023-10-06T11:14:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 -- 172.21.15.55:0/260965168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b54159470 msgr2=0x7f9b540ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 --2- 172.21.15.55:0/260965168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b54159470 0x7f9b540ce980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009990 tx=0x7f9b4c009220 comp rx=0 tx=0).stop 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 -- 172.21.15.55:0/260965168 shutdown_connections 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 --2- 172.21.15.55:0/260965168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b54159470 0x7f9b540ce980 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 --2- 172.21.15.55:0/260965168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b540ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 -- 172.21.15.55:0/260965168 >> 172.21.15.55:0/260965168 conn(0x7f9b540996e0 msgr2=0x7f9b5406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 -- 172.21.15.55:0/260965168 shutdown_connections 2023-10-06T11:14:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.834+0000 7f9b5b781700 1 -- 172.21.15.55:0/260965168 wait complete. 2023-10-06T11:14:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.835+0000 7f9b5b781700 1 Processor -- start 2023-10-06T11:14:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.835+0000 7f9b5b781700 1 -- start start 2023-10-06T11:14:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5b781700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 0x7f9b540c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5b781700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b54159470 0x7f9b54156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5b781700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b54153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5b781700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54155ba0 con 0x7f9b540c6170 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5b781700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54155e40 con 0x7f9b54159470 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5b781700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54156120 con 0x7f9b54159840 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5951d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 0x7f9b540c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5951d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 0x7f9b540c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48334/0 (socket says 172.21.15.55:48334) 2023-10-06T11:14:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b5951d700 1 -- 172.21.15.55:0/619528107 learned_addr learned my addr 172.21.15.55:0/619528107 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b58d1c700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b54159470 0x7f9b54156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.836+0000 7f9b59d1e700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b54153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5951d700 1 -- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 msgr2=0x7f9b54153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5951d700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b54153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5951d700 1 -- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b54159470 msgr2=0x7f9b54156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5951d700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b54159470 0x7f9b54156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5951d700 1 -- 172.21.15.55:0/619528107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c009480 con 0x7f9b540c6170 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5951d700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 0x7f9b540c9b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009260 tx=0x7f9b4c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c000d10 con 0x7f9b540c6170 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c011c80 con 0x7f9b540c6170 2023-10-06T11:14:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b54156400 con 0x7f9b540c6170 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01d430 con 0x7f9b540c6170 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.837+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b541570d0 con 0x7f9b540c6170 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.838+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b541572c0 con 0x7f9b540c6170 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.838+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b4c01d7e0 con 0x7f9b540c6170 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.839+0000 7f9b517fa700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9b40066f30 0x7f9b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.839+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9b4c086550 con 0x7f9b540c6170 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.839+0000 7f9b58d1c700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9b40066f30 0x7f9b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.839+0000 7f9b58d1c700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9b40066f30 0x7f9b400693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9b48006fd0 tx=0x7f9b48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:51.843+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b4c053520 con 0x7f9b540c6170 2023-10-06T11:14:52.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.116+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9b54064a90 con 0x7f9b540c6170 2023-10-06T11:14:52.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.119+0000 7f9b517fa700 1 -- 172.21.15.55:0/619528107 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9b4c05c020 con 0x7f9b540c6170 2023-10-06T11:14:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9b40066f30 msgr2=0x7f9b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9b40066f30 0x7f9b400693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9b48006fd0 tx=0x7f9b48008040 comp rx=0 tx=0).stop 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 msgr2=0x7f9b540c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 0x7f9b540c9b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009260 tx=0x7f9b4c015000 comp rx=0 tx=0).stop 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 shutdown_connections 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9b40066f30 0x7f9b400693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c6170 0x7f9b540c9b20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b54159840 0x7f9b54153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 --2- 172.21.15.55:0/619528107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b54159470 0x7f9b54156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 >> 172.21.15.55:0/619528107 conn(0x7f9b540996e0 msgr2=0x7f9b54068b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 shutdown_connections 2023-10-06T11:14:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.122+0000 7f9b5b781700 1 -- 172.21.15.55:0/619528107 wait complete. 2023-10-06T11:14:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-10-06T11:14:52.135 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.253+0000 7fe95d0dc700 1 Processor -- start 2023-10-06T11:14:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.253+0000 7fe95d0dc700 1 -- start start 2023-10-06T11:14:52.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe95d0dc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 0x7fe9580b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe95d0dc700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9580cb7a0 con 0x7fe9580b2100 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe95d0dc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9580b0860 con 0x7fe9580b35d0 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe95d0dc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580cb150 con 0x7fe958159440 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe95c8db700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe9580b2100 0x7fe9580b2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45792/0 (socket says 172.21.15.55:45792) 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe95c8db700 1 -- 172.21.15.55:0/330171888 learned_addr learned my addr 172.21.15.55:0/330171888 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe957fff700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 0x7fe9580b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903182049 0 0) 0x7fe9580cb7a0 con 0x7fe9580b2100 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe944003570 con 0x7fe9580b2100 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066795299 0 0) 0x7fe9580b0860 con 0x7fe9580b35d0 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9580cb7a0 con 0x7fe9580b35d0 2023-10-06T11:14:52.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3468011600 0 0) 0x7fe944003570 con 0x7fe9580b2100 2023-10-06T11:14:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 msgr2=0x7fe9580b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 0x7fe9580b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.254+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 >> v1:172.21.15.142:6789/0 conn(0x7fe9580b35d0 legacy=0x7fe9580cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580cb430 con 0x7fe9580b2100 2023-10-06T11:14:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fe9500017f0 con 0x7fe9580b2100 2023-10-06T11:14:52.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 >> v1:172.21.15.55:6789/0 conn(0x7fe9580b2100 legacy=0x7fe9580b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 0x7fe944003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe944004180 0x7fe944004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe944004d50 0x7fe9440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580cb150 con 0x7fe944004d50 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94400bc50 con 0x7fe944004180 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94400be10 con 0x7fe958159440 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe944004d50 0x7fe9440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe957fff700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 0x7fe944003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe9577fe700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe944004180 0x7fe944004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 -- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 msgr2=0x7fe944003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958159440 0x7fe944003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 -- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe944004180 msgr2=0x7fe944004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe944004180 0x7fe944004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 -- 172.21.15.55:0/330171888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944003570 con 0x7fe944004d50 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe95c8db700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe944004d50 0x7fe9440051c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe95000a8a0 tx=0x7fe950002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d90999c0a69e9e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9500070d0 con 0x7fe944004d50 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950007230 con 0x7fe944004d50 2023-10-06T11:14:52.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.255+0000 7fe956ffd700 1 -- 172.21.15.55:0/330171888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9500075d0 con 0x7fe944004d50 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95d0dc700 1 -- 172.21.15.55:0/330171888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe944004d50 msgr2=0x7fe9440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/330171888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe944004d50 0x7fe9440051c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe95000a8a0 tx=0x7fe950002190 comp rx=0 tx=0).stop 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95c8db700 1 -- 172.21.15.55:0/330171888 reap_dead start 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95d0dc700 1 -- 172.21.15.55:0/330171888 shutdown_connections 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95d0dc700 1 -- 172.21.15.55:0/330171888 >> 172.21.15.55:0/330171888 conn(0x7fe95806ece0 msgr2=0x7fe95806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95d0dc700 1 -- 172.21.15.55:0/330171888 shutdown_connections 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.256+0000 7fe95d0dc700 1 -- 172.21.15.55:0/330171888 wait complete. 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.257+0000 7fe95d0dc700 1 Processor -- start 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.257+0000 7fe95d0dc700 1 -- start start 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95d0dc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958154940 0x7fe958157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95d0dc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9580c9400 0x7fe9581584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95d0dc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 0x7fe9580c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95d0dc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c8130 con 0x7fe9580c6090 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95d0dc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c8f70 con 0x7fe9580c9400 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95d0dc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe958154d10 con 0x7fe958154940 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 0x7fe9580c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 0x7fe9580c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48360/0 (socket says 172.21.15.55:48360) 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 -- 172.21.15.55:0/501454433 learned_addr learned my addr 172.21.15.55:0/501454433 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe9577fe700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9580c9400 0x7fe9581584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe957fff700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958154940 0x7fe958157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 -- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958154940 msgr2=0x7fe958157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958154940 0x7fe958157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 -- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9580c9400 msgr2=0x7fe9581584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9580c9400 0x7fe9581584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.258+0000 7fe95c8db700 1 -- 172.21.15.55:0/501454433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580c8360 con 0x7fe9580c6090 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.259+0000 7fe95c8db700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 0x7fe9580c6500 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe950000f80 tx=0x7fe950015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.259+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950023070 con 0x7fe9580c6090 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.259+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950001a10 con 0x7fe9580c6090 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.259+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9580c8640 con 0x7fe9580c6090 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.259+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9500070d0 con 0x7fe9580c6090 2023-10-06T11:14:52.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.259+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9580c8c00 con 0x7fe9580c6090 2023-10-06T11:14:52.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.260+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9580c9120 con 0x7fe9580c6090 2023-10-06T11:14:52.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.260+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9500073a0 con 0x7fe9580c6090 2023-10-06T11:14:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.261+0000 7fe94ffff700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe938066f30 0x7fe9380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.261+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe950086810 con 0x7fe9580c6090 2023-10-06T11:14:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.261+0000 7fe957fff700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe938066f30 0x7fe9380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.261+0000 7fe957fff700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe938066f30 0x7fe9380693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe958166f10 tx=0x7fe9400091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:52.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.265+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9580c9120 con 0x7fe9580c6090 2023-10-06T11:14:52.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.500+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9580c90e0 con 0x7fe9580c6090 2023-10-06T11:14:52.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.501+0000 7fe94ffff700 1 -- 172.21.15.55:0/501454433 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fe9500537e0 con 0x7fe9580c6090 2023-10-06T11:14:52.503 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:52.503 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:46.560821+0000","modified":"2023-10-06T11:14:50.181274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/173974006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":173974006},{"type":"v1","addr":"172.21.15.55:6835","nonce":173974006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:14:52.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe938066f30 msgr2=0x7fe9380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe938066f30 0x7fe9380693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe958166f10 tx=0x7fe9400091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 msgr2=0x7fe9580c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 0x7fe9580c6500 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe950000f80 tx=0x7fe950015000 comp rx=0 tx=0).stop 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 shutdown_connections 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe938066f30 0x7fe9380693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9580c6090 0x7fe9580c6500 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe958154940 0x7fe958157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 --2- 172.21.15.55:0/501454433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9580c9400 0x7fe9581584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 >> 172.21.15.55:0/501454433 conn(0x7fe95806ece0 msgr2=0x7fe958155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:52.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 shutdown_connections 2023-10-06T11:14:52.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:52.503+0000 7fe95d0dc700 1 -- 172.21.15.55:0/501454433 wait complete. 2023-10-06T11:14:52.507 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2023-10-06T11:14:52.919 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:14:46.560821+0000', 'modified': '2023-10-06T11:14:50.181274+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5490': {'gid': 5490, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/173974006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 173974006}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 173974006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:14:52.919 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:14:52.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:14:53.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.041+0000 7fdbf8890700 1 Processor -- start 2023-10-06T11:14:53.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.041+0000 7fdbf8890700 1 -- start start 2023-10-06T11:14:53.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf8890700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbf4157410 0x7fdbf40cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf8890700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf415b1d0 con 0x7fdbf4157040 2023-10-06T11:14:53.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf8890700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf40ce4b0 con 0x7fdbf415b660 2023-10-06T11:14:53.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf8890700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf40ce790 con 0x7fdbf4157410 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdbf4157040 0x7fdbf406d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45808/0 (socket says 172.21.15.55:45808) 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf37fe700 1 -- 172.21.15.55:0/1677906319 learned_addr learned my addr 172.21.15.55:0/1677906319 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/1677906319 >> v2:172.21.15.142:3300/0 conn(0x7fdbf4157410 0x7fdbf40cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf27fc700 1 -- 172.21.15.55:0/1677906319 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247170683 0 0) 0x7fdbf415b1d0 con 0x7fdbf4157040 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.042+0000 7fdbf27fc700 1 -- 172.21.15.55:0/1677906319 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbdc003570 con 0x7fdbf4157040 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/1677906319 >> v1:172.21.15.142:6789/0 conn(0x7fdbf415b660 legacy=0x7fdbf40c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/1677906319 >> v1:172.21.15.55:6789/0 conn(0x7fdbf4157040 legacy=0x7fdbf406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf27fc700 1 -- 172.21.15.55:0/1677906319 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169205895 0 0) 0x7fdbdc003570 con 0x7fdbf4157040 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/1677906319 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf415ae60 con 0x7fdbf4157410 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/1677906319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157410 0x7fdbf40cde60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80098e0 tx=0x7fdbe80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc821f4e93a54864 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf27fc700 1 -- 172.21.15.55:0/1677906319 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4001470 con 0x7fdbf4157410 2023-10-06T11:14:53.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf27fc700 1 -- 172.21.15.55:0/1677906319 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8011420 con 0x7fdbf4157410 2023-10-06T11:14:53.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf27fc700 1 -- 172.21.15.55:0/1677906319 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80117c0 con 0x7fdbf4157410 2023-10-06T11:14:53.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.043+0000 7fdbf8890700 1 -- 172.21.15.55:0/1677906319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157410 msgr2=0x7fdbf40cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.044+0000 7fdbf8890700 1 --2- 172.21.15.55:0/1677906319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157410 0x7fdbf40cde60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80098e0 tx=0x7fdbe80091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.044+0000 7fdbf8890700 1 -- 172.21.15.55:0/1677906319 shutdown_connections 2023-10-06T11:14:53.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.044+0000 7fdbf8890700 1 --2- 172.21.15.55:0/1677906319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157410 0x7fdbf40cde60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.044+0000 7fdbf8890700 1 -- 172.21.15.55:0/1677906319 >> 172.21.15.55:0/1677906319 conn(0x7fdbf406b500 msgr2=0x7fdbf406b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.044+0000 7fdbf8890700 1 -- 172.21.15.55:0/1677906319 shutdown_connections 2023-10-06T11:14:53.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.044+0000 7fdbf8890700 1 -- 172.21.15.55:0/1677906319 wait complete. 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.045+0000 7fdbf8890700 1 Processor -- start 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.045+0000 7fdbf8890700 1 -- start start 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157040 0x7fdbf4169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 0x7fdbf41592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf415b660 0x7fdbf40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40c7460 con 0x7fdbf4157410 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4159da0 con 0x7fdbf4157040 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf415a080 con 0x7fdbf415b660 2023-10-06T11:14:53.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 0x7fdbf41592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 0x7fdbf41592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48374/0 (socket says 172.21.15.55:48374) 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3107403190 learned_addr learned my addr 172.21.15.55:0/3107403190 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157040 0x7fdbf4169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf415b660 0x7fdbf40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf415b660 msgr2=0x7fdbf40cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf415b660 0x7fdbf40cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157040 msgr2=0x7fdbf4169230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157040 0x7fdbf4169230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3107403190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8009420 con 0x7fdbf4157410 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157040 0x7fdbf4169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 0x7fdbf41592c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80091e0 tx=0x7fdbe8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbdb7fe700 1 -- 172.21.15.55:0/3107403190 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe801cc90 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf415a360 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.046+0000 7fdbdb7fe700 1 -- 172.21.15.55:0/3107403190 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe801ce10 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.047+0000 7fdbdb7fe700 1 -- 172.21.15.55:0/3107403190 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe801a6a0 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.047+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf4169770 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.048+0000 7fdbdb7fe700 1 -- 172.21.15.55:0/3107403190 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbe801aa50 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.048+0000 7fdbdb7fe700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe0066f30 0x7fdbe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.048+0000 7fdbdb7fe700 1 -- 172.21.15.55:0/3107403190 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdbe8086630 con 0x7fdbf4157410 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.049+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe0066f30 0x7fdbe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.049+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe0066f30 0x7fdbe00693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4001ed0 tx=0x7fdbe4000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.050+0000 7fdc02deab80 1 Processor -- start 2023-10-06T11:14:53.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.050+0000 7fdc02deab80 1 -- start start 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 0x561a2fb3cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb65920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb38990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdc02deab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fabcc80 con 0x561a2fb3c950 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fa93a70 con 0x561a2fb86bc0 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2fa91270 con 0x561a2fb65e60 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdbf37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 0x561a2fb3cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdbf37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 0x561a2fb3cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48378/0 (socket says 172.21.15.55:48378) 2023-10-06T11:14:53.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdbf37fe700 1 -- 172.21.15.55:0/1086464956 learned_addr learned my addr 172.21.15.55:0/1086464956 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb65920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.051+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb38990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf37fe700 1 -- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 msgr2=0x561a2fb38990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb38990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf37fe700 1 -- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 msgr2=0x561a2fb65920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb65920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf37fe700 1 -- 172.21.15.55:0/1086464956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a2f927270 con 0x561a2fb3c950 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb65920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 0x561a2fb3cd20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400ebd0 tx=0x7fdbe4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9a82509f5c9237 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbd8ff9700 1 -- 172.21.15.55:0/1086464956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40158d0 con 0x561a2fb3c950 2023-10-06T11:14:53.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbd8ff9700 1 -- 172.21.15.55:0/1086464956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe4015a30 con 0x561a2fb3c950 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdbd8ff9700 1 -- 172.21.15.55:0/1086464956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4015dd0 con 0x561a2fb3c950 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdc02deab80 1 -- 172.21.15.55:0/1086464956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 msgr2=0x561a2fb3cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.052+0000 7fdc02deab80 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 0x561a2fb3cd20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400ebd0 tx=0x7fdbe4013000 comp rx=0 tx=0).stop 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 -- 172.21.15.55:0/1086464956 shutdown_connections 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb3c950 0x561a2fb3cd20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb38990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 --2- 172.21.15.55:0/1086464956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb65920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 -- 172.21.15.55:0/1086464956 >> 172.21.15.55:0/1086464956 conn(0x561a2fb3e270 msgr2=0x561a2fb3e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 -- 172.21.15.55:0/1086464956 shutdown_connections 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 -- 172.21.15.55:0/1086464956 wait complete. 2023-10-06T11:14:53.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 -- start start 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.053+0000 7fdc02deab80 1 Processor -- start 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb3c950 0x561a2fb7b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb64550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fa8d060 con 0x561a2fb65e60 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fa38890 con 0x561a2fb86bc0 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2fa53ea0 con 0x561a2fb3c950 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdc02deab80 10 client.0 _ll_register_callbacks cb 0x561a2f929f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb64010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48394/0 (socket says 172.21.15.55:48394) 2023-10-06T11:14:53.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3638938242 learned_addr learned my addr 172.21.15.55:0/3638938242 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:53.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb3c950 0x561a2fb7b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.054+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb64550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb3c950 msgr2=0x561a2fb7b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb3c950 0x561a2fb7b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 msgr2=0x561a2fb64550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb64550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/3638938242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe400f040 con 0x561a2fb65e60 2023-10-06T11:14:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb64010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8084840 tx=0x7fdbe8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a50166c56a76ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:14:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/3638938242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8057920 con 0x561a2fb65e60 2023-10-06T11:14:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/3638938242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdbe8057220 con 0x561a2fb65e60 2023-10-06T11:14:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a2fb31690 con 0x561a2fb65e60 2023-10-06T11:14:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/3638938242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbe805a470 con 0x561a2fb65e60 2023-10-06T11:14:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 10 client.5643 fetch_fsmap learned FSMap version 27 2023-10-06T11:14:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x561a2f8c9fe0 con 0x561a2fb65e60 2023-10-06T11:14:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/3638938242 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a2fb31690 con 0x561a2fb65e60 2023-10-06T11:14:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/3638938242 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdbe8053930 con 0x561a2fb65e60 2023-10-06T11:14:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 10 client.5643 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T11:14:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 10 client.5643 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:14:53.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 20 client.5643 populate_metadata read hostname 'smithi055' 2023-10-06T11:14:53.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb7d280 0x561a2fb7d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 4 client.5643 mds_command: new command op to 5490 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:53.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 --> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a2fb0e5c0 con 0x561a2fb7d280 2023-10-06T11:14:53.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.055+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb7d280 0x561a2fb7d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdbd1ffb700 10 client.5643 ms_handle_connect on v2:172.21.15.55:6833/173974006 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb7d280 0x561a2fb7d650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f40ae9fa20ebbf6 server_cookie=18b95fdd81a4698a in_seq=0 out_seq=0 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/3638938242 <== mds.0 v2:172.21.15.55:6833/173974006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561a2fb0e5c0 con 0x561a2fb7d280 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdbd1ffb700 10 client.5643 handle_command_reply: tid=0 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdc02deab80 1 client.5643 shutdown 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 msgr2=0x561a2fb64010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdc02deab80 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb64010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8084840 tx=0x7fdbe8086040 comp rx=0 tx=0).stop 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.056+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 shutdown_connections 2023-10-06T11:14:53.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb7d280 0x561a2fb7d650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb86bc0 0x561a2fb64550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb3c950 0x561a2fb7b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdbd1ffb700 0 client.5643 ms_handle_reset on v2:172.21.15.55:6833/173974006 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 --2- 172.21.15.55:0/3638938242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb64010 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 >> 172.21.15.55:0/3638938242 conn(0x561a2fb3e270 msgr2=0x561a2fb824a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 shutdown_connections 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 1 -- 172.21.15.55:0/3638938242 wait complete. 2023-10-06T11:14:53.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.057+0000 7fdc02deab80 20 client.5643 trim_cache size 0 max 16384 2023-10-06T11:14:53.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.073+0000 7fdc02deab80 1 Processor -- start 2023-10-06T11:14:53.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.073+0000 7fdc02deab80 1 -- start start 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb804a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb86bc0 0x561a2fb7b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdc02deab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2f90fe30 con 0x561a2fb65e60 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fb95a30 con 0x561a2fb3c950 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2fb7ab50 con 0x561a2fb86bc0 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb7aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48396/0 (socket says 172.21.15.55:48396) 2023-10-06T11:14:53.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.074+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/511497477 learned_addr learned my addr 172.21.15.55:0/511497477 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb804a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb86bc0 msgr2=0x561a2fb7b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb86bc0 0x561a2fb7b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb86bc0 0x561a2fb7b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 msgr2=0x561a2fb804a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb804a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf2ffd700 1 -- 172.21.15.55:0/511497477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a2fa5b780 con 0x561a2fb65e60 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb804a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb7aeb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8057160 tx=0x7fdbe806e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb5984fef6f5533 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbd97fa700 1 -- 172.21.15.55:0/511497477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8057920 con 0x561a2fb65e60 2023-10-06T11:14:53.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbd97fa700 1 -- 172.21.15.55:0/511497477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8057220 con 0x561a2fb65e60 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdbd97fa700 1 -- 172.21.15.55:0/511497477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe805a470 con 0x561a2fb65e60 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 -- 172.21.15.55:0/511497477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 msgr2=0x561a2fb7aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb7aeb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8057160 tx=0x7fdbe806e000 comp rx=0 tx=0).stop 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 -- 172.21.15.55:0/511497477 shutdown_connections 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb86bc0 0x561a2fb7b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb804a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 --2- 172.21.15.55:0/511497477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb65e60 0x561a2fb7aeb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 -- 172.21.15.55:0/511497477 >> 172.21.15.55:0/511497477 conn(0x561a2fb3e270 msgr2=0x561a2fb3e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.075+0000 7fdc02deab80 1 -- 172.21.15.55:0/511497477 shutdown_connections 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.076+0000 7fdc02deab80 1 -- 172.21.15.55:0/511497477 wait complete. 2023-10-06T11:14:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.076+0000 7fdc02deab80 1 -- start start 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.076+0000 7fdc02deab80 1 Processor -- start 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb7ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb7b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 0x561a2fb97500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fbe91a0 con 0x561a2fb86bc0 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a2fb3d420 con 0x561a2fb3c950 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a2fb3d670 con 0x561a2fb65e60 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdc02deab80 10 client.0 _ll_register_callbacks cb 0x561a2f929f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 0x561a2fb97500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 0x561a2fb97500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48400/0 (socket says 172.21.15.55:48400) 2023-10-06T11:14:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 -- 172.21.15.55:0/809385877 learned_addr learned my addr 172.21.15.55:0/809385877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb7ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf2ffd700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb7b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 -- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 msgr2=0x561a2fb7b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb7b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 -- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 msgr2=0x561a2fb7ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb7ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.077+0000 7fdbf3fff700 1 -- 172.21.15.55:0/809385877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe400f040 con 0x561a2fb86bc0 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbf3fff700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 0x561a2fb97500 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdbec001970 tx=0x7fdbec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7b971f9a118bb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/809385877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec01d030 con 0x561a2fb86bc0 2023-10-06T11:14:53.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdbe4015a30 con 0x561a2fb86bc0 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/809385877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdbec01e070 con 0x561a2fb86bc0 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/809385877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbec006db0 con 0x561a2fb86bc0 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 10 client.5649 fetch_fsmap learned FSMap version 27 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x561a2fa42470 con 0x561a2fb86bc0 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/809385877 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec028020 con 0x561a2fb86bc0 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/809385877 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdbec0174a0 con 0x561a2fb86bc0 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 10 client.5649 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 10 client.5649 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 20 client.5649 populate_metadata read hostname 'smithi055' 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb980a0 0x561a2fbe7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 4 client.5649 mds_command: new command op to 5490 tid=0[{"prefix": "status"}] 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 --> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561a2fa2fe00 con 0x561a2fb980a0 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.078+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb980a0 0x561a2fbe7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdbd1ffb700 10 client.5649 ms_handle_connect on v2:172.21.15.55:6833/173974006 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdbf37fe700 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb980a0 0x561a2fbe7cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe1ac93428b7dd76 server_cookie=5bebed7bccba7ebb in_seq=0 out_seq=0 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdbd1ffb700 1 -- 172.21.15.55:0/809385877 <== mds.0 v2:172.21.15.55:6833/173974006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x561a2fa2fe00 con 0x561a2fb980a0 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdbd1ffb700 10 client.5649 handle_command_reply: tid=0 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 client.5649 shutdown 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 msgr2=0x561a2fb97500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 0x561a2fb97500 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdbec001970 tx=0x7fdbec009040 comp rx=0 tx=0).stop 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 shutdown_connections 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:6833/173974006,v1:172.21.15.55:6835/173974006] conn(0x561a2fb980a0 0x561a2fbe7cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561a2fb86bc0 0x561a2fb97500 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdbd1ffb700 0 client.5649 ms_handle_reset on v2:172.21.15.55:6833/173974006 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2fb3c950 0x561a2fb7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 --2- 172.21.15.55:0/809385877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2fb65e60 0x561a2fb7b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 >> 172.21.15.55:0/809385877 conn(0x561a2fb3e270 msgr2=0x561a2fb804a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 shutdown_connections 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 1 -- 172.21.15.55:0/809385877 wait complete. 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.079+0000 7fdc02deab80 20 client.5649 trim_cache size 0 max 16384 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:14:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5490, 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9147588129999997, 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 27, 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 55, 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 55, 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.0045602 2023-10-06T11:14:53.090 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:14:53.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe0066f30 msgr2=0x7fdbe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe0066f30 0x7fdbe00693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4001ed0 tx=0x7fdbe4000bc0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 msgr2=0x7fdbf41592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 0x7fdbf41592c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80091e0 tx=0x7fdbe8016000 comp rx=0 tx=0).stop 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 shutdown_connections 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe0066f30 0x7fdbe00693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf415b660 0x7fdbf40cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4157040 0x7fdbf4169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 --2- 172.21.15.55:0/3107403190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4157410 0x7fdbf41592c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 >> 172.21.15.55:0/3107403190 conn(0x7fdbf406b500 msgr2=0x7fdbf40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 shutdown_connections 2023-10-06T11:14:53.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.080+0000 7fdbf8890700 1 -- 172.21.15.55:0/3107403190 wait complete. 2023-10-06T11:14:53.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:14:53.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.211+0000 7fc589b70700 1 Processor -- start 2023-10-06T11:14:53.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.211+0000 7fc589b70700 1 -- start start 2023-10-06T11:14:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc589b70700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5840b49a0 0x7fc5840aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc589b70700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840b0c60 con 0x7fc584159560 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc589b70700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840b0f40 con 0x7fc5840b0760 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc589b70700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840b1220 con 0x7fc5840b49a0 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc582ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5840b49a0 0x7fc5840aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc5837fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc584159560 0x7fc5840aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45810/0 (socket says 172.21.15.55:45810) 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc5837fe700 1 -- 172.21.15.55:0/2983568766 learned_addr learned my addr 172.21.15.55:0/2983568766 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc582ffd700 1 -- 172.21.15.55:0/2983568766 >> v1:172.21.15.142:6789/0 conn(0x7fc5840b0760 legacy=0x7fc5840b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc582ffd700 1 -- 172.21.15.55:0/2983568766 >> v1:172.21.15.55:6789/0 conn(0x7fc584159560 legacy=0x7fc5840aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc582ffd700 1 -- 172.21.15.55:0/2983568766 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840b1500 con 0x7fc5840b49a0 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc5827fc700 1 -- 172.21.15.55:0/2983568766 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425234927 0 0) 0x7fc5840b0c60 con 0x7fc584159560 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc582ffd700 1 --2- 172.21.15.55:0/2983568766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc5840aac40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc578009910 tx=0x7fc5780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debe16422859ebb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc5827fc700 1 -- 172.21.15.55:0/2983568766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800b7e0 con 0x7fc5840b49a0 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc5827fc700 1 -- 172.21.15.55:0/2983568766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57800b940 con 0x7fc5840b49a0 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.212+0000 7fc5827fc700 1 -- 172.21.15.55:0/2983568766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800bce0 con 0x7fc5840b49a0 2023-10-06T11:14:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 -- 172.21.15.55:0/2983568766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 msgr2=0x7fc5840aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 --2- 172.21.15.55:0/2983568766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc5840aac40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc578009910 tx=0x7fc5780091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 -- 172.21.15.55:0/2983568766 shutdown_connections 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 --2- 172.21.15.55:0/2983568766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc5840aac40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 -- 172.21.15.55:0/2983568766 >> 172.21.15.55:0/2983568766 conn(0x7fc5840997f0 msgr2=0x7fc58406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 -- 172.21.15.55:0/2983568766 shutdown_connections 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.213+0000 7fc589b70700 1 -- 172.21.15.55:0/2983568766 wait complete. 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.214+0000 7fc589b70700 1 Processor -- start 2023-10-06T11:14:53.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.214+0000 7fc589b70700 1 -- start start 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc589b70700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840b0760 0x7fc58409a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc589b70700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc58409b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc589b70700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc584159560 0x7fc58409d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc589b70700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415be10 con 0x7fc5840b49a0 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc589b70700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584156f40 con 0x7fc584159560 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc589b70700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58409afd0 con 0x7fc5840b0760 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc58409b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc58409b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48426/0 (socket says 172.21.15.55:48426) 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 -- 172.21.15.55:0/934650261 learned_addr learned my addr 172.21.15.55:0/934650261 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:53.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc5837fe700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840b0760 0x7fc58409a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc583fff700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc584159560 0x7fc58409d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 -- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840b0760 msgr2=0x7fc58409a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840b0760 0x7fc58409a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 -- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc584159560 msgr2=0x7fc58409d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc584159560 0x7fc58409d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.215+0000 7fc582ffd700 1 -- 172.21.15.55:0/934650261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578009420 con 0x7fc5840b49a0 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.216+0000 7fc582ffd700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc58409b960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc5780093f0 tx=0x7fc578016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.216+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57801b470 con 0x7fc5840b49a0 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.216+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57801b5d0 con 0x7fc5840b49a0 2023-10-06T11:14:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.216+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58409a730 con 0x7fc5840b49a0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.216+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57801b990 con 0x7fc5840b49a0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.216+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58409acf0 con 0x7fc5840b49a0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.217+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58415bf80 con 0x7fc5840b49a0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.217+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc57801bd00 con 0x7fc5840b49a0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.218+0000 7fc56b7fe700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc570066f30 0x7fc5700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.218+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc578086080 con 0x7fc5840b49a0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.218+0000 7fc5837fe700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc570066f30 0x7fc5700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.218+0000 7fc5837fe700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc570066f30 0x7fc5700693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc5740029c0 tx=0x7fc574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.222+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5780b75a0 con 0x7fc5840b49a0 2023-10-06T11:14:53.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.462+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc584064a90 con 0x7fc5840b49a0 2023-10-06T11:14:53.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.462+0000 7fc56b7fe700 1 -- 172.21.15.55:0/934650261 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc58415bf80 con 0x7fc5840b49a0 2023-10-06T11:14:53.464 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:14:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc570066f30 msgr2=0x7fc5700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc570066f30 0x7fc5700693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc5740029c0 tx=0x7fc574009040 comp rx=0 tx=0).stop 2023-10-06T11:14:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 msgr2=0x7fc58409b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc58409b960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc5780093f0 tx=0x7fc578016000 comp rx=0 tx=0).stop 2023-10-06T11:14:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 shutdown_connections 2023-10-06T11:14:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc570066f30 0x7fc5700693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc584159560 0x7fc58409d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840b0760 0x7fc58409a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 --2- 172.21.15.55:0/934650261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5840b49a0 0x7fc58409b960 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 >> 172.21.15.55:0/934650261 conn(0x7fc5840997f0 msgr2=0x7fc584069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 shutdown_connections 2023-10-06T11:14:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:53.464+0000 7fc589b70700 1 -- 172.21.15.55:0/934650261 wait complete. 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:14:53.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:14:53.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:14:53.479 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:53.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:53.479 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:14:53.495 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:14:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:14:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:14:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:14:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.496 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:14:53.497 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:14:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:14:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:14:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42399sec preferred_lft 42399sec 2023-10-06T11:14:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:14:53.499 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:14:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:14:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.501 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:14:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:14:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:53.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:53.502 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:14:53.559 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:14:53.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:53.561 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:14:53.618 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:14:53.618 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:14:53.619 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:14:53.619 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:14:53.619 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:14:53.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:53.620 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:14:53.620 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:14:53.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:14:53.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:14:53.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:14:53.620 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:14:53.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:53.720 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:14:53.735 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:14:53.735 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:14:53.735 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:53.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:53.735 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:14:53.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:53.801 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:53.856 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:53.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:53.857 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:53.911 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:14:53.911 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:53.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:53.992 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:53.992 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:54.011 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:14:54.034 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:14:54.035 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:14:54.036 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:14:54.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:54.102 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:14:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.261+0000 7fc04d28e700 1 Processor -- start 2023-10-06T11:14:54.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.261+0000 7fc04d28e700 1 -- start start 2023-10-06T11:14:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc04d28e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc048156500 0x7fc0480c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc04d28e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0480c7570 0x7fc04806e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc04d28e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480acd20 con 0x7fc04806eb90 2023-10-06T11:14:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc04d28e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04806f430 con 0x7fc0480c7570 2023-10-06T11:14:54.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc04d28e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04806f010 con 0x7fc048156500 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc0467fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0480c7570 0x7fc04806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc0467fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0480c7570 0x7fc04806e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48434/0 (socket says 172.21.15.55:48434) 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.262+0000 7fc0467fc700 1 -- 172.21.15.55:0/1334011843 learned_addr learned my addr 172.21.15.55:0/1334011843 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc046ffd700 1 --2- 172.21.15.55:0/1334011843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc048156500 0x7fc0480c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc0467fc700 1 -- 172.21.15.55:0/1334011843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc048156500 msgr2=0x7fc0480c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc0467fc700 1 --2- 172.21.15.55:0/1334011843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc048156500 0x7fc0480c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc0467fc700 1 -- 172.21.15.55:0/1334011843 >> v1:172.21.15.142:6789/0 conn(0x7fc04806eb90 legacy=0x7fc04806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc0467fc700 1 -- 172.21.15.55:0/1334011843 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0481568d0 con 0x7fc0480c7570 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc0467fc700 1 --2- 172.21.15.55:0/1334011843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0480c7570 0x7fc04806e650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc0300099e0 tx=0x7fc030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85e3d308491526b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc045ffb700 1 -- 172.21.15.55:0/1334011843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000b7e0 con 0x7fc0480c7570 2023-10-06T11:14:54.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc045ffb700 1 -- 172.21.15.55:0/1334011843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000b940 con 0x7fc0480c7570 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.263+0000 7fc045ffb700 1 -- 172.21.15.55:0/1334011843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000bce0 con 0x7fc0480c7570 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 -- 172.21.15.55:0/1334011843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0480c7570 msgr2=0x7fc04806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 --2- 172.21.15.55:0/1334011843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0480c7570 0x7fc04806e650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc0300099e0 tx=0x7fc030009250 comp rx=0 tx=0).stop 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 -- 172.21.15.55:0/1334011843 shutdown_connections 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 --2- 172.21.15.55:0/1334011843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc048156500 0x7fc0480c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 --2- 172.21.15.55:0/1334011843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0480c7570 0x7fc04806e650 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 -- 172.21.15.55:0/1334011843 >> 172.21.15.55:0/1334011843 conn(0x7fc048068080 msgr2=0x7fc0480cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 -- 172.21.15.55:0/1334011843 shutdown_connections 2023-10-06T11:14:54.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.264+0000 7fc04d28e700 1 -- 172.21.15.55:0/1334011843 wait complete. 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.265+0000 7fc04d28e700 1 Processor -- start 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.265+0000 7fc04d28e700 1 -- start start 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc04806eb90 0x7fc0480c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0480c7570 0x7fc04814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 0x7fc0480ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480c5a60 con 0x7fc048156500 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04814ef10 con 0x7fc0480c7570 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04814b770 con 0x7fc04806eb90 2023-10-06T11:14:54.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 0x7fc0480ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 0x7fc0480ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48438/0 (socket says 172.21.15.55:48438) 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 -- 172.21.15.55:0/2305587817 learned_addr learned my addr 172.21.15.55:0/2305587817 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0467fc700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0480c7570 0x7fc04814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc046ffd700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc04806eb90 0x7fc0480c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 -- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc04806eb90 msgr2=0x7fc0480c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc04806eb90 0x7fc0480c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 -- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0480c7570 msgr2=0x7fc04814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0480c7570 0x7fc04814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 -- 172.21.15.55:0/2305587817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300094f0 con 0x7fc048156500 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0467fc700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0480c7570 0x7fc04814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:54.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc0477fe700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 0x7fc0480ad0b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc03800c5b0 tx=0x7fc038007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011590 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc038011710 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0480c5c50 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.266+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011ad0 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.267+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04814b1a0 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.267+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04814b8e0 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.268+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc03801c460 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.268+0000 7fc03effd700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc028066f30 0x7fc0280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.268+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc0380844f0 con 0x7fc048156500 2023-10-06T11:14:54.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.269+0000 7fc046ffd700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc028066f30 0x7fc0280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:54.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.269+0000 7fc046ffd700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc028066f30 0x7fc0280693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc040007f60 tx=0x7fc040007470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:54.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.272+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0380514c0 con 0x7fc048156500 2023-10-06T11:14:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.510+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc048064a90 con 0x7fc048156500 2023-10-06T11:14:54.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.510+0000 7fc03effd700 1 -- 172.21.15.55:0/2305587817 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc038054ae0 con 0x7fc048156500 2023-10-06T11:14:54.512 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:14:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc028066f30 msgr2=0x7fc0280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc028066f30 0x7fc0280693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc040007f60 tx=0x7fc040007470 comp rx=0 tx=0).stop 2023-10-06T11:14:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 msgr2=0x7fc0480ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 0x7fc0480ad0b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc03800c5b0 tx=0x7fc038007f60 comp rx=0 tx=0).stop 2023-10-06T11:14:54.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 shutdown_connections 2023-10-06T11:14:54.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc028066f30 0x7fc0280693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc048156500 0x7fc0480ad0b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc04806eb90 0x7fc0480c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 --2- 172.21.15.55:0/2305587817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0480c7570 0x7fc04814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 >> 172.21.15.55:0/2305587817 conn(0x7fc048068080 msgr2=0x7fc0480b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 shutdown_connections 2023-10-06T11:14:54.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:54.512+0000 7fc04d28e700 1 -- 172.21.15.55:0/2305587817 wait complete. 2023-10-06T11:14:54.526 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:14:54.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:14:54.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:14:54.527 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:14:54.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:54.527 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:14:54.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:14:54.527 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:14:54.527 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:14:54.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.527 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.546 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:14:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42401sec preferred_lft 42401sec 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.548 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:14:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:54.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.550 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:14:54.613 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:14:54.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.615 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:14:54.673 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:14:54.674 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:14:54.674 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:14:54.674 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:14:54.674 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:14:54.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.674 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:14:54.674 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:14:54.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:14:54.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:14:54.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:14:54.675 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:14:54.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.778 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:14:54.794 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:14:54.794 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:14:54.794 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:14:54.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:54.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:14:54.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:54.859 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:54.914 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:14:54.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:54.914 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:54.968 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:14:54.968 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:54.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:55.049 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:55.049 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:55.068 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:55.068 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:55.068 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:55.068 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:55.068 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:55.069 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:55.069 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:55.069 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:55.092 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:14:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:14:55.094 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:14:55.094 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:14:55.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:55.095 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:55.159 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:14:55.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:55.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:55.247 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:14:55.247 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:14:55.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:55.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:55.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:14:55.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:55.289 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:14:55.347 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:14:55.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:55.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:14:55.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:14:55.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:55.395 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:14:55.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.532+0000 7f2df59b6700 1 Processor -- start 2023-10-06T11:14:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.532+0000 7f2df59b6700 1 -- start start 2023-10-06T11:14:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2df59b6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2df0159580 0x7f2df006e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2df59b6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df006e9a0 0x7f2df00675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2df59b6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df0159950 0x7f2df0067af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2df59b6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df00cde30 con 0x7f2df006e9a0 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2df59b6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df006ef20 con 0x7f2df0159580 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2df59b6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df006f200 con 0x7f2df0159950 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df006e9a0 0x7f2df00675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df006e9a0 0x7f2df00675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44994/0 (socket says 172.21.15.55:44994) 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 -- 172.21.15.55:0/4282261539 learned_addr learned my addr 172.21.15.55:0/4282261539 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2deeffd700 1 --2- 172.21.15.55:0/4282261539 >> v2:172.21.15.142:3300/0 conn(0x7f2df0159580 0x7f2df006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2def7fe700 1 --2- 172.21.15.55:0/4282261539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df0159950 0x7f2df0067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 -- 172.21.15.55:0/4282261539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df0159950 msgr2=0x7f2df0067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 --2- 172.21.15.55:0/4282261539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df0159950 0x7f2df0067af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 -- 172.21.15.55:0/4282261539 >> v2:172.21.15.142:3300/0 conn(0x7f2df0159580 msgr2=0x7f2df006e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 --2- 172.21.15.55:0/4282261539 >> v2:172.21.15.142:3300/0 conn(0x7f2df0159580 0x7f2df006e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.533+0000 7f2dee7fc700 1 -- 172.21.15.55:0/4282261539 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00b0150 con 0x7f2df006e9a0 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2dee7fc700 1 --2- 172.21.15.55:0/4282261539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df006e9a0 0x7f2df00675b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2df00705d0 tx=0x7f2dd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf1100b18e7a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2dedffb700 1 -- 172.21.15.55:0/4282261539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800b860 con 0x7f2df006e9a0 2023-10-06T11:14:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2dedffb700 1 -- 172.21.15.55:0/4282261539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800b9c0 con 0x7f2df006e9a0 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2dedffb700 1 -- 172.21.15.55:0/4282261539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800bd60 con 0x7f2df006e9a0 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 -- 172.21.15.55:0/4282261539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df006e9a0 msgr2=0x7f2df00675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 --2- 172.21.15.55:0/4282261539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df006e9a0 0x7f2df00675b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2df00705d0 tx=0x7f2dd8009250 comp rx=0 tx=0).stop 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 -- 172.21.15.55:0/4282261539 shutdown_connections 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 --2- 172.21.15.55:0/4282261539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df0159950 0x7f2df0067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 --2- 172.21.15.55:0/4282261539 >> v2:172.21.15.142:3300/0 conn(0x7f2df0159580 0x7f2df006e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 --2- 172.21.15.55:0/4282261539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df006e9a0 0x7f2df00675b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 -- 172.21.15.55:0/4282261539 >> 172.21.15.55:0/4282261539 conn(0x7f2df0069140 msgr2=0x7f2df00cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 -- 172.21.15.55:0/4282261539 shutdown_connections 2023-10-06T11:14:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.534+0000 7f2df59b6700 1 -- 172.21.15.55:0/4282261539 wait complete. 2023-10-06T11:14:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.535+0000 7f2df59b6700 1 Processor -- start 2023-10-06T11:14:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 -- start start 2023-10-06T11:14:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df006e9a0 0x7f2df0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df0159580 0x7f2df015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 0x7f2df0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df016d650 con 0x7f2df0159950 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df016d930 con 0x7f2df0159580 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2df59b6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df016dc10 con 0x7f2df006e9a0 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2def7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 0x7f2df0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2def7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 0x7f2df0153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45006/0 (socket says 172.21.15.55:45006) 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.536+0000 7f2def7fe700 1 -- 172.21.15.55:0/3506149053 learned_addr learned my addr 172.21.15.55:0/3506149053 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2dee7fc700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df0159580 0x7f2df015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2deeffd700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df006e9a0 0x7f2df0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2def7fe700 1 -- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df006e9a0 msgr2=0x7f2df0159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2def7fe700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df006e9a0 0x7f2df0159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2def7fe700 1 -- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df0159580 msgr2=0x7f2df015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2def7fe700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df0159580 0x7f2df015abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2def7fe700 1 -- 172.21.15.55:0/3506149053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80094f0 con 0x7f2df0159950 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2def7fe700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 0x7f2df0153680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2de0007f20 tx=0x7f2de0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000eb90 con 0x7f2df0159950 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000ed10 con 0x7f2df0159950 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0014670 con 0x7f2df0159950 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df016def0 con 0x7f2df0159950 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.537+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df016e4b0 con 0x7f2df0159950 2023-10-06T11:14:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.538+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df006e7e0 con 0x7f2df0159950 2023-10-06T11:14:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.539+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2de00149e0 con 0x7f2df0159950 2023-10-06T11:14:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.539+0000 7f2de6ffd700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.539+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2de0084d50 con 0x7f2df0159950 2023-10-06T11:14:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.539+0000 7f2deeffd700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.540+0000 7f2deeffd700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2de8006fd0 tx=0x7f2de8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.543+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2de0088030 con 0x7f2df0159950 2023-10-06T11:14:55.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.780+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2df0064a90 con 0x7f2df0159950 2023-10-06T11:14:55.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.780+0000 7f2de6ffd700 1 -- 172.21.15.55:0/3506149053 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2de0051d20 con 0x7f2df0159950 2023-10-06T11:14:55.782 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:55.782 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:46.560821+0000","modified":"2023-10-06T11:14:50.181274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/173974006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":173974006},{"type":"v1","addr":"172.21.15.55:6835","nonce":173974006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:14:55.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2dd0066f30 msgr2=0x7f2dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2de8006fd0 tx=0x7f2de8008040 comp rx=0 tx=0).stop 2023-10-06T11:14:55.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 msgr2=0x7f2df0153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 0x7f2df0153680 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2de0007f20 tx=0x7f2de0009860 comp rx=0 tx=0).stop 2023-10-06T11:14:55.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 shutdown_connections 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df0159950 0x7f2df0153680 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2df006e9a0 0x7f2df0159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.782+0000 7f2df59b6700 1 --2- 172.21.15.55:0/3506149053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df0159580 0x7f2df015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.783+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 >> 172.21.15.55:0/3506149053 conn(0x7f2df0069140 msgr2=0x7f2df00b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.783+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 shutdown_connections 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.783+0000 7f2df59b6700 1 -- 172.21.15.55:0/3506149053 wait complete. 2023-10-06T11:14:55.785 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2023-10-06T11:14:55.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.913+0000 7ff507c9b700 1 Processor -- start 2023-10-06T11:14:55.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.914+0000 7ff507c9b700 1 -- start start 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.914+0000 7ff507c9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff500159560 0x7ff5000aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.914+0000 7ff507c9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff5000b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff507c9b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000b0c60 con 0x7ff5000b49a0 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff507c9b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000b0f40 con 0x7ff500159560 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff507c9b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000b1220 con 0x7ff5000b0760 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505236700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5000b49a0 0x7ff5000aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46232/0 (socket says 172.21.15.55:46232) 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505236700 1 -- 172.21.15.55:0/1496601422 learned_addr learned my addr 172.21.15.55:0/1496601422 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505a37700 1 --2- 172.21.15.55:0/1496601422 >> v2:172.21.15.142:3300/0 conn(0x7ff500159560 0x7ff5000aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff506238700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff5000b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff504a35700 1 -- 172.21.15.55:0/1496601422 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537425679 0 0) 0x7ff5000b0c60 con 0x7ff5000b49a0 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff504a35700 1 -- 172.21.15.55:0/1496601422 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e8003570 con 0x7ff5000b49a0 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505a37700 1 -- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 msgr2=0x7ff5000b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505a37700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff5000b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505a37700 1 -- 172.21.15.55:0/1496601422 >> v1:172.21.15.55:6789/0 conn(0x7ff5000b49a0 legacy=0x7ff5000aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505a37700 1 -- 172.21.15.55:0/1496601422 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000b1500 con 0x7ff500159560 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff506238700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff5000b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff505a37700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000aa530 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009900 tx=0x7ff4f8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a72a1cb3dededf0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.915+0000 7ff504a35700 1 -- 172.21.15.55:0/1496601422 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8005c10 con 0x7ff500159560 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff504a35700 1 -- 172.21.15.55:0/1496601422 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8005d70 con 0x7ff500159560 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff504a35700 1 -- 172.21.15.55:0/1496601422 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8006280 con 0x7ff500159560 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 -- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 msgr2=0x7ff5000aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000aa530 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009900 tx=0x7ff4f8009120 comp rx=0 tx=0).stop 2023-10-06T11:14:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 -- 172.21.15.55:0/1496601422 shutdown_connections 2023-10-06T11:14:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff5000b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 --2- 172.21.15.55:0/1496601422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000aa530 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 -- 172.21.15.55:0/1496601422 >> 172.21.15.55:0/1496601422 conn(0x7ff5000997f0 msgr2=0x7ff50006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 -- 172.21.15.55:0/1496601422 shutdown_connections 2023-10-06T11:14:55.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.916+0000 7ff507c9b700 1 -- 172.21.15.55:0/1496601422 wait complete. 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.917+0000 7ff507c9b700 1 Processor -- start 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.917+0000 7ff507c9b700 1 -- start start 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff507c9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff500157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff507c9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 0x7ff500069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff507c9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff507c9b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50009c4a0 con 0x7ff5000b49a0 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff507c9b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000ae760 con 0x7ff500159560 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff507c9b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000aea40 con 0x7ff5000b0760 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 0x7ff500069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 0x7ff500069390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45012/0 (socket says 172.21.15.55:45012) 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 -- 172.21.15.55:0/191942902 learned_addr learned my addr 172.21.15.55:0/191942902 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505a37700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff500157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff506238700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 -- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 msgr2=0x7ff500157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff500157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 -- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 msgr2=0x7ff5000698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.918+0000 7ff505236700 1 -- 172.21.15.55:0/191942902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009a20 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.919+0000 7ff505236700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 0x7ff500069390 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400c790 tx=0x7ff4f4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.919+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4005c00 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.919+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4005d60 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.919+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80093c0 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.919+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40072e0 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.919+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000aed20 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.920+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500064a90 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.920+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4f401b3b0 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.921+0000 7ff4fdffb700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff4ec066f30 0x7ff4ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.921+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff4f4083ad0 con 0x7ff5000b49a0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.921+0000 7ff505a37700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff4ec066f30 0x7ff4ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.921+0000 7ff505a37700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff4ec066f30 0x7ff4ec0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009160 tx=0x7ff4f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:55.925+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4f404b5a0 con 0x7ff5000b49a0 2023-10-06T11:14:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.121+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff50009c5e0 con 0x7ff5000b49a0 2023-10-06T11:14:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.122+0000 7ff4fdffb700 1 -- 172.21.15.55:0/191942902 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17071 (secure 0 0 0) 0x7ff4f4017070 con 0x7ff5000b49a0 2023-10-06T11:14:56.124 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:56.124 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":55,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:48.027215+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:44.294407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:45.538885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff4ec066f30 msgr2=0x7ff4ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff4ec066f30 0x7ff4ec0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009160 tx=0x7ff4f8016000 comp rx=0 tx=0).stop 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 msgr2=0x7ff500069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 0x7ff500069390 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400c790 tx=0x7ff4f4007db0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 shutdown_connections 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff4ec066f30 0x7ff4ec0693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff500159560 0x7ff5000698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5000b0760 0x7ff500157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 --2- 172.21.15.55:0/191942902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5000b49a0 0x7ff500069390 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 >> 172.21.15.55:0/191942902 conn(0x7ff5000997f0 msgr2=0x7ff500158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 shutdown_connections 2023-10-06T11:14:56.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.125+0000 7ff507c9b700 1 -- 172.21.15.55:0/191942902 wait complete. 2023-10-06T11:14:56.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:14:44.294407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:14:45.538885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:14:56.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:56.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.263+0000 7ff5a4e2c700 1 Processor -- start 2023-10-06T11:14:56.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.263+0000 7ff5a4e2c700 1 -- start start 2023-10-06T11:14:56.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.264+0000 7ff5a4e2c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.264+0000 7ff5a4e2c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00c9670 con 0x7ff5a00cc740 2023-10-06T11:14:56.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.264+0000 7ff5a4e2c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a0159c00 con 0x7ff5a00c4450 2023-10-06T11:14:56.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.264+0000 7ff5a4e2c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00c8a60 con 0x7ff5a00b0820 2023-10-06T11:14:56.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.264+0000 7ff59ed9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5a00cc740 0x7ff5a00ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46238/0 (socket says 172.21.15.55:46238) 2023-10-06T11:14:56.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.264+0000 7ff59ed9d700 1 -- 172.21.15.55:0/2877390052 learned_addr learned my addr 172.21.15.55:0/2877390052 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59e59c700 1 --2- 172.21.15.55:0/2877390052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090642529 0 0) 0x7ff5a00c9670 con 0x7ff5a00cc740 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c003570 con 0x7ff5a00cc740 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037079270 0 0) 0x7ff5a0159c00 con 0x7ff5a00c4450 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a00c9670 con 0x7ff5a00c4450 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59e59c700 1 -- 172.21.15.55:0/2877390052 >> v1:172.21.15.142:6789/0 conn(0x7ff5a00c4450 legacy=0x7ff5a00cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59e59c700 1 -- 172.21.15.55:0/2877390052 >> v1:172.21.15.55:6789/0 conn(0x7ff5a00cc740 legacy=0x7ff5a00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59e59c700 1 -- 172.21.15.55:0/2877390052 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00c8d40 con 0x7ff5a00b0820 2023-10-06T11:14:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59e59c700 1 --2- 172.21.15.55:0/2877390052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00686c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff598009900 tx=0x7ff598009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f91b8b9f1cabbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598005c10 con 0x7ff5a00b0820 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598005d70 con 0x7ff5a00b0820 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.265+0000 7ff59d59a700 1 -- 172.21.15.55:0/2877390052 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598006240 con 0x7ff5a00b0820 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2877390052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 msgr2=0x7ff5a00686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2877390052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00686c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff598009900 tx=0x7ff598009120 comp rx=0 tx=0).stop 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2877390052 shutdown_connections 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2877390052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00686c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2877390052 >> 172.21.15.55:0/2877390052 conn(0x7ff5a0087fc0 msgr2=0x7ff5a00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2877390052 shutdown_connections 2023-10-06T11:14:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.266+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2877390052 wait complete. 2023-10-06T11:14:56.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.267+0000 7ff5a4e2c700 1 Processor -- start 2023-10-06T11:14:56.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.267+0000 7ff5a4e2c700 1 -- start start 2023-10-06T11:14:56.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff5a4e2c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff5a4e2c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 0x7ff5a00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff5a4e2c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5a00cc740 0x7ff5a00ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff5a4e2c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0169ba0 con 0x7ff5a00c4450 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff5a4e2c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00c62c0 con 0x7ff5a00cc740 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff5a4e2c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0169e70 con 0x7ff5a00b0820 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 0x7ff5a00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 0x7ff5a00cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45016/0 (socket says 172.21.15.55:45016) 2023-10-06T11:14:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 -- 172.21.15.55:0/2218363835 learned_addr learned my addr 172.21.15.55:0/2218363835 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59e59c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59ed9d700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5a00cc740 0x7ff5a00ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 -- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 msgr2=0x7ff5a00c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 -- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5a00cc740 msgr2=0x7ff5a00ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5a00cc740 0x7ff5a00ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 -- 172.21.15.55:0/2218363835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980093c0 con 0x7ff5a00c4450 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59e59c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.268+0000 7ff59dd9b700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 0x7ff5a00cdf90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff58800c7c0 tx=0x7ff588007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.269+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588010510 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.269+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588010670 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.269+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a00c78e0 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.269+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588010a30 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.269+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a00c7320 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.269+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0064a90 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.270+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff58801b400 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.270+0000 7ff5967fc700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff580066f30 0x7ff5800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.270+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff5880844e0 con 0x7ff5a00c4450 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.271+0000 7ff59e59c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff580066f30 0x7ff5800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.271+0000 7ff59e59c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff580066f30 0x7ff5800693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff598009160 tx=0x7ff598016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.275+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5880514b0 con 0x7ff5a00c4450 2023-10-06T11:14:56.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.467+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5a004bb40 con 0x7ff5a00c4450 2023-10-06T11:14:56.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.468+0000 7ff5967fc700 1 -- 172.21.15.55:0/2218363835 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff588054ad0 con 0x7ff5a00c4450 2023-10-06T11:14:56.469 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff580066f30 msgr2=0x7ff5800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff580066f30 0x7ff5800693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff598009160 tx=0x7ff598016000 comp rx=0 tx=0).stop 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 msgr2=0x7ff5a00cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 0x7ff5a00cdf90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff58800c7c0 tx=0x7ff588007dc0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 shutdown_connections 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff580066f30 0x7ff5800693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5a00cc740 0x7ff5a00ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5a00b0820 0x7ff5a00c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 --2- 172.21.15.55:0/2218363835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a00c4450 0x7ff5a00cdf90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 >> 172.21.15.55:0/2218363835 conn(0x7ff5a0087fc0 msgr2=0x7ff5a00692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 shutdown_connections 2023-10-06T11:14:56.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.470+0000 7ff5a4e2c700 1 -- 172.21.15.55:0/2218363835 wait complete. 2023-10-06T11:14:56.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.603+0000 7f41462b6700 1 Processor -- start 2023-10-06T11:14:56.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.603+0000 7f41462b6700 1 -- start start 2023-10-06T11:14:56.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f41462b6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4140159470 0x7f41400ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f41462b6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400cbb80 con 0x7f4140159840 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f41462b6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400c6f00 con 0x7f41400cd020 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f41462b6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41400cb530 con 0x7f4140159470 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f413f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4140159840 0x7f41400c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46252/0 (socket says 172.21.15.55:46252) 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f413f7fe700 1 -- 172.21.15.55:0/2789515547 learned_addr learned my addr 172.21.15.55:0/2789515547 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.604+0000 7f413ffff700 1 --2- 172.21.15.55:0/2789515547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4140159470 0x7f41400ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413effd700 1 -- 172.21.15.55:0/2789515547 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670136256 0 0) 0x7f41400cbb80 con 0x7f4140159840 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413effd700 1 -- 172.21.15.55:0/2789515547 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4128003570 con 0x7f4140159840 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413effd700 1 -- 172.21.15.55:0/2789515547 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34763241 0 0) 0x7f41400c6f00 con 0x7f41400cd020 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413ffff700 1 -- 172.21.15.55:0/2789515547 >> v1:172.21.15.142:6789/0 conn(0x7f41400cd020 legacy=0x7f4140163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413ffff700 1 -- 172.21.15.55:0/2789515547 >> v1:172.21.15.55:6789/0 conn(0x7f4140159840 legacy=0x7f41400c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413ffff700 1 -- 172.21.15.55:0/2789515547 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400cb810 con 0x7f4140159470 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413ffff700 1 --2- 172.21.15.55:0/2789515547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4140159470 0x7f41400ce980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f4134009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a588046bf3974234 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413effd700 1 -- 172.21.15.55:0/2789515547 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134005c10 con 0x7f4140159470 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413effd700 1 -- 172.21.15.55:0/2789515547 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4134005d70 con 0x7f4140159470 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.605+0000 7f413effd700 1 -- 172.21.15.55:0/2789515547 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134006260 con 0x7f4140159470 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 -- 172.21.15.55:0/2789515547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4140159470 msgr2=0x7f41400ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 --2- 172.21.15.55:0/2789515547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4140159470 0x7f41400ce980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f4134009120 comp rx=0 tx=0).stop 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 -- 172.21.15.55:0/2789515547 shutdown_connections 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 --2- 172.21.15.55:0/2789515547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4140159470 0x7f41400ce980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 -- 172.21.15.55:0/2789515547 >> 172.21.15.55:0/2789515547 conn(0x7f41400996e0 msgr2=0x7f414006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 -- 172.21.15.55:0/2789515547 shutdown_connections 2023-10-06T11:14:56.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.606+0000 7f41462b6700 1 -- 172.21.15.55:0/2789515547 wait complete. 2023-10-06T11:14:56.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.607+0000 7f41462b6700 1 Processor -- start 2023-10-06T11:14:56.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.607+0000 7f41462b6700 1 -- start start 2023-10-06T11:14:56.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41400cd020 0x7f41400c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 0x7f414015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4140159840 0x7f41400c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414016e300 con 0x7f4140159470 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414015b570 con 0x7f4140159840 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414015bdf0 con 0x7f41400cd020 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 0x7f414015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 0x7f414015c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45022/0 (socket says 172.21.15.55:45022) 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 -- 172.21.15.55:0/2651594192 learned_addr learned my addr 172.21.15.55:0/2651594192 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413ffff700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41400cd020 0x7f41400c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f4144853700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4140159840 0x7f41400c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 -- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41400cd020 msgr2=0x7f41400c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41400cd020 0x7f41400c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 -- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4140159840 msgr2=0x7f41400c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4140159840 0x7f41400c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 -- 172.21.15.55:0/2651594192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340093c0 con 0x7f4140159470 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f413f7fe700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 0x7f414015c280 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f413000c580 tx=0x7f4130007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130005b30 con 0x7f4140159470 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130005c90 con 0x7f4140159470 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414016e020 con 0x7f4140159470 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.608+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130007320 con 0x7f4140159470 2023-10-06T11:14:56.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.609+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414015ba80 con 0x7f4140159470 2023-10-06T11:14:56.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.609+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414015bfa0 con 0x7f4140159470 2023-10-06T11:14:56.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.610+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4130007690 con 0x7f4140159470 2023-10-06T11:14:56.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.610+0000 7f4127fff700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.610+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4130083be0 con 0x7f4140159470 2023-10-06T11:14:56.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.611+0000 7f413ffff700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.611+0000 7f413ffff700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4134009160 tx=0x7f4134016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.615+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f414015bfa0 con 0x7f4140159470 2023-10-06T11:14:56.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.811+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f414015bf60 con 0x7f4140159470 2023-10-06T11:14:56.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.811+0000 7f4127fff700 1 -- 172.21.15.55:0/2651594192 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4130017020 con 0x7f4140159470 2023-10-06T11:14:56.813 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:14:56.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 msgr2=0x7f412c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4134009160 tx=0x7f4134016000 comp rx=0 tx=0).stop 2023-10-06T11:14:56.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 msgr2=0x7f414015c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 0x7f414015c280 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f413000c580 tx=0x7f4130007df0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 shutdown_connections 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f412c066f30 0x7f412c0693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4140159840 0x7f41400c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.813+0000 7f41462b6700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41400cd020 0x7f41400c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.814+0000 7f41462b6700 1 --2- 172.21.15.55:0/2651594192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4140159470 0x7f414015c280 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.814+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 >> 172.21.15.55:0/2651594192 conn(0x7f41400996e0 msgr2=0x7f4140154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.814+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 shutdown_connections 2023-10-06T11:14:56.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.814+0000 7f41462b6700 1 -- 172.21.15.55:0/2651594192 wait complete. 2023-10-06T11:14:56.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:14:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.947+0000 7f34b4280700 1 Processor -- start 2023-10-06T11:14:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.947+0000 7f34b4280700 1 -- start start 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.948+0000 7f34b4280700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34ac1598a0 0x7f34ac0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.948+0000 7f34b4280700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0cf5d0 con 0x7f34ac1594d0 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.948+0000 7f34b4280700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0cf8b0 con 0x7f34ac0cbc70 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.948+0000 7f34b4280700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0cfb90 con 0x7f34ac1598a0 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b201c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f34ac1594d0 0x7f34ac0cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46254/0 (socket says 172.21.15.55:46254) 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b201c700 1 -- 172.21.15.55:0/3142479163 learned_addr learned my addr 172.21.15.55:0/3142479163 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b181b700 1 --2- 172.21.15.55:0/3142479163 >> v2:172.21.15.142:3300/0 conn(0x7f34ac1598a0 0x7f34ac0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b101a700 1 -- 172.21.15.55:0/3142479163 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303238091 0 0) 0x7f34ac0cf5d0 con 0x7f34ac1594d0 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b101a700 1 -- 172.21.15.55:0/3142479163 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3494003570 con 0x7f34ac1594d0 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b181b700 1 -- 172.21.15.55:0/3142479163 >> v1:172.21.15.142:6789/0 conn(0x7f34ac0cbc70 legacy=0x7f34ac0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b101a700 1 -- 172.21.15.55:0/3142479163 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104633372 0 0) 0x7f34ac0cf8b0 con 0x7f34ac0cbc70 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b181b700 1 -- 172.21.15.55:0/3142479163 >> v1:172.21.15.55:6789/0 conn(0x7f34ac1594d0 legacy=0x7f34ac0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b181b700 1 -- 172.21.15.55:0/3142479163 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac0cfe70 con 0x7f34ac1598a0 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.949+0000 7f34b181b700 1 --2- 172.21.15.55:0/3142479163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac1598a0 0x7f34ac0ce7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098e0 tx=0x7f34a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4618ae68e49e6f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b101a700 1 -- 172.21.15.55:0/3142479163 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000b640 con 0x7f34ac1598a0 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b101a700 1 -- 172.21.15.55:0/3142479163 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000b7a0 con 0x7f34ac1598a0 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b101a700 1 -- 172.21.15.55:0/3142479163 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000bb40 con 0x7f34ac1598a0 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 -- 172.21.15.55:0/3142479163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac1598a0 msgr2=0x7f34ac0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 --2- 172.21.15.55:0/3142479163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac1598a0 0x7f34ac0ce7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098e0 tx=0x7f34a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 -- 172.21.15.55:0/3142479163 shutdown_connections 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 --2- 172.21.15.55:0/3142479163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac1598a0 0x7f34ac0ce7e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 -- 172.21.15.55:0/3142479163 >> 172.21.15.55:0/3142479163 conn(0x7f34ac089e50 msgr2=0x7f34ac099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 -- 172.21.15.55:0/3142479163 shutdown_connections 2023-10-06T11:14:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.950+0000 7f34b4280700 1 -- 172.21.15.55:0/3142479163 wait complete. 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.951+0000 7f34b4280700 1 Processor -- start 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.951+0000 7f34b4280700 1 -- start start 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b4280700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac0cbc70 0x7f34ac14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b4280700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 0x7f34ac15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b4280700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34ac1598a0 0x7f34ac0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b4280700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14eee0 con 0x7f34ac1594d0 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b4280700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac16b060 con 0x7f34ac0cbc70 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b4280700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac15cb30 con 0x7f34ac1598a0 2023-10-06T11:14:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 0x7f34ac15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 0x7f34ac15c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45034/0 (socket says 172.21.15.55:45034) 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 -- 172.21.15.55:0/2444125866 learned_addr learned my addr 172.21.15.55:0/2444125866 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b201c700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac0cbc70 0x7f34ac14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b281d700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34ac1598a0 0x7f34ac0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 -- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34ac1598a0 msgr2=0x7f34ac0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34ac1598a0 0x7f34ac0b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 -- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac0cbc70 msgr2=0x7f34ac14e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac0cbc70 0x7f34ac14e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.952+0000 7f34b181b700 1 -- 172.21.15.55:0/2444125866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009420 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.953+0000 7f34b181b700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 0x7f34ac15c5f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f34a0013000 tx=0x7f34a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.953+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a001f070 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.953+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0002f70 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.953+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac14ec00 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.953+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011420 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.953+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac15a0d0 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.954+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac064a90 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.954+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34a0011810 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.954+0000 7f34aa7fc700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3498066f30 0x7f34980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.955+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f34a00858d0 con 0x7f34ac1594d0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.955+0000 7f34b201c700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3498066f30 0x7f34980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.955+0000 7f34b201c700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3498066f30 0x7f34980693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34a4007fd0 tx=0x7f34a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:56.959+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34a00528a0 con 0x7f34ac1594d0 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.150+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34ac0c66a0 con 0x7f34ac1594d0 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.150+0000 7f34aa7fc700 1 -- 172.21.15.55:0/2444125866 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34a0055ec0 con 0x7f34ac1594d0 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:14:57.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.152+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3498066f30 msgr2=0x7f34980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.152+0000 7f34b4280700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3498066f30 0x7f34980693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34a4007fd0 tx=0x7f34a4009040 comp rx=0 tx=0).stop 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.152+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 msgr2=0x7f34ac15c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.152+0000 7f34b4280700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 0x7f34ac15c5f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f34a0013000 tx=0x7f34a0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 shutdown_connections 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3498066f30 0x7f34980693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34ac1598a0 0x7f34ac0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34ac0cbc70 0x7f34ac14e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 --2- 172.21.15.55:0/2444125866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34ac1594d0 0x7f34ac15c5f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 >> 172.21.15.55:0/2444125866 conn(0x7f34ac089e50 msgr2=0x7f34ac14bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 shutdown_connections 2023-10-06T11:14:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.153+0000 7f34b4280700 1 -- 172.21.15.55:0/2444125866 wait complete. 2023-10-06T11:14:57.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:14:57.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.288+0000 7fce15d5c700 1 Processor -- start 2023-10-06T11:14:57.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.288+0000 7fce15d5c700 1 -- start start 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce15d5c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 0x7fce1006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce15d5c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1006ea20 con 0x7fce1013fe00 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce15d5c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1006ed00 con 0x7fce100c7ac0 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce15d5c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1006efe0 con 0x7fce100c7e90 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0effd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce1013fe00 0x7fce100c9d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46256/0 (socket says 172.21.15.55:46256) 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0effd700 1 -- 172.21.15.55:0/1685155208 learned_addr learned my addr 172.21.15.55:0/1685155208 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0ffff700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 0x7fce1006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857467991 0 0) 0x7fce1006ea20 con 0x7fce1013fe00 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8003570 con 0x7fce1013fe00 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769615326 0 0) 0x7fce1006ed00 con 0x7fce100c7ac0 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce1006ea20 con 0x7fce100c7ac0 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3304583755 0 0) 0x7fcdf8003570 con 0x7fce1013fe00 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 msgr2=0x7fce1006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 0x7fce1006e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 >> v1:172.21.15.142:6789/0 conn(0x7fce100c7ac0 legacy=0x7fce1013f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1006f2c0 con 0x7fce1013fe00 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fce04001470 con 0x7fce1013fe00 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 >> v1:172.21.15.55:6789/0 conn(0x7fce1013fe00 legacy=0x7fce100c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8003c20 0x7fcdf8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdf8004810 0x7fcdf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 0x7fcdf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1006efe0 con 0x7fcdf8004810 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800bb40 con 0x7fcdf8003c20 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800bd00 con 0x7fce100c7e90 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.289+0000 7fce0effd700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdf8004810 0x7fcdf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0f7fe700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8003c20 0x7fcdf8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0ffff700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 0x7fcdf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0effd700 1 -- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 msgr2=0x7fcdf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0effd700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c7e90 0x7fcdf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0effd700 1 -- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8003c20 msgr2=0x7fcdf8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0effd700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8003c20 0x7fcdf8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0effd700 1 -- 172.21.15.55:0/1685155208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8003570 con 0x7fcdf8004810 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0effd700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdf8004810 0x7fcdf8004c80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fce1006b090 tx=0x7fce04001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3701afbe436c044a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400cb40 con 0x7fcdf8004810 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400cca0 con 0x7fcdf8004810 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0e7fc700 1 -- 172.21.15.55:0/1685155208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04005b70 con 0x7fcdf8004810 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce15d5c700 1 -- 172.21.15.55:0/1685155208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdf8004810 msgr2=0x7fcdf8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce15d5c700 1 --2- 172.21.15.55:0/1685155208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdf8004810 0x7fcdf8004c80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fce1006b090 tx=0x7fce04001e10 comp rx=0 tx=0).stop 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.290+0000 7fce0ffff700 1 -- 172.21.15.55:0/1685155208 reap_dead start 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.291+0000 7fce15d5c700 1 -- 172.21.15.55:0/1685155208 shutdown_connections 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.291+0000 7fce15d5c700 1 -- 172.21.15.55:0/1685155208 >> 172.21.15.55:0/1685155208 conn(0x7fce100cc0a0 msgr2=0x7fce100cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.291+0000 7fce15d5c700 1 -- 172.21.15.55:0/1685155208 shutdown_connections 2023-10-06T11:14:57.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.291+0000 7fce15d5c700 1 -- 172.21.15.55:0/1685155208 wait complete. 2023-10-06T11:14:57.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.292+0000 7fce15d5c700 1 Processor -- start 2023-10-06T11:14:57.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.292+0000 7fce15d5c700 1 -- start start 2023-10-06T11:14:57.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.292+0000 7fce15d5c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8004810 0x7fce1013c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.292+0000 7fce15d5c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c3ba0 0x7fce100c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce15d5c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 0x7fce100c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce15d5c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100c3150 con 0x7fce100c4010 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce15d5c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100c3710 con 0x7fcdf8004810 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce15d5c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce100b1610 con 0x7fce100c3ba0 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 0x7fce100c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 0x7fce100c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45042/0 (socket says 172.21.15.55:45042) 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 -- 172.21.15.55:0/667875412 learned_addr learned my addr 172.21.15.55:0/667875412 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0f7fe700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8004810 0x7fce1013c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0effd700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c3ba0 0x7fce100c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 -- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c3ba0 msgr2=0x7fce100c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c3ba0 0x7fce100c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 -- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8004810 msgr2=0x7fce1013c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8004810 0x7fce1013c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 -- 172.21.15.55:0/667875412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100c5020 con 0x7fce100c4010 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce0ffff700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 0x7fce100c49f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fce1006d090 tx=0x7fce0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800e070 con 0x7fce100c4010 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce08011b80 con 0x7fce100c4010 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce100c5300 con 0x7fce100c4010 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08016470 con 0x7fce100c4010 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.293+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce100afe10 con 0x7fce100c4010 2023-10-06T11:14:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.294+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce10064a90 con 0x7fce100c4010 2023-10-06T11:14:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.295+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce080168a0 con 0x7fce100c4010 2023-10-06T11:14:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.295+0000 7fcdf77fe700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdfc066f30 0x7fcdfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.295+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fce08085140 con 0x7fce100c4010 2023-10-06T11:14:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.295+0000 7fce0f7fe700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdfc066f30 0x7fcdfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.296+0000 7fce0f7fe700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdfc066f30 0x7fcdfc0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce00003bc0 tx=0x7fce00007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.299+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce08052110 con 0x7fce100c4010 2023-10-06T11:14:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.492+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce100c3850 con 0x7fce100c4010 2023-10-06T11:14:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.493+0000 7fcdf77fe700 1 -- 172.21.15.55:0/667875412 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce08055730 con 0x7fce100c4010 2023-10-06T11:14:57.494 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:14:57.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdfc066f30 msgr2=0x7fcdfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdfc066f30 0x7fcdfc0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce00003bc0 tx=0x7fce00007ea0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 msgr2=0x7fce100c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 0x7fce100c49f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fce1006d090 tx=0x7fce0800b040 comp rx=0 tx=0).stop 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 shutdown_connections 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdfc066f30 0x7fcdfc0693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce100c4010 0x7fce100c49f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf8004810 0x7fce1013c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 --2- 172.21.15.55:0/667875412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce100c3ba0 0x7fce100c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.494+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 >> 172.21.15.55:0/667875412 conn(0x7fce100cc0a0 msgr2=0x7fce1013e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.495+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 shutdown_connections 2023-10-06T11:14:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.495+0000 7fce15d5c700 1 -- 172.21.15.55:0/667875412 wait complete. 2023-10-06T11:14:57.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.625+0000 7f8e9c2e0700 1 Processor -- start 2023-10-06T11:14:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.625+0000 7f8e9c2e0700 1 -- start start 2023-10-06T11:14:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9c2e0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e94159560 0x7f8e940aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9c2e0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940b0c60 con 0x7f8e940b49a0 2023-10-06T11:14:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9c2e0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940b0f40 con 0x7f8e940b0760 2023-10-06T11:14:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9c2e0700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e940b1220 con 0x7f8e94159560 2023-10-06T11:14:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9a07c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e94159560 0x7f8e940aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9987b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8e940b49a0 0x7f8e940aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46264/0 (socket says 172.21.15.55:46264) 2023-10-06T11:14:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9a07c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e94159560 0x7f8e940aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45058/0 (socket says 172.21.15.55:45058) 2023-10-06T11:14:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9987b700 1 -- 172.21.15.55:0/4019962689 learned_addr learned my addr 172.21.15.55:0/4019962689 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9a07c700 1 -- 172.21.15.55:0/4019962689 >> v1:172.21.15.142:6789/0 conn(0x7f8e940b0760 legacy=0x7f8e940b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.626+0000 7f8e9a07c700 1 -- 172.21.15.55:0/4019962689 >> v1:172.21.15.55:6789/0 conn(0x7f8e940b49a0 legacy=0x7f8e940aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9a07c700 1 -- 172.21.15.55:0/4019962689 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e940b1500 con 0x7f8e94159560 2023-10-06T11:14:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9a07c700 1 --2- 172.21.15.55:0/4019962689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e94159560 0x7f8e940aa530 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009ee0 tx=0x7f8e84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc30d7d4e4943764 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9907a700 1 -- 172.21.15.55:0/4019962689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400e070 con 0x7f8e94159560 2023-10-06T11:14:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9907a700 1 -- 172.21.15.55:0/4019962689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400bc10 con 0x7f8e94159560 2023-10-06T11:14:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9907a700 1 -- 172.21.15.55:0/4019962689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012430 con 0x7f8e94159560 2023-10-06T11:14:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/4019962689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e94159560 msgr2=0x7f8e940aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/4019962689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e94159560 0x7f8e940aa530 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009ee0 tx=0x7f8e84009780 comp rx=0 tx=0).stop 2023-10-06T11:14:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/4019962689 shutdown_connections 2023-10-06T11:14:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/4019962689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e94159560 0x7f8e940aa530 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/4019962689 >> 172.21.15.55:0/4019962689 conn(0x7f8e940997f0 msgr2=0x7f8e9406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/4019962689 shutdown_connections 2023-10-06T11:14:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.627+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/4019962689 wait complete. 2023-10-06T11:14:57.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.628+0000 7f8e9c2e0700 1 Processor -- start 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 -- start start 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 0x7f8e9416de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b49a0 0x7f8e940ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94159560 0x7f8e940ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9416a3a0 con 0x7f8e940b0760 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9416a680 con 0x7f8e94159560 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9c2e0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9416a960 con 0x7f8e940b49a0 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9a07c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 0x7f8e9416de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9a07c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 0x7f8e9416de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45074/0 (socket says 172.21.15.55:45074) 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9a07c700 1 -- 172.21.15.55:0/1169562330 learned_addr learned my addr 172.21.15.55:0/1169562330 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9987b700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b49a0 0x7f8e940ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.629+0000 7f8e9a87d700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94159560 0x7f8e940ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a07c700 1 -- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b49a0 msgr2=0x7f8e940ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a07c700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b49a0 0x7f8e940ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a07c700 1 -- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94159560 msgr2=0x7f8e940ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a07c700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94159560 0x7f8e940ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a07c700 1 -- 172.21.15.55:0/1169562330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84009a20 con 0x7f8e940b0760 2023-10-06T11:14:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a87d700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94159560 0x7f8e940ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9a07c700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 0x7f8e9416de90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8e94067c20 tx=0x7f8e84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8401d640 con 0x7f8e940b0760 2023-10-06T11:14:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8401d7a0 con 0x7f8e940b0760 2023-10-06T11:14:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8401db60 con 0x7f8e940b0760 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9416ac40 con 0x7f8e940b0760 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.630+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9409a280 con 0x7f8e940b0760 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.631+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9409c100 con 0x7f8e940b0760 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.631+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e84024070 con 0x7f8e940b0760 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.632+0000 7f8e927fc700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8e80066f00 0x7f8e800693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.632+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8e84087220 con 0x7f8e940b0760 2023-10-06T11:14:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.632+0000 7f8e9987b700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8e80066f00 0x7f8e800693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.633+0000 7f8e9987b700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8e80066f00 0x7f8e800693b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e940cf5d0 tx=0x7f8e88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.636+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e84054200 con 0x7f8e940b0760 2023-10-06T11:14:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.875+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e94064a90 con 0x7f8e940b0760 2023-10-06T11:14:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.876+0000 7f8e927fc700 1 -- 172.21.15.55:0/1169562330 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8e84057820 con 0x7f8e940b0760 2023-10-06T11:14:57.877 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:57.877 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:46.560821+0000","modified":"2023-10-06T11:14:50.181274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/173974006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":173974006},{"type":"v1","addr":"172.21.15.55:6835","nonce":173974006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:14:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8e80066f00 msgr2=0x7f8e800693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8e80066f00 0x7f8e800693b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e940cf5d0 tx=0x7f8e88009040 comp rx=0 tx=0).stop 2023-10-06T11:14:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 msgr2=0x7f8e9416de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 0x7f8e9416de90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8e94067c20 tx=0x7f8e84018000 comp rx=0 tx=0).stop 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 shutdown_connections 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8e80066f00 0x7f8e800693b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e940b0760 0x7f8e9416de90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e94159560 0x7f8e940ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 --2- 172.21.15.55:0/1169562330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e940b49a0 0x7f8e940ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 >> 172.21.15.55:0/1169562330 conn(0x7f8e940997f0 msgr2=0x7f8e94069840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 shutdown_connections 2023-10-06T11:14:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:57.878+0000 7f8e9c2e0700 1 -- 172.21.15.55:0/1169562330 wait complete. 2023-10-06T11:14:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2023-10-06T11:14:57.893 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:58.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.010+0000 7f6b564a9700 1 Processor -- start 2023-10-06T11:14:58.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.010+0000 7f6b564a9700 1 -- start start 2023-10-06T11:14:58.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b564a9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b50159560 0x7f6b500aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b564a9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b500b0c60 con 0x7f6b500b49a0 2023-10-06T11:14:58.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b564a9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b500b0f40 con 0x7f6b500b0760 2023-10-06T11:14:58.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b564a9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b500b1220 con 0x7f6b50159560 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b4ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b50159560 0x7f6b500aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b4f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b500b49a0 0x7f6b500aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46280/0 (socket says 172.21.15.55:46280) 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.011+0000 7f6b4f7fe700 1 -- 172.21.15.55:0/4074252683 learned_addr learned my addr 172.21.15.55:0/4074252683 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4ffff700 1 -- 172.21.15.55:0/4074252683 >> v1:172.21.15.142:6789/0 conn(0x7f6b500b0760 legacy=0x7f6b500b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4ffff700 1 -- 172.21.15.55:0/4074252683 >> v1:172.21.15.55:6789/0 conn(0x7f6b500b49a0 legacy=0x7f6b500aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4effd700 1 -- 172.21.15.55:0/4074252683 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248566425 0 0) 0x7f6b500b0c60 con 0x7f6b500b49a0 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4ffff700 1 -- 172.21.15.55:0/4074252683 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500b1500 con 0x7f6b50159560 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4ffff700 1 --2- 172.21.15.55:0/4074252683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b50159560 0x7f6b500aa530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b40009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e05cf098725b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4effd700 1 -- 172.21.15.55:0/4074252683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40009ea0 con 0x7f6b50159560 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4effd700 1 -- 172.21.15.55:0/4074252683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b40005c10 con 0x7f6b50159560 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b4effd700 1 -- 172.21.15.55:0/4074252683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000b610 con 0x7f6b50159560 2023-10-06T11:14:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b564a9700 1 -- 172.21.15.55:0/4074252683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b50159560 msgr2=0x7f6b500aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.012+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4074252683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b50159560 0x7f6b500aa530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b40009120 comp rx=0 tx=0).stop 2023-10-06T11:14:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.013+0000 7f6b564a9700 1 -- 172.21.15.55:0/4074252683 shutdown_connections 2023-10-06T11:14:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.013+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4074252683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b50159560 0x7f6b500aa530 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.013+0000 7f6b564a9700 1 -- 172.21.15.55:0/4074252683 >> 172.21.15.55:0/4074252683 conn(0x7f6b500997f0 msgr2=0x7f6b5006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.013+0000 7f6b564a9700 1 -- 172.21.15.55:0/4074252683 shutdown_connections 2023-10-06T11:14:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.013+0000 7f6b564a9700 1 -- 172.21.15.55:0/4074252683 wait complete. 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.014+0000 7f6b564a9700 1 Processor -- start 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.014+0000 7f6b564a9700 1 -- start start 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b500b0760 0x7f6b50147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 0x7f6b5015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b50159560 0x7f6b5015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5009ab00 con 0x7f6b500b49a0 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5009a1d0 con 0x7f6b50159560 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5009a4b0 con 0x7f6b500b0760 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 0x7f6b5015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 0x7f6b5015bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45088/0 (socket says 172.21.15.55:45088) 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 -- 172.21.15.55:0/4242091123 learned_addr learned my addr 172.21.15.55:0/4242091123 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b54a46700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b50159560 0x7f6b5015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4ffff700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b500b0760 0x7f6b50147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 -- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b500b0760 msgr2=0x7f6b50147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b500b0760 0x7f6b50147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 -- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b50159560 msgr2=0x7f6b5015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b50159560 0x7f6b5015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 -- 172.21.15.55:0/4242091123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400093c0 con 0x7f6b500b49a0 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4ffff700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b500b0760 0x7f6b50147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b4f7fe700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 0x7f6b5015bce0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c5b0 tx=0x7f6b38007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38005b30 con 0x7f6b500b49a0 2023-10-06T11:14:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b38005c90 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38007320 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5009a790 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.015+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b501476c0 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.016+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b50064a90 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.017+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b3801b3b0 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.017+0000 7f6b47fff700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6b30066f30 0x7f6b300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.017+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6b38083d90 con 0x7f6b500b49a0 2023-10-06T11:14:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.017+0000 7f6b4ffff700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6b30066f30 0x7f6b300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.018+0000 7f6b4ffff700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6b30066f30 0x7f6b300693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b40016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.021+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b38050d60 con 0x7f6b500b49a0 2023-10-06T11:14:58.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.215+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b500b17e0 con 0x7f6b500b49a0 2023-10-06T11:14:58.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.216+0000 7f6b47fff700 1 -- 172.21.15.55:0/4242091123 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f6b38017090 con 0x7f6b500b49a0 2023-10-06T11:14:58.217 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:58.218 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":55,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:48.027215+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:44.294407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:45.538885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.217+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6b30066f30 msgr2=0x7f6b300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6b30066f30 0x7f6b300693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b40016000 comp rx=0 tx=0).stop 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 msgr2=0x7f6b5015bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 0x7f6b5015bce0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c5b0 tx=0x7f6b38007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 shutdown_connections 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6b30066f30 0x7f6b300693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b50159560 0x7f6b5015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b500b0760 0x7f6b50147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 --2- 172.21.15.55:0/4242091123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b500b49a0 0x7f6b5015bce0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 >> 172.21.15.55:0/4242091123 conn(0x7f6b500997f0 msgr2=0x7f6b500683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 shutdown_connections 2023-10-06T11:14:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.218+0000 7f6b564a9700 1 -- 172.21.15.55:0/4242091123 wait complete. 2023-10-06T11:14:58.232 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:14:58.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.349+0000 7efd8d489700 1 Processor -- start 2023-10-06T11:14:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.349+0000 7efd8d489700 1 -- start start 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd8d489700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd880b29b0 0x7efd88159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd8d489700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd880b0da0 con 0x7efd880b25e0 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd8d489700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd880cbfa0 con 0x7efd88159660 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd8d489700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd880cb390 con 0x7efd880b29b0 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd86ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efd880b25e0 0x7efd880b0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46288/0 (socket says 172.21.15.55:46288) 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd86ffd700 1 -- 172.21.15.55:0/401814913 learned_addr learned my addr 172.21.15.55:0/401814913 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd867fc700 1 --2- 172.21.15.55:0/401814913 >> v2:172.21.15.142:3300/0 conn(0x7efd880b29b0 0x7efd88159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.350+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889139337 0 0) 0x7efd80001610 con 0x7efd880b25e0 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd74003570 con 0x7efd880b25e0 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257145501 0 0) 0x7efd880cbfa0 con 0x7efd88159660 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd80001610 con 0x7efd88159660 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116971638 0 0) 0x7efd74003570 con 0x7efd880b25e0 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 >> v2:172.21.15.142:3300/0 conn(0x7efd880b29b0 msgr2=0x7efd88159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 --2- 172.21.15.55:0/401814913 >> v2:172.21.15.142:3300/0 conn(0x7efd880b29b0 0x7efd88159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 >> v1:172.21.15.142:6789/0 conn(0x7efd88159660 legacy=0x7efd880cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880cb670 con 0x7efd880b25e0 2023-10-06T11:14:58.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7efd80001b00 con 0x7efd880b25e0 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 >> v1:172.21.15.55:6789/0 conn(0x7efd880b25e0 legacy=0x7efd880b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd74003bf0 0x7efd74003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd74004810 0x7efd74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd740051c0 0x7efd7400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880cb390 con 0x7efd74003bf0 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7400c0b0 con 0x7efd740051c0 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7400c270 con 0x7efd74004810 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd74003bf0 0x7efd74003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd867fc700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd74004810 0x7efd74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd877fe700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd740051c0 0x7efd7400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 -- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd74004810 msgr2=0x7efd74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd74004810 0x7efd74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 -- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd740051c0 msgr2=0x7efd7400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd740051c0 0x7efd7400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 -- 172.21.15.55:0/401814913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74003570 con 0x7efd74003bf0 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd877fe700 1 -- 172.21.15.55:0/401814913 reap_dead start 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.351+0000 7efd86ffd700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd74003bf0 0x7efd74003fe0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c750 tx=0x7efd80007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16338966ca35c533 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80005b70 con 0x7efd74003bf0 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd80005cf0 con 0x7efd74003bf0 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd85ffb700 1 -- 172.21.15.55:0/401814913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80007360 con 0x7efd74003bf0 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 -- 172.21.15.55:0/401814913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd74003bf0 msgr2=0x7efd74003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd74003bf0 0x7efd74003fe0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c750 tx=0x7efd80007db0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 -- 172.21.15.55:0/401814913 shutdown_connections 2023-10-06T11:14:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 --2- 172.21.15.55:0/401814913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd74003bf0 0x7efd74003fe0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 -- 172.21.15.55:0/401814913 >> 172.21.15.55:0/401814913 conn(0x7efd8806ece0 msgr2=0x7efd8806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 -- 172.21.15.55:0/401814913 shutdown_connections 2023-10-06T11:14:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.352+0000 7efd8d489700 1 -- 172.21.15.55:0/401814913 wait complete. 2023-10-06T11:14:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.353+0000 7efd8d489700 1 Processor -- start 2023-10-06T11:14:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.353+0000 7efd8d489700 1 -- start start 2023-10-06T11:14:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd8d489700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd74003bf0 0x7efd880c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd8d489700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 0x7efd880c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd8d489700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8816d090 0x7efd8816d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd8d489700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c88b0 con 0x7efd880c9950 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd8d489700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c8b90 con 0x7efd74003bf0 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd8d489700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c8e70 con 0x7efd8816d090 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd867fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 0x7efd880c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd867fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 0x7efd880c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45100/0 (socket says 172.21.15.55:45100) 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd867fc700 1 -- 172.21.15.55:0/340403135 learned_addr learned my addr 172.21.15.55:0/340403135 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd877fe700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8816d090 0x7efd8816d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd867fc700 1 -- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8816d090 msgr2=0x7efd8816d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd86ffd700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd74003bf0 0x7efd880c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd867fc700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8816d090 0x7efd8816d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.354+0000 7efd867fc700 1 -- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd74003bf0 msgr2=0x7efd880c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd867fc700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd74003bf0 0x7efd880c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd867fc700 1 -- 172.21.15.55:0/340403135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880c9150 con 0x7efd880c9950 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd867fc700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 0x7efd880c68f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efd70011990 tx=0x7efd70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000f6d0 con 0x7efd880c9950 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000f830 con 0x7efd880c9950 2023-10-06T11:14:58.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880c9430 con 0x7efd880c9950 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000fbf0 con 0x7efd880c9950 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.355+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd880c6ff0 con 0x7efd880c9950 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.356+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd88064a90 con 0x7efd880c9950 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.356+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd70015460 con 0x7efd880c9950 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.357+0000 7efd7effd700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.357+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efd70085020 con 0x7efd880c9950 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.357+0000 7efd86ffd700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.358+0000 7efd86ffd700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd68066f30 0x7efd680693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efd80001270 tx=0x7efd80015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.361+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd70055a80 con 0x7efd880c9950 2023-10-06T11:14:58.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.596+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd880cb950 con 0x7efd880c9950 2023-10-06T11:14:58.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.597+0000 7efd7effd700 1 -- 172.21.15.55:0/340403135 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4600 (secure 0 0 0) 0x7efd70055610 con 0x7efd880c9950 2023-10-06T11:14:58.598 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:58.598 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:46.560821+0000","modified":"2023-10-06T11:14:50.181274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/173974006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":173974006},{"type":"v1","addr":"172.21.15.55:6835","nonce":173974006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:14:58.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd68066f30 msgr2=0x7efd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd68066f30 0x7efd680693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efd80001270 tx=0x7efd80015000 comp rx=0 tx=0).stop 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 msgr2=0x7efd880c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 0x7efd880c68f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7efd70011990 tx=0x7efd70008040 comp rx=0 tx=0).stop 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 shutdown_connections 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd68066f30 0x7efd680693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8816d090 0x7efd8816d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd74003bf0 0x7efd880c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 --2- 172.21.15.55:0/340403135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd880c9950 0x7efd880c68f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 >> 172.21.15.55:0/340403135 conn(0x7efd8806ece0 msgr2=0x7efd880cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 shutdown_connections 2023-10-06T11:14:58.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.599+0000 7efd8d489700 1 -- 172.21.15.55:0/340403135 wait complete. 2023-10-06T11:14:58.602 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2023-10-06T11:14:58.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.729+0000 7efd2730d700 1 Processor -- start 2023-10-06T11:14:58.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.730+0000 7efd2730d700 1 -- start start 2023-10-06T11:14:58.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.730+0000 7efd2730d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 0x7efd20159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.730+0000 7efd2730d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd20068d10 con 0x7efd200cb5f0 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.730+0000 7efd2730d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2015a670 con 0x7efd200ca670 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.730+0000 7efd2730d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd20154020 con 0x7efd20159ad0 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.730+0000 7efd250a9700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efd200cb5f0 0x7efd200691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46290/0 (socket says 172.21.15.55:46290) 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd250a9700 1 -- 172.21.15.55:0/3082285514 learned_addr learned my addr 172.21.15.55:0/3082285514 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd248a8700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 0x7efd20159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247110821 0 0) 0x7efd20068d10 con 0x7efd200cb5f0 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd08003570 con 0x7efd200cb5f0 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704121255 0 0) 0x7efd08003570 con 0x7efd200cb5f0 2023-10-06T11:14:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 msgr2=0x7efd20159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 0x7efd20159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 >> v1:172.21.15.142:6789/0 conn(0x7efd200ca670 legacy=0x7efd200ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2015a950 con 0x7efd200cb5f0 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7efd100017f0 con 0x7efd200cb5f0 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 >> v1:172.21.15.55:6789/0 conn(0x7efd200cb5f0 legacy=0x7efd200691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08003a90 0x7efd08003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08004810 0x7efd08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 0x7efd080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20154020 con 0x7efd08003a90 2023-10-06T11:14:58.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0800bb40 con 0x7efd08004810 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0800bd00 con 0x7efd20159ad0 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd250a9700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08003a90 0x7efd08003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd248a8700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08004810 0x7efd08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.731+0000 7efd258aa700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 0x7efd080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd250a9700 1 -- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 msgr2=0x7efd080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd250a9700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20159ad0 0x7efd080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd250a9700 1 -- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08004810 msgr2=0x7efd08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd250a9700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08004810 0x7efd08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd250a9700 1 -- 172.21.15.55:0/3082285514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08003570 con 0x7efd08003a90 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd250a9700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08003a90 0x7efd08003e60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd1000a880 tx=0x7efd10002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25231f69b575f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100070f0 con 0x7efd08003a90 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd10007270 con 0x7efd08003a90 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd1ffff700 1 -- 172.21.15.55:0/3082285514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10007630 con 0x7efd08003a90 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd2730d700 1 -- 172.21.15.55:0/3082285514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08003a90 msgr2=0x7efd08003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd2730d700 1 --2- 172.21.15.55:0/3082285514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08003a90 0x7efd08003e60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd1000a880 tx=0x7efd10002120 comp rx=0 tx=0).stop 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd258aa700 1 -- 172.21.15.55:0/3082285514 reap_dead start 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd2730d700 1 -- 172.21.15.55:0/3082285514 shutdown_connections 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.732+0000 7efd2730d700 1 -- 172.21.15.55:0/3082285514 >> 172.21.15.55:0/3082285514 conn(0x7efd200707d0 msgr2=0x7efd20070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.733+0000 7efd2730d700 1 -- 172.21.15.55:0/3082285514 shutdown_connections 2023-10-06T11:14:58.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.733+0000 7efd2730d700 1 -- 172.21.15.55:0/3082285514 wait complete. 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 Processor -- start 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 -- start start 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08003a90 0x7efd2014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 0x7efd20155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20154f80 0x7efd20155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2016a820 con 0x7efd20154b10 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200b23f0 con 0x7efd08003a90 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.734+0000 7efd2730d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200b20f0 con 0x7efd20154f80 2023-10-06T11:14:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 0x7efd20155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 0x7efd20155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45118/0 (socket says 172.21.15.55:45118) 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 -- 172.21.15.55:0/3990477796 learned_addr learned my addr 172.21.15.55:0/3990477796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd250a9700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08003a90 0x7efd2014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd258aa700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20154f80 0x7efd20155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 -- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20154f80 msgr2=0x7efd20155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20154f80 0x7efd20155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 -- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08003a90 msgr2=0x7efd2014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08003a90 0x7efd2014ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 -- 172.21.15.55:0/3990477796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200c4a50 con 0x7efd20154b10 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd248a8700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 0x7efd20155a80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7efd14011d70 tx=0x7efd140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400fa10 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1400fb70 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200c4d30 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14014440 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.735+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200b3da0 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.736+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd200b2580 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.737+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd14014870 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.737+0000 7efd1d7fa700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd0c066f30 0x7efd0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.737+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efd14018030 con 0x7efd20154b10 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.738+0000 7efd250a9700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd0c066f30 0x7efd0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.738+0000 7efd250a9700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd0c066f30 0x7efd0c0693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efd2015a3b0 tx=0x7efd10016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.742+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd140520f0 con 0x7efd20154b10 2023-10-06T11:14:58.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.977+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd20064a90 con 0x7efd20154b10 2023-10-06T11:14:58.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.978+0000 7efd1d7fa700 1 -- 172.21.15.55:0/3990477796 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4600 (secure 0 0 0) 0x7efd14055710 con 0x7efd20154b10 2023-10-06T11:14:58.980 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:58.980 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:46.560821+0000","modified":"2023-10-06T11:14:50.181274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5490":{"gid":5490,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/173974006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":173974006},{"type":"v1","addr":"172.21.15.55:6835","nonce":173974006}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd0c066f30 msgr2=0x7efd0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd0c066f30 0x7efd0c0693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efd2015a3b0 tx=0x7efd10016000 comp rx=0 tx=0).stop 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 msgr2=0x7efd20155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 0x7efd20155a80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7efd14011d70 tx=0x7efd140091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 shutdown_connections 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efd0c066f30 0x7efd0c0693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd20154f80 0x7efd20155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd08003a90 0x7efd2014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 --2- 172.21.15.55:0/3990477796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20154b10 0x7efd20155a80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 >> 172.21.15.55:0/3990477796 conn(0x7efd200707d0 msgr2=0x7efd200ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 shutdown_connections 2023-10-06T11:14:58.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:58.980+0000 7efd2730d700 1 -- 172.21.15.55:0/3990477796 wait complete. 2023-10-06T11:14:58.983 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2023-10-06T11:14:58.994 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.112+0000 7fa325e84700 1 Processor -- start 2023-10-06T11:14:59.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.112+0000 7fa325e84700 1 -- start start 2023-10-06T11:14:59.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa325e84700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3200cc8e0 0x7fa32006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa325e84700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa32006c160 0x7fa3200c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa325e84700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32006c9a0 con 0x7fa320156350 2023-10-06T11:14:59.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa325e84700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa320156b20 con 0x7fa3200cc8e0 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa325e84700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320156e00 con 0x7fa32006c160 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3200cc8e0 0x7fa32006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa320156350 0x7fa3200cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46294/0 (socket says 172.21.15.55:46294) 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31f7fe700 1 -- 172.21.15.55:0/1577376837 learned_addr learned my addr 172.21.15.55:0/1577376837 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31ffff700 1 --2- 172.21.15.55:0/1577376837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa32006c160 0x7fa3200c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31effd700 1 -- 172.21.15.55:0/1577376837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa32006c160 msgr2=0x7fa3200c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31effd700 1 --2- 172.21.15.55:0/1577376837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa32006c160 0x7fa3200c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31effd700 1 -- 172.21.15.55:0/1577376837 >> v1:172.21.15.55:6789/0 conn(0x7fa320156350 legacy=0x7fa3200cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31effd700 1 -- 172.21.15.55:0/1577376837 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3201570e0 con 0x7fa3200cc8e0 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.113+0000 7fa31e7fc700 1 -- 172.21.15.55:0/1577376837 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903497314 0 0) 0x7fa32006c9a0 con 0x7fa320156350 2023-10-06T11:14:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa31effd700 1 --2- 172.21.15.55:0/1577376837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3200cc8e0 0x7fa32006bc20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa3140098e0 tx=0x7fa3140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b323bb0c910e3c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa31e7fc700 1 -- 172.21.15.55:0/1577376837 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314009e80 con 0x7fa3200cc8e0 2023-10-06T11:14:59.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa31e7fc700 1 -- 172.21.15.55:0/1577376837 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31400b860 con 0x7fa3200cc8e0 2023-10-06T11:14:59.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa31e7fc700 1 -- 172.21.15.55:0/1577376837 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400bbe0 con 0x7fa3200cc8e0 2023-10-06T11:14:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 -- 172.21.15.55:0/1577376837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3200cc8e0 msgr2=0x7fa32006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 --2- 172.21.15.55:0/1577376837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3200cc8e0 0x7fa32006bc20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa3140098e0 tx=0x7fa3140091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 -- 172.21.15.55:0/1577376837 shutdown_connections 2023-10-06T11:14:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 --2- 172.21.15.55:0/1577376837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa32006c160 0x7fa3200c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 --2- 172.21.15.55:0/1577376837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3200cc8e0 0x7fa32006bc20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 -- 172.21.15.55:0/1577376837 >> 172.21.15.55:0/1577376837 conn(0x7fa3200cdeb0 msgr2=0x7fa3200c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 -- 172.21.15.55:0/1577376837 shutdown_connections 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.114+0000 7fa325e84700 1 -- 172.21.15.55:0/1577376837 wait complete. 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 Processor -- start 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 -- start start 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa32006c160 0x7fa32014a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3200cc8e0 0x7fa3200a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 0x7fa32016d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32016dd70 con 0x7fa320156350 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200b0a00 con 0x7fa32006c160 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa325e84700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200b0ce0 con 0x7fa3200cc8e0 2023-10-06T11:14:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.116+0000 7fa31ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 0x7fa32016d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 0x7fa32016d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45136/0 (socket says 172.21.15.55:45136) 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 -- 172.21.15.55:0/3935712324 learned_addr learned my addr 172.21.15.55:0/3935712324 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31f7fe700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa32006c160 0x7fa32014a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31effd700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3200cc8e0 0x7fa3200a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 -- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3200cc8e0 msgr2=0x7fa3200a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3200cc8e0 0x7fa3200a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 -- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa32006c160 msgr2=0x7fa32014a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa32006c160 0x7fa32014a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 -- 172.21.15.55:0/3935712324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314009420 con 0x7fa320156350 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa31ffff700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 0x7fa32016d830 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa318009fa0 tx=0x7fa318009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800ebc0 con 0x7fa320156350 2023-10-06T11:14:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800ed20 con 0x7fa320156350 2023-10-06T11:14:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318014670 con 0x7fa320156350 2023-10-06T11:14:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200b0fc0 con 0x7fa320156350 2023-10-06T11:14:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.117+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa320168f00 con 0x7fa320156350 2023-10-06T11:14:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.118+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3200b14e0 con 0x7fa320156350 2023-10-06T11:14:59.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.119+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3180149e0 con 0x7fa320156350 2023-10-06T11:14:59.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.119+0000 7fa3077fe700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa30c066f30 0x7fa30c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.119+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa318084e70 con 0x7fa320156350 2023-10-06T11:14:59.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.119+0000 7fa31f7fe700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa30c066f30 0x7fa30c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.120+0000 7fa31f7fe700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa30c066f30 0x7fa30c0693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa310007160 tx=0x7fa310007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.123+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3200b14e0 con 0x7fa320156350 2023-10-06T11:14:59.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.318+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3200b14e0 con 0x7fa320156350 2023-10-06T11:14:59.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.319+0000 7fa3077fe700 1 -- 172.21.15.55:0/3935712324 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fa3200b14e0 con 0x7fa320156350 2023-10-06T11:14:59.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:14:59.321 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":55,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:14:48.027215+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:44.294407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:45.538885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa30c066f30 msgr2=0x7fa30c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa30c066f30 0x7fa30c0693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa310007160 tx=0x7fa310007f50 comp rx=0 tx=0).stop 2023-10-06T11:14:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 msgr2=0x7fa32016d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 0x7fa32016d830 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa318009fa0 tx=0x7fa318009900 comp rx=0 tx=0).stop 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 shutdown_connections 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa30c066f30 0x7fa30c0693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa320156350 0x7fa32016d830 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa32006c160 0x7fa32014a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 --2- 172.21.15.55:0/3935712324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3200cc8e0 0x7fa3200a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 >> 172.21.15.55:0/3935712324 conn(0x7fa3200cdeb0 msgr2=0x7fa3200cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.321+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 shutdown_connections 2023-10-06T11:14:59.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.322+0000 7fa325e84700 1 -- 172.21.15.55:0/3935712324 wait complete. 2023-10-06T11:14:59.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:14:59.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 Processor -- start 2023-10-06T11:14:59.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 -- start start 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faed00adb60 0x7faed00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faed00ce6d0 0x7faed015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed0157de0 con 0x7faed00ca370 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00cbb90 con 0x7faed00adb60 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.454+0000 7faed6e50700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00ceb10 con 0x7faed00ce6d0 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faed00adb60 0x7faed00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faed00adb60 0x7faed00ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45148/0 (socket says 172.21.15.55:45148) 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 -- 172.21.15.55:0/710830993 learned_addr learned my addr 172.21.15.55:0/710830993 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faed53ed700 1 --2- 172.21.15.55:0/710830993 >> v2:172.21.15.142:3300/0 conn(0x7faed00ce6d0 0x7faed015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 -- 172.21.15.55:0/710830993 >> v2:172.21.15.142:3300/0 conn(0x7faed00ce6d0 msgr2=0x7faed015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 --2- 172.21.15.55:0/710830993 >> v2:172.21.15.142:3300/0 conn(0x7faed00ce6d0 0x7faed015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 -- 172.21.15.55:0/710830993 >> v1:172.21.15.142:6789/0 conn(0x7faed00ca370 legacy=0x7faed0158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 -- 172.21.15.55:0/710830993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00cb5d0 con 0x7faed00adb60 2023-10-06T11:14:59.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecffff700 1 --2- 172.21.15.55:0/710830993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00adb60 0x7faed00ce190 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faed01554c0 tx=0x7faec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb7eae9a862c98d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecf7fe700 1 -- 172.21.15.55:0/710830993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4009e70 con 0x7faed00adb60 2023-10-06T11:14:59.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecf7fe700 1 -- 172.21.15.55:0/710830993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400b860 con 0x7faed00adb60 2023-10-06T11:14:59.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.455+0000 7faecf7fe700 1 -- 172.21.15.55:0/710830993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400bc00 con 0x7faed00adb60 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 -- 172.21.15.55:0/710830993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00adb60 msgr2=0x7faed00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 --2- 172.21.15.55:0/710830993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00adb60 0x7faed00ce190 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faed01554c0 tx=0x7faec4009250 comp rx=0 tx=0).stop 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 -- 172.21.15.55:0/710830993 shutdown_connections 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 --2- 172.21.15.55:0/710830993 >> v2:172.21.15.142:3300/0 conn(0x7faed00ce6d0 0x7faed015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 --2- 172.21.15.55:0/710830993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00adb60 0x7faed00ce190 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 -- 172.21.15.55:0/710830993 >> 172.21.15.55:0/710830993 conn(0x7faed00707d0 msgr2=0x7faed0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 -- 172.21.15.55:0/710830993 shutdown_connections 2023-10-06T11:14:59.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.456+0000 7faed6e50700 1 -- 172.21.15.55:0/710830993 wait complete. 2023-10-06T11:14:59.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.457+0000 7faed6e50700 1 Processor -- start 2023-10-06T11:14:59.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.457+0000 7faed6e50700 1 -- start start 2023-10-06T11:14:59.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed6e50700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed00adb60 0x7faed016b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed6e50700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed00ca370 0x7faed00c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed6e50700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 0x7faed014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed6e50700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c3e30 con 0x7faed00ce6d0 2023-10-06T11:14:59.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed6e50700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c40b0 con 0x7faed00adb60 2023-10-06T11:14:59.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed6e50700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c4390 con 0x7faed00ca370 2023-10-06T11:14:59.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 0x7faed014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 0x7faed014a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45150/0 (socket says 172.21.15.55:45150) 2023-10-06T11:14:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 -- 172.21.15.55:0/2486572562 learned_addr learned my addr 172.21.15.55:0/2486572562 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed4bec700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed00adb60 0x7faed016b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faecffff700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed00ca370 0x7faed00c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 -- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed00ca370 msgr2=0x7faed00c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed00ca370 0x7faed00c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 -- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed00adb60 msgr2=0x7faed016b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed00adb60 0x7faed016b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faed53ed700 1 -- 172.21.15.55:0/2486572562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec40094f0 con 0x7faed00ce6d0 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.458+0000 7faecffff700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed00ca370 0x7faed00c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.459+0000 7faed53ed700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 0x7faed014a7a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faec8009e90 tx=0x7faec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.459+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800cb50 con 0x7faed00ce6d0 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.459+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800f040 con 0x7faed00ce6d0 2023-10-06T11:14:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.459+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8014480 con 0x7faed00ce6d0 2023-10-06T11:14:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.459+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed00b1200 con 0x7faed00ce6d0 2023-10-06T11:14:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.459+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed014ace0 con 0x7faed00ce6d0 2023-10-06T11:14:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.460+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0064a90 con 0x7faed00ce6d0 2023-10-06T11:14:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.460+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faec8014830 con 0x7faed00ce6d0 2023-10-06T11:14:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.461+0000 7faeccff9700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faebc066f30 0x7faebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.461+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faec8085200 con 0x7faed00ce6d0 2023-10-06T11:14:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.461+0000 7faed4bec700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faebc066f30 0x7faebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.461+0000 7faed4bec700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faebc066f30 0x7faebc0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faec00039e0 tx=0x7faec0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.465+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faec80521d0 con 0x7faed00ce6d0 2023-10-06T11:14:59.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.701+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faed00cb8b0 con 0x7faed00ce6d0 2023-10-06T11:14:59.703 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:14:59.702+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:14:59.709 INFO:tasks.ceph.mds.a.smithi055.stderr: -558> 2023-10-06T11:14:51.473+0000 7f501fa90700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:14:59.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.708+0000 7faeccff9700 1 -- 172.21.15.55:0/2486572562 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7faec80557f0 con 0x7faed00ce6d0 2023-10-06T11:14:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faebc066f30 msgr2=0x7faebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faebc066f30 0x7faebc0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faec00039e0 tx=0x7faec0007ec0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 msgr2=0x7faed014a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 0x7faed014a7a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faec8009e90 tx=0x7faec800b040 comp rx=0 tx=0).stop 2023-10-06T11:14:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 shutdown_connections 2023-10-06T11:14:59.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faebc066f30 0x7faebc0693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed00ce6d0 0x7faed014a7a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faed00adb60 0x7faed016b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 --2- 172.21.15.55:0/2486572562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faed00ca370 0x7faed00c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 >> 172.21.15.55:0/2486572562 conn(0x7faed00707d0 msgr2=0x7faed00cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 shutdown_connections 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.710+0000 7faed6e50700 1 -- 172.21.15.55:0/2486572562 wait complete. 2023-10-06T11:14:59.713 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:14:59.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:14:59.730 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:14:59.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.844+0000 7f84c0b02700 1 Processor -- start 2023-10-06T11:14:59.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.844+0000 7f84c0b02700 1 -- start start 2023-10-06T11:14:59.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84c0b02700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84bc150940 0x7f84bc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84c0b02700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f84bc15a160 0x7f84bc0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84c0b02700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc15ac30 con 0x7f84bc0c5250 2023-10-06T11:14:59.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84c0b02700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0cb6a0 con 0x7f84bc150940 2023-10-06T11:14:59.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84c0b02700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0cb090 con 0x7f84bc15a160 2023-10-06T11:14:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84ba59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84bc150940 0x7f84bc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84bad9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84bc0c5250 0x7f84bc0b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46312/0 (socket says 172.21.15.55:46312) 2023-10-06T11:14:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.845+0000 7f84bad9d700 1 -- 172.21.15.55:0/830672003 learned_addr learned my addr 172.21.15.55:0/830672003 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:14:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84b9d9b700 1 --2- 172.21.15.55:0/830672003 >> v2:172.21.15.142:3300/0 conn(0x7f84bc15a160 0x7f84bc0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84ba59c700 1 -- 172.21.15.55:0/830672003 >> v2:172.21.15.142:3300/0 conn(0x7f84bc15a160 msgr2=0x7f84bc0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84ba59c700 1 --2- 172.21.15.55:0/830672003 >> v2:172.21.15.142:3300/0 conn(0x7f84bc15a160 0x7f84bc0ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84ba59c700 1 -- 172.21.15.55:0/830672003 >> v1:172.21.15.55:6789/0 conn(0x7f84bc0c5250 legacy=0x7f84bc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84b959a700 1 -- 172.21.15.55:0/830672003 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683657923 0 0) 0x7f84b4001490 con 0x7f84bc0c5250 2023-10-06T11:14:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84ba59c700 1 -- 172.21.15.55:0/830672003 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc15a670 con 0x7f84bc150940 2023-10-06T11:14:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84b9d9b700 1 --2- 172.21.15.55:0/830672003 >> v2:172.21.15.142:3300/0 conn(0x7f84bc15a160 0x7f84bc0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84ba59c700 1 --2- 172.21.15.55:0/830672003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc150940 0x7f84bc159c20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84bc089650 tx=0x7f84ac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac08a09c24b61fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84b959a700 1 -- 172.21.15.55:0/830672003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005c10 con 0x7f84bc150940 2023-10-06T11:14:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84b959a700 1 -- 172.21.15.55:0/830672003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac005d70 con 0x7f84bc150940 2023-10-06T11:14:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84b959a700 1 -- 172.21.15.55:0/830672003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac006260 con 0x7f84bc150940 2023-10-06T11:14:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84c0b02700 1 -- 172.21.15.55:0/830672003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc150940 msgr2=0x7f84bc159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.846+0000 7f84c0b02700 1 --2- 172.21.15.55:0/830672003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc150940 0x7f84bc159c20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84bc089650 tx=0x7f84ac009120 comp rx=0 tx=0).stop 2023-10-06T11:14:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.847+0000 7f84c0b02700 1 -- 172.21.15.55:0/830672003 shutdown_connections 2023-10-06T11:14:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.847+0000 7f84c0b02700 1 --2- 172.21.15.55:0/830672003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc150940 0x7f84bc159c20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.847+0000 7f84c0b02700 1 --2- 172.21.15.55:0/830672003 >> v2:172.21.15.142:3300/0 conn(0x7f84bc15a160 0x7f84bc0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.847+0000 7f84c0b02700 1 -- 172.21.15.55:0/830672003 >> 172.21.15.55:0/830672003 conn(0x7f84bc099700 msgr2=0x7f84bc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.847+0000 7f84c0b02700 1 -- 172.21.15.55:0/830672003 shutdown_connections 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.847+0000 7f84c0b02700 1 -- 172.21.15.55:0/830672003 wait complete. 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.848+0000 7f84c0b02700 1 Processor -- start 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.848+0000 7f84c0b02700 1 -- start start 2023-10-06T11:14:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.848+0000 7f84c0b02700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84bc0c5250 0x7f84bc14ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.848+0000 7f84c0b02700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84bc15a160 0x7f84bc0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.848+0000 7f84c0b02700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 0x7f84bc0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84c0b02700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c9c00 con 0x7f84bc0c9220 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84c0b02700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b4260 con 0x7f84bc15a160 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84c0b02700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc150500 con 0x7f84bc0c5250 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 0x7f84bc0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 0x7f84bc0c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45200/0 (socket says 172.21.15.55:45200) 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 -- 172.21.15.55:0/1379413413 learned_addr learned my addr 172.21.15.55:0/1379413413 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:14:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84b9d9b700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84bc15a160 0x7f84bc0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84ba59c700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84bc0c5250 0x7f84bc14ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 -- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84bc0c5250 msgr2=0x7f84bc14ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84bc0c5250 0x7f84bc14ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 -- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84bc15a160 msgr2=0x7f84bc0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84bc15a160 0x7f84bc0b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 -- 172.21.15.55:0/1379413413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0093c0 con 0x7f84bc0c9220 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84bad9d700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 0x7f84bc0c96c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f84b400cc90 tx=0x7f84b4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400cea0 con 0x7f84bc0c9220 2023-10-06T11:14:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b4004bb0 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0b5370 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400ab70 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.849+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0b3930 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.850+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc15d450 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.851+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84b40070f0 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.851+0000 7f84aa7fc700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.851+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f84b40845a0 con 0x7f84bc0c9220 2023-10-06T11:14:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.851+0000 7f84ba59c700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.852+0000 7f84ba59c700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009160 tx=0x7f84ac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:14:59.855+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b40515a0 con 0x7f84bc0c9220 2023-10-06T11:15:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.090+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84bc15ac30 con 0x7f84bc0c9220 2023-10-06T11:15:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.706+0000 7f84aa7fc700 1 -- 172.21.15.55:0/1379413413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84bc15ac30 con 0x7f84bc0c9220 2023-10-06T11:15:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f849c066f30 msgr2=0x7f849c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009160 tx=0x7f84ac016000 comp rx=0 tx=0).stop 2023-10-06T11:15:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 msgr2=0x7f84bc0c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 0x7f84bc0c96c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f84b400cc90 tx=0x7f84b4001a50 comp rx=0 tx=0).stop 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 shutdown_connections 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84bc0c9220 0x7f84bc0c96c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84bc0c5250 0x7f84bc14ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.708+0000 7f84c0b02700 1 --2- 172.21.15.55:0/1379413413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84bc15a160 0x7f84bc0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.709+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 >> 172.21.15.55:0/1379413413 conn(0x7f84bc099700 msgr2=0x7f84bc0cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.709+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 shutdown_connections 2023-10-06T11:15:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.709+0000 7f84c0b02700 1 -- 172.21.15.55:0/1379413413 wait complete. 2023-10-06T11:15:00.726 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:15:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.894+0000 7ff449893700 1 Processor -- start 2023-10-06T11:15:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.894+0000 7ff449893700 1 -- start start 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff449893700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4440c32e0 0x7ff4440cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff449893700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff449893700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4440c8eb0 con 0x7ff44415d560 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff449893700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4440c47e0 con 0x7ff4440c32e0 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff449893700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440c4020 con 0x7ff4440c36b0 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff4427fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff442ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4440c32e0 0x7ff4440cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff4437fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff44415d560 0x7ff44415d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:33092/0 (socket says 172.21.15.55:33092) 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff4437fe700 1 -- 172.21.15.55:0/1017939981 learned_addr learned my addr 172.21.15.55:0/1017939981 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff442ffd700 1 -- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 msgr2=0x7ff4440c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff442ffd700 1 --2- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff442ffd700 1 -- 172.21.15.55:0/1017939981 >> v1:172.21.15.142:6789/0 conn(0x7ff44415d560 legacy=0x7ff44415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff442ffd700 1 -- 172.21.15.55:0/1017939981 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440cf230 con 0x7ff4440c32e0 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff441ffb700 1 -- 172.21.15.55:0/1017939981 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202119139 0 0) 0x7ff4440c8eb0 con 0x7ff44415d560 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff4427fc700 1 --2- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.895+0000 7ff442ffd700 1 --2- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4440c32e0 0x7ff4440cecf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff4340098d0 tx=0x7ff434009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37cdd30274c420 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff441ffb700 1 -- 172.21.15.55:0/1017939981 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434005c10 con 0x7ff4440c32e0 2023-10-06T11:15:00.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff441ffb700 1 -- 172.21.15.55:0/1017939981 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434005d70 con 0x7ff4440c32e0 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff441ffb700 1 -- 172.21.15.55:0/1017939981 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434006280 con 0x7ff4440c32e0 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 -- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4440c32e0 msgr2=0x7ff4440cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 --2- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4440c32e0 0x7ff4440cecf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff4340098d0 tx=0x7ff434009120 comp rx=0 tx=0).stop 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 -- 172.21.15.55:0/1017939981 shutdown_connections 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 --2- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4440c32e0 0x7ff4440cecf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 --2- 172.21.15.55:0/1017939981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 -- 172.21.15.55:0/1017939981 >> 172.21.15.55:0/1017939981 conn(0x7ff444087fc0 msgr2=0x7ff4440ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 -- 172.21.15.55:0/1017939981 shutdown_connections 2023-10-06T11:15:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.896+0000 7ff449893700 1 -- 172.21.15.55:0/1017939981 wait complete. 2023-10-06T11:15:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.897+0000 7ff449893700 1 Processor -- start 2023-10-06T11:15:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 -- start start 2023-10-06T11:15:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 0x7ff4441534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44415d560 0x7ff44415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44415f1b0 con 0x7ff4440c32e0 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444160010 con 0x7ff44415d560 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff449893700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440cec10 con 0x7ff4440c36b0 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff442ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 0x7ff4441534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff442ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 0x7ff4441534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45204/0 (socket says 172.21.15.55:45204) 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.898+0000 7ff442ffd700 1 -- 172.21.15.55:0/1112961551 learned_addr learned my addr 172.21.15.55:0/1112961551 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff4427fc700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff4437fe700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44415d560 0x7ff44415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff442ffd700 1 -- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 msgr2=0x7ff4440ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff442ffd700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff442ffd700 1 -- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44415d560 msgr2=0x7ff44415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff442ffd700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44415d560 0x7ff44415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff442ffd700 1 -- 172.21.15.55:0/1112961551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009420 con 0x7ff4440c32e0 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff4437fe700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44415d560 0x7ff44415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff442ffd700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 0x7ff4441534c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff434009f70 tx=0x7ff434016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43400b8a0 con 0x7ff4440c32e0 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43400ba00 con 0x7ff4440c32e0 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4340093c0 con 0x7ff4440c32e0 2023-10-06T11:15:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43400bda0 con 0x7ff4440c32e0 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.899+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44415f6e0 con 0x7ff4440c32e0 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.900+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff444064a90 con 0x7ff4440c32e0 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.901+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff43401a630 con 0x7ff4440c32e0 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.901+0000 7ff42affd700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff430066f30 0x7ff4300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.901+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff434085eb0 con 0x7ff4440c32e0 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.901+0000 7ff4427fc700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff430066f30 0x7ff4300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.902+0000 7ff4427fc700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff430066f30 0x7ff4300693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff44416caa0 tx=0x7ff4380091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:00.905+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff434052e30 con 0x7ff4440c32e0 2023-10-06T11:15:01.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.099+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff44404bb40 con 0x7ff4440c32e0 2023-10-06T11:15:01.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.713+0000 7ff42affd700 1 -- 172.21.15.55:0/1112961551 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff43402b0d0 con 0x7ff4440c32e0 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff430066f30 msgr2=0x7ff4300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff430066f30 0x7ff4300693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff44416caa0 tx=0x7ff4380091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 msgr2=0x7ff4441534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 0x7ff4441534c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff434009f70 tx=0x7ff434016000 comp rx=0 tx=0).stop 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 shutdown_connections 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff430066f30 0x7ff4300693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4440c32e0 0x7ff4441534c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff44415d560 0x7ff44415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 --2- 172.21.15.55:0/1112961551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4440c36b0 0x7ff4440ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 >> 172.21.15.55:0/1112961551 conn(0x7ff444087fc0 msgr2=0x7ff4440ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:01.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 shutdown_connections 2023-10-06T11:15:01.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.717+0000 7ff449893700 1 -- 172.21.15.55:0/1112961551 wait complete. 2023-10-06T11:15:01.721 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:15:01.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:15:01.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.866+0000 7f4826262700 1 Processor -- start 2023-10-06T11:15:01.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.866+0000 7f4826262700 1 -- start start 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f4826262700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4820153950 0x7f482015c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f4826262700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f48201577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f4826262700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482015c400 con 0x7f4820157ce0 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f4826262700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820158200 con 0x7f4820153950 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f4826262700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482015b7f0 con 0x7f4820153d20 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f481f7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4820153950 0x7f482015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f481ffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4820157ce0 0x7f482015ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46324/0 (socket says 172.21.15.55:46324) 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f481ffff700 1 -- 172.21.15.55:0/3666979696 learned_addr learned my addr 172.21.15.55:0/3666979696 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f481effd700 1 --2- 172.21.15.55:0/3666979696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f48201577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f481f7fe700 1 -- 172.21.15.55:0/3666979696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 msgr2=0x7f48201577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.867+0000 7f481f7fe700 1 --2- 172.21.15.55:0/3666979696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f48201577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481f7fe700 1 -- 172.21.15.55:0/3666979696 >> v1:172.21.15.55:6789/0 conn(0x7f4820157ce0 legacy=0x7f482015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481f7fe700 1 -- 172.21.15.55:0/3666979696 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482015bad0 con 0x7f4820153950 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481e7fc700 1 -- 172.21.15.55:0/3666979696 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829672355 0 0) 0x7f482015c400 con 0x7f4820157ce0 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481f7fe700 1 --2- 172.21.15.55:0/3666979696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820153950 0x7f482015c890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f48100098d0 tx=0x7f4810009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f34e3ec75fe2c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481e7fc700 1 -- 172.21.15.55:0/3666979696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810009e70 con 0x7f4820153950 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481e7fc700 1 -- 172.21.15.55:0/3666979696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810005c10 con 0x7f4820153950 2023-10-06T11:15:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f481e7fc700 1 -- 172.21.15.55:0/3666979696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000b650 con 0x7f4820153950 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 -- 172.21.15.55:0/3666979696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820153950 msgr2=0x7f482015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 --2- 172.21.15.55:0/3666979696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820153950 0x7f482015c890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f48100098d0 tx=0x7f4810009120 comp rx=0 tx=0).stop 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 -- 172.21.15.55:0/3666979696 shutdown_connections 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 --2- 172.21.15.55:0/3666979696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820153950 0x7f482015c890 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 --2- 172.21.15.55:0/3666979696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f48201577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 -- 172.21.15.55:0/3666979696 >> 172.21.15.55:0/3666979696 conn(0x7f482006ece0 msgr2=0x7f482006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 -- 172.21.15.55:0/3666979696 shutdown_connections 2023-10-06T11:15:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.868+0000 7f4826262700 1 -- 172.21.15.55:0/3666979696 wait complete. 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.870+0000 7f4826262700 1 Processor -- start 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.870+0000 7f4826262700 1 -- start start 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.870+0000 7f4826262700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820153950 0x7f482016db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f4820151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 0x7f48200d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482016e080 con 0x7f4820157ce0 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200d05c0 con 0x7f4820153950 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4820151c40 con 0x7f4820153d20 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 0x7f48200d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 0x7f48200d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45226/0 (socket says 172.21.15.55:45226) 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 -- 172.21.15.55:0/2887603502 learned_addr learned my addr 172.21.15.55:0/2887603502 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481effd700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f4820151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481f7fe700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820153950 0x7f482016db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 -- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 msgr2=0x7f4820151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f4820151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 -- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820153950 msgr2=0x7f482016db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820153950 0x7f482016db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 -- 172.21.15.55:0/2887603502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100093c0 con 0x7f4820157ce0 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481effd700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f4820151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f481ffff700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 0x7f48200d0a50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f481800ccc0 tx=0x7f4818001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481800ab30 con 0x7f4820157ce0 2023-10-06T11:15:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481800ac90 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48200cf9b0 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818007340 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.871+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48200cff70 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.872+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820064a90 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.873+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4818007730 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.873+0000 7f48077fe700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f480c066f30 0x7f480c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.873+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6026+0+0 (secure 0 0 0) 0x7f4818084a80 con 0x7f4820157ce0 2023-10-06T11:15:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.873+0000 7f481f7fe700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f480c066f30 0x7f480c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.874+0000 7f481f7fe700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f480c066f30 0x7f480c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4810009160 tx=0x7f4810016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:01.877+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4818051c30 con 0x7f4820157ce0 2023-10-06T11:15:02.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:02.070+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f482015bdb0 con 0x7f4820157ce0 2023-10-06T11:15:03.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.035+0000 7f48077fe700 1 -- 172.21.15.55:0/2887603502 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4818055250 con 0x7f4820157ce0 2023-10-06T11:15:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f480c066f30 msgr2=0x7f480c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f480c066f30 0x7f480c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4810009160 tx=0x7f4810016000 comp rx=0 tx=0).stop 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 msgr2=0x7f48200d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 0x7f48200d0a50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f481800ccc0 tx=0x7f4818001a80 comp rx=0 tx=0).stop 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 shutdown_connections 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f480c066f30 0x7f480c0693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4820157ce0 0x7f48200d0a50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820153950 0x7f482016db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 --2- 172.21.15.55:0/2887603502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4820153d20 0x7f4820151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 >> 172.21.15.55:0/2887603502 conn(0x7f482006ece0 msgr2=0x7f482015ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 shutdown_connections 2023-10-06T11:15:03.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.039+0000 7f4826262700 1 -- 172.21.15.55:0/2887603502 wait complete. 2023-10-06T11:15:03.043 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:15:03.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:15:03.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.183+0000 7f8f628dd700 1 Processor -- start 2023-10-06T11:15:03.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.183+0000 7f8f628dd700 1 -- start start 2023-10-06T11:15:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f628dd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8f5c13c430 0x7f8f5c0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f628dd700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c0ca5b0 con 0x7f8f5c15a250 2023-10-06T11:15:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f628dd700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c15a8e0 con 0x7f8f5c0cae90 2023-10-06T11:15:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f628dd700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0cb330 con 0x7f8f5c13c430 2023-10-06T11:15:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f620dc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f5c15a250 0x7f8f5c0c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46332/0 (socket says 172.21.15.55:46332) 2023-10-06T11:15:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f620dc700 1 -- 172.21.15.55:0/3695875632 learned_addr learned my addr 172.21.15.55:0/3695875632 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f618db700 1 --2- 172.21.15.55:0/3695875632 >> v2:172.21.15.142:3300/0 conn(0x7f8f5c13c430 0x7f8f5c0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087334387 0 0) 0x7f8f5c0ca5b0 con 0x7f8f5c15a250 2023-10-06T11:15:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.184+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f44003570 con 0x7f8f5c15a250 2023-10-06T11:15:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 883602613 0 0) 0x7f8f44003570 con 0x7f8f5c15a250 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 >> v2:172.21.15.142:3300/0 conn(0x7f8f5c13c430 msgr2=0x7f8f5c0ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 --2- 172.21.15.55:0/3695875632 >> v2:172.21.15.142:3300/0 conn(0x7f8f5c13c430 0x7f8f5c0ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 >> v1:172.21.15.142:6789/0 conn(0x7f8f5c0cae90 legacy=0x7f8f5c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c06d500 con 0x7f8f5c15a250 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f8f54001470 con 0x7f8f5c15a250 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 >> v1:172.21.15.55:6789/0 conn(0x7f8f5c15a250 legacy=0x7f8f5c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44003a60 0x7f8f44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f44004810 0x7f8f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440051c0 0x7f8f4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0cb330 con 0x7f8f44004810 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4400c160 con 0x7f8f44003a60 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4400c320 con 0x7f8f440051c0 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f44004810 0x7f8f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f618db700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44003a60 0x7f8f44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f620dc700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440051c0 0x7f8f4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 -- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440051c0 msgr2=0x7f8f4400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f440051c0 0x7f8f4400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 -- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44003a60 msgr2=0x7f8f44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f44003a60 0x7f8f44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 -- 172.21.15.55:0/3695875632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44003570 con 0x7f8f44004810 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f620dc700 1 -- 172.21.15.55:0/3695875632 reap_dead start 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f610da700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f44004810 0x7f8f44004c80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8f500018b0 tx=0x7f8f50007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f381f15be2e30d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50012420 con 0x7f8f44004810 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f500125a0 con 0x7f8f44004810 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.185+0000 7f8f608d9700 1 -- 172.21.15.55:0/3695875632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50012960 con 0x7f8f44004810 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 -- 172.21.15.55:0/3695875632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f44004810 msgr2=0x7f8f44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f44004810 0x7f8f44004c80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8f500018b0 tx=0x7f8f50007d30 comp rx=0 tx=0).stop 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 -- 172.21.15.55:0/3695875632 shutdown_connections 2023-10-06T11:15:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 --2- 172.21.15.55:0/3695875632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f44004810 0x7f8f44004c80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 -- 172.21.15.55:0/3695875632 >> 172.21.15.55:0/3695875632 conn(0x7f8f5c06b330 msgr2=0x7f8f5c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 -- 172.21.15.55:0/3695875632 shutdown_connections 2023-10-06T11:15:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.186+0000 7f8f628dd700 1 -- 172.21.15.55:0/3695875632 wait complete. 2023-10-06T11:15:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.187+0000 7f8f628dd700 1 Processor -- start 2023-10-06T11:15:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.187+0000 7f8f628dd700 1 -- start start 2023-10-06T11:15:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f628dd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44004810 0x7f8f5c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f628dd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 0x7f8f5c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f628dd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f5c15aa90 0x7f8f5c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f628dd700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c154c20 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f628dd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c15cbd0 con 0x7f8f5c15aa90 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f628dd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0b37c0 con 0x7f8f44004810 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 0x7f8f5c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 0x7f8f5c0b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45248/0 (socket says 172.21.15.55:45248) 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 -- 172.21.15.55:0/4191721851 learned_addr learned my addr 172.21.15.55:0/4191721851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f620dc700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f5c15aa90 0x7f8f5c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f618db700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44004810 0x7f8f5c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 -- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44004810 msgr2=0x7f8f5c1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44004810 0x7f8f5c1546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 -- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f5c15aa90 msgr2=0x7f8f5c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f5c15aa90 0x7f8f5c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f610da700 1 -- 172.21.15.55:0/4191721851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c15d730 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.188+0000 7f8f620dc700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f5c15aa90 0x7f8f5c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.189+0000 7f8f610da700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 0x7f8f5c0b31b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000cfa0 tx=0x7f8f50015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.189+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50001200 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.189+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f50012cd0 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.189+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c15b420 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.189+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50012960 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.189+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c15d0e0 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.190+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c15d8c0 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.190+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f5001f620 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.191+0000 7f8f59ffb700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.191+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f8f50085e70 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.191+0000 7f8f618db700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.192+0000 7f8f618db700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0094d0 tx=0x7f8f4c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.195+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f500531f0 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.390+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8f5c05f230 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.395+0000 7f8f59ffb700 1 -- 172.21.15.55:0/4191721851 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8f500079f0 con 0x7f8f5c0b2d40 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 msgr2=0x7f8f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0094d0 tx=0x7f8f4c00b040 comp rx=0 tx=0).stop 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 msgr2=0x7f8f5c0b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 0x7f8f5c0b31b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000cfa0 tx=0x7f8f50015000 comp rx=0 tx=0).stop 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 shutdown_connections 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f5c15aa90 0x7f8f5c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f44004810 0x7f8f5c1546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 --2- 172.21.15.55:0/4191721851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0b2d40 0x7f8f5c0b31b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 >> 172.21.15.55:0/4191721851 conn(0x7f8f5c06b330 msgr2=0x7f8f5c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 shutdown_connections 2023-10-06T11:15:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.397+0000 7f8f628dd700 1 -- 172.21.15.55:0/4191721851 wait complete. 2023-10-06T11:15:03.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2023-10-06T11:15:03.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.530+0000 7fde2759e700 1 Processor -- start 2023-10-06T11:15:03.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.530+0000 7fde2759e700 1 -- start start 2023-10-06T11:15:03.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde2759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde280cbc30 0x7fde280cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde2759e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde280b2100 0x7fde280b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde2759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280cb7a0 con 0x7fde28159440 2023-10-06T11:15:03.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde2759e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280b0860 con 0x7fde280b2100 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde2759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280cb150 con 0x7fde280cbc30 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde26d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde280b2100 0x7fde280b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde26d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde280b2100 0x7fde280b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45256/0 (socket says 172.21.15.55:45256) 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.531+0000 7fde26d9d700 1 -- 172.21.15.55:0/137708064 learned_addr learned my addr 172.21.15.55:0/137708064 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde25d9b700 1 --2- 172.21.15.55:0/137708064 >> v2:172.21.15.142:3300/0 conn(0x7fde280cbc30 0x7fde280cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde26d9d700 1 -- 172.21.15.55:0/137708064 >> v2:172.21.15.142:3300/0 conn(0x7fde280cbc30 msgr2=0x7fde280cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde26d9d700 1 --2- 172.21.15.55:0/137708064 >> v2:172.21.15.142:3300/0 conn(0x7fde280cbc30 0x7fde280cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde26d9d700 1 -- 172.21.15.55:0/137708064 >> v1:172.21.15.142:6789/0 conn(0x7fde28159440 legacy=0x7fde280b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde26d9d700 1 -- 172.21.15.55:0/137708064 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280cb430 con 0x7fde280b2100 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde25d9b700 1 --2- 172.21.15.55:0/137708064 >> v2:172.21.15.142:3300/0 conn(0x7fde280cbc30 0x7fde280cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde26d9d700 1 --2- 172.21.15.55:0/137708064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280b2520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fde280d0220 tx=0x7fde18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfd6f8dfb59a21d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde2559a700 1 -- 172.21.15.55:0/137708064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800e070 con 0x7fde280b2100 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde2559a700 1 -- 172.21.15.55:0/137708064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800ba10 con 0x7fde280b2100 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde2559a700 1 -- 172.21.15.55:0/137708064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180092e0 con 0x7fde280b2100 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde2759e700 1 -- 172.21.15.55:0/137708064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 msgr2=0x7fde280b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.532+0000 7fde2759e700 1 --2- 172.21.15.55:0/137708064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280b2520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fde280d0220 tx=0x7fde18009840 comp rx=0 tx=0).stop 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.533+0000 7fde2759e700 1 -- 172.21.15.55:0/137708064 shutdown_connections 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.533+0000 7fde2759e700 1 --2- 172.21.15.55:0/137708064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280b2520 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.533+0000 7fde2759e700 1 --2- 172.21.15.55:0/137708064 >> v2:172.21.15.142:3300/0 conn(0x7fde280cbc30 0x7fde280cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.533+0000 7fde2759e700 1 -- 172.21.15.55:0/137708064 >> 172.21.15.55:0/137708064 conn(0x7fde2806ece0 msgr2=0x7fde2806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.533+0000 7fde2759e700 1 -- 172.21.15.55:0/137708064 shutdown_connections 2023-10-06T11:15:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.533+0000 7fde2759e700 1 -- 172.21.15.55:0/137708064 wait complete. 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 Processor -- start 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 -- start start 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde280cbc30 0x7fde281547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde28159440 0x7fde2815cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2815d760 con 0x7fde280b2100 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2815da40 con 0x7fde28159440 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.534+0000 7fde2759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2815dd20 con 0x7fde280cbc30 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45266/0 (socket says 172.21.15.55:45266) 2023-10-06T11:15:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 -- 172.21.15.55:0/3294116064 learned_addr learned my addr 172.21.15.55:0/3294116064 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde25d9b700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde280cbc30 0x7fde281547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde26d9d700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde28159440 0x7fde2815cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 -- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde280cbc30 msgr2=0x7fde281547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde280cbc30 0x7fde281547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 -- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde28159440 msgr2=0x7fde2815cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde28159440 0x7fde2815cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 -- 172.21.15.55:0/3294116064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009ae0 con 0x7fde280b2100 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2659c700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280c4940 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fde2000b5e0 tx=0x7fde20009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000f510 con 0x7fde280b2100 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000f670 con 0x7fde280b2100 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000fa30 con 0x7fde280b2100 2023-10-06T11:15:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2815e000 con 0x7fde280b2100 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.535+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde28154cf0 con 0x7fde280b2100 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.536+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2805f230 con 0x7fde280b2100 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.537+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde2001a400 con 0x7fde280b2100 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.537+0000 7fde1e7fc700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fde08066f30 0x7fde080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.537+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fde20084000 con 0x7fde280b2100 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.537+0000 7fde25d9b700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fde08066f30 0x7fde080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.538+0000 7fde25d9b700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fde08066f30 0x7fde080693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde280b5790 tx=0x7fde10006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.541+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde20051350 con 0x7fde280b2100 2023-10-06T11:15:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:03.811+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) v1 -- 0x7fde28159810 con 0x7fde280b2100 2023-10-06T11:15:04.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.038+0000 7fde1e7fc700 1 -- 172.21.15.55:0/3294116064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v130) v1 ==== 153+0+0 (secure 0 0 0) 0x7fde20054970 con 0x7fde280b2100 2023-10-06T11:15:04.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.040+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fde08066f30 msgr2=0x7fde080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.040+0000 7fde2759e700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fde08066f30 0x7fde080693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde280b5790 tx=0x7fde10006f90 comp rx=0 tx=0).stop 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.040+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 msgr2=0x7fde280c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.040+0000 7fde2759e700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280c4940 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fde2000b5e0 tx=0x7fde20009120 comp rx=0 tx=0).stop 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.040+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 shutdown_connections 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.040+0000 7fde2759e700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fde08066f30 0x7fde080693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.041+0000 7fde2759e700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde280b2100 0x7fde280c4940 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.041+0000 7fde2759e700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde28159440 0x7fde2815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.041+0000 7fde2759e700 1 --2- 172.21.15.55:0/3294116064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde280cbc30 0x7fde281547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.041+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 >> 172.21.15.55:0/3294116064 conn(0x7fde2806ece0 msgr2=0x7fde280ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.041+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 shutdown_connections 2023-10-06T11:15:04.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.041+0000 7fde2759e700 1 -- 172.21.15.55:0/3294116064 wait complete. 2023-10-06T11:15:04.056 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... skipped 'Requires FUSE client to use mds_cluster.is_addr_blocklisted()' 2023-10-06T11:15:04.056 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T11:15:04.056 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2023-10-06T11:15:04.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.174+0000 7fcdeda2d700 1 Processor -- start 2023-10-06T11:15:04.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.174+0000 7fcdeda2d700 1 -- start start 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.174+0000 7fcdeda2d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde80b49a0 0x7fcde80aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcdeda2d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcde80b0760 0x7fcde80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcdeda2d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde80b0c60 con 0x7fcde8159560 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcdeda2d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde80b0f40 con 0x7fcde80b49a0 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcdeda2d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde80b1220 con 0x7fcde80b0760 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde80b49a0 0x7fcde80aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde80b49a0 0x7fcde80aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45268/0 (socket says 172.21.15.55:45268) 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 -- 172.21.15.55:0/804376286 learned_addr learned my addr 172.21.15.55:0/804376286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde77fe700 1 --2- 172.21.15.55:0/804376286 >> v2:172.21.15.142:3300/0 conn(0x7fcde80b0760 0x7fcde80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 -- 172.21.15.55:0/804376286 >> v2:172.21.15.142:3300/0 conn(0x7fcde80b0760 msgr2=0x7fcde80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 --2- 172.21.15.55:0/804376286 >> v2:172.21.15.142:3300/0 conn(0x7fcde80b0760 0x7fcde80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 -- 172.21.15.55:0/804376286 >> v1:172.21.15.142:6789/0 conn(0x7fcde8159560 legacy=0x7fcde80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 -- 172.21.15.55:0/804376286 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde80b1500 con 0x7fcde80b49a0 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde77fe700 1 --2- 172.21.15.55:0/804376286 >> v2:172.21.15.142:3300/0 conn(0x7fcde80b0760 0x7fcde80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde67fc700 1 --2- 172.21.15.55:0/804376286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b49a0 0x7fcde80aac40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00099b0 tx=0x7fcdd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a867e10dd657d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde5ffb700 1 -- 172.21.15.55:0/804376286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000b820 con 0x7fcde80b49a0 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde5ffb700 1 -- 172.21.15.55:0/804376286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd000b980 con 0x7fcde80b49a0 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.175+0000 7fcde5ffb700 1 -- 172.21.15.55:0/804376286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000bd20 con 0x7fcde80b49a0 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 -- 172.21.15.55:0/804376286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b49a0 msgr2=0x7fcde80aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/804376286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b49a0 0x7fcde80aac40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00099b0 tx=0x7fcdd0009250 comp rx=0 tx=0).stop 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 -- 172.21.15.55:0/804376286 shutdown_connections 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/804376286 >> v2:172.21.15.142:3300/0 conn(0x7fcde80b0760 0x7fcde80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/804376286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b49a0 0x7fcde80aac40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 -- 172.21.15.55:0/804376286 >> 172.21.15.55:0/804376286 conn(0x7fcde80997f0 msgr2=0x7fcde806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:04.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 -- 172.21.15.55:0/804376286 shutdown_connections 2023-10-06T11:15:04.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.176+0000 7fcdeda2d700 1 -- 172.21.15.55:0/804376286 wait complete. 2023-10-06T11:15:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.177+0000 7fcdeda2d700 1 Processor -- start 2023-10-06T11:15:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.177+0000 7fcdeda2d700 1 -- start start 2023-10-06T11:15:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcdeda2d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 0x7fcde809da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcdeda2d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde80b49a0 0x7fcde809a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcdeda2d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcde8159560 0x7fcde81579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcdeda2d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde809b0b0 con 0x7fcde80b0760 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcdeda2d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde809bc90 con 0x7fcde80b49a0 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcdeda2d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde809a590 con 0x7fcde8159560 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 0x7fcde809da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 0x7fcde809da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45282/0 (socket says 172.21.15.55:45282) 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 -- 172.21.15.55:0/414509392 learned_addr learned my addr 172.21.15.55:0/414509392 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde67fc700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde80b49a0 0x7fcde809a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde77fe700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcde8159560 0x7fcde81579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 -- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcde8159560 msgr2=0x7fcde81579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcde8159560 0x7fcde81579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 -- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde80b49a0 msgr2=0x7fcde809a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde80b49a0 0x7fcde809a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.178+0000 7fcde6ffd700 1 -- 172.21.15.55:0/414509392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00094f0 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.179+0000 7fcde6ffd700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 0x7fcde809da90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c4c0 tx=0x7fcdd800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.179+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800cea0 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.179+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd8011590 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.179+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde809a810 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.179+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8011930 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.179+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde809add0 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.180+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde809ba60 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.180+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdd8011ce0 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.181+0000 7fcddeffd700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.181+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fcdd8083750 con 0x7fcde80b0760 2023-10-06T11:15:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.181+0000 7fcde67fc700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.181+0000 7fcde67fc700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdc8066f30 0x7fcdc80693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcde8088de0 tx=0x7fcdd0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:04.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.185+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdd8050ad0 con 0x7fcde80b0760 2023-10-06T11:15:04.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:04.459+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7fcde8064a90 con 0x7fcde80b0760 2023-10-06T11:15:05.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.045+0000 7fcddeffd700 1 -- 172.21.15.55:0/414509392 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v131) v1 ==== 145+0+0 (secure 0 0 0) 0x7fcdd8017020 con 0x7fcde80b0760 2023-10-06T11:15:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdc8066f30 msgr2=0x7fcdc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdc8066f30 0x7fcdc80693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcde8088de0 tx=0x7fcdd0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 msgr2=0x7fcde809da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 0x7fcde809da90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c4c0 tx=0x7fcdd800c7d0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 shutdown_connections 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde80b0760 0x7fcde809da90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcde8159560 0x7fcde81579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 --2- 172.21.15.55:0/414509392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde80b49a0 0x7fcde809a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 >> 172.21.15.55:0/414509392 conn(0x7fcde80997f0 msgr2=0x7fcde815cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 shutdown_connections 2023-10-06T11:15:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.047+0000 7fcdeda2d700 1 -- 172.21.15.55:0/414509392 wait complete. 2023-10-06T11:15:05.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:15:05.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.190+0000 7fd32ac6a700 1 Processor -- start 2023-10-06T11:15:05.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.190+0000 7fd32ac6a700 1 -- start start 2023-10-06T11:15:05.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd32ac6a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3241539c0 0x7fd324069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd32ac6a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd324069a90 0x7fd32415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd32ac6a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32415db90 con 0x7fd324153d90 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd32ac6a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32415ab70 con 0x7fd324069a90 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd32ac6a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32415de70 con 0x7fd3241539c0 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd324069a90 0x7fd32415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd329207700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd324153d90 0x7fd3240cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46468/0 (socket says 172.21.15.55:46468) 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd324069a90 0x7fd32415d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46872/0 (socket says 172.21.15.55:46872) 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd329207700 1 -- 172.21.15.55:0/2556123760 learned_addr learned my addr 172.21.15.55:0/2556123760 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd328a06700 1 --2- 172.21.15.55:0/2556123760 >> v2:172.21.15.142:3300/0 conn(0x7fd3241539c0 0x7fd324069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 -- 172.21.15.55:0/2556123760 >> v2:172.21.15.142:3300/0 conn(0x7fd3241539c0 msgr2=0x7fd324069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 --2- 172.21.15.55:0/2556123760 >> v2:172.21.15.142:3300/0 conn(0x7fd3241539c0 0x7fd324069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 -- 172.21.15.55:0/2556123760 >> v1:172.21.15.55:6789/0 conn(0x7fd324153d90 legacy=0x7fd3240cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 -- 172.21.15.55:0/2556123760 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324068d50 con 0x7fd324069a90 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd3237fe700 1 -- 172.21.15.55:0/2556123760 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774081978 0 0) 0x7fd32415db90 con 0x7fd324153d90 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.191+0000 7fd323fff700 1 --2- 172.21.15.55:0/2556123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324069a90 0x7fd32415d110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd32406af20 tx=0x7fd3180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf72f82d4c3e6aef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd3237fe700 1 -- 172.21.15.55:0/2556123760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800b6b0 con 0x7fd324069a90 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd3237fe700 1 -- 172.21.15.55:0/2556123760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31800b810 con 0x7fd324069a90 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd3237fe700 1 -- 172.21.15.55:0/2556123760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800bbb0 con 0x7fd324069a90 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 -- 172.21.15.55:0/2556123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324069a90 msgr2=0x7fd32415d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/2556123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324069a90 0x7fd32415d110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd32406af20 tx=0x7fd3180091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 -- 172.21.15.55:0/2556123760 shutdown_connections 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/2556123760 >> v2:172.21.15.142:3300/0 conn(0x7fd3241539c0 0x7fd324069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/2556123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324069a90 0x7fd32415d110 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 -- 172.21.15.55:0/2556123760 >> 172.21.15.55:0/2556123760 conn(0x7fd32406b610 msgr2=0x7fd32406ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 -- 172.21.15.55:0/2556123760 shutdown_connections 2023-10-06T11:15:05.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.192+0000 7fd32ac6a700 1 -- 172.21.15.55:0/2556123760 wait complete. 2023-10-06T11:15:05.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.193+0000 7fd32ac6a700 1 Processor -- start 2023-10-06T11:15:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.193+0000 7fd32ac6a700 1 -- start start 2023-10-06T11:15:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd32ac6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd324069a90 0x7fd3240b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd32ac6a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3241539c0 0x7fd32414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd32ac6a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 0x7fd3240b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd32ac6a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324157860 con 0x7fd324153d90 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd32ac6a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324155100 con 0x7fd324069a90 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd32ac6a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324157b00 con 0x7fd3241539c0 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd329207700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 0x7fd3240b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd329207700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 0x7fd3240b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46876/0 (socket says 172.21.15.55:46876) 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd329207700 1 -- 172.21.15.55:0/3627371685 learned_addr learned my addr 172.21.15.55:0/3627371685 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.194+0000 7fd328a06700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd324069a90 0x7fd3240b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd323fff700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3241539c0 0x7fd32414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd329207700 1 -- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3241539c0 msgr2=0x7fd32414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd329207700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3241539c0 0x7fd32414de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd329207700 1 -- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd324069a90 msgr2=0x7fd3240b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd329207700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd324069a90 0x7fd3240b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd329207700 1 -- 172.21.15.55:0/3627371685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009420 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd328a06700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd324069a90 0x7fd3240b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd329207700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 0x7fd3240b1040 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00cb90 tx=0x7fd31c001910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00a8d0 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c00aa50 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd324157de0 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00ae10 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.195+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3240b3e80 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.196+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3241576c0 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.196+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd31c007300 con 0x7fd324153d90 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.197+0000 7fd320ff9700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd310066f30 0x7fd3100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.197+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd31c0848a0 con 0x7fd324153d90 2023-10-06T11:15:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.197+0000 7fd328a06700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd310066f30 0x7fd3100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.197+0000 7fd328a06700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd310066f30 0x7fd3100693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd314006fd0 tx=0x7fd314008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.201+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3241576c0 con 0x7fd324153d90 2023-10-06T11:15:05.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.395+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd3241576c0 con 0x7fd324153d90 2023-10-06T11:15:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.403+0000 7fd320ff9700 1 -- 172.21.15.55:0/3627371685 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd3241576c0 con 0x7fd324153d90 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd310066f30 msgr2=0x7fd3100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd310066f30 0x7fd3100693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd314006fd0 tx=0x7fd314008040 comp rx=0 tx=0).stop 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 msgr2=0x7fd3240b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 0x7fd3240b1040 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00cb90 tx=0x7fd31c001910 comp rx=0 tx=0).stop 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 shutdown_connections 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd310066f30 0x7fd3100693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324153d90 0x7fd3240b1040 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd324069a90 0x7fd3240b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 --2- 172.21.15.55:0/3627371685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3241539c0 0x7fd32414de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 >> 172.21.15.55:0/3627371685 conn(0x7fd32406b610 msgr2=0x7fd3240c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 shutdown_connections 2023-10-06T11:15:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.405+0000 7fd32ac6a700 1 -- 172.21.15.55:0/3627371685 wait complete. 2023-10-06T11:15:05.419 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:15:05.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:05.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:05.512 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:15:05.513 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:15:05.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.629+0000 7f08cc1ed700 1 Processor -- start 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08cc1ed700 1 -- start start 2023-10-06T11:15:05.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08cc1ed700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08c40b25e0 0x7f08c40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08cc1ed700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40cbfa0 con 0x7f08c40b29b0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08cc1ed700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40cb390 con 0x7f08c4159830 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08cc1ed700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c40cb670 con 0x7f08c40b25e0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08c9f89700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08c40b25e0 0x7f08c40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08c9788700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f08c40b29b0 0x7f08c4159120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46472/0 (socket says 172.21.15.55:46472) 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.630+0000 7f08c9788700 1 -- 172.21.15.55:0/3232153855 learned_addr learned my addr 172.21.15.55:0/3232153855 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c9f89700 1 -- 172.21.15.55:0/3232153855 >> v1:172.21.15.142:6789/0 conn(0x7f08c4159830 legacy=0x7f08c40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c9f89700 1 -- 172.21.15.55:0/3232153855 >> v1:172.21.15.55:6789/0 conn(0x7f08c40b29b0 legacy=0x7f08c4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c9f89700 1 -- 172.21.15.55:0/3232153855 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40cb950 con 0x7f08c40b25e0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c9f89700 1 --2- 172.21.15.55:0/3232153855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c40b25e0 0x7f08c40b0690 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009eb0 tx=0x7f08bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727817cc8ae64446 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c8f87700 1 -- 172.21.15.55:0/3232153855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00e070 con 0x7f08c40b25e0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c8f87700 1 -- 172.21.15.55:0/3232153855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc00bc30 con 0x7f08c40b25e0 2023-10-06T11:15:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.631+0000 7f08c8f87700 1 -- 172.21.15.55:0/3232153855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc012430 con 0x7f08c40b25e0 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 -- 172.21.15.55:0/3232153855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c40b25e0 msgr2=0x7f08c40b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/3232153855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c40b25e0 0x7f08c40b0690 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009eb0 tx=0x7f08bc009780 comp rx=0 tx=0).stop 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 -- 172.21.15.55:0/3232153855 shutdown_connections 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/3232153855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c40b25e0 0x7f08c40b0690 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 -- 172.21.15.55:0/3232153855 >> 172.21.15.55:0/3232153855 conn(0x7f08c406ece0 msgr2=0x7f08c406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 -- 172.21.15.55:0/3232153855 shutdown_connections 2023-10-06T11:15:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.632+0000 7f08cc1ed700 1 -- 172.21.15.55:0/3232153855 wait complete. 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.633+0000 7f08cc1ed700 1 Processor -- start 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.633+0000 7f08cc1ed700 1 -- start start 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c40b25e0 0x7f08c40c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08c40b29b0 0x7f08c40cf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 0x7f08c416d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40ce780 con 0x7f08c4159830 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40cea60 con 0x7f08c40b25e0 2023-10-06T11:15:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40ced40 con 0x7f08c40b29b0 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 0x7f08c416d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 0x7f08c416d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46890/0 (socket says 172.21.15.55:46890) 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 -- 172.21.15.55:0/4179757225 learned_addr learned my addr 172.21.15.55:0/4179757225 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c9f89700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c40b25e0 0x7f08c40c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c9788700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08c40b29b0 0x7f08c40cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 -- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08c40b29b0 msgr2=0x7f08c40cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08c40b29b0 0x7f08c40cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 -- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c40b25e0 msgr2=0x7f08c40c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c40b25e0 0x7f08c40c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 -- 172.21.15.55:0/4179757225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc009a20 con 0x7f08c4159830 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c9f89700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c40b25e0 0x7f08c40c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c9788700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08c40b29b0 0x7f08c40cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08ca78a700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 0x7f08c416d210 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c4c0 tx=0x7f08b4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4011590 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4011710 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4011ad0 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.634+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c40cf020 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.635+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c40c7a10 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.635+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c40cf540 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.636+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08b401b3b0 con 0x7f08c4159830 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.636+0000 7f08c1ffb700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f08b0066f30 0x7f08b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.636+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f08b4083950 con 0x7f08c4159830 2023-10-06T11:15:05.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.637+0000 7f08c9f89700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f08b0066f30 0x7f08b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.637+0000 7f08c9f89700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f08b0066f30 0x7f08b00693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009eb0 tx=0x7f08bc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.641+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08c40cf540 con 0x7f08c4159830 2023-10-06T11:15:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.878+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08c40cf540 con 0x7f08c4159830 2023-10-06T11:15:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.878+0000 7f08c1ffb700 1 -- 172.21.15.55:0/4179757225 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f08c40cf540 con 0x7f08c4159830 2023-10-06T11:15:05.881 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:05.881 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4964,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/3177013946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3177013946},{"type":"v1","addr":"172.21.15.142:6836","nonce":3177013946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":4967,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4240378136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4240378136},{"type":"v1","addr":"172.21.15.142:6837","nonce":4240378136}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1718736649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1718736649},{"type":"v1","addr":"172.21.15.55:6834","nonce":1718736649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2277110322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2277110322},{"type":"v1","addr":"172.21.15.55:6835","nonce":2277110322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[]} 2023-10-06T11:15:05.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f08b0066f30 msgr2=0x7f08b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f08b0066f30 0x7f08b00693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009eb0 tx=0x7f08bc017000 comp rx=0 tx=0).stop 2023-10-06T11:15:05.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 msgr2=0x7f08c416d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 0x7f08c416d210 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c4c0 tx=0x7f08b4007f50 comp rx=0 tx=0).stop 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 shutdown_connections 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f08b0066f30 0x7f08b00693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08c4159830 0x7f08c416d210 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c40b25e0 0x7f08c40c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.880+0000 7f08cc1ed700 1 --2- 172.21.15.55:0/4179757225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08c40b29b0 0x7f08c40cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.881+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 >> 172.21.15.55:0/4179757225 conn(0x7f08c406ece0 msgr2=0x7f08c40c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.881+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 shutdown_connections 2023-10-06T11:15:05.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:05.881+0000 7f08cc1ed700 1 -- 172.21.15.55:0/4179757225 wait complete. 2023-10-06T11:15:05.885 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 29 2023-10-06T11:15:05.895 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:15:05.895 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:15:05.896 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:15:05.896 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:05.896 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:15:05.896 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:15:05.896 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:15:05.896 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:05.897 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:15:05.897 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:15:05.897 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:15:05.897 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:05.897 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:15:05.897 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:15:05.898 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:15:05.898 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:05.906 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:15:05.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:15:05.907 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:15:05.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:15:05.908 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:15:05.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:15:05.909 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:15:05.909 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:15:05.949 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:15:05.949 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:05.950 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:15:05.950 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:05.951 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:15:05.951 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:05.952 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:15:05.952 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:05.952 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:15:06.024 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:15:06.024 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:15:06.032 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:15:06.032 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:15:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.076+0000 7fbebe5e9700 1 Processor -- start 2023-10-06T11:15:06.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.076+0000 7fbebe5e9700 1 -- start start 2023-10-06T11:15:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebe5e9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbeb80cbc30 0x7fbeb80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebe5e9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbeb80b2100 0x7fbeb80b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebe5e9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb80cb7a0 con 0x7fbeb8159440 2023-10-06T11:15:06.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebe5e9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb80b0860 con 0x7fbeb80cbc30 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebe5e9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb80cb150 con 0x7fbeb80b2100 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebcde6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbeb80cbc30 0x7fbeb80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebcde6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbeb80cbc30 0x7fbeb80cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46922/0 (socket says 172.21.15.55:46922) 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebcde6700 1 -- 172.21.15.55:0/3092380241 learned_addr learned my addr 172.21.15.55:0/3092380241 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.077+0000 7fbebdde8700 1 --2- 172.21.15.55:0/3092380241 >> v2:172.21.15.142:3300/0 conn(0x7fbeb80b2100 0x7fbeb80b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbebcde6700 1 -- 172.21.15.55:0/3092380241 >> v2:172.21.15.142:3300/0 conn(0x7fbeb80b2100 msgr2=0x7fbeb80b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbebcde6700 1 --2- 172.21.15.55:0/3092380241 >> v2:172.21.15.142:3300/0 conn(0x7fbeb80b2100 0x7fbeb80b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbebcde6700 1 -- 172.21.15.55:0/3092380241 >> v1:172.21.15.142:6789/0 conn(0x7fbeb8159440 legacy=0x7fbeb80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbebcde6700 1 -- 172.21.15.55:0/3092380241 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb80cb430 con 0x7fbeb80cbc30 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbebcde6700 1 --2- 172.21.15.55:0/3092380241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb80cc080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80ca7f0 tx=0x7fbeac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e09e91e615f500 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbeb7fff700 1 -- 172.21.15.55:0/3092380241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac009e70 con 0x7fbeb80cbc30 2023-10-06T11:15:06.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbeb7fff700 1 -- 172.21.15.55:0/3092380241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac00b860 con 0x7fbeb80cbc30 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.078+0000 7fbeb7fff700 1 -- 172.21.15.55:0/3092380241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00bc00 con 0x7fbeb80cbc30 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 -- 172.21.15.55:0/3092380241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 msgr2=0x7fbeb80cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/3092380241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb80cc080 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80ca7f0 tx=0x7fbeac009250 comp rx=0 tx=0).stop 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 -- 172.21.15.55:0/3092380241 shutdown_connections 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/3092380241 >> v2:172.21.15.142:3300/0 conn(0x7fbeb80b2100 0x7fbeb80b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/3092380241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb80cc080 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 -- 172.21.15.55:0/3092380241 >> 172.21.15.55:0/3092380241 conn(0x7fbeb806ece0 msgr2=0x7fbeb806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 -- 172.21.15.55:0/3092380241 shutdown_connections 2023-10-06T11:15:06.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.079+0000 7fbebe5e9700 1 -- 172.21.15.55:0/3092380241 wait complete. 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.080+0000 7fbebe5e9700 1 Processor -- start 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.080+0000 7fbebe5e9700 1 -- start start 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebe5e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeb80b2100 0x7fbeb80cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebe5e9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebe5e9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbeb8159440 0x7fbeb8157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebe5e9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80ceff0 con 0x7fbeb80cbc30 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebe5e9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80ce370 con 0x7fbeb80b2100 2023-10-06T11:15:06.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebe5e9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb80ce650 con 0x7fbeb8159440 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb8156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46926/0 (socket says 172.21.15.55:46926) 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 -- 172.21.15.55:0/559793903 learned_addr learned my addr 172.21.15.55:0/559793903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebd5e7700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeb80b2100 0x7fbeb80cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebdde8700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbeb8159440 0x7fbeb8157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 -- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbeb8159440 msgr2=0x7fbeb8157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbeb8159440 0x7fbeb8157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 -- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeb80b2100 msgr2=0x7fbeb80cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeb80b2100 0x7fbeb80cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 -- 172.21.15.55:0/559793903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0094f0 con 0x7fbeb80cbc30 2023-10-06T11:15:06.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbebcde6700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb8156b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8069150 tx=0x7fbeac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.081+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00bbe0 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.082+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac011420 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.082+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb80ce930 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.082+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0117e0 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.082+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb80cf950 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.083+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb805f230 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.083+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbeac011c10 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.083+0000 7fbeb57fa700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbea4066f30 0x7fbea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.083+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fbeac085d20 con 0x7fbeb80cbc30 2023-10-06T11:15:06.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.084+0000 7fbebd5e7700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbea4066f30 0x7fbea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.084+0000 7fbebd5e7700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbea4066f30 0x7fbea40693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00039e0 tx=0x7fbeb0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.088+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbeac052ff0 con 0x7fbeb80cbc30 2023-10-06T11:15:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:06.295+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbeb8159810 con 0x7fbeb80cbc30 2023-10-06T11:15:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.064+0000 7fbeb57fa700 1 -- 172.21.15.55:0/559793903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbeac056610 con 0x7fbeb80cbc30 2023-10-06T11:15:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.067+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbea4066f30 msgr2=0x7fbea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.067+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbea4066f30 0x7fbea40693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00039e0 tx=0x7fbeb0007ec0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.067+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 msgr2=0x7fbeb8156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.067+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb8156b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8069150 tx=0x7fbeac017000 comp rx=0 tx=0).stop 2023-10-06T11:15:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 shutdown_connections 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbea4066f30 0x7fbea40693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbeb8159440 0x7fbeb8157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbeb80b2100 0x7fbeb80cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 --2- 172.21.15.55:0/559793903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb80cbc30 0x7fbeb8156b50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 >> 172.21.15.55:0/559793903 conn(0x7fbeb806ece0 msgr2=0x7fbeb8155990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 shutdown_connections 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.068+0000 7fbebe5e9700 1 -- 172.21.15.55:0/559793903 wait complete. 2023-10-06T11:15:07.071 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-10-06T11:15:07.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:15:07.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.209+0000 7fe805e52700 1 Processor -- start 2023-10-06T11:15:07.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.209+0000 7fe805e52700 1 -- start start 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.209+0000 7fe805e52700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe800069ab0 0x7fe8000ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.209+0000 7fe805e52700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80006e6d0 con 0x7fe8000696e0 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.209+0000 7fe805e52700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80006dac0 con 0x7fe80006d350 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.209+0000 7fe805e52700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8000cd000 con 0x7fe800069ab0 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7feffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe800069ab0 0x7fe8000ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7ff7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8000696e0 0x7fe8000aeeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46488/0 (socket says 172.21.15.55:46488) 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7ff7fe700 1 -- 172.21.15.55:0/2118878327 learned_addr learned my addr 172.21.15.55:0/2118878327 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7feffd700 1 -- 172.21.15.55:0/2118878327 >> v1:172.21.15.142:6789/0 conn(0x7fe80006d350 legacy=0x7fe80006eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7feffd700 1 -- 172.21.15.55:0/2118878327 >> v1:172.21.15.55:6789/0 conn(0x7fe8000696e0 legacy=0x7fe8000aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7feffd700 1 -- 172.21.15.55:0/2118878327 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80006dda0 con 0x7fe800069ab0 2023-10-06T11:15:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7feffd700 1 --2- 172.21.15.55:0/2118878327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000ada60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098e0 tx=0x7fe7f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa31a26098a6154 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7fe7fc700 1 -- 172.21.15.55:0/2118878327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4009e80 con 0x7fe800069ab0 2023-10-06T11:15:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7fe7fc700 1 -- 172.21.15.55:0/2118878327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400b820 con 0x7fe800069ab0 2023-10-06T11:15:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.210+0000 7fe7fe7fc700 1 -- 172.21.15.55:0/2118878327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400bba0 con 0x7fe800069ab0 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 -- 172.21.15.55:0/2118878327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 msgr2=0x7fe8000ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 --2- 172.21.15.55:0/2118878327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000ada60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098e0 tx=0x7fe7f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 -- 172.21.15.55:0/2118878327 shutdown_connections 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 --2- 172.21.15.55:0/2118878327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000ada60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 -- 172.21.15.55:0/2118878327 >> 172.21.15.55:0/2118878327 conn(0x7fe800068080 msgr2=0x7fe8000cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 -- 172.21.15.55:0/2118878327 shutdown_connections 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.211+0000 7fe805e52700 1 -- 172.21.15.55:0/2118878327 wait complete. 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.212+0000 7fe805e52700 1 Processor -- start 2023-10-06T11:15:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.212+0000 7fe805e52700 1 -- start start 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe805e52700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8000696e0 0x7fe8000aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe805e52700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe805e52700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80006d350 0x7fe8000c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe805e52700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8000aa260 con 0x7fe800069ab0 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe805e52700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe800157b10 con 0x7fe80006d350 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe805e52700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8000abd10 con 0x7fe8000696e0 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46932/0 (socket says 172.21.15.55:46932) 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 -- 172.21.15.55:0/1337397960 learned_addr learned my addr 172.21.15.55:0/1337397960 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7ff7fe700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8000696e0 0x7fe8000aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7fffff700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80006d350 0x7fe8000c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 -- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8000696e0 msgr2=0x7fe8000aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8000696e0 0x7fe8000aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 -- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80006d350 msgr2=0x7fe8000c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80006d350 0x7fe8000c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.213+0000 7fe7feffd700 1 -- 172.21.15.55:0/1337397960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f4009420 con 0x7fe800069ab0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.214+0000 7fe7feffd700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000c6680 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe80006fd70 tx=0x7fe7f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.214+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400b990 con 0x7fe800069ab0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.214+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4020070 con 0x7fe800069ab0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.214+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8000abff0 con 0x7fe800069ab0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.214+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4025480 con 0x7fe800069ab0 2023-10-06T11:15:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.214+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8000aa480 con 0x7fe800069ab0 2023-10-06T11:15:07.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.215+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8000aa670 con 0x7fe800069ab0 2023-10-06T11:15:07.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.215+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7f4022030 con 0x7fe800069ab0 2023-10-06T11:15:07.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.216+0000 7fe7e77fe700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7ec066f30 0x7fe7ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.216+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe7f4086160 con 0x7fe800069ab0 2023-10-06T11:15:07.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.216+0000 7fe7ff7fe700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7ec066f30 0x7fe7ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.216+0000 7fe7ff7fe700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7ec066f30 0x7fe7ec0693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007130 tx=0x7fe7f0007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.220+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7f4053480 con 0x7fe800069ab0 2023-10-06T11:15:07.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.494+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe800064a90 con 0x7fe800069ab0 2023-10-06T11:15:07.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.494+0000 7fe7e77fe700 1 -- 172.21.15.55:0/1337397960 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe7f4056aa0 con 0x7fe800069ab0 2023-10-06T11:15:07.497 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:07.497 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:15:07.497 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ==", 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.498 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg==", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q==", 2023-10-06T11:15:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag==", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:07.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw==", 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.501 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw==", 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-10-06T11:15:07.502 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA==", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA==", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ==", 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.504 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug==", 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw==", 2023-10-06T11:15:07.505 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg==", 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.506 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w==", 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.507 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg==", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ==", 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.508 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA==", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:07.509 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9loAeQDxAAHRWvLBSoBR/HeRdtrvbGCw==", 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.510 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA==", 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g==", 2023-10-06T11:15:07.511 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:15:07.512 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:15:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7ec066f30 msgr2=0x7fe7ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7ec066f30 0x7fe7ec0693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007130 tx=0x7fe7f0007eb0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 msgr2=0x7fe8000c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000c6680 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe80006fd70 tx=0x7fe7f4016000 comp rx=0 tx=0).stop 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 shutdown_connections 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7ec066f30 0x7fe7ec0693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80006d350 0x7fe8000c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8000696e0 0x7fe8000aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 --2- 172.21.15.55:0/1337397960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe800069ab0 0x7fe8000c6680 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 >> 172.21.15.55:0/1337397960 conn(0x7fe800068080 msgr2=0x7fe800159410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 shutdown_connections 2023-10-06T11:15:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.496+0000 7fe805e52700 1 -- 172.21.15.55:0/1337397960 wait complete. 2023-10-06T11:15:07.515 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.632+0000 7fc7795de700 1 Processor -- start 2023-10-06T11:15:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.632+0000 7fc7795de700 1 -- start start 2023-10-06T11:15:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7795de700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7740cbc30 0x7fc7740cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7795de700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7740cb7a0 con 0x7fc7740b2100 2023-10-06T11:15:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7795de700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7740b0860 con 0x7fc774159440 2023-10-06T11:15:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7795de700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7740cb150 con 0x7fc7740cbc30 2023-10-06T11:15:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7737fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc7740b2100 0x7fc7740b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46494/0 (socket says 172.21.15.55:46494) 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7737fe700 1 -- 172.21.15.55:0/1570790803 learned_addr learned my addr 172.21.15.55:0/1570790803 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc7727fc700 1 --2- 172.21.15.55:0/1570790803 >> v2:172.21.15.142:3300/0 conn(0x7fc7740cbc30 0x7fc7740cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237564381 0 0) 0x7fc7740cb7a0 con 0x7fc7740b2100 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc760003570 con 0x7fc7740b2100 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.633+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249628637 0 0) 0x7fc7740b0860 con 0x7fc774159440 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7740cb7a0 con 0x7fc774159440 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc7727fc700 1 -- 172.21.15.55:0/1570790803 >> v1:172.21.15.142:6789/0 conn(0x7fc774159440 legacy=0x7fc7740b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc7727fc700 1 -- 172.21.15.55:0/1570790803 >> v1:172.21.15.55:6789/0 conn(0x7fc7740b2100 legacy=0x7fc7740b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc7727fc700 1 -- 172.21.15.55:0/1570790803 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740cb430 con 0x7fc7740cbc30 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc7727fc700 1 --2- 172.21.15.55:0/1570790803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7740cbc30 0x7fc7740cc080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0098e0 tx=0x7fc75c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a47478b5a3727ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011630 con 0x7fc7740cbc30 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c011790 con 0x7fc7740cbc30 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc771ffb700 1 -- 172.21.15.55:0/1570790803 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011b10 con 0x7fc7740cbc30 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc7795de700 1 -- 172.21.15.55:0/1570790803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7740cbc30 msgr2=0x7fc7740cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.634+0000 7fc7795de700 1 --2- 172.21.15.55:0/1570790803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7740cbc30 0x7fc7740cc080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0098e0 tx=0x7fc75c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.635+0000 7fc7795de700 1 -- 172.21.15.55:0/1570790803 shutdown_connections 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.635+0000 7fc7795de700 1 --2- 172.21.15.55:0/1570790803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7740cbc30 0x7fc7740cc080 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.635+0000 7fc7795de700 1 -- 172.21.15.55:0/1570790803 >> 172.21.15.55:0/1570790803 conn(0x7fc77406ece0 msgr2=0x7fc77406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.635+0000 7fc7795de700 1 -- 172.21.15.55:0/1570790803 shutdown_connections 2023-10-06T11:15:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.635+0000 7fc7795de700 1 -- 172.21.15.55:0/1570790803 wait complete. 2023-10-06T11:15:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 Processor -- start 2023-10-06T11:15:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 -- start start 2023-10-06T11:15:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7740b2100 0x7fc77416c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 0x7fc77416a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc774159440 0x7fc774169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740ce7c0 con 0x7fc7740cbc30 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740d0940 con 0x7fc774159440 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740cde90 con 0x7fc7740b2100 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 0x7fc77416a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 0x7fc77416a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46936/0 (socket says 172.21.15.55:46936) 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 -- 172.21.15.55:0/2150408672 learned_addr learned my addr 172.21.15.55:0/2150408672 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7737fe700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc774159440 0x7fc774169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc772ffd700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7740b2100 0x7fc77416c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 -- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7740b2100 msgr2=0x7fc77416c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7740b2100 0x7fc77416c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 -- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc774159440 msgr2=0x7fc774169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc774159440 0x7fc774169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 -- 172.21.15.55:0/2150408672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c009420 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7737fe700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc774159440 0x7fc774169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7727fc700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 0x7fc77416a5b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009ed0 tx=0x7fc75c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011b10 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c01a430 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c01a7d0 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7740ce170 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.637+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77416a340 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.638+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77405f230 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.639+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc75c01ab80 con 0x7fc7740cbc30 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.639+0000 7fc76affd700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc754066f30 0x7fc7540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.639+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc75c086160 con 0x7fc7740cbc30 2023-10-06T11:15:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.639+0000 7fc772ffd700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc754066f30 0x7fc7540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.640+0000 7fc772ffd700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc754066f30 0x7fc7540693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc76c001120 tx=0x7fc76c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.644+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc75c053480 con 0x7fc7740cbc30 2023-10-06T11:15:07.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.839+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7740ce900 con 0x7fc7740cbc30 2023-10-06T11:15:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.840+0000 7fc76affd700 1 -- 172.21.15.55:0/2150408672 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fc75c056aa0 con 0x7fc7740cbc30 2023-10-06T11:15:07.842 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:07.843 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:07.062444+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc754066f30 msgr2=0x7fc7540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc754066f30 0x7fc7540693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc76c001120 tx=0x7fc76c009040 comp rx=0 tx=0).stop 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 msgr2=0x7fc77416a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 0x7fc77416a5b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009ed0 tx=0x7fc75c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 shutdown_connections 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc754066f30 0x7fc7540693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc774159440 0x7fc774169e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7740b2100 0x7fc77416c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 --2- 172.21.15.55:0/2150408672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7740cbc30 0x7fc77416a5b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 >> 172.21.15.55:0/2150408672 conn(0x7fc77406ece0 msgr2=0x7fc774155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 shutdown_connections 2023-10-06T11:15:07.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.842+0000 7fc7795de700 1 -- 172.21.15.55:0/2150408672 wait complete. 2023-10-06T11:15:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:15:07.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:15:07.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.977+0000 7f9f53be6700 1 Processor -- start 2023-10-06T11:15:07.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.977+0000 7f9f53be6700 1 -- start start 2023-10-06T11:15:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f53be6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 0x7f9f4c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f53be6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f4c0675b0 0x7f9f4c067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f53be6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c0cbf70 con 0x7f9f4c0cc820 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f53be6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c159bc0 con 0x7f9f4c0675b0 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f53be6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c15ab70 con 0x7f9f4c0ccbf0 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f51982700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f4c0cc820 0x7f9f4c0c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46510/0 (socket says 172.21.15.55:46510) 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.978+0000 7f9f51982700 1 -- 172.21.15.55:0/1614646814 learned_addr learned my addr 172.21.15.55:0/1614646814 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f51181700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 0x7f9f4c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 --2- 172.21.15.55:0/1614646814 >> v2:172.21.15.142:3300/0 conn(0x7f9f4c0675b0 0x7f9f4c067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14760244 0 0) 0x7f9f4c0cbf70 con 0x7f9f4c0cc820 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f34003570 con 0x7f9f4c0cc820 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 798610879 0 0) 0x7f9f34003570 con 0x7f9f4c0cc820 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 msgr2=0x7f9f4c06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 0x7f9f4c06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 >> v2:172.21.15.142:3300/0 conn(0x7f9f4c0675b0 msgr2=0x7f9f4c067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 --2- 172.21.15.55:0/1614646814 >> v2:172.21.15.142:3300/0 conn(0x7f9f4c0675b0 0x7f9f4c067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c159db0 con 0x7f9f4c0cc820 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f9f3c001470 con 0x7f9f4c0cc820 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 --2- 172.21.15.55:0/1614646814 >> v2:172.21.15.142:3300/0 conn(0x7f9f4c0675b0 0x7f9f4c067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 >> v1:172.21.15.55:6789/0 conn(0x7f9f4c0cc820 legacy=0x7f9f4c0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f34003a90 0x7f9f34003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 0x7f9f34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f34004d50 0x7f9f340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c15ab70 con 0x7f9f34004d50 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3400ba60 con 0x7f9f34003a90 2023-10-06T11:15:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3400bba0 con 0x7f9f4c0ccbf0 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f34004d50 0x7f9f340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f51181700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 0x7f9f34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f51982700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f34003a90 0x7f9f34003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 -- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 msgr2=0x7f9f34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c0ccbf0 0x7f9f34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 -- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f34003a90 msgr2=0x7f9f34003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f34003a90 0x7f9f34003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f52183700 1 -- 172.21.15.55:0/1614646814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f34003570 con 0x7f9f34004d50 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.979+0000 7f9f51982700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f34003a90 0x7f9f34003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f52183700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f34004d50 0x7f9f340051c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400e3c0 tx=0x7f9f4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12b69084d4f2d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400ec10 con 0x7f9f34004d50 2023-10-06T11:15:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4400f040 con 0x7f9f34004d50 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f50980700 1 -- 172.21.15.55:0/1614646814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44014480 con 0x7f9f34004d50 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f53be6700 1 -- 172.21.15.55:0/1614646814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f34004d50 msgr2=0x7f9f340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1614646814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f34004d50 0x7f9f340051c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400e3c0 tx=0x7f9f4400b040 comp rx=0 tx=0).stop 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f52183700 1 -- 172.21.15.55:0/1614646814 reap_dead start 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f53be6700 1 -- 172.21.15.55:0/1614646814 shutdown_connections 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f53be6700 1 -- 172.21.15.55:0/1614646814 >> 172.21.15.55:0/1614646814 conn(0x7f9f4c069190 msgr2=0x7f9f4c0cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f53be6700 1 -- 172.21.15.55:0/1614646814 shutdown_connections 2023-10-06T11:15:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.980+0000 7f9f53be6700 1 -- 172.21.15.55:0/1614646814 wait complete. 2023-10-06T11:15:07.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.981+0000 7f9f53be6700 1 Processor -- start 2023-10-06T11:15:07.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.981+0000 7f9f53be6700 1 -- start start 2023-10-06T11:15:07.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f53be6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c153d70 0x7f9f4c0a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f53be6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4c0aa2b0 0x7f9f4c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f53be6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 0x7f9f4c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f53be6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0aa720 con 0x7f9f4c0b1150 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f53be6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c157e70 con 0x7f9f4c0aa2b0 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f53be6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c157860 con 0x7f9f4c153d70 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f52183700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 0x7f9f4c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f52183700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 0x7f9f4c158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46958/0 (socket says 172.21.15.55:46958) 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f52183700 1 -- 172.21.15.55:0/1840045429 learned_addr learned my addr 172.21.15.55:0/1840045429 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f51181700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4c0aa2b0 0x7f9f4c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.982+0000 7f9f51982700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c153d70 0x7f9f4c0a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f52183700 1 -- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c153d70 msgr2=0x7f9f4c0a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f52183700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c153d70 0x7f9f4c0a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f52183700 1 -- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4c0aa2b0 msgr2=0x7f9f4c0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f52183700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4c0aa2b0 0x7f9f4c0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f52183700 1 -- 172.21.15.55:0/1840045429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0b19b0 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f52183700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 0x7f9f4c158300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9f44016000 tx=0x7f9f4401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44014480 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4401e640 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c157b00 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4401e9c0 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.983+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c0b15c0 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.984+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c064a90 con 0x7f9f4c0b1150 2023-10-06T11:15:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.984+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f44003040 con 0x7f9f4c0b1150 2023-10-06T11:15:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.985+0000 7f9f49ffb700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f38066f60 0x7f9f38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.985+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9f44085980 con 0x7f9f4c0b1150 2023-10-06T11:15:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.985+0000 7f9f51982700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f38066f60 0x7f9f38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.986+0000 7f9f51982700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f38066f60 0x7f9f38069410 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0015a0 tx=0x7f9f3c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:07.989+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f44052ca0 con 0x7f9f4c0b1150 2023-10-06T11:15:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.182+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f4c04bb40 con 0x7f9f4c0b1150 2023-10-06T11:15:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.183+0000 7f9f49ffb700 1 -- 172.21.15.55:0/1840045429 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f440180a0 con 0x7f9f4c0b1150 2023-10-06T11:15:08.186 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f38066f60 msgr2=0x7f9f38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f38066f60 0x7f9f38069410 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0015a0 tx=0x7f9f3c007040 comp rx=0 tx=0).stop 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 msgr2=0x7f9f4c158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 0x7f9f4c158300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9f44016000 tx=0x7f9f4401a000 comp rx=0 tx=0).stop 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 shutdown_connections 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f38066f60 0x7f9f38069410 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f4c0b1150 0x7f9f4c158300 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4c153d70 0x7f9f4c0a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 --2- 172.21.15.55:0/1840045429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4c0aa2b0 0x7f9f4c0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 >> 172.21.15.55:0/1840045429 conn(0x7f9f4c069190 msgr2=0x7f9f4c06e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 shutdown_connections 2023-10-06T11:15:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.185+0000 7f9f53be6700 1 -- 172.21.15.55:0/1840045429 wait complete. 2023-10-06T11:15:08.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:15:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.319+0000 7fb3df59e700 1 Processor -- start 2023-10-06T11:15:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.319+0000 7fb3df59e700 1 -- start start 2023-10-06T11:15:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3df59e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3e00cd3c0 0x7fb3e00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3df59e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00cc970 con 0x7fb3e00b29f0 2023-10-06T11:15:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3df59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00cbd60 con 0x7fb3e00b2620 2023-10-06T11:15:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3df59e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00cc040 con 0x7fb3e00cd3c0 2023-10-06T11:15:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ddd9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3e00cd3c0 0x7fb3e00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ded9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb3e00b29f0 0x7fb3e00c5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46526/0 (socket says 172.21.15.55:46526) 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ded9d700 1 -- 172.21.15.55:0/2084112183 learned_addr learned my addr 172.21.15.55:0/2084112183 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ddd9b700 1 -- 172.21.15.55:0/2084112183 >> v1:172.21.15.142:6789/0 conn(0x7fb3e00b2620 legacy=0x7fb3e00cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ddd9b700 1 -- 172.21.15.55:0/2084112183 >> v1:172.21.15.55:6789/0 conn(0x7fb3e00b29f0 legacy=0x7fb3e00c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3dd59a700 1 -- 172.21.15.55:0/2084112183 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509620460 0 0) 0x7fb3e00cc970 con 0x7fb3e00b29f0 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ddd9b700 1 -- 172.21.15.55:0/2084112183 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00cc320 con 0x7fb3e00cd3c0 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.321+0000 7fb3ddd9b700 1 --2- 172.21.15.55:0/2084112183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00ceaa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80098e0 tx=0x7fb3c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faed025ad0bb12d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3dd59a700 1 -- 172.21.15.55:0/2084112183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8009e80 con 0x7fb3e00cd3c0 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3dd59a700 1 -- 172.21.15.55:0/2084112183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c800b860 con 0x7fb3e00cd3c0 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3dd59a700 1 -- 172.21.15.55:0/2084112183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800bbe0 con 0x7fb3e00cd3c0 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 -- 172.21.15.55:0/2084112183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00cd3c0 msgr2=0x7fb3e00ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2084112183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00ceaa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80098e0 tx=0x7fb3c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 -- 172.21.15.55:0/2084112183 shutdown_connections 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2084112183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00ceaa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 -- 172.21.15.55:0/2084112183 >> 172.21.15.55:0/2084112183 conn(0x7fb3e0099520 msgr2=0x7fb3e006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 -- 172.21.15.55:0/2084112183 shutdown_connections 2023-10-06T11:15:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.322+0000 7fb3df59e700 1 -- 172.21.15.55:0/2084112183 wait complete. 2023-10-06T11:15:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.323+0000 7fb3df59e700 1 Processor -- start 2023-10-06T11:15:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.323+0000 7fb3df59e700 1 -- start start 2023-10-06T11:15:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 0x7fb3e0153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3e00b29f0 0x7fb3e015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e015b5a0 con 0x7fb3e00b2620 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e0153cd0 con 0x7fb3e00cd3c0 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e015baf0 con 0x7fb3e00b29f0 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 0x7fb3e0153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 0x7fb3e0153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46980/0 (socket says 172.21.15.55:46980) 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 -- 172.21.15.55:0/2035459177 learned_addr learned my addr 172.21.15.55:0/2035459177 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3ddd9b700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3e00b29f0 0x7fb3e015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3ded9d700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 -- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3e00b29f0 msgr2=0x7fb3e015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3e00b29f0 0x7fb3e015bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 -- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3e00cd3c0 msgr2=0x7fb3e00c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 -- 172.21.15.55:0/2035459177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8009420 con 0x7fb3e00b2620 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3ddd9b700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3e00b29f0 0x7fb3e015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3ded9d700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3de59c700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 0x7fb3e0153790 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800c540 tx=0x7fb3d8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8011590 con 0x7fb3e00b2620 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d80116f0 con 0x7fb3e00b2620 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e015c4c0 con 0x7fb3e00b2620 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8011ab0 con 0x7fb3e00b2620 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.324+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e00b4210 con 0x7fb3e00b2620 2023-10-06T11:15:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.326+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e005f230 con 0x7fb3e00b2620 2023-10-06T11:15:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.326+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3d801b3b0 con 0x7fb3e00b2620 2023-10-06T11:15:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.327+0000 7fb3d67fc700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb3c0066f30 0x7fb3c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.327+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb3d8083920 con 0x7fb3e00b2620 2023-10-06T11:15:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.327+0000 7fb3ddd9b700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb3c0066f30 0x7fb3c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.327+0000 7fb3ddd9b700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb3c0066f30 0x7fb3c00693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00cd7c0 tx=0x7fb3c8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.331+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3d8050cf0 con 0x7fb3e00b2620 2023-10-06T11:15:08.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.524+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb3e00cc600 con 0x7fb3e00b2620 2023-10-06T11:15:08.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.524+0000 7fb3d67fc700 1 -- 172.21.15.55:0/2035459177 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb3d8017070 con 0x7fb3e00b2620 2023-10-06T11:15:08.526 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:15:08.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.526+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb3c0066f30 msgr2=0x7fb3c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.526+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb3c0066f30 0x7fb3c00693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00cd7c0 tx=0x7fb3c8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.526+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 msgr2=0x7fb3e0153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.526+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 0x7fb3e0153790 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800c540 tx=0x7fb3d8001070 comp rx=0 tx=0).stop 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 shutdown_connections 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb3c0066f30 0x7fb3c00693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e00b2620 0x7fb3e0153790 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3e00cd3c0 0x7fb3e00c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 --2- 172.21.15.55:0/2035459177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3e00b29f0 0x7fb3e015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 >> 172.21.15.55:0/2035459177 conn(0x7fb3e0099520 msgr2=0x7fb3e0068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 shutdown_connections 2023-10-06T11:15:08.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.527+0000 7fb3df59e700 1 -- 172.21.15.55:0/2035459177 wait complete. 2023-10-06T11:15:08.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:15:08.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:08.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:08.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.717+0000 7fd1eb4fc700 1 Processor -- start 2023-10-06T11:15:08.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.717+0000 7fd1eb4fc700 1 -- start start 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1eb4fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1eb4fc700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e40cecf0 con 0x7fd1e40ad210 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1eb4fc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e40cefd0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1eb4fc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e40cca90 con 0x7fd1e415db10 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1e9298700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1e40ad210 0x7fd1e415d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46538/0 (socket says 172.21.15.55:46538) 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1e9298700 1 -- 172.21.15.55:0/1689364751 learned_addr learned my addr 172.21.15.55:0/1689364751 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1e8a97700 1 --2- 172.21.15.55:0/1689364751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831566390 0 0) 0x7fd1e40cecf0 con 0x7fd1e40ad210 2023-10-06T11:15:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d0003570 con 0x7fd1e40ad210 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176021711 0 0) 0x7fd1e40cefd0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e40cecf0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1e8a97700 1 -- 172.21.15.55:0/1689364751 >> v1:172.21.15.142:6789/0 conn(0x7fd1e40ad5e0 legacy=0x7fd1e40ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091961131 0 0) 0x7fd1d0003570 con 0x7fd1e40ad210 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1e8a97700 1 -- 172.21.15.55:0/1689364751 >> v1:172.21.15.55:6789/0 conn(0x7fd1e40ad210 legacy=0x7fd1e415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.718+0000 7fd1e8a97700 1 -- 172.21.15.55:0/1689364751 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40ccd70 con 0x7fd1e415db10 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1e8a97700 1 --2- 172.21.15.55:0/1689364751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40cd290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009910 tx=0x7fd1d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26ba1c50ee4a4d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4011630 con 0x7fd1e415db10 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d4011790 con 0x7fd1e415db10 2023-10-06T11:15:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1dbfff700 1 -- 172.21.15.55:0/1689364751 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4011b10 con 0x7fd1e415db10 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/1689364751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 msgr2=0x7fd1e40cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/1689364751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40cd290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009910 tx=0x7fd1d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/1689364751 shutdown_connections 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/1689364751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40cd290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/1689364751 >> 172.21.15.55:0/1689364751 conn(0x7fd1e4067d90 msgr2=0x7fd1e40ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/1689364751 shutdown_connections 2023-10-06T11:15:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.719+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/1689364751 wait complete. 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.720+0000 7fd1eb4fc700 1 Processor -- start 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.720+0000 7fd1eb4fc700 1 -- start start 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1eb4fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1e40ad210 0x7fd1e40c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1eb4fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 0x7fd1e40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1eb4fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1eb4fc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e40c3750 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1eb4fc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e416ddf0 con 0x7fd1e40ad210 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1eb4fc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e40c5740 con 0x7fd1e415db10 2023-10-06T11:15:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1e8a97700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 0x7fd1e40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1e8a97700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 0x7fd1e40afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46988/0 (socket says 172.21.15.55:46988) 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.721+0000 7fd1e8a97700 1 -- 172.21.15.55:0/871475869 learned_addr learned my addr 172.21.15.55:0/871475869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e9298700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1e40ad210 0x7fd1e40c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e9a99700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e8a97700 1 -- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 msgr2=0x7fd1e40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e8a97700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e8a97700 1 -- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1e40ad210 msgr2=0x7fd1e40c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e8a97700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1e40ad210 0x7fd1e40c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e8a97700 1 -- 172.21.15.55:0/871475869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009420 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e9298700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1e40ad210 0x7fd1e40c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1e8a97700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 0x7fd1e40afd50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40091e0 tx=0x7fd1d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d401f070 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d4000bc0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e40c5a20 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4025420 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.722+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e40c5fe0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.723+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e416dff0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.724+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1d4023070 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.724+0000 7fd1d97fa700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd1c8066f30 0x7fd1c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.724+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd1d40858f0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.724+0000 7fd1e9298700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd1c8066f30 0x7fd1c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.725+0000 7fd1e9298700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd1c8066f30 0x7fd1c80693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.728+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1e416dff0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.921+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1e416dff0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.922+0000 7fd1d97fa700 1 -- 172.21.15.55:0/871475869 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd1e416dff0 con 0x7fd1e40ad5e0 2023-10-06T11:15:08.923 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:08.923 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:08.924 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:15:08.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd1c8066f30 msgr2=0x7fd1c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd1c8066f30 0x7fd1c80693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0009040 comp rx=0 tx=0).stop 2023-10-06T11:15:08.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 msgr2=0x7fd1e40afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 0x7fd1e40afd50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40091e0 tx=0x7fd1d4017000 comp rx=0 tx=0).stop 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 shutdown_connections 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd1c8066f30 0x7fd1c80693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1e415db10 0x7fd1e40b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1e40ad210 0x7fd1e40c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.923+0000 7fd1eb4fc700 1 --2- 172.21.15.55:0/871475869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e40ad5e0 0x7fd1e40afd50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.924+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 >> 172.21.15.55:0/871475869 conn(0x7fd1e4067d90 msgr2=0x7fd1e40ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.924+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 shutdown_connections 2023-10-06T11:15:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:08.924+0000 7fd1eb4fc700 1 -- 172.21.15.55:0/871475869 wait complete. 2023-10-06T11:15:08.937 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:15:08.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:15:09.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.100+0000 7f9d0d705700 1 Processor -- start 2023-10-06T11:15:09.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.100+0000 7f9d0d705700 1 -- start start 2023-10-06T11:15:09.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0d705700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9d08159360 0x7f9d080b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0d705700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159730 0x7f9d080b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0d705700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d080ab1c0 con 0x7f9d080b4280 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0d705700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d080b4700 con 0x7f9d08159360 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0d705700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080b1620 con 0x7f9d08159730 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d07fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9d08159360 0x7f9d080b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d077fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159730 0x7f9d080b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0cf04700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9d080b4280 0x7f9d080cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:60846/0 (socket says 172.21.15.55:60846) 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.101+0000 7f9d0cf04700 1 -- 172.21.15.55:0/3339494235 learned_addr learned my addr 172.21.15.55:0/3339494235 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d077fe700 1 -- 172.21.15.55:0/3339494235 >> v2:172.21.15.142:3300/0 conn(0x7f9d08159360 msgr2=0x7f9d080b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d077fe700 1 --2- 172.21.15.55:0/3339494235 >> v2:172.21.15.142:3300/0 conn(0x7f9d08159360 0x7f9d080b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d077fe700 1 -- 172.21.15.55:0/3339494235 >> v1:172.21.15.142:6789/0 conn(0x7f9d080b4280 legacy=0x7f9d080cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d077fe700 1 -- 172.21.15.55:0/3339494235 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080b0a10 con 0x7f9d08159730 2023-10-06T11:15:09.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d07fff700 1 --2- 172.21.15.55:0/3339494235 >> v2:172.21.15.142:3300/0 conn(0x7f9d08159360 0x7f9d080b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:09.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d077fe700 1 --2- 172.21.15.55:0/3339494235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159730 0x7f9d080b3d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80098e0 tx=0x7f9cf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a4aab47af63a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d06ffd700 1 -- 172.21.15.55:0/3339494235 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800b6d0 con 0x7f9d08159730 2023-10-06T11:15:09.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d06ffd700 1 -- 172.21.15.55:0/3339494235 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800b830 con 0x7f9d08159730 2023-10-06T11:15:09.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d06ffd700 1 -- 172.21.15.55:0/3339494235 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800bbd0 con 0x7f9d08159730 2023-10-06T11:15:09.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d0d705700 1 -- 172.21.15.55:0/3339494235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159730 msgr2=0x7f9d080b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d0d705700 1 --2- 172.21.15.55:0/3339494235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159730 0x7f9d080b3d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80098e0 tx=0x7f9cf80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d0d705700 1 -- 172.21.15.55:0/3339494235 shutdown_connections 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d0d705700 1 --2- 172.21.15.55:0/3339494235 >> v2:172.21.15.142:3300/0 conn(0x7f9d08159360 0x7f9d080b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d0d705700 1 --2- 172.21.15.55:0/3339494235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159730 0x7f9d080b3d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.102+0000 7f9d0d705700 1 -- 172.21.15.55:0/3339494235 >> 172.21.15.55:0/3339494235 conn(0x7f9d08099580 msgr2=0x7f9d0806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.103+0000 7f9d0d705700 1 -- 172.21.15.55:0/3339494235 shutdown_connections 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.103+0000 7f9d0d705700 1 -- 172.21.15.55:0/3339494235 wait complete. 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 Processor -- start 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 -- start start 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 0x7f9d08153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159360 0x7f9d08169b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d08159730 0x7f9d0816a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08152400 con 0x7f9d080b4280 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d081526e0 con 0x7f9d08159730 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.104+0000 7f9d0d705700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d081529c0 con 0x7f9d08159360 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 0x7f9d08153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 0x7f9d08153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46994/0 (socket says 172.21.15.55:46994) 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 -- 172.21.15.55:0/1776305053 learned_addr learned my addr 172.21.15.55:0/1776305053 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d077fe700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159360 0x7f9d08169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d0cf04700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d08159730 0x7f9d0816a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 -- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159360 msgr2=0x7f9d08169b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159360 0x7f9d08169b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 -- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d08159730 msgr2=0x7f9d0816a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d08159730 0x7f9d0816a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 -- 172.21.15.55:0/1776305053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009420 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d0cf04700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d08159730 0x7f9d0816a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d07fff700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 0x7f9d08153350 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000ec80 tx=0x7f9cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000c8f0 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf8009420 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000ca50 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000cdd0 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.105+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d08153890 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.106+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0814e190 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.107+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cf0013680 con 0x7f9d080b4280 2023-10-06T11:15:09.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.107+0000 7f9cfffff700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce8066f30 0x7f9ce80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.107+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9cf0084850 con 0x7f9d080b4280 2023-10-06T11:15:09.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.107+0000 7f9d077fe700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce8066f30 0x7f9ce80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.108+0000 7f9d077fe700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce8066f30 0x7f9ce80693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80093f0 tx=0x7f9cf8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.111+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cf0051b70 con 0x7f9d080b4280 2023-10-06T11:15:09.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:09.304+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9d0805f230 con 0x7f9d080b4280 2023-10-06T11:15:10.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.076+0000 7f9cfffff700 1 -- 172.21.15.55:0/1776305053 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9cf00170b0 con 0x7f9d080b4280 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce8066f30 msgr2=0x7f9ce80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce8066f30 0x7f9ce80693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80093f0 tx=0x7f9cf8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 msgr2=0x7f9d08153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 0x7f9d08153350 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000ec80 tx=0x7f9cf00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 shutdown_connections 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9ce8066f30 0x7f9ce80693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d080b4280 0x7f9d08153350 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d08159730 0x7f9d0816a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 --2- 172.21.15.55:0/1776305053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d08159360 0x7f9d08169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.080+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 >> 172.21.15.55:0/1776305053 conn(0x7f9d08099580 msgr2=0x7f9d0809acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.081+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 shutdown_connections 2023-10-06T11:15:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.081+0000 7f9d0d705700 1 -- 172.21.15.55:0/1776305053 wait complete. 2023-10-06T11:15:10.085 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:15:10.100 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:15:10.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.231+0000 7fb2617d6700 1 Processor -- start 2023-10-06T11:15:10.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.231+0000 7fb2617d6700 1 -- start start 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb2617d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb25c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb2617d6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c0cf5d0 con 0x7fb25c1598a0 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb2617d6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c0cf8b0 con 0x7fb25c1594d0 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb2617d6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0cfb90 con 0x7fb25c0cbc70 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb25a7fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb25c1598a0 0x7fb25c0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46546/0 (socket says 172.21.15.55:46546) 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb25a7fc700 1 -- 172.21.15.55:0/880329468 learned_addr learned my addr 172.21.15.55:0/880329468 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:10.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb25b7fe700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb25c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927146450 0 0) 0x7fb25c0cf5d0 con 0x7fb25c1598a0 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb244003570 con 0x7fb25c1598a0 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1962753119 0 0) 0x7fb244003570 con 0x7fb25c1598a0 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 msgr2=0x7fb25c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb25c0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 >> v1:172.21.15.142:6789/0 conn(0x7fb25c1594d0 legacy=0x7fb25c0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c0cfe70 con 0x7fb25c1598a0 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fb250001470 con 0x7fb25c1598a0 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 >> v1:172.21.15.55:6789/0 conn(0x7fb25c1598a0 legacy=0x7fb25c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.232+0000 7fb259ffb700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb244003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb244004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb244004d50 0x7fb2440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0cfb90 con 0x7fb244003fd0 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24400bb40 con 0x7fb244004d50 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24400bd00 con 0x7fb25c0cbc70 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb244004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25affd700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb244003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25b7fe700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb244004d50 0x7fb2440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 -- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 msgr2=0x7fb244003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb244003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 -- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb244004d50 msgr2=0x7fb2440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb244004d50 0x7fb2440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 -- 172.21.15.55:0/880329468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244003570 con 0x7fb244003fd0 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25affd700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0cbc70 0x7fb244003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb244004810 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb25c067cf0 tx=0x7fb250001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c68c3b0f280940 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000cc00 con 0x7fb244003fd0 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000cd80 con 0x7fb244003fd0 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.233+0000 7fb259ffb700 1 -- 172.21.15.55:0/880329468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250005b70 con 0x7fb244003fd0 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb2617d6700 1 -- 172.21.15.55:0/880329468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 msgr2=0x7fb244004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb2617d6700 1 --2- 172.21.15.55:0/880329468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb244004810 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb25c067cf0 tx=0x7fb250001e70 comp rx=0 tx=0).stop 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb25b7fe700 1 -- 172.21.15.55:0/880329468 reap_dead start 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb2617d6700 1 -- 172.21.15.55:0/880329468 shutdown_connections 2023-10-06T11:15:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb2617d6700 1 -- 172.21.15.55:0/880329468 >> 172.21.15.55:0/880329468 conn(0x7fb25c089e50 msgr2=0x7fb25c099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb2617d6700 1 -- 172.21.15.55:0/880329468 shutdown_connections 2023-10-06T11:15:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.234+0000 7fb2617d6700 1 -- 172.21.15.55:0/880329468 wait complete. 2023-10-06T11:15:10.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.235+0000 7fb2617d6700 1 Processor -- start 2023-10-06T11:15:10.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.235+0000 7fb2617d6700 1 -- start start 2023-10-06T11:15:10.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb2617d6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb25c15c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb2617d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c16e120 0x7fb25c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb2617d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0b3e80 0x7fb25c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb2617d6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c14cca0 con 0x7fb244003fd0 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb2617d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0b4860 con 0x7fb25c16e120 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb2617d6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c1583d0 con 0x7fb25c0b3e80 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb25c15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb25c15c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47006/0 (socket says 172.21.15.55:47006) 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 -- 172.21.15.55:0/3709665665 learned_addr learned my addr 172.21.15.55:0/3709665665 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c16e120 0x7fb25c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25b7fe700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0b3e80 0x7fb25c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 -- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0b3e80 msgr2=0x7fb25c0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0b3e80 0x7fb25c0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 -- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c16e120 msgr2=0x7fb25c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c16e120 0x7fb25c157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 -- 172.21.15.55:0/3709665665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c16a1b0 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.236+0000 7fb25affd700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb25c15c590 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00fc50 tx=0x7fb24c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.237+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00d7d0 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.237+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c00d930 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.237+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c16a490 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.237+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00dcd0 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.237+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c169ea0 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.238+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c063c20 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.238+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb24c013600 con 0x7fb244003fd0 2023-10-06T11:15:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.239+0000 7fb242ffd700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb248066f30 0x7fb2480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.239+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fb24c084840 con 0x7fb244003fd0 2023-10-06T11:15:10.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.239+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb248066f30 0x7fb2480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.239+0000 7fb25a7fc700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb248066f30 0x7fb2480693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb25c067cf0 tx=0x7fb250015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:10.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.243+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb24c0519f0 con 0x7fb244003fd0 2023-10-06T11:15:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:10.438+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb25c064a90 con 0x7fb244003fd0 2023-10-06T11:15:11.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.080+0000 7fb242ffd700 1 -- 172.21.15.55:0/3709665665 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb24c055010 con 0x7fb244003fd0 2023-10-06T11:15:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.085+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb248066f30 msgr2=0x7fb2480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.085+0000 7fb2617d6700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb248066f30 0x7fb2480693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb25c067cf0 tx=0x7fb250015000 comp rx=0 tx=0).stop 2023-10-06T11:15:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.085+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 msgr2=0x7fb25c15c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.085+0000 7fb2617d6700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb25c15c590 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00fc50 tx=0x7fb24c009040 comp rx=0 tx=0).stop 2023-10-06T11:15:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.086+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 shutdown_connections 2023-10-06T11:15:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.086+0000 7fb2617d6700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb248066f30 0x7fb2480693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.086+0000 7fb2617d6700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb244003fd0 0x7fb25c15c590 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.086+0000 7fb2617d6700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb25c0b3e80 0x7fb25c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.086+0000 7fb2617d6700 1 --2- 172.21.15.55:0/3709665665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c16e120 0x7fb25c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.086+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 >> 172.21.15.55:0/3709665665 conn(0x7fb25c089e50 msgr2=0x7fb25c155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.087+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 shutdown_connections 2023-10-06T11:15:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.088+0000 7fb2617d6700 1 -- 172.21.15.55:0/3709665665 wait complete. 2023-10-06T11:15:11.100 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:15:11.113 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:15:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.236+0000 7fca03933700 1 Processor -- start 2023-10-06T11:15:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.236+0000 7fca03933700 1 -- start start 2023-10-06T11:15:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca03933700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9fc159470 0x7fc9fc0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca03933700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159840 0x7fc9fc0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca03933700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9fc0c6170 0x7fc9fc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca03933700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc0cbb80 con 0x7fc9fc0c6170 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca03933700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc0c6f00 con 0x7fc9fc159470 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca03933700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0cb530 con 0x7fc9fc159840 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9fc0c6170 0x7fc9fc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9fc0c6170 0x7fc9fc0c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47010/0 (socket says 172.21.15.55:47010) 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 -- 172.21.15.55:0/373537002 learned_addr learned my addr 172.21.15.55:0/373537002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca016cf700 1 --2- 172.21.15.55:0/373537002 >> v2:172.21.15.142:3300/0 conn(0x7fc9fc159470 0x7fc9fc0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca00ece700 1 --2- 172.21.15.55:0/373537002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159840 0x7fc9fc0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 -- 172.21.15.55:0/373537002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159840 msgr2=0x7fc9fc0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 --2- 172.21.15.55:0/373537002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159840 0x7fc9fc0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 -- 172.21.15.55:0/373537002 >> v2:172.21.15.142:3300/0 conn(0x7fc9fc159470 msgr2=0x7fc9fc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 --2- 172.21.15.55:0/373537002 >> v2:172.21.15.142:3300/0 conn(0x7fc9fc159470 0x7fc9fc0ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.237+0000 7fca01ed0700 1 -- 172.21.15.55:0/373537002 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0cb810 con 0x7fc9fc0c6170 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca01ed0700 1 --2- 172.21.15.55:0/373537002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc0c65f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc089d50 tx=0x7fc9ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d547d81d6b9bb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fc9fbfff700 1 -- 172.21.15.55:0/373537002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec00e070 con 0x7fc9fc0c6170 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fc9fbfff700 1 -- 172.21.15.55:0/373537002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec00ba50 con 0x7fc9fc0c6170 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fc9fbfff700 1 -- 172.21.15.55:0/373537002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0092e0 con 0x7fc9fc0c6170 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 -- 172.21.15.55:0/373537002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc0c6170 msgr2=0x7fc9fc0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 --2- 172.21.15.55:0/373537002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc0c65f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc089d50 tx=0x7fc9ec009840 comp rx=0 tx=0).stop 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 -- 172.21.15.55:0/373537002 shutdown_connections 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 --2- 172.21.15.55:0/373537002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc0c65f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 --2- 172.21.15.55:0/373537002 >> v2:172.21.15.142:3300/0 conn(0x7fc9fc159470 0x7fc9fc0ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 --2- 172.21.15.55:0/373537002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159840 0x7fc9fc0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 -- 172.21.15.55:0/373537002 >> 172.21.15.55:0/373537002 conn(0x7fc9fc0996e0 msgr2=0x7fc9fc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:11.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.238+0000 7fca03933700 1 -- 172.21.15.55:0/373537002 shutdown_connections 2023-10-06T11:15:11.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.239+0000 7fca03933700 1 -- 172.21.15.55:0/373537002 wait complete. 2023-10-06T11:15:11.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.240+0000 7fca03933700 1 Processor -- start 2023-10-06T11:15:11.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.240+0000 7fca03933700 1 -- start start 2023-10-06T11:15:11.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.240+0000 7fca03933700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc09dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.240+0000 7fca03933700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159470 0x7fc9fc153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.240+0000 7fca03933700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 0x7fc9fc0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca03933700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc159f80 con 0x7fc9fc159840 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca03933700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc153590 con 0x7fc9fc0c6170 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca03933700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0c8790 con 0x7fc9fc159470 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 0x7fc9fc0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 0x7fc9fc0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47016/0 (socket says 172.21.15.55:47016) 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 -- 172.21.15.55:0/412152696 learned_addr learned my addr 172.21.15.55:0/412152696 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca00ece700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159470 0x7fc9fc153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca016cf700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc09dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 -- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159470 msgr2=0x7fc9fc153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159470 0x7fc9fc153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 -- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc0c6170 msgr2=0x7fc9fc09dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc09dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 -- 172.21.15.55:0/412152696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec009ae0 con 0x7fc9fc159840 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca016cf700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc09dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca01ed0700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 0x7fc9fc0c7f10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc067c70 tx=0x7fc9ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0032f0 con 0x7fc9fc159840 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec008e80 con 0x7fc9fc159840 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc0c8a70 con 0x7fc9fc159840 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec026690 con 0x7fc9fc159840 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.241+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc159c10 con 0x7fc9fc159840 2023-10-06T11:15:11.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.242+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc15a130 con 0x7fc9fc159840 2023-10-06T11:15:11.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.243+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9ec003040 con 0x7fc9fc159840 2023-10-06T11:15:11.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.243+0000 7fc9f97fa700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc9e8066f30 0x7fc9e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.243+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fc9ec086140 con 0x7fc9fc159840 2023-10-06T11:15:11.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.244+0000 7fca016cf700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc9e8066f30 0x7fc9e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.244+0000 7fca016cf700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc9e8066f30 0x7fc9e80693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006aa0 tx=0x7fc9f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:11.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.248+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9fc15a130 con 0x7fc9fc159840 2023-10-06T11:15:11.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:11.487+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc9fc069d80 con 0x7fc9fc159840 2023-10-06T11:15:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.107+0000 7fc9f97fa700 1 -- 172.21.15.55:0/412152696 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc9ec053170 con 0x7fc9fc159840 2023-10-06T11:15:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc9e8066f30 msgr2=0x7fc9e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc9e8066f30 0x7fc9e80693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006aa0 tx=0x7fc9f4008040 comp rx=0 tx=0).stop 2023-10-06T11:15:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 msgr2=0x7fc9fc0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 0x7fc9fc0c7f10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc067c70 tx=0x7fc9ec018000 comp rx=0 tx=0).stop 2023-10-06T11:15:12.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 shutdown_connections 2023-10-06T11:15:12.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc9e8066f30 0x7fc9e80693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9fc159840 0x7fc9fc0c7f10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9fc0c6170 0x7fc9fc09dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 --2- 172.21.15.55:0/412152696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9fc159470 0x7fc9fc153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.111+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 >> 172.21.15.55:0/412152696 conn(0x7fc9fc0996e0 msgr2=0x7fc9fc1538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.113+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 shutdown_connections 2023-10-06T11:15:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.113+0000 7fca03933700 1 -- 172.21.15.55:0/412152696 wait complete. 2023-10-06T11:15:12.116 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 10 and data pool 11 2023-10-06T11:15:12.129 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.249+0000 7fd88cdb6700 1 Processor -- start 2023-10-06T11:15:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.249+0000 7fd88cdb6700 1 -- start start 2023-10-06T11:15:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd88cdb6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8880ca370 0x7fd888158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd88cdb6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8880adb60 0x7fd8880ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd88cdb6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd888157de0 con 0x7fd8880ce6d0 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd88cdb6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880cbb90 con 0x7fd8880ca370 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd88cdb6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880ceb10 con 0x7fd8880adb60 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd88659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8880ca370 0x7fd888158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd886d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8880ce6d0 0x7fd88815aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46556/0 (socket says 172.21.15.55:46556) 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd886d9d700 1 -- 172.21.15.55:0/2840153584 learned_addr learned my addr 172.21.15.55:0/2840153584 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.250+0000 7fd885d9b700 1 --2- 172.21.15.55:0/2840153584 >> v2:172.21.15.142:3300/0 conn(0x7fd8880adb60 0x7fd8880ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88659c700 1 -- 172.21.15.55:0/2840153584 >> v2:172.21.15.142:3300/0 conn(0x7fd8880adb60 msgr2=0x7fd8880ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88659c700 1 --2- 172.21.15.55:0/2840153584 >> v2:172.21.15.142:3300/0 conn(0x7fd8880adb60 0x7fd8880ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88659c700 1 -- 172.21.15.55:0/2840153584 >> v1:172.21.15.55:6789/0 conn(0x7fd8880ce6d0 legacy=0x7fd88815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88659c700 1 -- 172.21.15.55:0/2840153584 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880cb5d0 con 0x7fd8880ca370 2023-10-06T11:15:12.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88559a700 1 -- 172.21.15.55:0/2840153584 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847249132 0 0) 0x7fd888157de0 con 0x7fd8880ce6d0 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd885d9b700 1 --2- 172.21.15.55:0/2840153584 >> v2:172.21.15.142:3300/0 conn(0x7fd8880adb60 0x7fd8880ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88659c700 1 --2- 172.21.15.55:0/2840153584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ca370 0x7fd888158270 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd88806c350 tx=0x7fd880009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa356ea92b168c49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88559a700 1 -- 172.21.15.55:0/2840153584 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000e070 con 0x7fd8880ca370 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88559a700 1 -- 172.21.15.55:0/2840153584 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000bc30 con 0x7fd8880ca370 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88559a700 1 -- 172.21.15.55:0/2840153584 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880012430 con 0x7fd8880ca370 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2840153584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ca370 msgr2=0x7fd888158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.251+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2840153584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ca370 0x7fd888158270 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd88806c350 tx=0x7fd880009780 comp rx=0 tx=0).stop 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.252+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2840153584 shutdown_connections 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.252+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2840153584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ca370 0x7fd888158270 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.252+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2840153584 >> v2:172.21.15.142:3300/0 conn(0x7fd8880adb60 0x7fd8880ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.252+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2840153584 >> 172.21.15.55:0/2840153584 conn(0x7fd8880707d0 msgr2=0x7fd888070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.252+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2840153584 shutdown_connections 2023-10-06T11:15:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.252+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2840153584 wait complete. 2023-10-06T11:15:12.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 Processor -- start 2023-10-06T11:15:12.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 -- start start 2023-10-06T11:15:12.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8880adb60 0x7fd8880c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8880ca370 0x7fd8880b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 0x7fd8880ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880686c0 con 0x7fd8880ce6d0 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888068960 con 0x7fd8880adb60 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.253+0000 7fd88cdb6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b1a60 con 0x7fd8880ca370 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 0x7fd8880ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 0x7fd8880ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47038/0 (socket says 172.21.15.55:47038) 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 -- 172.21.15.55:0/2932700620 learned_addr learned my addr 172.21.15.55:0/2932700620 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd88659c700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8880adb60 0x7fd8880c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd885d9b700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8880ca370 0x7fd8880b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 -- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8880ca370 msgr2=0x7fd8880b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8880ca370 0x7fd8880b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 -- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8880adb60 msgr2=0x7fd8880c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8880adb60 0x7fd8880c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 -- 172.21.15.55:0/2932700620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880009a20 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd886d9d700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 0x7fd8880ca740 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c7e0 tx=0x7fd878007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878005c00 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878005d60 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880b1d40 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878004a80 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.254+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd888152e10 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.255+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888068af0 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.255+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd878005030 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.256+0000 7fd87e7fc700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.256+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd878083c40 con 0x7fd8880ce6d0 2023-10-06T11:15:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.256+0000 7fd88659c700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.256+0000 7fd88659c700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd88806c350 tx=0x7fd880019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.260+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd87804b5a0 con 0x7fd8880ce6d0 2023-10-06T11:15:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.455+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd888064a90 con 0x7fd8880ce6d0 2023-10-06T11:15:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.456+0000 7fd87e7fc700 1 -- 172.21.15.55:0/2932700620 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fd878050c10 con 0x7fd8880ce6d0 2023-10-06T11:15:12.458 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:12.458 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:11.488826+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.335026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.468577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:12.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.458+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 msgr2=0x7fd8680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.458+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd88806c350 tx=0x7fd880019000 comp rx=0 tx=0).stop 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 msgr2=0x7fd8880ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 0x7fd8880ca740 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c7e0 tx=0x7fd878007d90 comp rx=0 tx=0).stop 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 shutdown_connections 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8880ce6d0 0x7fd8880ca740 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8880adb60 0x7fd8880c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 --2- 172.21.15.55:0/2932700620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8880ca370 0x7fd8880b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 >> 172.21.15.55:0/2932700620 conn(0x7fd8880707d0 msgr2=0x7fd888153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 shutdown_connections 2023-10-06T11:15:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.459+0000 7fd88cdb6700 1 -- 172.21.15.55:0/2932700620 wait complete. 2023-10-06T11:15:12.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:12.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.589+0000 7fd31cf1b700 1 Processor -- start 2023-10-06T11:15:12.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.589+0000 7fd31cf1b700 1 -- start start 2023-10-06T11:15:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31cf1b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3180ccb50 0x7fd31806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31cf1b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31cf1b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd318067af0 0x7fd3180cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31cf1b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd318067f70 con 0x7fd3180ccb50 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31cf1b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd318158480 con 0x7fd318067af0 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31cf1b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180ccf20 con 0x7fd3180c77c0 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.590+0000 7fd31659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3180ccb50 0x7fd31806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3180ccb50 0x7fd31806eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47044/0 (socket says 172.21.15.55:47044) 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 -- 172.21.15.55:0/1368648936 learned_addr learned my addr 172.21.15.55:0/1368648936 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd315d9b700 1 --2- 172.21.15.55:0/1368648936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd316d9d700 1 --2- 172.21.15.55:0/1368648936 >> v2:172.21.15.142:3300/0 conn(0x7fd318067af0 0x7fd3180cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 -- 172.21.15.55:0/1368648936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 msgr2=0x7fd3180675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:12.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 --2- 172.21.15.55:0/1368648936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 -- 172.21.15.55:0/1368648936 >> v2:172.21.15.142:3300/0 conn(0x7fd318067af0 msgr2=0x7fd3180cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 --2- 172.21.15.55:0/1368648936 >> v2:172.21.15.142:3300/0 conn(0x7fd318067af0 0x7fd3180cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 -- 172.21.15.55:0/1368648936 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180c7f60 con 0x7fd3180ccb50 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31659c700 1 --2- 172.21.15.55:0/1368648936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3180ccb50 0x7fd31806eed0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd31806e410 tx=0x7fd308009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a79341d6cc1377 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31559a700 1 -- 172.21.15.55:0/1368648936 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800e070 con 0x7fd3180ccb50 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31559a700 1 -- 172.21.15.55:0/1368648936 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800ba50 con 0x7fd3180ccb50 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.591+0000 7fd31559a700 1 -- 172.21.15.55:0/1368648936 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3080092e0 con 0x7fd3180ccb50 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 -- 172.21.15.55:0/1368648936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3180ccb50 msgr2=0x7fd31806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/1368648936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3180ccb50 0x7fd31806eed0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd31806e410 tx=0x7fd308009840 comp rx=0 tx=0).stop 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 -- 172.21.15.55:0/1368648936 shutdown_connections 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/1368648936 >> v2:172.21.15.142:3300/0 conn(0x7fd318067af0 0x7fd3180cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/1368648936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3180ccb50 0x7fd31806eed0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/1368648936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 -- 172.21.15.55:0/1368648936 >> 172.21.15.55:0/1368648936 conn(0x7fd318069180 msgr2=0x7fd3180cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 -- 172.21.15.55:0/1368648936 shutdown_connections 2023-10-06T11:15:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.592+0000 7fd31cf1b700 1 -- 172.21.15.55:0/1368648936 wait complete. 2023-10-06T11:15:12.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.593+0000 7fd31cf1b700 1 Processor -- start 2023-10-06T11:15:12.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.593+0000 7fd31cf1b700 1 -- start start 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 0x7fd318165150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180ccb50 0x7fd31816b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b1260 con 0x7fd318067af0 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180af160 con 0x7fd3180ccb50 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180af440 con 0x7fd3180c77c0 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 0x7fd318165150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 0x7fd318165150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47058/0 (socket says 172.21.15.55:47058) 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 -- 172.21.15.55:0/2032616618 learned_addr learned my addr 172.21.15.55:0/2032616618 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd315d9b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd316d9d700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180ccb50 0x7fd31816b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 -- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 msgr2=0x7fd3180ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 -- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180ccb50 msgr2=0x7fd31816b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180ccb50 0x7fd31816b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 -- 172.21.15.55:0/2032616618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009ae0 con 0x7fd318067af0 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd315d9b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd316d9d700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180ccb50 0x7fd31816b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31659c700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 0x7fd318165150 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd308009430 tx=0x7fd308018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308008ae0 con 0x7fd318067af0 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308008c60 con 0x7fd318067af0 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308026460 con 0x7fd318067af0 2023-10-06T11:15:12.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3180af720 con 0x7fd318067af0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.594+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318165690 con 0x7fd318067af0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.595+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd318064a90 con 0x7fd318067af0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.596+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd308003040 con 0x7fd318067af0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.596+0000 7fd30e7fc700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd2f8066f30 0x7fd2f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.596+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd3080860f0 con 0x7fd318067af0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.596+0000 7fd315d9b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd2f8066f30 0x7fd2f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.597+0000 7fd315d9b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd2f8066f30 0x7fd2f80693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b2ef0 tx=0x7fd300008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.601+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd308053170 con 0x7fd318067af0 2023-10-06T11:15:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.794+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd31809aed0 con 0x7fd318067af0 2023-10-06T11:15:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.795+0000 7fd30e7fc700 1 -- 172.21.15.55:0/2032616618 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fd308056790 con 0x7fd318067af0 2023-10-06T11:15:12.797 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:12.797 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:11.488826+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.335026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.468577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:12.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd2f8066f30 msgr2=0x7fd2f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd2f8066f30 0x7fd2f80693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b2ef0 tx=0x7fd300008040 comp rx=0 tx=0).stop 2023-10-06T11:15:12.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 msgr2=0x7fd318165150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 0x7fd318165150 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd308009430 tx=0x7fd308018000 comp rx=0 tx=0).stop 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 shutdown_connections 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd2f8066f30 0x7fd2f80693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd318067af0 0x7fd318165150 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180ccb50 0x7fd31816b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 --2- 172.21.15.55:0/2032616618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180c77c0 0x7fd3180ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 >> 172.21.15.55:0/2032616618 conn(0x7fd318069180 msgr2=0x7fd3180cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.797+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 shutdown_connections 2023-10-06T11:15:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.798+0000 7fd31cf1b700 1 -- 172.21.15.55:0/2032616618 wait complete. 2023-10-06T11:15:12.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:15:12.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 Processor -- start 2023-10-06T11:15:12.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 -- start start 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effbc156370 0x7effbc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc156740 0x7effbc06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0c84a0 con 0x7effbc06e8d0 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc06ed10 con 0x7effbc156370 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.933+0000 7effc2b73700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c7890 con 0x7effbc156740 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc090f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effbc156370 0x7effbc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc1110700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7effbc06e8d0 0x7effbc06a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46572/0 (socket says 172.21.15.55:46572) 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc1110700 1 -- 172.21.15.55:0/520546511 learned_addr learned my addr 172.21.15.55:0/520546511 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effbbfff700 1 --2- 172.21.15.55:0/520546511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc156740 0x7effbc06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc090f700 1 -- 172.21.15.55:0/520546511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc156740 msgr2=0x7effbc06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc090f700 1 --2- 172.21.15.55:0/520546511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc156740 0x7effbc06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc090f700 1 -- 172.21.15.55:0/520546511 >> v1:172.21.15.55:6789/0 conn(0x7effbc06e8d0 legacy=0x7effbc06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc090f700 1 -- 172.21.15.55:0/520546511 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0c7b70 con 0x7effbc156370 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effc090f700 1 --2- 172.21.15.55:0/520546511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc06f1c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7effb4009eb0 tx=0x7effb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3162dfde5f2447c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effbb7fe700 1 -- 172.21.15.55:0/520546511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400e070 con 0x7effbc156370 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effbb7fe700 1 -- 172.21.15.55:0/520546511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400bc30 con 0x7effbc156370 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.934+0000 7effbb7fe700 1 -- 172.21.15.55:0/520546511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4012430 con 0x7effbc156370 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 -- 172.21.15.55:0/520546511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 msgr2=0x7effbc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 --2- 172.21.15.55:0/520546511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc06f1c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7effb4009eb0 tx=0x7effb4009780 comp rx=0 tx=0).stop 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 -- 172.21.15.55:0/520546511 shutdown_connections 2023-10-06T11:15:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 --2- 172.21.15.55:0/520546511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc06f1c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 --2- 172.21.15.55:0/520546511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc156740 0x7effbc06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 -- 172.21.15.55:0/520546511 >> 172.21.15.55:0/520546511 conn(0x7effbc069150 msgr2=0x7effbc0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 -- 172.21.15.55:0/520546511 shutdown_connections 2023-10-06T11:15:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.935+0000 7effc2b73700 1 -- 172.21.15.55:0/520546511 wait complete. 2023-10-06T11:15:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.936+0000 7effc2b73700 1 Processor -- start 2023-10-06T11:15:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.936+0000 7effc2b73700 1 -- start start 2023-10-06T11:15:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc2b73700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc06e8d0 0x7effbc0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc2b73700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc2b73700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effbc156740 0x7effbc158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc2b73700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc167f30 con 0x7effbc156370 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc2b73700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc168210 con 0x7effbc156740 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc2b73700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1684f0 con 0x7effbc06e8d0 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc167690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47066/0 (socket says 172.21.15.55:47066) 2023-10-06T11:15:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 -- 172.21.15.55:0/775687230 learned_addr learned my addr 172.21.15.55:0/775687230 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc090f700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc06e8d0 0x7effbc0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc1110700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effbc156740 0x7effbc158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 -- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc06e8d0 msgr2=0x7effbc0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc06e8d0 0x7effbc0cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 -- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effbc156740 msgr2=0x7effbc158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effbc156740 0x7effbc158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 -- 172.21.15.55:0/775687230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009a20 con 0x7effbc156370 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effc1110700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effbc156740 0x7effbc158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.937+0000 7effbbfff700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc167690 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7effac00c880 tx=0x7effac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.938+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011600 con 0x7effbc156370 2023-10-06T11:15:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.938+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac011760 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.938+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0c2a90 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.938+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011b00 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.938+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc167bd0 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.938+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc0c2cb0 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.939+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effac0223a0 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.939+0000 7effb8ff9700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff9c066f30 0x7eff9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.939+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6378+0+0 (secure 0 0 0) 0x7effac084810 con 0x7effbc156370 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.940+0000 7effc090f700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff9c066f30 0x7eff9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.940+0000 7effc090f700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff9c066f30 0x7eff9c0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7effb4009eb0 tx=0x7effb4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:12.944+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effac0517e0 con 0x7effbc156370 2023-10-06T11:15:13.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:13.186+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7effbc168660 con 0x7effbc156370 2023-10-06T11:15:14.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.118+0000 7effb8ff9700 1 -- 172.21.15.55:0/775687230 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7effac054e00 con 0x7effbc156370 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff9c066f30 msgr2=0x7eff9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff9c066f30 0x7eff9c0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7effb4009eb0 tx=0x7effb4017000 comp rx=0 tx=0).stop 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 msgr2=0x7effbc167690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc167690 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7effac00c880 tx=0x7effac008040 comp rx=0 tx=0).stop 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 shutdown_connections 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff9c066f30 0x7eff9c0693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effbc156740 0x7effbc158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7effbc06e8d0 0x7effbc0cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 --2- 172.21.15.55:0/775687230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc156370 0x7effbc167690 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 >> 172.21.15.55:0/775687230 conn(0x7effbc069150 msgr2=0x7effbc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:14.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 shutdown_connections 2023-10-06T11:15:14.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.121+0000 7effc2b73700 1 -- 172.21.15.55:0/775687230 wait complete. 2023-10-06T11:15:14.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:15:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.265+0000 7f9fe6291700 1 Processor -- start 2023-10-06T11:15:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.265+0000 7f9fe6291700 1 -- start start 2023-10-06T11:15:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.266+0000 7f9fe6291700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 0x7f9fe00c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.266+0000 7f9fe6291700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00cbb80 con 0x7f9fe0159470 2023-10-06T11:15:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.266+0000 7f9fe6291700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00c6f00 con 0x7f9fe0159840 2023-10-06T11:15:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.266+0000 7f9fe6291700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00cb530 con 0x7f9fe00cf090 2023-10-06T11:15:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.266+0000 7f9fdffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9fe0159470 0x7f9fe00ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46586/0 (socket says 172.21.15.55:46586) 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.266+0000 7f9fdffff700 1 -- 172.21.15.55:0/1669847884 learned_addr learned my addr 172.21.15.55:0/1669847884 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fe482e700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 0x7f9fe00c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221519708 0 0) 0x7f9fe00cbb80 con 0x7f9fe0159470 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc8003570 con 0x7f9fe0159470 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171535741 0 0) 0x7f9fc8003570 con 0x7f9fe0159470 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 msgr2=0x7f9fe00c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 0x7f9fe00c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 >> v1:172.21.15.142:6789/0 conn(0x7f9fe0159840 legacy=0x7f9fe00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00cb810 con 0x7f9fe0159470 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f9fd00015f0 con 0x7f9fe0159470 2023-10-06T11:15:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 >> v1:172.21.15.55:6789/0 conn(0x7f9fe0159470 legacy=0x7f9fe00ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fc8003a90 0x7f9fc8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8004810 0x7f9fc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 0x7f9fc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00cb530 con 0x7f9fc8003a90 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc800bb10 con 0x7f9fc8004810 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc800bcd0 con 0x7f9fe00cf090 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdffff700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fc8003a90 0x7f9fc8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdf7fe700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8004810 0x7f9fc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fe482e700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 0x7f9fc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdffff700 1 -- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 msgr2=0x7f9fc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdffff700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00cf090 0x7f9fc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdffff700 1 -- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8004810 msgr2=0x7f9fc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdffff700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8004810 0x7f9fc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdffff700 1 -- 172.21.15.55:0/1669847884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8003570 con 0x7f9fc8003a90 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.267+0000 7f9fdf7fe700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8004810 0x7f9fc8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fdffff700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fc8003a90 0x7f9fc8003e60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c300 tx=0x7f9fd0007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a15892e4f6d31d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000cc30 con 0x7f9fc8003a90 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000cdb0 con 0x7f9fc8003a90 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fdeffd700 1 -- 172.21.15.55:0/1669847884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0001de0 con 0x7f9fc8003a90 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe6291700 1 -- 172.21.15.55:0/1669847884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fc8003a90 msgr2=0x7f9fc8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe6291700 1 --2- 172.21.15.55:0/1669847884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fc8003a90 0x7f9fc8003e60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c300 tx=0x7f9fd0007920 comp rx=0 tx=0).stop 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe482e700 1 -- 172.21.15.55:0/1669847884 reap_dead start 2023-10-06T11:15:14.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe6291700 1 -- 172.21.15.55:0/1669847884 shutdown_connections 2023-10-06T11:15:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe6291700 1 -- 172.21.15.55:0/1669847884 >> 172.21.15.55:0/1669847884 conn(0x7f9fe00996e0 msgr2=0x7f9fe006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe6291700 1 -- 172.21.15.55:0/1669847884 shutdown_connections 2023-10-06T11:15:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.268+0000 7f9fe6291700 1 -- 172.21.15.55:0/1669847884 wait complete. 2023-10-06T11:15:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.269+0000 7f9fe6291700 1 Processor -- start 2023-10-06T11:15:14.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 -- start start 2023-10-06T11:15:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8003a90 0x7f9fe0141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 0x7f9fe00c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00b4970 0x7f9fe00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00b5350 con 0x7f9fe0156920 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0142480 con 0x7f9fc8003a90 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fe6291700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0156da0 con 0x7f9fe00b4970 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fdf7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 0x7f9fe00c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fdf7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 0x7f9fe00c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47076/0 (socket says 172.21.15.55:47076) 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.270+0000 7f9fdf7fe700 1 -- 172.21.15.55:0/155552203 learned_addr learned my addr 172.21.15.55:0/155552203 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdffff700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8003a90 0x7f9fe0141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fe482e700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00b4970 0x7f9fe00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdf7fe700 1 -- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00b4970 msgr2=0x7f9fe00b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdf7fe700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00b4970 0x7f9fe00b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdf7fe700 1 -- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8003a90 msgr2=0x7f9fe0141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdf7fe700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8003a90 0x7f9fe0141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdf7fe700 1 -- 172.21.15.55:0/155552203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0157080 con 0x7f9fe0156920 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fe482e700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00b4970 0x7f9fe00b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fdf7fe700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 0x7f9fe00c8c30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e870 tx=0x7f9fd4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4012590 con 0x7f9fe0156920 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd40126f0 con 0x7f9fe0156920 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe0157360 con 0x7f9fe0156920 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4012ab0 con 0x7f9fe0156920 2023-10-06T11:15:14.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.271+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe016d4d0 con 0x7f9fe0156920 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.272+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe0064a90 con 0x7f9fe0156920 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.272+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fd401d460 con 0x7f9fe0156920 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.273+0000 7f9fc7fff700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.273+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9fd4084990 con 0x7f9fe0156920 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.273+0000 7f9fdffff700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.274+0000 7f9fdffff700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0000ef0 tx=0x7f9fd0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:14.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.277+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fd40518c0 con 0x7f9fe0156920 2023-10-06T11:15:14.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:14.515+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9fe00cb1e0 con 0x7f9fe0156920 2023-10-06T11:15:15.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.129+0000 7f9fc7fff700 1 -- 172.21.15.55:0/155552203 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9fd4054ee0 con 0x7f9fe0156920 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9fcc066f30 msgr2=0x7f9fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0000ef0 tx=0x7f9fd0015000 comp rx=0 tx=0).stop 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 msgr2=0x7f9fe00c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 0x7f9fe00c8c30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400e870 tx=0x7f9fd4009040 comp rx=0 tx=0).stop 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 shutdown_connections 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fe00b4970 0x7f9fe00b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fc8003a90 0x7f9fe0141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 --2- 172.21.15.55:0/155552203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe0156920 0x7f9fe00c8c30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 >> 172.21.15.55:0/155552203 conn(0x7f9fe00996e0 msgr2=0x7f9fe00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 shutdown_connections 2023-10-06T11:15:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.131+0000 7f9fe6291700 1 -- 172.21.15.55:0/155552203 wait complete. 2023-10-06T11:15:15.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:15.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.269+0000 7f0e5d1e6700 1 Processor -- start 2023-10-06T11:15:15.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.269+0000 7f0e5d1e6700 1 -- start start 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5d1e6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5d1e6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580b0c60 con 0x7f0e580b0760 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5d1e6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580b0f40 con 0x7f0e58159560 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5d1e6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b1220 con 0x7f0e580b49a0 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5759e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0e580b0760 0x7f0e580b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35150/0 (socket says 172.21.15.55:35150) 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5759e700 1 -- 172.21.15.55:0/3100503118 learned_addr learned my addr 172.21.15.55:0/3100503118 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5659c700 1 --2- 172.21.15.55:0/3100503118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563141083 0 0) 0x7f0e580b0c60 con 0x7f0e580b0760 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003570 con 0x7f0e580b0760 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056815672 0 0) 0x7f0e580b0f40 con 0x7f0e58159560 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e580b0c60 con 0x7f0e58159560 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5659c700 1 -- 172.21.15.55:0/3100503118 >> v1:172.21.15.142:6789/0 conn(0x7f0e58159560 legacy=0x7f0e580aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5659c700 1 -- 172.21.15.55:0/3100503118 >> v1:172.21.15.55:6789/0 conn(0x7f0e580b0760 legacy=0x7f0e580b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3818246859 0 0) 0x7f0e44003570 con 0x7f0e580b0760 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.270+0000 7f0e5659c700 1 -- 172.21.15.55:0/3100503118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580b1500 con 0x7f0e580b49a0 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5659c700 1 --2- 172.21.15.55:0/3100503118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580aac40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009910 tx=0x7f0e400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af329d9b8b71180 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50001470 con 0x7f0e580b49a0 2023-10-06T11:15:15.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40011420 con 0x7f0e580b49a0 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e55d9b700 1 -- 172.21.15.55:0/3100503118 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e400117a0 con 0x7f0e580b49a0 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/3100503118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 msgr2=0x7f0e580aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/3100503118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580aac40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009910 tx=0x7f0e400091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/3100503118 shutdown_connections 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/3100503118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580aac40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/3100503118 >> 172.21.15.55:0/3100503118 conn(0x7f0e580997f0 msgr2=0x7f0e5806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/3100503118 shutdown_connections 2023-10-06T11:15:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.271+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/3100503118 wait complete. 2023-10-06T11:15:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.272+0000 7f0e5d1e6700 1 Processor -- start 2023-10-06T11:15:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 -- start start 2023-10-06T11:15:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 0x7f0e58157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e58159560 0x7f0e5815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ac0f0 con 0x7f0e580b0760 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ac4e0 con 0x7f0e58159560 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e5d1e6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5809a2a0 con 0x7f0e580b49a0 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e56d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 0x7f0e58157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e56d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 0x7f0e58157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58888/0 (socket says 172.21.15.55:58888) 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.273+0000 7f0e56d9d700 1 -- 172.21.15.55:0/330407268 learned_addr learned my addr 172.21.15.55:0/330407268 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e5659c700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e5759e700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e58159560 0x7f0e5815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e56d9d700 1 -- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 msgr2=0x7f0e580ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e56d9d700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e56d9d700 1 -- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e58159560 msgr2=0x7f0e5815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e56d9d700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e58159560 0x7f0e5815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e56d9d700 1 -- 172.21.15.55:0/330407268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009420 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e56d9d700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 0x7f0e58157d60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800cd30 tx=0x7f0e48002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800ab70 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800acd0 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48012650 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580ab200 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.274+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580ab7c0 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.275+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58064a90 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.275+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e48012a00 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.276+0000 7f0e4effd700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e38066f30 0x7f0e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.276+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0e48084ff0 con 0x7f0e580b0760 2023-10-06T11:15:15.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.276+0000 7f0e5659c700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e38066f30 0x7f0e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.277+0000 7f0e5659c700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e38066f30 0x7f0e380693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0e580cf830 tx=0x7f0e40016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.280+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e48051f40 con 0x7f0e580b0760 2023-10-06T11:15:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.519+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e580b17e0 con 0x7f0e580b0760 2023-10-06T11:15:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.519+0000 7f0e4effd700 1 -- 172.21.15.55:0/330407268 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0e48012cb0 con 0x7f0e580b0760 2023-10-06T11:15:15.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:15.521 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.489146+0000","modified":"2023-10-06T11:15:15.117701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1949751392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1949751392},{"type":"v1","addr":"172.21.15.142:6837","nonce":1949751392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:15:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e38066f30 msgr2=0x7f0e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e38066f30 0x7f0e380693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0e580cf830 tx=0x7f0e40016000 comp rx=0 tx=0).stop 2023-10-06T11:15:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 msgr2=0x7f0e58157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 0x7f0e58157d60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800cd30 tx=0x7f0e48002b90 comp rx=0 tx=0).stop 2023-10-06T11:15:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 shutdown_connections 2023-10-06T11:15:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0e38066f30 0x7f0e380693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e580b0760 0x7f0e58157d60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e58159560 0x7f0e5815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 --2- 172.21.15.55:0/330407268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e580b49a0 0x7f0e580ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 >> 172.21.15.55:0/330407268 conn(0x7f0e580997f0 msgr2=0x7f0e580b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 shutdown_connections 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.521+0000 7f0e5d1e6700 1 -- 172.21.15.55:0/330407268 wait complete. 2023-10-06T11:15:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2023-10-06T11:15:15.535 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.652+0000 7f1f889ea700 1 Processor -- start 2023-10-06T11:15:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.652+0000 7f1f889ea700 1 -- start start 2023-10-06T11:15:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f889ea700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f840ad6f0 0x7f1f840685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f889ea700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f84068b00 0x7f1f8415b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f889ea700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f840ac940 con 0x7f1f840ad320 2023-10-06T11:15:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f889ea700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f84068f80 con 0x7f1f840ad6f0 2023-10-06T11:15:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f889ea700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84159f40 con 0x7f1f84068b00 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f81d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f840ad6f0 0x7f1f840685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f81d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f840ad6f0 0x7f1f840685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58896/0 (socket says 172.21.15.55:58896) 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.653+0000 7f1f81d9b700 1 -- 172.21.15.55:0/875023336 learned_addr learned my addr 172.21.15.55:0/875023336 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f82d9d700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f84068b00 0x7f1f8415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f81d9b700 1 -- 172.21.15.55:0/875023336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f84068b00 msgr2=0x7f1f8415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f81d9b700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f84068b00 0x7f1f8415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f81d9b700 1 -- 172.21.15.55:0/875023336 >> v1:172.21.15.142:6789/0 conn(0x7f1f840ad320 legacy=0x7f1f840ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f81d9b700 1 -- 172.21.15.55:0/875023336 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8415a220 con 0x7f1f840ad6f0 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f82d9d700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f84068b00 0x7f1f8415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f81d9b700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f840ad6f0 0x7f1f840685c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0099b0 tx=0x7f1f6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abb1ffc7b77debf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f8159a700 1 -- 172.21.15.55:0/875023336 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00b860 con 0x7f1f840ad6f0 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f8159a700 1 -- 172.21.15.55:0/875023336 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00b9c0 con 0x7f1f840ad6f0 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f8159a700 1 -- 172.21.15.55:0/875023336 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00bd60 con 0x7f1f840ad6f0 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.654+0000 7f1f889ea700 1 -- 172.21.15.55:0/875023336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f840ad6f0 msgr2=0x7f1f840685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f840ad6f0 0x7f1f840685c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0099b0 tx=0x7f1f6c009250 comp rx=0 tx=0).stop 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 -- 172.21.15.55:0/875023336 shutdown_connections 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f84068b00 0x7f1f8415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 --2- 172.21.15.55:0/875023336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f840ad6f0 0x7f1f840685c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 -- 172.21.15.55:0/875023336 >> 172.21.15.55:0/875023336 conn(0x7f1f8406dcd0 msgr2=0x7f1f8406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 -- 172.21.15.55:0/875023336 shutdown_connections 2023-10-06T11:15:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.655+0000 7f1f889ea700 1 -- 172.21.15.55:0/875023336 wait complete. 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.656+0000 7f1f889ea700 1 Processor -- start 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.656+0000 7f1f889ea700 1 -- start start 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.656+0000 7f1f889ea700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 0x7f1f8416d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.656+0000 7f1f889ea700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840ad320 0x7f1f8415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f889ea700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840ad6f0 0x7f1f840c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f889ea700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8416e2e0 con 0x7f1f84068b00 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f889ea700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8416dd20 con 0x7f1f840ad320 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f889ea700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8416e000 con 0x7f1f840ad6f0 2023-10-06T11:15:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 0x7f1f8416d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 0x7f1f8416d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58908/0 (socket says 172.21.15.55:58908) 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 -- 172.21.15.55:0/2084879126 learned_addr learned my addr 172.21.15.55:0/2084879126 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f81d9b700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840ad320 0x7f1f8415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f82d9d700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840ad6f0 0x7f1f840c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 -- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840ad6f0 msgr2=0x7f1f840c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840ad6f0 0x7f1f840c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 -- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840ad320 msgr2=0x7f1f8415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840ad320 0x7f1f8415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 -- 172.21.15.55:0/2084879126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0094f0 con 0x7f1f84068b00 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f8259c700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 0x7f1f8416d3d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400cb10 tx=0x7f1f740017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400a760 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7400a8e0 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8416b030 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400aca0 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.657+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8416b3c0 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.658+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8416b1c0 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.659+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f74003030 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.659+0000 7f1f7a7fc700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1f64066f30 0x7f1f640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.659+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1f740848b0 con 0x7f1f84068b00 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.659+0000 7f1f81d9b700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1f64066f30 0x7f1f640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.660+0000 7f1f81d9b700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1f64066f30 0x7f1f640693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0099b0 tx=0x7f1f6c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.663+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f74051880 con 0x7f1f84068b00 2023-10-06T11:15:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.859+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f84064a90 con 0x7f1f84068b00 2023-10-06T11:15:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.860+0000 7f1f7a7fc700 1 -- 172.21.15.55:0/2084879126 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f1f74054ea0 con 0x7f1f84068b00 2023-10-06T11:15:15.862 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:15.862 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:13.032147+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.335026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.468577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1f64066f30 msgr2=0x7f1f640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1f64066f30 0x7f1f640693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0099b0 tx=0x7f1f6c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 msgr2=0x7f1f8416d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 0x7f1f8416d3d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400cb10 tx=0x7f1f740017b0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 shutdown_connections 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1f64066f30 0x7f1f640693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f84068b00 0x7f1f8416d3d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840ad6f0 0x7f1f840c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 --2- 172.21.15.55:0/2084879126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840ad320 0x7f1f8415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 >> 172.21.15.55:0/2084879126 conn(0x7f1f8406dcd0 msgr2=0x7f1f840b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 shutdown_connections 2023-10-06T11:15:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.862+0000 7f1f889ea700 1 -- 172.21.15.55:0/2084879126 wait complete. 2023-10-06T11:15:15.876 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:15:15.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.993+0000 7fe40d2e9700 1 Processor -- start 2023-10-06T11:15:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.993+0000 7fe40d2e9700 1 -- start start 2023-10-06T11:15:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe40d2e9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4080b25e0 0x7fe4080b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe40d2e9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe408159830 0x7fe4080cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe40d2e9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080cbfa0 con 0x7fe4080b29b0 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe40d2e9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080cb390 con 0x7fe4080b25e0 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe40d2e9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080cb670 con 0x7fe408159830 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe406ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4080b25e0 0x7fe4080b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe406ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4080b25e0 0x7fe4080b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58918/0 (socket says 172.21.15.55:58918) 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe406ffd700 1 -- 172.21.15.55:0/606691736 learned_addr learned my addr 172.21.15.55:0/606691736 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.994+0000 7fe4077fe700 1 --2- 172.21.15.55:0/606691736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe408159830 0x7fe4080cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe406ffd700 1 -- 172.21.15.55:0/606691736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe408159830 msgr2=0x7fe4080cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe406ffd700 1 --2- 172.21.15.55:0/606691736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe408159830 0x7fe4080cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe406ffd700 1 -- 172.21.15.55:0/606691736 >> v1:172.21.15.142:6789/0 conn(0x7fe4080b29b0 legacy=0x7fe408159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe406ffd700 1 -- 172.21.15.55:0/606691736 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080cb950 con 0x7fe4080b25e0 2023-10-06T11:15:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe406ffd700 1 --2- 172.21.15.55:0/606691736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4080b25e0 0x7fe4080b0690 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe400009f70 tx=0x7fe400009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0194df9fa3a8c27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe405ffb700 1 -- 172.21.15.55:0/606691736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000e070 con 0x7fe4080b25e0 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe405ffb700 1 -- 172.21.15.55:0/606691736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40000ba20 con 0x7fe4080b25e0 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe405ffb700 1 -- 172.21.15.55:0/606691736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000092e0 con 0x7fe4080b25e0 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe40d2e9700 1 -- 172.21.15.55:0/606691736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4080b25e0 msgr2=0x7fe4080b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/606691736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4080b25e0 0x7fe4080b0690 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe400009f70 tx=0x7fe400009840 comp rx=0 tx=0).stop 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe40d2e9700 1 -- 172.21.15.55:0/606691736 shutdown_connections 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/606691736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe408159830 0x7fe4080cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/606691736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4080b25e0 0x7fe4080b0690 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.995+0000 7fe40d2e9700 1 -- 172.21.15.55:0/606691736 >> 172.21.15.55:0/606691736 conn(0x7fe40806ece0 msgr2=0x7fe40806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.996+0000 7fe40d2e9700 1 -- 172.21.15.55:0/606691736 shutdown_connections 2023-10-06T11:15:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.996+0000 7fe40d2e9700 1 -- 172.21.15.55:0/606691736 wait complete. 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 Processor -- start 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 -- start start 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4080b25e0 0x7fe4080c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4080b29b0 0x7fe4080cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 0x7fe4080ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c4da0 con 0x7fe408159830 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.997+0000 7fe40d2e9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c5080 con 0x7fe4080b25e0 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe40d2e9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c5360 con 0x7fe4080b29b0 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 0x7fe4080ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 0x7fe4080ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58932/0 (socket says 172.21.15.55:58932) 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 -- 172.21.15.55:0/2308264745 learned_addr learned my addr 172.21.15.55:0/2308264745 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe406ffd700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4080b25e0 0x7fe4080c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4067fc700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4080b29b0 0x7fe4080cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 -- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4080b29b0 msgr2=0x7fe4080cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4080b29b0 0x7fe4080cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 -- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4080b25e0 msgr2=0x7fe4080c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4080b25e0 0x7fe4080c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 -- 172.21.15.55:0/2308264745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009ae0 con 0x7fe408159830 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe4077fe700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 0x7fe4080ce530 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800e8d0 tx=0x7fe3f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8013680 con 0x7fe408159830 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f80137e0 con 0x7fe408159830 2023-10-06T11:15:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4080c5640 con 0x7fe408159830 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8013ba0 con 0x7fe408159830 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.998+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4080c6cf0 con 0x7fe408159830 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:15.999+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe408064a90 con 0x7fe408159830 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.000+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3f80123d0 con 0x7fe408159830 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.000+0000 7fe3feffd700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe3e8066f60 0x7fe3e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.000+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe3f80848e0 con 0x7fe408159830 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.000+0000 7fe406ffd700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe3e8066f60 0x7fe3e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.001+0000 7fe406ffd700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe3e8066f60 0x7fe3e8069410 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe400009880 tx=0x7fe400018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.004+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f80518b0 con 0x7fe408159830 2023-10-06T11:15:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.193+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4080c51f0 con 0x7fe3e8066f60 2023-10-06T11:15:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.202+0000 7fe3feffd700 1 -- 172.21.15.55:0/2308264745 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311145 (secure 0 0 0) 0x7fe4080c51f0 con 0x7fe3e8066f60 2023-10-06T11:15:16.207 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:16.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe3e8066f60 msgr2=0x7fe3e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe3e8066f60 0x7fe3e8069410 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe400009880 tx=0x7fe400018000 comp rx=0 tx=0).stop 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 msgr2=0x7fe4080ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 0x7fe4080ce530 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800e8d0 tx=0x7fe3f80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 shutdown_connections 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe3e8066f60 0x7fe3e8069410 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe408159830 0x7fe4080ce530 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4080b25e0 0x7fe4080c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 --2- 172.21.15.55:0/2308264745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4080b29b0 0x7fe4080cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 >> 172.21.15.55:0/2308264745 conn(0x7fe40806ece0 msgr2=0x7fe408153b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 shutdown_connections 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.205+0000 7fe40d2e9700 1 -- 172.21.15.55:0/2308264745 wait complete. 2023-10-06T11:15:16.210 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:15:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T11:15:14.870150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385828,"kb_used_data":7524,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588892,"statfs":{"total":773094113280,"available":770651025408,"internally_reserved":0,"allocated":7704576,"data_stored":4169577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.794890"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052738+0000","last_change":"2023-10-06T11:15:12.052738+0000","last_active":"2023-10-06T11:15:12.052738+0000","last_peered":"2023-10-06T11:15:12.052738+0000","last_clean":"2023-10-06T11:15:12.052738+0000","last_became_active":"2023-10-06T11:15:12.052497+0000","last_became_peered":"2023-10-06T11:15:12.052497+0000","last_unstale":"2023-10-06T11:15:12.052738+0000","last_undegraded":"2023-10-06T11:15:12.052738+0000","last_fullsized":"2023-10-06T11:15:12.052738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:32.244000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059215+0000","last_change":"2023-10-06T11:15:12.056990+0000","last_active":"2023-10-06T11:15:12.059215+0000","last_peered":"2023-10-06T11:15:12.059215+0000","last_clean":"2023-10-06T11:15:12.059215+0000","last_became_active":"2023-10-06T11:15:12.056730+0000","last_became_peered":"2023-10-06T11:15:12.056730+0000","last_unstale":"2023-10-06T11:15:12.059215+0000","last_undegraded":"2023-10-06T11:15:12.059215+0000","last_fullsized":"2023-10-06T11:15:12.059215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:21.995464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053260+0000","last_change":"2023-10-06T11:15:12.046508+0000","last_active":"2023-10-06T11:15:12.053260+0000","last_peered":"2023-10-06T11:15:12.053260+0000","last_clean":"2023-10-06T11:15:12.053260+0000","last_became_active":"2023-10-06T11:15:12.046242+0000","last_became_peered":"2023-10-06T11:15:12.046242+0000","last_unstale":"2023-10-06T11:15:12.053260+0000","last_undegraded":"2023-10-06T11:15:12.053260+0000","last_fullsized":"2023-10-06T11:15:12.053260+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:12.690575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059120+0000","last_change":"2023-10-06T11:15:12.053339+0000","last_active":"2023-10-06T11:15:12.059120+0000","last_peered":"2023-10-06T11:15:12.059120+0000","last_clean":"2023-10-06T11:15:12.059120+0000","last_became_active":"2023-10-06T11:15:12.052363+0000","last_became_peered":"2023-10-06T11:15:12.052363+0000","last_unstale":"2023-10-06T11:15:12.059120+0000","last_undegraded":"2023-10-06T11:15:12.059120+0000","last_fullsized":"2023-10-06T11:15:12.059120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:08:48.309250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051808+0000","last_change":"2023-10-06T11:15:12.047804+0000","last_active":"2023-10-06T11:15:12.051808+0000","last_peered":"2023-10-06T11:15:12.051808+0000","last_clean":"2023-10-06T11:15:12.051808+0000","last_became_active":"2023-10-06T11:15:12.047481+0000","last_became_peered":"2023-10-06T11:15:12.047481+0000","last_unstale":"2023-10-06T11:15:12.051808+0000","last_undegraded":"2023-10-06T11:15:12.051808+0000","last_fullsized":"2023-10-06T11:15:12.051808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:04.754431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058301+0000","last_change":"2023-10-06T11:15:12.055346+0000","last_active":"2023-10-06T11:15:12.058301+0000","last_peered":"2023-10-06T11:15:12.058301+0000","last_clean":"2023-10-06T11:15:12.058301+0000","last_became_active":"2023-10-06T11:15:12.054998+0000","last_became_peered":"2023-10-06T11:15:12.054998+0000","last_unstale":"2023-10-06T11:15:12.058301+0000","last_undegraded":"2023-10-06T11:15:12.058301+0000","last_fullsized":"2023-10-06T11:15:12.058301+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:14.460503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051912+0000","last_change":"2023-10-06T11:15:12.045838+0000","last_active":"2023-10-06T11:15:12.051912+0000","last_peered":"2023-10-06T11:15:12.051912+0000","last_clean":"2023-10-06T11:15:12.051912+0000","last_became_active":"2023-10-06T11:15:12.045582+0000","last_became_peered":"2023-10-06T11:15:12.045582+0000","last_unstale":"2023-10-06T11:15:12.051912+0000","last_undegraded":"2023-10-06T11:15:12.051912+0000","last_fullsized":"2023-10-06T11:15:12.051912+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:29.570575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058289+0000","last_change":"2023-10-06T11:15:12.055352+0000","last_active":"2023-10-06T11:15:12.058289+0000","last_peered":"2023-10-06T11:15:12.058289+0000","last_clean":"2023-10-06T11:15:12.058289+0000","last_became_active":"2023-10-06T11:15:12.055033+0000","last_became_peered":"2023-10-06T11:15:12.055033+0000","last_unstale":"2023-10-06T11:15:12.058289+0000","last_undegraded":"2023-10-06T11:15:12.058289+0000","last_fullsized":"2023-10-06T11:15:12.058289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:08.692730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.048923+0000","last_change":"2023-10-06T11:15:12.043539+0000","last_active":"2023-10-06T11:15:12.048923+0000","last_peered":"2023-10-06T11:15:12.048923+0000","last_clean":"2023-10-06T11:15:12.048923+0000","last_became_active":"2023-10-06T11:15:12.043266+0000","last_became_peered":"2023-10-06T11:15:12.043266+0000","last_unstale":"2023-10-06T11:15:12.048923+0000","last_undegraded":"2023-10-06T11:15:12.048923+0000","last_fullsized":"2023-10-06T11:15:12.048923+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:30.819045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053889+0000","last_change":"2023-10-06T11:15:12.046513+0000","last_active":"2023-10-06T11:15:12.053889+0000","last_peered":"2023-10-06T11:15:12.053889+0000","last_clean":"2023-10-06T11:15:12.053889+0000","last_became_active":"2023-10-06T11:15:12.046204+0000","last_became_peered":"2023-10-06T11:15:12.046204+0000","last_unstale":"2023-10-06T11:15:12.053889+0000","last_undegraded":"2023-10-06T11:15:12.053889+0000","last_fullsized":"2023-10-06T11:15:12.053889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:15.546634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052873+0000","last_change":"2023-10-06T11:15:12.052873+0000","last_active":"2023-10-06T11:15:12.052873+0000","last_peered":"2023-10-06T11:15:12.052873+0000","last_clean":"2023-10-06T11:15:12.052873+0000","last_became_active":"2023-10-06T11:15:12.052477+0000","last_became_peered":"2023-10-06T11:15:12.052477+0000","last_unstale":"2023-10-06T11:15:12.052873+0000","last_undegraded":"2023-10-06T11:15:12.052873+0000","last_fullsized":"2023-10-06T11:15:12.052873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:04.813712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059134+0000","last_change":"2023-10-06T11:15:12.053509+0000","last_active":"2023-10-06T11:15:12.059134+0000","last_peered":"2023-10-06T11:15:12.059134+0000","last_clean":"2023-10-06T11:15:12.059134+0000","last_became_active":"2023-10-06T11:15:12.052737+0000","last_became_peered":"2023-10-06T11:15:12.052737+0000","last_unstale":"2023-10-06T11:15:12.059134+0000","last_undegraded":"2023-10-06T11:15:12.059134+0000","last_fullsized":"2023-10-06T11:15:12.059134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:38.504386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.048585+0000","last_change":"2023-10-06T11:15:12.048585+0000","last_active":"2023-10-06T11:15:12.048585+0000","last_peered":"2023-10-06T11:15:12.048585+0000","last_clean":"2023-10-06T11:15:12.048585+0000","last_became_active":"2023-10-06T11:15:12.048413+0000","last_became_peered":"2023-10-06T11:15:12.048413+0000","last_unstale":"2023-10-06T11:15:12.048585+0000","last_undegraded":"2023-10-06T11:15:12.048585+0000","last_fullsized":"2023-10-06T11:15:12.048585+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:35:45.584771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051466+0000","last_change":"2023-10-06T11:15:12.046359+0000","last_active":"2023-10-06T11:15:12.051466+0000","last_peered":"2023-10-06T11:15:12.051466+0000","last_clean":"2023-10-06T11:15:12.051466+0000","last_became_active":"2023-10-06T11:15:12.045852+0000","last_became_peered":"2023-10-06T11:15:12.045852+0000","last_unstale":"2023-10-06T11:15:12.051466+0000","last_undegraded":"2023-10-06T11:15:12.051466+0000","last_fullsized":"2023-10-06T11:15:12.051466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:01.906834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.046359+0000","last_change":"2023-10-06T11:15:12.046359+0000","last_active":"2023-10-06T11:15:12.046359+0000","last_peered":"2023-10-06T11:15:12.046359+0000","last_clean":"2023-10-06T11:15:12.046359+0000","last_became_active":"2023-10-06T11:15:12.046101+0000","last_became_peered":"2023-10-06T11:15:12.046101+0000","last_unstale":"2023-10-06T11:15:12.046359+0000","last_undegraded":"2023-10-06T11:15:12.046359+0000","last_fullsized":"2023-10-06T11:15:12.046359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:09.270538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054644+0000","last_change":"2023-10-06T11:15:12.053237+0000","last_active":"2023-10-06T11:15:12.054644+0000","last_peered":"2023-10-06T11:15:12.054644+0000","last_clean":"2023-10-06T11:15:12.054644+0000","last_became_active":"2023-10-06T11:15:12.052992+0000","last_became_peered":"2023-10-06T11:15:12.052992+0000","last_unstale":"2023-10-06T11:15:12.054644+0000","last_undegraded":"2023-10-06T11:15:12.054644+0000","last_fullsized":"2023-10-06T11:15:12.054644+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:59.563337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058562+0000","last_change":"2023-10-06T11:15:12.051576+0000","last_active":"2023-10-06T11:15:12.058562+0000","last_peered":"2023-10-06T11:15:12.058562+0000","last_clean":"2023-10-06T11:15:12.058562+0000","last_became_active":"2023-10-06T11:15:12.051284+0000","last_became_peered":"2023-10-06T11:15:12.051284+0000","last_unstale":"2023-10-06T11:15:12.058562+0000","last_undegraded":"2023-10-06T11:15:12.058562+0000","last_fullsized":"2023-10-06T11:15:12.058562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:46.444329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059058+0000","last_change":"2023-10-06T11:15:12.052791+0000","last_active":"2023-10-06T11:15:12.059058+0000","last_peered":"2023-10-06T11:15:12.059058+0000","last_clean":"2023-10-06T11:15:12.059058+0000","last_became_active":"2023-10-06T11:15:12.052539+0000","last_became_peered":"2023-10-06T11:15:12.052539+0000","last_unstale":"2023-10-06T11:15:12.059058+0000","last_undegraded":"2023-10-06T11:15:12.059058+0000","last_fullsized":"2023-10-06T11:15:12.059058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058088+0000","last_change":"2023-10-06T11:15:12.052807+0000","last_active":"2023-10-06T11:15:12.058088+0000","last_peered":"2023-10-06T11:15:12.058088+0000","last_clean":"2023-10-06T11:15:12.058088+0000","last_became_active":"2023-10-06T11:15:12.051908+0000","last_became_peered":"2023-10-06T11:15:12.051908+0000","last_unstale":"2023-10-06T11:15:12.058088+0000","last_undegraded":"2023-10-06T11:15:12.058088+0000","last_fullsized":"2023-10-06T11:15:12.058088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:38.179903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.044628+0000","last_change":"2023-10-06T11:15:12.044628+0000","last_active":"2023-10-06T11:15:12.044628+0000","last_peered":"2023-10-06T11:15:12.044628+0000","last_clean":"2023-10-06T11:15:12.044628+0000","last_became_active":"2023-10-06T11:15:12.044336+0000","last_became_peered":"2023-10-06T11:15:12.044336+0000","last_unstale":"2023-10-06T11:15:12.044628+0000","last_undegraded":"2023-10-06T11:15:12.044628+0000","last_fullsized":"2023-10-06T11:15:12.044628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:05.884133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059166+0000","last_change":"2023-10-06T11:15:12.056225+0000","last_active":"2023-10-06T11:15:12.059166+0000","last_peered":"2023-10-06T11:15:12.059166+0000","last_clean":"2023-10-06T11:15:12.059166+0000","last_became_active":"2023-10-06T11:15:12.055876+0000","last_became_peered":"2023-10-06T11:15:12.055876+0000","last_unstale":"2023-10-06T11:15:12.059166+0000","last_undegraded":"2023-10-06T11:15:12.059166+0000","last_fullsized":"2023-10-06T11:15:12.059166+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:32.244000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.049617+0000","last_change":"2023-10-06T11:15:12.045396+0000","last_active":"2023-10-06T11:15:12.049617+0000","last_peered":"2023-10-06T11:15:12.049617+0000","last_clean":"2023-10-06T11:15:12.049617+0000","last_became_active":"2023-10-06T11:15:12.045133+0000","last_became_peered":"2023-10-06T11:15:12.045133+0000","last_unstale":"2023-10-06T11:15:12.049617+0000","last_undegraded":"2023-10-06T11:15:12.049617+0000","last_fullsized":"2023-10-06T11:15:12.049617+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:56.109304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.047578+0000","last_change":"2023-10-06T11:15:12.047578+0000","last_active":"2023-10-06T11:15:12.047578+0000","last_peered":"2023-10-06T11:15:12.047578+0000","last_clean":"2023-10-06T11:15:12.047578+0000","last_became_active":"2023-10-06T11:15:12.047207+0000","last_became_peered":"2023-10-06T11:15:12.047207+0000","last_unstale":"2023-10-06T11:15:12.047578+0000","last_undegraded":"2023-10-06T11:15:12.047578+0000","last_fullsized":"2023-10-06T11:15:12.047578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:19:59.460547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054304+0000","last_change":"2023-10-06T11:15:12.054304+0000","last_active":"2023-10-06T11:15:12.054304+0000","last_peered":"2023-10-06T11:15:12.054304+0000","last_clean":"2023-10-06T11:15:12.054304+0000","last_became_active":"2023-10-06T11:15:12.053956+0000","last_became_peered":"2023-10-06T11:15:12.053956+0000","last_unstale":"2023-10-06T11:15:12.054304+0000","last_undegraded":"2023-10-06T11:15:12.054304+0000","last_fullsized":"2023-10-06T11:15:12.054304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.454679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051190+0000","last_change":"2023-10-06T11:15:12.046981+0000","last_active":"2023-10-06T11:15:12.051190+0000","last_peered":"2023-10-06T11:15:12.051190+0000","last_clean":"2023-10-06T11:15:12.051190+0000","last_became_active":"2023-10-06T11:15:12.046716+0000","last_became_peered":"2023-10-06T11:15:12.046716+0000","last_unstale":"2023-10-06T11:15:12.051190+0000","last_undegraded":"2023-10-06T11:15:12.051190+0000","last_fullsized":"2023-10-06T11:15:12.051190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:35:45.584771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.046515+0000","last_change":"2023-10-06T11:15:12.044984+0000","last_active":"2023-10-06T11:15:12.046515+0000","last_peered":"2023-10-06T11:15:12.046515+0000","last_clean":"2023-10-06T11:15:12.046515+0000","last_became_active":"2023-10-06T11:15:12.044710+0000","last_became_peered":"2023-10-06T11:15:12.044710+0000","last_unstale":"2023-10-06T11:15:12.046515+0000","last_undegraded":"2023-10-06T11:15:12.046515+0000","last_fullsized":"2023-10-06T11:15:12.046515+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:33.178980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053280+0000","last_change":"2023-10-06T11:15:12.048637+0000","last_active":"2023-10-06T11:15:12.053280+0000","last_peered":"2023-10-06T11:15:12.053280+0000","last_clean":"2023-10-06T11:15:12.053280+0000","last_became_active":"2023-10-06T11:15:12.048398+0000","last_became_peered":"2023-10-06T11:15:12.048398+0000","last_unstale":"2023-10-06T11:15:12.053280+0000","last_undegraded":"2023-10-06T11:15:12.053280+0000","last_fullsized":"2023-10-06T11:15:12.053280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:41.966367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052053+0000","last_change":"2023-10-06T11:15:12.046301+0000","last_active":"2023-10-06T11:15:12.052053+0000","last_peered":"2023-10-06T11:15:12.052053+0000","last_clean":"2023-10-06T11:15:12.052053+0000","last_became_active":"2023-10-06T11:15:12.046017+0000","last_became_peered":"2023-10-06T11:15:12.046017+0000","last_unstale":"2023-10-06T11:15:12.052053+0000","last_undegraded":"2023-10-06T11:15:12.052053+0000","last_fullsized":"2023-10-06T11:15:12.052053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:23.867660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052715+0000","last_change":"2023-10-06T11:15:12.046311+0000","last_active":"2023-10-06T11:15:12.052715+0000","last_peered":"2023-10-06T11:15:12.052715+0000","last_clean":"2023-10-06T11:15:12.052715+0000","last_became_active":"2023-10-06T11:15:12.046031+0000","last_became_peered":"2023-10-06T11:15:12.046031+0000","last_unstale":"2023-10-06T11:15:12.052715+0000","last_undegraded":"2023-10-06T11:15:12.052715+0000","last_fullsized":"2023-10-06T11:15:12.052715+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:24:32.458335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057094+0000","last_change":"2023-10-06T11:15:12.050858+0000","last_active":"2023-10-06T11:15:12.057094+0000","last_peered":"2023-10-06T11:15:12.057094+0000","last_clean":"2023-10-06T11:15:12.057094+0000","last_became_active":"2023-10-06T11:15:12.050567+0000","last_became_peered":"2023-10-06T11:15:12.050567+0000","last_unstale":"2023-10-06T11:15:12.057094+0000","last_undegraded":"2023-10-06T11:15:12.057094+0000","last_fullsized":"2023-10-06T11:15:12.057094+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:50.637771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.044539+0000","last_change":"2023-10-06T11:15:12.043051+0000","last_active":"2023-10-06T11:15:12.044539+0000","last_peered":"2023-10-06T11:15:12.044539+0000","last_clean":"2023-10-06T11:15:12.044539+0000","last_became_active":"2023-10-06T11:15:12.042782+0000","last_became_peered":"2023-10-06T11:15:12.042782+0000","last_unstale":"2023-10-06T11:15:12.044539+0000","last_undegraded":"2023-10-06T11:15:12.044539+0000","last_fullsized":"2023-10-06T11:15:12.044539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.454679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057845+0000","last_change":"2023-10-06T11:15:12.052222+0000","last_active":"2023-10-06T11:15:12.057845+0000","last_peered":"2023-10-06T11:15:12.057845+0000","last_clean":"2023-10-06T11:15:12.057845+0000","last_became_active":"2023-10-06T11:15:12.051815+0000","last_became_peered":"2023-10-06T11:15:12.051815+0000","last_unstale":"2023-10-06T11:15:12.057845+0000","last_undegraded":"2023-10-06T11:15:12.057845+0000","last_fullsized":"2023-10-06T11:15:12.057845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:07.620085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054380+0000","last_change":"2023-10-06T11:15:12.054380+0000","last_active":"2023-10-06T11:15:12.054380+0000","last_peered":"2023-10-06T11:15:12.054380+0000","last_clean":"2023-10-06T11:15:12.054380+0000","last_became_active":"2023-10-06T11:15:12.053487+0000","last_became_peered":"2023-10-06T11:15:12.053487+0000","last_unstale":"2023-10-06T11:15:12.054380+0000","last_undegraded":"2023-10-06T11:15:12.054380+0000","last_fullsized":"2023-10-06T11:15:12.054380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:50.637771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.117955+0000","last_change":"2023-10-06T11:15:11.101976+0000","last_active":"2023-10-06T11:15:12.117955+0000","last_peered":"2023-10-06T11:15:12.117955+0000","last_clean":"2023-10-06T11:15:12.117955+0000","last_became_active":"2023-10-06T11:15:11.101729+0000","last_became_peered":"2023-10-06T11:15:11.101729+0000","last_unstale":"2023-10-06T11:15:12.117955+0000","last_undegraded":"2023-10-06T11:15:12.117955+0000","last_fullsized":"2023-10-06T11:15:12.117955+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:00.408769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051784+0000","last_change":"2023-10-06T11:15:12.045771+0000","last_active":"2023-10-06T11:15:12.051784+0000","last_peered":"2023-10-06T11:15:12.051784+0000","last_clean":"2023-10-06T11:15:12.051784+0000","last_became_active":"2023-10-06T11:15:12.045078+0000","last_became_peered":"2023-10-06T11:15:12.045078+0000","last_unstale":"2023-10-06T11:15:12.051784+0000","last_undegraded":"2023-10-06T11:15:12.051784+0000","last_fullsized":"2023-10-06T11:15:12.051784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:25.958059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"66'1","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.035079+0000","last_change":"2023-10-06T11:15:11.095632+0000","last_active":"2023-10-06T11:15:12.035079+0000","last_peered":"2023-10-06T11:15:12.035079+0000","last_clean":"2023-10-06T11:15:12.035079+0000","last_became_active":"2023-10-06T11:15:11.095445+0000","last_became_peered":"2023-10-06T11:15:11.095445+0000","last_unstale":"2023-10-06T11:15:12.035079+0000","last_undegraded":"2023-10-06T11:15:12.035079+0000","last_fullsized":"2023-10-06T11:15:12.035079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:19:58.457698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.062292+0000","last_change":"2023-10-06T11:15:12.057963+0000","last_active":"2023-10-06T11:15:12.062292+0000","last_peered":"2023-10-06T11:15:12.062292+0000","last_clean":"2023-10-06T11:15:12.062292+0000","last_became_active":"2023-10-06T11:15:12.057593+0000","last_became_peered":"2023-10-06T11:15:12.057593+0000","last_unstale":"2023-10-06T11:15:12.062292+0000","last_undegraded":"2023-10-06T11:15:12.062292+0000","last_fullsized":"2023-10-06T11:15:12.062292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:48.708737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120942+0000","last_change":"2023-10-06T11:15:11.094579+0000","last_active":"2023-10-06T11:15:12.120942+0000","last_peered":"2023-10-06T11:15:12.120942+0000","last_clean":"2023-10-06T11:15:12.120942+0000","last_became_active":"2023-10-06T11:15:11.094314+0000","last_became_peered":"2023-10-06T11:15:11.094314+0000","last_unstale":"2023-10-06T11:15:12.120942+0000","last_undegraded":"2023-10-06T11:15:12.120942+0000","last_fullsized":"2023-10-06T11:15:12.120942+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:56.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.050173+0000","last_change":"2023-10-06T11:15:12.050173+0000","last_active":"2023-10-06T11:15:12.050173+0000","last_peered":"2023-10-06T11:15:12.050173+0000","last_clean":"2023-10-06T11:15:12.050173+0000","last_became_active":"2023-10-06T11:15:12.049883+0000","last_became_peered":"2023-10-06T11:15:12.049883+0000","last_unstale":"2023-10-06T11:15:12.050173+0000","last_undegraded":"2023-10-06T11:15:12.050173+0000","last_fullsized":"2023-10-06T11:15:12.050173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:07:37.159361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120629+0000","last_change":"2023-10-06T11:15:11.097656+0000","last_active":"2023-10-06T11:15:12.120629+0000","last_peered":"2023-10-06T11:15:12.120629+0000","last_clean":"2023-10-06T11:15:12.120629+0000","last_became_active":"2023-10-06T11:15:11.097360+0000","last_became_peered":"2023-10-06T11:15:11.097360+0000","last_unstale":"2023-10-06T11:15:12.120629+0000","last_undegraded":"2023-10-06T11:15:12.120629+0000","last_fullsized":"2023-10-06T11:15:12.120629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:29.065140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.044524+0000","last_change":"2023-10-06T11:15:12.040582+0000","last_active":"2023-10-06T11:15:12.044524+0000","last_peered":"2023-10-06T11:15:12.044524+0000","last_clean":"2023-10-06T11:15:12.044524+0000","last_became_active":"2023-10-06T11:15:12.040281+0000","last_became_peered":"2023-10-06T11:15:12.040281+0000","last_unstale":"2023-10-06T11:15:12.044524+0000","last_undegraded":"2023-10-06T11:15:12.044524+0000","last_fullsized":"2023-10-06T11:15:12.044524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:57.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.115644+0000","last_change":"2023-10-06T11:15:11.097483+0000","last_active":"2023-10-06T11:15:12.115644+0000","last_peered":"2023-10-06T11:15:12.115644+0000","last_clean":"2023-10-06T11:15:12.115644+0000","last_became_active":"2023-10-06T11:15:11.097212+0000","last_became_peered":"2023-10-06T11:15:11.097212+0000","last_unstale":"2023-10-06T11:15:12.115644+0000","last_undegraded":"2023-10-06T11:15:12.115644+0000","last_fullsized":"2023-10-06T11:15:12.115644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.241150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051411+0000","last_change":"2023-10-06T11:15:12.047038+0000","last_active":"2023-10-06T11:15:12.051411+0000","last_peered":"2023-10-06T11:15:12.051411+0000","last_clean":"2023-10-06T11:15:12.051411+0000","last_became_active":"2023-10-06T11:15:12.046753+0000","last_became_peered":"2023-10-06T11:15:12.046753+0000","last_unstale":"2023-10-06T11:15:12.051411+0000","last_undegraded":"2023-10-06T11:15:12.051411+0000","last_fullsized":"2023-10-06T11:15:12.051411+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:31.204787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.117783+0000","last_change":"2023-10-06T11:15:11.097996+0000","last_active":"2023-10-06T11:15:12.117783+0000","last_peered":"2023-10-06T11:15:12.117783+0000","last_clean":"2023-10-06T11:15:12.117783+0000","last_became_active":"2023-10-06T11:15:11.097665+0000","last_became_peered":"2023-10-06T11:15:11.097665+0000","last_unstale":"2023-10-06T11:15:12.117783+0000","last_undegraded":"2023-10-06T11:15:12.117783+0000","last_fullsized":"2023-10-06T11:15:12.117783+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:00.903985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051592+0000","last_change":"2023-10-06T11:15:12.047597+0000","last_active":"2023-10-06T11:15:12.051592+0000","last_peered":"2023-10-06T11:15:12.051592+0000","last_clean":"2023-10-06T11:15:12.051592+0000","last_became_active":"2023-10-06T11:15:12.047309+0000","last_became_peered":"2023-10-06T11:15:12.047309+0000","last_unstale":"2023-10-06T11:15:12.051592+0000","last_undegraded":"2023-10-06T11:15:12.051592+0000","last_fullsized":"2023-10-06T11:15:12.051592+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:59.514474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.042426+0000","last_change":"2023-10-06T11:15:11.093636+0000","last_active":"2023-10-06T11:15:12.042426+0000","last_peered":"2023-10-06T11:15:12.042426+0000","last_clean":"2023-10-06T11:15:12.042426+0000","last_became_active":"2023-10-06T11:15:11.093311+0000","last_became_peered":"2023-10-06T11:15:11.093311+0000","last_unstale":"2023-10-06T11:15:12.042426+0000","last_undegraded":"2023-10-06T11:15:12.042426+0000","last_fullsized":"2023-10-06T11:15:12.042426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.533350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.047976+0000","last_change":"2023-10-06T11:15:12.047976+0000","last_active":"2023-10-06T11:15:12.047976+0000","last_peered":"2023-10-06T11:15:12.047976+0000","last_clean":"2023-10-06T11:15:12.047976+0000","last_became_active":"2023-10-06T11:15:12.047649+0000","last_became_peered":"2023-10-06T11:15:12.047649+0000","last_unstale":"2023-10-06T11:15:12.047976+0000","last_undegraded":"2023-10-06T11:15:12.047976+0000","last_fullsized":"2023-10-06T11:15:12.047976+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:28.823418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.039782+0000","last_change":"2023-10-06T11:15:11.101865+0000","last_active":"2023-10-06T11:15:12.039782+0000","last_peered":"2023-10-06T11:15:12.039782+0000","last_clean":"2023-10-06T11:15:12.039782+0000","last_became_active":"2023-10-06T11:15:11.101591+0000","last_became_peered":"2023-10-06T11:15:11.101591+0000","last_unstale":"2023-10-06T11:15:12.039782+0000","last_undegraded":"2023-10-06T11:15:12.039782+0000","last_fullsized":"2023-10-06T11:15:12.039782+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:34.264602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057067+0000","last_change":"2023-10-06T11:15:12.049200+0000","last_active":"2023-10-06T11:15:12.057067+0000","last_peered":"2023-10-06T11:15:12.057067+0000","last_clean":"2023-10-06T11:15:12.057067+0000","last_became_active":"2023-10-06T11:15:12.048972+0000","last_became_peered":"2023-10-06T11:15:12.048972+0000","last_unstale":"2023-10-06T11:15:12.057067+0000","last_undegraded":"2023-10-06T11:15:12.057067+0000","last_fullsized":"2023-10-06T11:15:12.057067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:09.825629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037983+0000","last_change":"2023-10-06T11:15:11.095764+0000","last_active":"2023-10-06T11:15:12.037983+0000","last_peered":"2023-10-06T11:15:12.037983+0000","last_clean":"2023-10-06T11:15:12.037983+0000","last_became_active":"2023-10-06T11:15:11.095543+0000","last_became_peered":"2023-10-06T11:15:11.095543+0000","last_unstale":"2023-10-06T11:15:12.037983+0000","last_undegraded":"2023-10-06T11:15:12.037983+0000","last_fullsized":"2023-10-06T11:15:12.037983+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:05.498484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053969+0000","last_change":"2023-10-06T11:15:12.053969+0000","last_active":"2023-10-06T11:15:12.053969+0000","last_peered":"2023-10-06T11:15:12.053969+0000","last_clean":"2023-10-06T11:15:12.053969+0000","last_became_active":"2023-10-06T11:15:12.053698+0000","last_became_peered":"2023-10-06T11:15:12.053698+0000","last_unstale":"2023-10-06T11:15:12.053969+0000","last_undegraded":"2023-10-06T11:15:12.053969+0000","last_fullsized":"2023-10-06T11:15:12.053969+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:33.178980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040977+0000","last_change":"2023-10-06T11:15:11.099813+0000","last_active":"2023-10-06T11:15:12.040977+0000","last_peered":"2023-10-06T11:15:12.040977+0000","last_clean":"2023-10-06T11:15:12.040977+0000","last_became_active":"2023-10-06T11:15:11.099625+0000","last_became_peered":"2023-10-06T11:15:11.099625+0000","last_unstale":"2023-10-06T11:15:12.040977+0000","last_undegraded":"2023-10-06T11:15:12.040977+0000","last_fullsized":"2023-10-06T11:15:12.040977+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:57.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058229+0000","last_change":"2023-10-06T11:15:12.055042+0000","last_active":"2023-10-06T11:15:12.058229+0000","last_peered":"2023-10-06T11:15:12.058229+0000","last_clean":"2023-10-06T11:15:12.058229+0000","last_became_active":"2023-10-06T11:15:12.054638+0000","last_became_peered":"2023-10-06T11:15:12.054638+0000","last_unstale":"2023-10-06T11:15:12.058229+0000","last_undegraded":"2023-10-06T11:15:12.058229+0000","last_fullsized":"2023-10-06T11:15:12.058229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:18.411246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.118364+0000","last_change":"2023-10-06T11:15:11.094409+0000","last_active":"2023-10-06T11:15:12.118364+0000","last_peered":"2023-10-06T11:15:12.118364+0000","last_clean":"2023-10-06T11:15:12.118364+0000","last_became_active":"2023-10-06T11:15:11.094116+0000","last_became_peered":"2023-10-06T11:15:11.094116+0000","last_unstale":"2023-10-06T11:15:12.118364+0000","last_undegraded":"2023-10-06T11:15:12.118364+0000","last_fullsized":"2023-10-06T11:15:12.118364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:35.692849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053805+0000","last_change":"2023-10-06T11:15:12.050420+0000","last_active":"2023-10-06T11:15:12.053805+0000","last_peered":"2023-10-06T11:15:12.053805+0000","last_clean":"2023-10-06T11:15:12.053805+0000","last_became_active":"2023-10-06T11:15:12.050043+0000","last_became_peered":"2023-10-06T11:15:12.050043+0000","last_unstale":"2023-10-06T11:15:12.053805+0000","last_undegraded":"2023-10-06T11:15:12.053805+0000","last_fullsized":"2023-10-06T11:15:12.053805+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:58.298900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.117119+0000","last_change":"2023-10-06T11:15:11.098443+0000","last_active":"2023-10-06T11:15:12.117119+0000","last_peered":"2023-10-06T11:15:12.117119+0000","last_clean":"2023-10-06T11:15:12.117119+0000","last_became_active":"2023-10-06T11:15:11.098157+0000","last_became_peered":"2023-10-06T11:15:11.098157+0000","last_unstale":"2023-10-06T11:15:12.117119+0000","last_undegraded":"2023-10-06T11:15:12.117119+0000","last_fullsized":"2023-10-06T11:15:12.117119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:00.903985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052229+0000","last_change":"2023-10-06T11:15:12.052229+0000","last_active":"2023-10-06T11:15:12.052229+0000","last_peered":"2023-10-06T11:15:12.052229+0000","last_clean":"2023-10-06T11:15:12.052229+0000","last_became_active":"2023-10-06T11:15:12.051967+0000","last_became_peered":"2023-10-06T11:15:12.051967+0000","last_unstale":"2023-10-06T11:15:12.052229+0000","last_undegraded":"2023-10-06T11:15:12.052229+0000","last_fullsized":"2023-10-06T11:15:12.052229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:36.695698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.123020+0000","last_change":"2023-10-06T11:15:11.092311+0000","last_active":"2023-10-06T11:15:12.123020+0000","last_peered":"2023-10-06T11:15:12.123020+0000","last_clean":"2023-10-06T11:15:12.123020+0000","last_became_active":"2023-10-06T11:15:11.091982+0000","last_became_peered":"2023-10-06T11:15:11.091982+0000","last_unstale":"2023-10-06T11:15:12.123020+0000","last_undegraded":"2023-10-06T11:15:12.123020+0000","last_fullsized":"2023-10-06T11:15:12.123020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:03.751582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.055538+0000","last_change":"2023-10-06T11:15:12.047944+0000","last_active":"2023-10-06T11:15:12.055538+0000","last_peered":"2023-10-06T11:15:12.055538+0000","last_clean":"2023-10-06T11:15:12.055538+0000","last_became_active":"2023-10-06T11:15:12.047664+0000","last_became_peered":"2023-10-06T11:15:12.047664+0000","last_unstale":"2023-10-06T11:15:12.055538+0000","last_undegraded":"2023-10-06T11:15:12.055538+0000","last_fullsized":"2023-10-06T11:15:12.055538+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:54.941688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041461+0000","last_change":"2023-10-06T11:15:11.099373+0000","last_active":"2023-10-06T11:15:12.041461+0000","last_peered":"2023-10-06T11:15:12.041461+0000","last_clean":"2023-10-06T11:15:12.041461+0000","last_became_active":"2023-10-06T11:15:11.099096+0000","last_became_peered":"2023-10-06T11:15:11.099096+0000","last_unstale":"2023-10-06T11:15:12.041461+0000","last_undegraded":"2023-10-06T11:15:12.041461+0000","last_fullsized":"2023-10-06T11:15:12.041461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:24.955210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.047088+0000","last_change":"2023-10-06T11:15:12.047088+0000","last_active":"2023-10-06T11:15:12.047088+0000","last_peered":"2023-10-06T11:15:12.047088+0000","last_clean":"2023-10-06T11:15:12.047088+0000","last_became_active":"2023-10-06T11:15:12.046821+0000","last_became_peered":"2023-10-06T11:15:12.046821+0000","last_unstale":"2023-10-06T11:15:12.047088+0000","last_undegraded":"2023-10-06T11:15:12.047088+0000","last_fullsized":"2023-10-06T11:15:12.047088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:31.204787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037232+0000","last_change":"2023-10-06T11:15:11.093987+0000","last_active":"2023-10-06T11:15:12.037232+0000","last_peered":"2023-10-06T11:15:12.037232+0000","last_clean":"2023-10-06T11:15:12.037232+0000","last_became_active":"2023-10-06T11:15:11.093419+0000","last_became_peered":"2023-10-06T11:15:11.093419+0000","last_unstale":"2023-10-06T11:15:12.037232+0000","last_undegraded":"2023-10-06T11:15:12.037232+0000","last_fullsized":"2023-10-06T11:15:12.037232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:07.689881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051988+0000","last_change":"2023-10-06T11:15:12.044856+0000","last_active":"2023-10-06T11:15:12.051988+0000","last_peered":"2023-10-06T11:15:12.051988+0000","last_clean":"2023-10-06T11:15:12.051988+0000","last_became_active":"2023-10-06T11:15:12.044589+0000","last_became_peered":"2023-10-06T11:15:12.044589+0000","last_unstale":"2023-10-06T11:15:12.051988+0000","last_undegraded":"2023-10-06T11:15:12.051988+0000","last_fullsized":"2023-10-06T11:15:12.051988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:30.067989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.123437+0000","last_change":"2023-10-06T11:15:11.091389+0000","last_active":"2023-10-06T11:15:12.123437+0000","last_peered":"2023-10-06T11:15:12.123437+0000","last_clean":"2023-10-06T11:15:12.123437+0000","last_became_active":"2023-10-06T11:15:11.091106+0000","last_became_peered":"2023-10-06T11:15:11.091106+0000","last_unstale":"2023-10-06T11:15:12.123437+0000","last_undegraded":"2023-10-06T11:15:12.123437+0000","last_fullsized":"2023-10-06T11:15:12.123437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:53.938839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.045777+0000","last_change":"2023-10-06T11:15:12.045777+0000","last_active":"2023-10-06T11:15:12.045777+0000","last_peered":"2023-10-06T11:15:12.045777+0000","last_clean":"2023-10-06T11:15:12.045777+0000","last_became_active":"2023-10-06T11:15:12.045482+0000","last_became_peered":"2023-10-06T11:15:12.045482+0000","last_unstale":"2023-10-06T11:15:12.045777+0000","last_undegraded":"2023-10-06T11:15:12.045777+0000","last_fullsized":"2023-10-06T11:15:12.045777+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:12.690575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120495+0000","last_change":"2023-10-06T11:15:11.099853+0000","last_active":"2023-10-06T11:15:12.120495+0000","last_peered":"2023-10-06T11:15:12.120495+0000","last_clean":"2023-10-06T11:15:12.120495+0000","last_became_active":"2023-10-06T11:15:11.099590+0000","last_became_peered":"2023-10-06T11:15:11.099590+0000","last_unstale":"2023-10-06T11:15:12.120495+0000","last_undegraded":"2023-10-06T11:15:12.120495+0000","last_fullsized":"2023-10-06T11:15:12.120495+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:03.751582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057125+0000","last_change":"2023-10-06T11:15:12.050897+0000","last_active":"2023-10-06T11:15:12.057125+0000","last_peered":"2023-10-06T11:15:12.057125+0000","last_clean":"2023-10-06T11:15:12.057125+0000","last_became_active":"2023-10-06T11:15:12.050586+0000","last_became_peered":"2023-10-06T11:15:12.050586+0000","last_unstale":"2023-10-06T11:15:12.057125+0000","last_undegraded":"2023-10-06T11:15:12.057125+0000","last_fullsized":"2023-10-06T11:15:12.057125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:31.643901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037231+0000","last_change":"2023-10-06T11:15:11.089210+0000","last_active":"2023-10-06T11:15:12.037231+0000","last_peered":"2023-10-06T11:15:12.037231+0000","last_clean":"2023-10-06T11:15:12.037231+0000","last_became_active":"2023-10-06T11:15:11.088902+0000","last_became_peered":"2023-10-06T11:15:11.088902+0000","last_unstale":"2023-10-06T11:15:12.037231+0000","last_undegraded":"2023-10-06T11:15:12.037231+0000","last_fullsized":"2023-10-06T11:15:12.037231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:00.408769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052713+0000","last_change":"2023-10-06T11:15:12.052713+0000","last_active":"2023-10-06T11:15:12.052713+0000","last_peered":"2023-10-06T11:15:12.052713+0000","last_clean":"2023-10-06T11:15:12.052713+0000","last_became_active":"2023-10-06T11:15:12.052438+0000","last_became_peered":"2023-10-06T11:15:12.052438+0000","last_unstale":"2023-10-06T11:15:12.052713+0000","last_undegraded":"2023-10-06T11:15:12.052713+0000","last_fullsized":"2023-10-06T11:15:12.052713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:29.570575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040275+0000","last_change":"2023-10-06T11:15:11.098361+0000","last_active":"2023-10-06T11:15:12.040275+0000","last_peered":"2023-10-06T11:15:12.040275+0000","last_clean":"2023-10-06T11:15:12.040275+0000","last_became_active":"2023-10-06T11:15:11.097339+0000","last_became_peered":"2023-10-06T11:15:11.097339+0000","last_unstale":"2023-10-06T11:15:12.040275+0000","last_undegraded":"2023-10-06T11:15:12.040275+0000","last_fullsized":"2023-10-06T11:15:12.040275+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:34.052417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.048529+0000","last_change":"2023-10-06T11:15:12.048529+0000","last_active":"2023-10-06T11:15:12.048529+0000","last_peered":"2023-10-06T11:15:12.048529+0000","last_clean":"2023-10-06T11:15:12.048529+0000","last_became_active":"2023-10-06T11:15:12.048251+0000","last_became_peered":"2023-10-06T11:15:12.048251+0000","last_unstale":"2023-10-06T11:15:12.048529+0000","last_undegraded":"2023-10-06T11:15:12.048529+0000","last_fullsized":"2023-10-06T11:15:12.048529+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:31.643901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.096734+0000","last_change":"2023-10-06T11:15:11.090737+0000","last_active":"2023-10-06T11:15:11.096734+0000","last_peered":"2023-10-06T11:15:11.096734+0000","last_clean":"2023-10-06T11:15:11.096734+0000","last_became_active":"2023-10-06T11:15:11.090404+0000","last_became_peered":"2023-10-06T11:15:11.090404+0000","last_unstale":"2023-10-06T11:15:11.096734+0000","last_undegraded":"2023-10-06T11:15:11.096734+0000","last_fullsized":"2023-10-06T11:15:11.096734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:07:36.156512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053517+0000","last_change":"2023-10-06T11:15:12.048219+0000","last_active":"2023-10-06T11:15:12.053517+0000","last_peered":"2023-10-06T11:15:12.053517+0000","last_clean":"2023-10-06T11:15:12.053517+0000","last_became_active":"2023-10-06T11:15:12.047924+0000","last_became_peered":"2023-10-06T11:15:12.047924+0000","last_unstale":"2023-10-06T11:15:12.053517+0000","last_undegraded":"2023-10-06T11:15:12.053517+0000","last_fullsized":"2023-10-06T11:15:12.053517+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:46.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040237+0000","last_change":"2023-10-06T11:15:11.094176+0000","last_active":"2023-10-06T11:15:12.040237+0000","last_peered":"2023-10-06T11:15:12.040237+0000","last_clean":"2023-10-06T11:15:12.040237+0000","last_became_active":"2023-10-06T11:15:11.093891+0000","last_became_peered":"2023-10-06T11:15:11.093891+0000","last_unstale":"2023-10-06T11:15:12.040237+0000","last_undegraded":"2023-10-06T11:15:12.040237+0000","last_fullsized":"2023-10-06T11:15:12.040237+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:19.770544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051575+0000","last_change":"2023-10-06T11:15:12.048071+0000","last_active":"2023-10-06T11:15:12.051575+0000","last_peered":"2023-10-06T11:15:12.051575+0000","last_clean":"2023-10-06T11:15:12.051575+0000","last_became_active":"2023-10-06T11:15:12.047772+0000","last_became_peered":"2023-10-06T11:15:12.047772+0000","last_unstale":"2023-10-06T11:15:12.051575+0000","last_undegraded":"2023-10-06T11:15:12.051575+0000","last_fullsized":"2023-10-06T11:15:12.051575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:01.411618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041170+0000","last_change":"2023-10-06T11:15:11.093535+0000","last_active":"2023-10-06T11:15:12.041170+0000","last_peered":"2023-10-06T11:15:12.041170+0000","last_clean":"2023-10-06T11:15:12.041170+0000","last_became_active":"2023-10-06T11:15:11.093282+0000","last_became_peered":"2023-10-06T11:15:11.093282+0000","last_unstale":"2023-10-06T11:15:12.041170+0000","last_undegraded":"2023-10-06T11:15:12.041170+0000","last_fullsized":"2023-10-06T11:15:12.041170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:58.511625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.055025+0000","last_change":"2023-10-06T11:15:12.051415+0000","last_active":"2023-10-06T11:15:12.055025+0000","last_peered":"2023-10-06T11:15:12.055025+0000","last_clean":"2023-10-06T11:15:12.055025+0000","last_became_active":"2023-10-06T11:15:12.051136+0000","last_became_peered":"2023-10-06T11:15:12.051136+0000","last_unstale":"2023-10-06T11:15:12.055025+0000","last_undegraded":"2023-10-06T11:15:12.055025+0000","last_fullsized":"2023-10-06T11:15:12.055025+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:46.317235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037517+0000","last_change":"2023-10-06T11:15:11.095257+0000","last_active":"2023-10-06T11:15:12.037517+0000","last_peered":"2023-10-06T11:15:12.037517+0000","last_clean":"2023-10-06T11:15:12.037517+0000","last_became_active":"2023-10-06T11:15:11.094709+0000","last_became_peered":"2023-10-06T11:15:11.094709+0000","last_unstale":"2023-10-06T11:15:12.037517+0000","last_undegraded":"2023-10-06T11:15:12.037517+0000","last_fullsized":"2023-10-06T11:15:12.037517+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:05.973186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051935+0000","last_change":"2023-10-06T11:15:12.048362+0000","last_active":"2023-10-06T11:15:12.051935+0000","last_peered":"2023-10-06T11:15:12.051935+0000","last_clean":"2023-10-06T11:15:12.051935+0000","last_became_active":"2023-10-06T11:15:12.048079+0000","last_became_peered":"2023-10-06T11:15:12.048079+0000","last_unstale":"2023-10-06T11:15:12.051935+0000","last_undegraded":"2023-10-06T11:15:12.051935+0000","last_fullsized":"2023-10-06T11:15:12.051935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:00.549566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040758+0000","last_change":"2023-10-06T11:15:11.097353+0000","last_active":"2023-10-06T11:15:12.040758+0000","last_peered":"2023-10-06T11:15:12.040758+0000","last_clean":"2023-10-06T11:15:12.040758+0000","last_became_active":"2023-10-06T11:15:11.097057+0000","last_became_peered":"2023-10-06T11:15:11.097057+0000","last_unstale":"2023-10-06T11:15:12.040758+0000","last_undegraded":"2023-10-06T11:15:12.040758+0000","last_fullsized":"2023-10-06T11:15:12.040758+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.533350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051603+0000","last_change":"2023-10-06T11:15:12.047487+0000","last_active":"2023-10-06T11:15:12.051603+0000","last_peered":"2023-10-06T11:15:12.051603+0000","last_clean":"2023-10-06T11:15:12.051603+0000","last_became_active":"2023-10-06T11:15:12.047157+0000","last_became_peered":"2023-10-06T11:15:12.047157+0000","last_unstale":"2023-10-06T11:15:12.051603+0000","last_undegraded":"2023-10-06T11:15:12.051603+0000","last_fullsized":"2023-10-06T11:15:12.051603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:05.536200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.103540+0000","last_change":"2023-10-06T11:15:11.100307+0000","last_active":"2023-10-06T11:15:11.103540+0000","last_peered":"2023-10-06T11:15:11.103540+0000","last_clean":"2023-10-06T11:15:11.103540+0000","last_became_active":"2023-10-06T11:15:11.100068+0000","last_became_peered":"2023-10-06T11:15:11.100068+0000","last_unstale":"2023-10-06T11:15:11.103540+0000","last_undegraded":"2023-10-06T11:15:11.103540+0000","last_fullsized":"2023-10-06T11:15:11.103540+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:44:59.546716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041931+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:15:12.041931+0000","last_peered":"2023-10-06T11:15:12.041931+0000","last_clean":"2023-10-06T11:15:12.041931+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:15:12.041931+0000","last_undegraded":"2023-10-06T11:15:12.041931+0000","last_fullsized":"2023-10-06T11:15:12.041931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053985+0000","last_change":"2023-10-06T11:15:12.050855+0000","last_active":"2023-10-06T11:15:12.053985+0000","last_peered":"2023-10-06T11:15:12.053985+0000","last_clean":"2023-10-06T11:15:12.053985+0000","last_became_active":"2023-10-06T11:15:12.050578+0000","last_became_peered":"2023-10-06T11:15:12.050578+0000","last_unstale":"2023-10-06T11:15:12.053985+0000","last_undegraded":"2023-10-06T11:15:12.053985+0000","last_fullsized":"2023-10-06T11:15:12.053985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:26:48.153418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041539+0000","last_change":"2023-10-06T11:15:11.097937+0000","last_active":"2023-10-06T11:15:12.041539+0000","last_peered":"2023-10-06T11:15:12.041539+0000","last_clean":"2023-10-06T11:15:12.041539+0000","last_became_active":"2023-10-06T11:15:11.097657+0000","last_became_peered":"2023-10-06T11:15:11.097657+0000","last_unstale":"2023-10-06T11:15:12.041539+0000","last_undegraded":"2023-10-06T11:15:12.041539+0000","last_fullsized":"2023-10-06T11:15:12.041539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:58.511625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.036943+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:15:12.036943+0000","last_peered":"2023-10-06T11:15:12.036943+0000","last_clean":"2023-10-06T11:15:12.036943+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:15:12.036943+0000","last_undegraded":"2023-10-06T11:15:12.036943+0000","last_fullsized":"2023-10-06T11:15:12.036943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058980+0000","last_change":"2023-10-06T11:15:12.054900+0000","last_active":"2023-10-06T11:15:12.058980+0000","last_peered":"2023-10-06T11:15:12.058980+0000","last_clean":"2023-10-06T11:15:12.058980+0000","last_became_active":"2023-10-06T11:15:12.054488+0000","last_became_peered":"2023-10-06T11:15:12.054488+0000","last_unstale":"2023-10-06T11:15:12.058980+0000","last_undegraded":"2023-10-06T11:15:12.058980+0000","last_fullsized":"2023-10-06T11:15:12.058980+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:09.270538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037346+0000","last_change":"2023-10-06T11:15:11.094161+0000","last_active":"2023-10-06T11:15:12.037346+0000","last_peered":"2023-10-06T11:15:12.037346+0000","last_clean":"2023-10-06T11:15:12.037346+0000","last_became_active":"2023-10-06T11:15:11.093741+0000","last_became_peered":"2023-10-06T11:15:11.093741+0000","last_unstale":"2023-10-06T11:15:12.037346+0000","last_undegraded":"2023-10-06T11:15:12.037346+0000","last_fullsized":"2023-10-06T11:15:12.037346+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:44:59.546716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040430+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:15:12.040430+0000","last_peered":"2023-10-06T11:15:12.040430+0000","last_clean":"2023-10-06T11:15:12.040430+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:15:12.040430+0000","last_undegraded":"2023-10-06T11:15:12.040430+0000","last_fullsized":"2023-10-06T11:15:12.040430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054012+0000","last_change":"2023-10-06T11:15:12.048580+0000","last_active":"2023-10-06T11:15:12.054012+0000","last_peered":"2023-10-06T11:15:12.054012+0000","last_clean":"2023-10-06T11:15:12.054012+0000","last_became_active":"2023-10-06T11:15:12.048256+0000","last_became_peered":"2023-10-06T11:15:12.048256+0000","last_unstale":"2023-10-06T11:15:12.054012+0000","last_undegraded":"2023-10-06T11:15:12.054012+0000","last_fullsized":"2023-10-06T11:15:12.054012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:39.744763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120576+0000","last_change":"2023-10-06T11:15:11.097396+0000","last_active":"2023-10-06T11:15:12.120576+0000","last_peered":"2023-10-06T11:15:12.120576+0000","last_clean":"2023-10-06T11:15:12.120576+0000","last_became_active":"2023-10-06T11:15:11.097149+0000","last_became_peered":"2023-10-06T11:15:11.097149+0000","last_unstale":"2023-10-06T11:15:12.120576+0000","last_undegraded":"2023-10-06T11:15:12.120576+0000","last_fullsized":"2023-10-06T11:15:12.120576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:45.441480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037446+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:15:12.037446+0000","last_peered":"2023-10-06T11:15:12.037446+0000","last_clean":"2023-10-06T11:15:12.037446+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:15:12.037446+0000","last_undegraded":"2023-10-06T11:15:12.037446+0000","last_fullsized":"2023-10-06T11:15:12.037446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.090380+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:15:11.090380+0000","last_peered":"2023-10-06T11:15:11.090380+0000","last_clean":"2023-10-06T11:15:11.090380+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:15:11.090380+0000","last_undegraded":"2023-10-06T11:15:11.090380+0000","last_fullsized":"2023-10-06T11:15:11.090380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052736+0000","last_change":"2023-10-06T11:15:12.049819+0000","last_active":"2023-10-06T11:15:12.052736+0000","last_peered":"2023-10-06T11:15:12.052736+0000","last_clean":"2023-10-06T11:15:12.052736+0000","last_became_active":"2023-10-06T11:15:12.049549+0000","last_became_peered":"2023-10-06T11:15:12.049549+0000","last_unstale":"2023-10-06T11:15:12.052736+0000","last_undegraded":"2023-10-06T11:15:12.052736+0000","last_fullsized":"2023-10-06T11:15:12.052736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:27.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.101194+0000","last_change":"2023-10-06T11:15:11.096588+0000","last_active":"2023-10-06T11:15:11.101194+0000","last_peered":"2023-10-06T11:15:11.101194+0000","last_clean":"2023-10-06T11:15:11.101194+0000","last_became_active":"2023-10-06T11:15:11.096313+0000","last_became_peered":"2023-10-06T11:15:11.096313+0000","last_unstale":"2023-10-06T11:15:11.101194+0000","last_undegraded":"2023-10-06T11:15:11.101194+0000","last_fullsized":"2023-10-06T11:15:11.101194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:03.810863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.090519+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:15:11.090519+0000","last_peered":"2023-10-06T11:15:11.090519+0000","last_clean":"2023-10-06T11:15:11.090519+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:15:11.090519+0000","last_undegraded":"2023-10-06T11:15:11.090519+0000","last_fullsized":"2023-10-06T11:15:11.090519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059143+0000","last_change":"2023-10-06T11:15:12.053666+0000","last_active":"2023-10-06T11:15:12.059143+0000","last_peered":"2023-10-06T11:15:12.059143+0000","last_clean":"2023-10-06T11:15:12.059143+0000","last_became_active":"2023-10-06T11:15:12.053083+0000","last_became_peered":"2023-10-06T11:15:12.053083+0000","last_unstale":"2023-10-06T11:15:12.059143+0000","last_undegraded":"2023-10-06T11:15:12.059143+0000","last_fullsized":"2023-10-06T11:15:12.059143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:33.478075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120526+0000","last_change":"2023-10-06T11:15:11.097238+0000","last_active":"2023-10-06T11:15:12.120526+0000","last_peered":"2023-10-06T11:15:12.120526+0000","last_clean":"2023-10-06T11:15:12.120526+0000","last_became_active":"2023-10-06T11:15:11.096884+0000","last_became_peered":"2023-10-06T11:15:11.096884+0000","last_unstale":"2023-10-06T11:15:12.120526+0000","last_undegraded":"2023-10-06T11:15:12.120526+0000","last_fullsized":"2023-10-06T11:15:12.120526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:37:02.733206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.090640+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:15:11.090640+0000","last_peered":"2023-10-06T11:15:11.090640+0000","last_clean":"2023-10-06T11:15:11.090640+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:15:11.090640+0000","last_undegraded":"2023-10-06T11:15:11.090640+0000","last_fullsized":"2023-10-06T11:15:11.090640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.050855+0000","last_change":"2023-10-06T11:15:12.050855+0000","last_active":"2023-10-06T11:15:12.050855+0000","last_peered":"2023-10-06T11:15:12.050855+0000","last_clean":"2023-10-06T11:15:12.050855+0000","last_became_active":"2023-10-06T11:15:12.050312+0000","last_became_peered":"2023-10-06T11:15:12.050312+0000","last_unstale":"2023-10-06T11:15:12.050855+0000","last_undegraded":"2023-10-06T11:15:12.050855+0000","last_fullsized":"2023-10-06T11:15:12.050855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:57.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120914+0000","last_change":"2023-10-06T11:15:11.095448+0000","last_active":"2023-10-06T11:15:12.120914+0000","last_peered":"2023-10-06T11:15:12.120914+0000","last_clean":"2023-10-06T11:15:12.120914+0000","last_became_active":"2023-10-06T11:15:11.094368+0000","last_became_peered":"2023-10-06T11:15:11.094368+0000","last_unstale":"2023-10-06T11:15:12.120914+0000","last_undegraded":"2023-10-06T11:15:12.120914+0000","last_fullsized":"2023-10-06T11:15:12.120914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:30.641052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.042284+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:15:12.042284+0000","last_peered":"2023-10-06T11:15:12.042284+0000","last_clean":"2023-10-06T11:15:12.042284+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:15:12.042284+0000","last_undegraded":"2023-10-06T11:15:12.042284+0000","last_fullsized":"2023-10-06T11:15:12.042284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054561+0000","last_change":"2023-10-06T11:15:12.051023+0000","last_active":"2023-10-06T11:15:12.054561+0000","last_peered":"2023-10-06T11:15:12.054561+0000","last_clean":"2023-10-06T11:15:12.054561+0000","last_became_active":"2023-10-06T11:15:12.050769+0000","last_became_peered":"2023-10-06T11:15:12.050769+0000","last_unstale":"2023-10-06T11:15:12.054561+0000","last_undegraded":"2023-10-06T11:15:12.054561+0000","last_fullsized":"2023-10-06T11:15:12.054561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:37.912016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120595+0000","last_change":"2023-10-06T11:15:11.094583+0000","last_active":"2023-10-06T11:15:12.120595+0000","last_peered":"2023-10-06T11:15:12.120595+0000","last_clean":"2023-10-06T11:15:12.120595+0000","last_became_active":"2023-10-06T11:15:11.094326+0000","last_became_peered":"2023-10-06T11:15:11.094326+0000","last_unstale":"2023-10-06T11:15:12.120595+0000","last_undegraded":"2023-10-06T11:15:12.120595+0000","last_fullsized":"2023-10-06T11:15:12.120595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:01.371488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041670+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:15:12.041670+0000","last_peered":"2023-10-06T11:15:12.041670+0000","last_clean":"2023-10-06T11:15:12.041670+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:15:12.041670+0000","last_undegraded":"2023-10-06T11:15:12.041670+0000","last_fullsized":"2023-10-06T11:15:12.041670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":959634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.498,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.438}]},{"osd":1,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4319999999999999,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.036,"15min":1.117},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77800000000000002,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78200000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78600000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80300000000000005,"5min":0.872,"15min":0.872},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":375731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":377763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42299999999999999,"15min":0.436},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83399999999999996,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.375,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.4319999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.92700000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.627,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.4219999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.5150000000000001,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.748,"15min":0.71699999999999997},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":7.2400000000000002,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.626}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.6919999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.1799999999999999,"5min":1.508,"15min":1.508},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298648,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073192,"statfs":{"total":96636764160,"available":96330948608,"internally_reserved":0,"allocated":1392640,"data_stored":959046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.221,"5min":0.214,"15min":0.214},"max":{"1min":0.46000000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51900000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.499,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52700000000000002,"5min":0.626,"15min":0.626},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.54800000000000004,"5min":0.626,"15min":0.626},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44400000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0680000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":377175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.378},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.318},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":375751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.218},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.376},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.499}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":375709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":368768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:16.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:16.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.377+0000 7fb56d90a700 1 Processor -- start 2023-10-06T11:15:16.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.377+0000 7fb56d90a700 1 -- start start 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d90a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb568140770 0x7fb56806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d90a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb568140b40 0x7fb5680aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d90a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680c6500 con 0x7fb5680af1c0 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d90a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680c67e0 con 0x7fb568140770 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d90a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c6ac0 con 0x7fb568140b40 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56c908700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb568140770 0x7fb56806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d109700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb5680af1c0 0x7fb56815adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35152/0 (socket says 172.21.15.55:35152) 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56d109700 1 -- 172.21.15.55:0/2438683873 learned_addr learned my addr 172.21.15.55:0/2438683873 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56c908700 1 -- 172.21.15.55:0/2438683873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb568140b40 msgr2=0x7fb5680aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb567fff700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb568140b40 0x7fb5680aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56c908700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb568140b40 0x7fb5680aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb5677fe700 1 -- 172.21.15.55:0/2438683873 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082981548 0 0) 0x7fb5680c6500 con 0x7fb5680af1c0 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56c908700 1 -- 172.21.15.55:0/2438683873 >> v1:172.21.15.55:6789/0 conn(0x7fb5680af1c0 legacy=0x7fb56815adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56c908700 1 -- 172.21.15.55:0/2438683873 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680c6da0 con 0x7fb568140770 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb567fff700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb568140b40 0x7fb5680aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.378+0000 7fb56c908700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb568140770 0x7fb56806d210 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0098e0 tx=0x7fb55c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e082fd6bed8e78c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb5677fe700 1 -- 172.21.15.55:0/2438683873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c009e80 con 0x7fb568140770 2023-10-06T11:15:16.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb5677fe700 1 -- 172.21.15.55:0/2438683873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c00b860 con 0x7fb568140770 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb5677fe700 1 -- 172.21.15.55:0/2438683873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00bbe0 con 0x7fb568140770 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 -- 172.21.15.55:0/2438683873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb568140770 msgr2=0x7fb56806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb568140770 0x7fb56806d210 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0098e0 tx=0x7fb55c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 -- 172.21.15.55:0/2438683873 shutdown_connections 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb568140770 0x7fb56806d210 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 --2- 172.21.15.55:0/2438683873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb568140b40 0x7fb5680aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 -- 172.21.15.55:0/2438683873 >> 172.21.15.55:0/2438683873 conn(0x7fb568068080 msgr2=0x7fb5680cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 -- 172.21.15.55:0/2438683873 shutdown_connections 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.379+0000 7fb56d90a700 1 -- 172.21.15.55:0/2438683873 wait complete. 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.380+0000 7fb56d90a700 1 Processor -- start 2023-10-06T11:15:16.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 -- start start 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5680af1c0 0x7fb5680c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb568140770 0x7fb56813c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 0x7fb5680c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c5e90 con 0x7fb5680c4750 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb568158060 con 0x7fb568140770 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d90a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56813cec0 con 0x7fb5680af1c0 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d109700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 0x7fb5680c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d109700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 0x7fb5680c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58950/0 (socket says 172.21.15.55:58950) 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.381+0000 7fb56d109700 1 -- 172.21.15.55:0/3366342121 learned_addr learned my addr 172.21.15.55:0/3366342121 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56c908700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5680af1c0 0x7fb5680c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb567fff700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb568140770 0x7fb56813c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d109700 1 -- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5680af1c0 msgr2=0x7fb5680c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d109700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5680af1c0 0x7fb5680c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d109700 1 -- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb568140770 msgr2=0x7fb56813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d109700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb568140770 0x7fb56813c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d109700 1 -- 172.21.15.55:0/3366342121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009420 con 0x7fb5680c4750 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d109700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 0x7fb5680c4bd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb56000ccc0 tx=0x7fb560001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000ab30 con 0x7fb5680c4750 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000ac90 con 0x7fb5680c4750 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5680c5bb0 con 0x7fb5680c4750 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560007340 con 0x7fb5680c4750 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.382+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56815a500 con 0x7fb5680c4750 2023-10-06T11:15:16.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.383+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5681581d0 con 0x7fb5680c4750 2023-10-06T11:15:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.384+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5600076b0 con 0x7fb5680c4750 2023-10-06T11:15:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.384+0000 7fb564ff9700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb54c066f60 0x7fb54c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.384+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb560084c50 con 0x7fb5680c4750 2023-10-06T11:15:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.384+0000 7fb56c908700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb54c066f60 0x7fb54c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.385+0000 7fb56c908700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb54c066f60 0x7fb54c069410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0091e0 tx=0x7fb55c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.388+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5681581d0 con 0x7fb5680c4750 2023-10-06T11:15:16.416 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-10-06T11:15:16.415+0000 7f746606a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:15:16.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.577+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5681581d0 con 0x7fb54c066f60 2023-10-06T11:15:16.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.586+0000 7fb564ff9700 1 -- 172.21.15.55:0/3366342121 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311145 (secure 0 0 0) 0x7fb5681581d0 con 0x7fb54c066f60 2023-10-06T11:15:16.593 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.589+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb54c066f60 msgr2=0x7fb54c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.589+0000 7fb56d90a700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb54c066f60 0x7fb54c069410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0091e0 tx=0x7fb55c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 msgr2=0x7fb5680c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 0x7fb5680c4bd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb56000ccc0 tx=0x7fb560001a80 comp rx=0 tx=0).stop 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 shutdown_connections 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb54c066f60 0x7fb54c069410 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680c4750 0x7fb5680c4bd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5680af1c0 0x7fb5680c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 --2- 172.21.15.55:0/3366342121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb568140770 0x7fb56813c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 >> 172.21.15.55:0/3366342121 conn(0x7fb568068080 msgr2=0x7fb5680b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 shutdown_connections 2023-10-06T11:15:16.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.590+0000 7fb56d90a700 1 -- 172.21.15.55:0/3366342121 wait complete. 2023-10-06T11:15:16.597 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:15:16.604 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T11:15:14.870150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385828,"kb_used_data":7524,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588892,"statfs":{"total":773094113280,"available":770651025408,"internally_reserved":0,"allocated":7704576,"data_stored":4169577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.794890"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052738+0000","last_change":"2023-10-06T11:15:12.052738+0000","last_active":"2023-10-06T11:15:12.052738+0000","last_peered":"2023-10-06T11:15:12.052738+0000","last_clean":"2023-10-06T11:15:12.052738+0000","last_became_active":"2023-10-06T11:15:12.052497+0000","last_became_peered":"2023-10-06T11:15:12.052497+0000","last_unstale":"2023-10-06T11:15:12.052738+0000","last_undegraded":"2023-10-06T11:15:12.052738+0000","last_fullsized":"2023-10-06T11:15:12.052738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:32.244000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059215+0000","last_change":"2023-10-06T11:15:12.056990+0000","last_active":"2023-10-06T11:15:12.059215+0000","last_peered":"2023-10-06T11:15:12.059215+0000","last_clean":"2023-10-06T11:15:12.059215+0000","last_became_active":"2023-10-06T11:15:12.056730+0000","last_became_peered":"2023-10-06T11:15:12.056730+0000","last_unstale":"2023-10-06T11:15:12.059215+0000","last_undegraded":"2023-10-06T11:15:12.059215+0000","last_fullsized":"2023-10-06T11:15:12.059215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:21.995464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053260+0000","last_change":"2023-10-06T11:15:12.046508+0000","last_active":"2023-10-06T11:15:12.053260+0000","last_peered":"2023-10-06T11:15:12.053260+0000","last_clean":"2023-10-06T11:15:12.053260+0000","last_became_active":"2023-10-06T11:15:12.046242+0000","last_became_peered":"2023-10-06T11:15:12.046242+0000","last_unstale":"2023-10-06T11:15:12.053260+0000","last_undegraded":"2023-10-06T11:15:12.053260+0000","last_fullsized":"2023-10-06T11:15:12.053260+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:12.690575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059120+0000","last_change":"2023-10-06T11:15:12.053339+0000","last_active":"2023-10-06T11:15:12.059120+0000","last_peered":"2023-10-06T11:15:12.059120+0000","last_clean":"2023-10-06T11:15:12.059120+0000","last_became_active":"2023-10-06T11:15:12.052363+0000","last_became_peered":"2023-10-06T11:15:12.052363+0000","last_unstale":"2023-10-06T11:15:12.059120+0000","last_undegraded":"2023-10-06T11:15:12.059120+0000","last_fullsized":"2023-10-06T11:15:12.059120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:08:48.309250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051808+0000","last_change":"2023-10-06T11:15:12.047804+0000","last_active":"2023-10-06T11:15:12.051808+0000","last_peered":"2023-10-06T11:15:12.051808+0000","last_clean":"2023-10-06T11:15:12.051808+0000","last_became_active":"2023-10-06T11:15:12.047481+0000","last_became_peered":"2023-10-06T11:15:12.047481+0000","last_unstale":"2023-10-06T11:15:12.051808+0000","last_undegraded":"2023-10-06T11:15:12.051808+0000","last_fullsized":"2023-10-06T11:15:12.051808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:04.754431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058301+0000","last_change":"2023-10-06T11:15:12.055346+0000","last_active":"2023-10-06T11:15:12.058301+0000","last_peered":"2023-10-06T11:15:12.058301+0000","last_clean":"2023-10-06T11:15:12.058301+0000","last_became_active":"2023-10-06T11:15:12.054998+0000","last_became_peered":"2023-10-06T11:15:12.054998+0000","last_unstale":"2023-10-06T11:15:12.058301+0000","last_undegraded":"2023-10-06T11:15:12.058301+0000","last_fullsized":"2023-10-06T11:15:12.058301+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:14.460503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051912+0000","last_change":"2023-10-06T11:15:12.045838+0000","last_active":"2023-10-06T11:15:12.051912+0000","last_peered":"2023-10-06T11:15:12.051912+0000","last_clean":"2023-10-06T11:15:12.051912+0000","last_became_active":"2023-10-06T11:15:12.045582+0000","last_became_peered":"2023-10-06T11:15:12.045582+0000","last_unstale":"2023-10-06T11:15:12.051912+0000","last_undegraded":"2023-10-06T11:15:12.051912+0000","last_fullsized":"2023-10-06T11:15:12.051912+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:29.570575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058289+0000","last_change":"2023-10-06T11:15:12.055352+0000","last_active":"2023-10-06T11:15:12.058289+0000","last_peered":"2023-10-06T11:15:12.058289+0000","last_clean":"2023-10-06T11:15:12.058289+0000","last_became_active":"2023-10-06T11:15:12.055033+0000","last_became_peered":"2023-10-06T11:15:12.055033+0000","last_unstale":"2023-10-06T11:15:12.058289+0000","last_undegraded":"2023-10-06T11:15:12.058289+0000","last_fullsized":"2023-10-06T11:15:12.058289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:08.692730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.048923+0000","last_change":"2023-10-06T11:15:12.043539+0000","last_active":"2023-10-06T11:15:12.048923+0000","last_peered":"2023-10-06T11:15:12.048923+0000","last_clean":"2023-10-06T11:15:12.048923+0000","last_became_active":"2023-10-06T11:15:12.043266+0000","last_became_peered":"2023-10-06T11:15:12.043266+0000","last_unstale":"2023-10-06T11:15:12.048923+0000","last_undegraded":"2023-10-06T11:15:12.048923+0000","last_fullsized":"2023-10-06T11:15:12.048923+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:30.819045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053889+0000","last_change":"2023-10-06T11:15:12.046513+0000","last_active":"2023-10-06T11:15:12.053889+0000","last_peered":"2023-10-06T11:15:12.053889+0000","last_clean":"2023-10-06T11:15:12.053889+0000","last_became_active":"2023-10-06T11:15:12.046204+0000","last_became_peered":"2023-10-06T11:15:12.046204+0000","last_unstale":"2023-10-06T11:15:12.053889+0000","last_undegraded":"2023-10-06T11:15:12.053889+0000","last_fullsized":"2023-10-06T11:15:12.053889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:15.546634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052873+0000","last_change":"2023-10-06T11:15:12.052873+0000","last_active":"2023-10-06T11:15:12.052873+0000","last_peered":"2023-10-06T11:15:12.052873+0000","last_clean":"2023-10-06T11:15:12.052873+0000","last_became_active":"2023-10-06T11:15:12.052477+0000","last_became_peered":"2023-10-06T11:15:12.052477+0000","last_unstale":"2023-10-06T11:15:12.052873+0000","last_undegraded":"2023-10-06T11:15:12.052873+0000","last_fullsized":"2023-10-06T11:15:12.052873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:04.813712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059134+0000","last_change":"2023-10-06T11:15:12.053509+0000","last_active":"2023-10-06T11:15:12.059134+0000","last_peered":"2023-10-06T11:15:12.059134+0000","last_clean":"2023-10-06T11:15:12.059134+0000","last_became_active":"2023-10-06T11:15:12.052737+0000","last_became_peered":"2023-10-06T11:15:12.052737+0000","last_unstale":"2023-10-06T11:15:12.059134+0000","last_undegraded":"2023-10-06T11:15:12.059134+0000","last_fullsized":"2023-10-06T11:15:12.059134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:38.504386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.048585+0000","last_change":"2023-10-06T11:15:12.048585+0000","last_active":"2023-10-06T11:15:12.048585+0000","last_peered":"2023-10-06T11:15:12.048585+0000","last_clean":"2023-10-06T11:15:12.048585+0000","last_became_active":"2023-10-06T11:15:12.048413+0000","last_became_peered":"2023-10-06T11:15:12.048413+0000","last_unstale":"2023-10-06T11:15:12.048585+0000","last_undegraded":"2023-10-06T11:15:12.048585+0000","last_fullsized":"2023-10-06T11:15:12.048585+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:35:45.584771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051466+0000","last_change":"2023-10-06T11:15:12.046359+0000","last_active":"2023-10-06T11:15:12.051466+0000","last_peered":"2023-10-06T11:15:12.051466+0000","last_clean":"2023-10-06T11:15:12.051466+0000","last_became_active":"2023-10-06T11:15:12.045852+0000","last_became_peered":"2023-10-06T11:15:12.045852+0000","last_unstale":"2023-10-06T11:15:12.051466+0000","last_undegraded":"2023-10-06T11:15:12.051466+0000","last_fullsized":"2023-10-06T11:15:12.051466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:01.906834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.046359+0000","last_change":"2023-10-06T11:15:12.046359+0000","last_active":"2023-10-06T11:15:12.046359+0000","last_peered":"2023-10-06T11:15:12.046359+0000","last_clean":"2023-10-06T11:15:12.046359+0000","last_became_active":"2023-10-06T11:15:12.046101+0000","last_became_peered":"2023-10-06T11:15:12.046101+0000","last_unstale":"2023-10-06T11:15:12.046359+0000","last_undegraded":"2023-10-06T11:15:12.046359+0000","last_fullsized":"2023-10-06T11:15:12.046359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:09.270538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054644+0000","last_change":"2023-10-06T11:15:12.053237+0000","last_active":"2023-10-06T11:15:12.054644+0000","last_peered":"2023-10-06T11:15:12.054644+0000","last_clean":"2023-10-06T11:15:12.054644+0000","last_became_active":"2023-10-06T11:15:12.052992+0000","last_became_peered":"2023-10-06T11:15:12.052992+0000","last_unstale":"2023-10-06T11:15:12.054644+0000","last_undegraded":"2023-10-06T11:15:12.054644+0000","last_fullsized":"2023-10-06T11:15:12.054644+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:59.563337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058562+0000","last_change":"2023-10-06T11:15:12.051576+0000","last_active":"2023-10-06T11:15:12.058562+0000","last_peered":"2023-10-06T11:15:12.058562+0000","last_clean":"2023-10-06T11:15:12.058562+0000","last_became_active":"2023-10-06T11:15:12.051284+0000","last_became_peered":"2023-10-06T11:15:12.051284+0000","last_unstale":"2023-10-06T11:15:12.058562+0000","last_undegraded":"2023-10-06T11:15:12.058562+0000","last_fullsized":"2023-10-06T11:15:12.058562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:46.444329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059058+0000","last_change":"2023-10-06T11:15:12.052791+0000","last_active":"2023-10-06T11:15:12.059058+0000","last_peered":"2023-10-06T11:15:12.059058+0000","last_clean":"2023-10-06T11:15:12.059058+0000","last_became_active":"2023-10-06T11:15:12.052539+0000","last_became_peered":"2023-10-06T11:15:12.052539+0000","last_unstale":"2023-10-06T11:15:12.059058+0000","last_undegraded":"2023-10-06T11:15:12.059058+0000","last_fullsized":"2023-10-06T11:15:12.059058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:23.778781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058088+0000","last_change":"2023-10-06T11:15:12.052807+0000","last_active":"2023-10-06T11:15:12.058088+0000","last_peered":"2023-10-06T11:15:12.058088+0000","last_clean":"2023-10-06T11:15:12.058088+0000","last_became_active":"2023-10-06T11:15:12.051908+0000","last_became_peered":"2023-10-06T11:15:12.051908+0000","last_unstale":"2023-10-06T11:15:12.058088+0000","last_undegraded":"2023-10-06T11:15:12.058088+0000","last_fullsized":"2023-10-06T11:15:12.058088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:38.179903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.044628+0000","last_change":"2023-10-06T11:15:12.044628+0000","last_active":"2023-10-06T11:15:12.044628+0000","last_peered":"2023-10-06T11:15:12.044628+0000","last_clean":"2023-10-06T11:15:12.044628+0000","last_became_active":"2023-10-06T11:15:12.044336+0000","last_became_peered":"2023-10-06T11:15:12.044336+0000","last_unstale":"2023-10-06T11:15:12.044628+0000","last_undegraded":"2023-10-06T11:15:12.044628+0000","last_fullsized":"2023-10-06T11:15:12.044628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:05.884133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059166+0000","last_change":"2023-10-06T11:15:12.056225+0000","last_active":"2023-10-06T11:15:12.059166+0000","last_peered":"2023-10-06T11:15:12.059166+0000","last_clean":"2023-10-06T11:15:12.059166+0000","last_became_active":"2023-10-06T11:15:12.055876+0000","last_became_peered":"2023-10-06T11:15:12.055876+0000","last_unstale":"2023-10-06T11:15:12.059166+0000","last_undegraded":"2023-10-06T11:15:12.059166+0000","last_fullsized":"2023-10-06T11:15:12.059166+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:32.244000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.049617+0000","last_change":"2023-10-06T11:15:12.045396+0000","last_active":"2023-10-06T11:15:12.049617+0000","last_peered":"2023-10-06T11:15:12.049617+0000","last_clean":"2023-10-06T11:15:12.049617+0000","last_became_active":"2023-10-06T11:15:12.045133+0000","last_became_peered":"2023-10-06T11:15:12.045133+0000","last_unstale":"2023-10-06T11:15:12.049617+0000","last_undegraded":"2023-10-06T11:15:12.049617+0000","last_fullsized":"2023-10-06T11:15:12.049617+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:56.109304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.047578+0000","last_change":"2023-10-06T11:15:12.047578+0000","last_active":"2023-10-06T11:15:12.047578+0000","last_peered":"2023-10-06T11:15:12.047578+0000","last_clean":"2023-10-06T11:15:12.047578+0000","last_became_active":"2023-10-06T11:15:12.047207+0000","last_became_peered":"2023-10-06T11:15:12.047207+0000","last_unstale":"2023-10-06T11:15:12.047578+0000","last_undegraded":"2023-10-06T11:15:12.047578+0000","last_fullsized":"2023-10-06T11:15:12.047578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:19:59.460547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054304+0000","last_change":"2023-10-06T11:15:12.054304+0000","last_active":"2023-10-06T11:15:12.054304+0000","last_peered":"2023-10-06T11:15:12.054304+0000","last_clean":"2023-10-06T11:15:12.054304+0000","last_became_active":"2023-10-06T11:15:12.053956+0000","last_became_peered":"2023-10-06T11:15:12.053956+0000","last_unstale":"2023-10-06T11:15:12.054304+0000","last_undegraded":"2023-10-06T11:15:12.054304+0000","last_fullsized":"2023-10-06T11:15:12.054304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.454679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051190+0000","last_change":"2023-10-06T11:15:12.046981+0000","last_active":"2023-10-06T11:15:12.051190+0000","last_peered":"2023-10-06T11:15:12.051190+0000","last_clean":"2023-10-06T11:15:12.051190+0000","last_became_active":"2023-10-06T11:15:12.046716+0000","last_became_peered":"2023-10-06T11:15:12.046716+0000","last_unstale":"2023-10-06T11:15:12.051190+0000","last_undegraded":"2023-10-06T11:15:12.051190+0000","last_fullsized":"2023-10-06T11:15:12.051190+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:35:45.584771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.046515+0000","last_change":"2023-10-06T11:15:12.044984+0000","last_active":"2023-10-06T11:15:12.046515+0000","last_peered":"2023-10-06T11:15:12.046515+0000","last_clean":"2023-10-06T11:15:12.046515+0000","last_became_active":"2023-10-06T11:15:12.044710+0000","last_became_peered":"2023-10-06T11:15:12.044710+0000","last_unstale":"2023-10-06T11:15:12.046515+0000","last_undegraded":"2023-10-06T11:15:12.046515+0000","last_fullsized":"2023-10-06T11:15:12.046515+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:33.178980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053280+0000","last_change":"2023-10-06T11:15:12.048637+0000","last_active":"2023-10-06T11:15:12.053280+0000","last_peered":"2023-10-06T11:15:12.053280+0000","last_clean":"2023-10-06T11:15:12.053280+0000","last_became_active":"2023-10-06T11:15:12.048398+0000","last_became_peered":"2023-10-06T11:15:12.048398+0000","last_unstale":"2023-10-06T11:15:12.053280+0000","last_undegraded":"2023-10-06T11:15:12.053280+0000","last_fullsized":"2023-10-06T11:15:12.053280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:41.966367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052053+0000","last_change":"2023-10-06T11:15:12.046301+0000","last_active":"2023-10-06T11:15:12.052053+0000","last_peered":"2023-10-06T11:15:12.052053+0000","last_clean":"2023-10-06T11:15:12.052053+0000","last_became_active":"2023-10-06T11:15:12.046017+0000","last_became_peered":"2023-10-06T11:15:12.046017+0000","last_unstale":"2023-10-06T11:15:12.052053+0000","last_undegraded":"2023-10-06T11:15:12.052053+0000","last_fullsized":"2023-10-06T11:15:12.052053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:23.867660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052715+0000","last_change":"2023-10-06T11:15:12.046311+0000","last_active":"2023-10-06T11:15:12.052715+0000","last_peered":"2023-10-06T11:15:12.052715+0000","last_clean":"2023-10-06T11:15:12.052715+0000","last_became_active":"2023-10-06T11:15:12.046031+0000","last_became_peered":"2023-10-06T11:15:12.046031+0000","last_unstale":"2023-10-06T11:15:12.052715+0000","last_undegraded":"2023-10-06T11:15:12.052715+0000","last_fullsized":"2023-10-06T11:15:12.052715+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:24:32.458335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057094+0000","last_change":"2023-10-06T11:15:12.050858+0000","last_active":"2023-10-06T11:15:12.057094+0000","last_peered":"2023-10-06T11:15:12.057094+0000","last_clean":"2023-10-06T11:15:12.057094+0000","last_became_active":"2023-10-06T11:15:12.050567+0000","last_became_peered":"2023-10-06T11:15:12.050567+0000","last_unstale":"2023-10-06T11:15:12.057094+0000","last_undegraded":"2023-10-06T11:15:12.057094+0000","last_fullsized":"2023-10-06T11:15:12.057094+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:50.637771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.044539+0000","last_change":"2023-10-06T11:15:12.043051+0000","last_active":"2023-10-06T11:15:12.044539+0000","last_peered":"2023-10-06T11:15:12.044539+0000","last_clean":"2023-10-06T11:15:12.044539+0000","last_became_active":"2023-10-06T11:15:12.042782+0000","last_became_peered":"2023-10-06T11:15:12.042782+0000","last_unstale":"2023-10-06T11:15:12.044539+0000","last_undegraded":"2023-10-06T11:15:12.044539+0000","last_fullsized":"2023-10-06T11:15:12.044539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.454679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057845+0000","last_change":"2023-10-06T11:15:12.052222+0000","last_active":"2023-10-06T11:15:12.057845+0000","last_peered":"2023-10-06T11:15:12.057845+0000","last_clean":"2023-10-06T11:15:12.057845+0000","last_became_active":"2023-10-06T11:15:12.051815+0000","last_became_peered":"2023-10-06T11:15:12.051815+0000","last_unstale":"2023-10-06T11:15:12.057845+0000","last_undegraded":"2023-10-06T11:15:12.057845+0000","last_fullsized":"2023-10-06T11:15:12.057845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:07.620085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054380+0000","last_change":"2023-10-06T11:15:12.054380+0000","last_active":"2023-10-06T11:15:12.054380+0000","last_peered":"2023-10-06T11:15:12.054380+0000","last_clean":"2023-10-06T11:15:12.054380+0000","last_became_active":"2023-10-06T11:15:12.053487+0000","last_became_peered":"2023-10-06T11:15:12.053487+0000","last_unstale":"2023-10-06T11:15:12.054380+0000","last_undegraded":"2023-10-06T11:15:12.054380+0000","last_fullsized":"2023-10-06T11:15:12.054380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:50.637771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.117955+0000","last_change":"2023-10-06T11:15:11.101976+0000","last_active":"2023-10-06T11:15:12.117955+0000","last_peered":"2023-10-06T11:15:12.117955+0000","last_clean":"2023-10-06T11:15:12.117955+0000","last_became_active":"2023-10-06T11:15:11.101729+0000","last_became_peered":"2023-10-06T11:15:11.101729+0000","last_unstale":"2023-10-06T11:15:12.117955+0000","last_undegraded":"2023-10-06T11:15:12.117955+0000","last_fullsized":"2023-10-06T11:15:12.117955+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:00.408769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051784+0000","last_change":"2023-10-06T11:15:12.045771+0000","last_active":"2023-10-06T11:15:12.051784+0000","last_peered":"2023-10-06T11:15:12.051784+0000","last_clean":"2023-10-06T11:15:12.051784+0000","last_became_active":"2023-10-06T11:15:12.045078+0000","last_became_peered":"2023-10-06T11:15:12.045078+0000","last_unstale":"2023-10-06T11:15:12.051784+0000","last_undegraded":"2023-10-06T11:15:12.051784+0000","last_fullsized":"2023-10-06T11:15:12.051784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:25.958059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"66'1","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.035079+0000","last_change":"2023-10-06T11:15:11.095632+0000","last_active":"2023-10-06T11:15:12.035079+0000","last_peered":"2023-10-06T11:15:12.035079+0000","last_clean":"2023-10-06T11:15:12.035079+0000","last_became_active":"2023-10-06T11:15:11.095445+0000","last_became_peered":"2023-10-06T11:15:11.095445+0000","last_unstale":"2023-10-06T11:15:12.035079+0000","last_undegraded":"2023-10-06T11:15:12.035079+0000","last_fullsized":"2023-10-06T11:15:12.035079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:19:58.457698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.062292+0000","last_change":"2023-10-06T11:15:12.057963+0000","last_active":"2023-10-06T11:15:12.062292+0000","last_peered":"2023-10-06T11:15:12.062292+0000","last_clean":"2023-10-06T11:15:12.062292+0000","last_became_active":"2023-10-06T11:15:12.057593+0000","last_became_peered":"2023-10-06T11:15:12.057593+0000","last_unstale":"2023-10-06T11:15:12.062292+0000","last_undegraded":"2023-10-06T11:15:12.062292+0000","last_fullsized":"2023-10-06T11:15:12.062292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:48.708737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120942+0000","last_change":"2023-10-06T11:15:11.094579+0000","last_active":"2023-10-06T11:15:12.120942+0000","last_peered":"2023-10-06T11:15:12.120942+0000","last_clean":"2023-10-06T11:15:12.120942+0000","last_became_active":"2023-10-06T11:15:11.094314+0000","last_became_peered":"2023-10-06T11:15:11.094314+0000","last_unstale":"2023-10-06T11:15:12.120942+0000","last_undegraded":"2023-10-06T11:15:12.120942+0000","last_fullsized":"2023-10-06T11:15:12.120942+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:56.805921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.050173+0000","last_change":"2023-10-06T11:15:12.050173+0000","last_active":"2023-10-06T11:15:12.050173+0000","last_peered":"2023-10-06T11:15:12.050173+0000","last_clean":"2023-10-06T11:15:12.050173+0000","last_became_active":"2023-10-06T11:15:12.049883+0000","last_became_peered":"2023-10-06T11:15:12.049883+0000","last_unstale":"2023-10-06T11:15:12.050173+0000","last_undegraded":"2023-10-06T11:15:12.050173+0000","last_fullsized":"2023-10-06T11:15:12.050173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:07:37.159361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120629+0000","last_change":"2023-10-06T11:15:11.097656+0000","last_active":"2023-10-06T11:15:12.120629+0000","last_peered":"2023-10-06T11:15:12.120629+0000","last_clean":"2023-10-06T11:15:12.120629+0000","last_became_active":"2023-10-06T11:15:11.097360+0000","last_became_peered":"2023-10-06T11:15:11.097360+0000","last_unstale":"2023-10-06T11:15:12.120629+0000","last_undegraded":"2023-10-06T11:15:12.120629+0000","last_fullsized":"2023-10-06T11:15:12.120629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:29.065140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.044524+0000","last_change":"2023-10-06T11:15:12.040582+0000","last_active":"2023-10-06T11:15:12.044524+0000","last_peered":"2023-10-06T11:15:12.044524+0000","last_clean":"2023-10-06T11:15:12.044524+0000","last_became_active":"2023-10-06T11:15:12.040281+0000","last_became_peered":"2023-10-06T11:15:12.040281+0000","last_unstale":"2023-10-06T11:15:12.044524+0000","last_undegraded":"2023-10-06T11:15:12.044524+0000","last_fullsized":"2023-10-06T11:15:12.044524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:57.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.115644+0000","last_change":"2023-10-06T11:15:11.097483+0000","last_active":"2023-10-06T11:15:12.115644+0000","last_peered":"2023-10-06T11:15:12.115644+0000","last_clean":"2023-10-06T11:15:12.115644+0000","last_became_active":"2023-10-06T11:15:11.097212+0000","last_became_peered":"2023-10-06T11:15:11.097212+0000","last_unstale":"2023-10-06T11:15:12.115644+0000","last_undegraded":"2023-10-06T11:15:12.115644+0000","last_fullsized":"2023-10-06T11:15:12.115644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:31.241150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051411+0000","last_change":"2023-10-06T11:15:12.047038+0000","last_active":"2023-10-06T11:15:12.051411+0000","last_peered":"2023-10-06T11:15:12.051411+0000","last_clean":"2023-10-06T11:15:12.051411+0000","last_became_active":"2023-10-06T11:15:12.046753+0000","last_became_peered":"2023-10-06T11:15:12.046753+0000","last_unstale":"2023-10-06T11:15:12.051411+0000","last_undegraded":"2023-10-06T11:15:12.051411+0000","last_fullsized":"2023-10-06T11:15:12.051411+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:31.204787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.117783+0000","last_change":"2023-10-06T11:15:11.097996+0000","last_active":"2023-10-06T11:15:12.117783+0000","last_peered":"2023-10-06T11:15:12.117783+0000","last_clean":"2023-10-06T11:15:12.117783+0000","last_became_active":"2023-10-06T11:15:11.097665+0000","last_became_peered":"2023-10-06T11:15:11.097665+0000","last_unstale":"2023-10-06T11:15:12.117783+0000","last_undegraded":"2023-10-06T11:15:12.117783+0000","last_fullsized":"2023-10-06T11:15:12.117783+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:00.903985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051592+0000","last_change":"2023-10-06T11:15:12.047597+0000","last_active":"2023-10-06T11:15:12.051592+0000","last_peered":"2023-10-06T11:15:12.051592+0000","last_clean":"2023-10-06T11:15:12.051592+0000","last_became_active":"2023-10-06T11:15:12.047309+0000","last_became_peered":"2023-10-06T11:15:12.047309+0000","last_unstale":"2023-10-06T11:15:12.051592+0000","last_undegraded":"2023-10-06T11:15:12.051592+0000","last_fullsized":"2023-10-06T11:15:12.051592+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:59.514474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.042426+0000","last_change":"2023-10-06T11:15:11.093636+0000","last_active":"2023-10-06T11:15:12.042426+0000","last_peered":"2023-10-06T11:15:12.042426+0000","last_clean":"2023-10-06T11:15:12.042426+0000","last_became_active":"2023-10-06T11:15:11.093311+0000","last_became_peered":"2023-10-06T11:15:11.093311+0000","last_unstale":"2023-10-06T11:15:12.042426+0000","last_undegraded":"2023-10-06T11:15:12.042426+0000","last_fullsized":"2023-10-06T11:15:12.042426+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.533350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.047976+0000","last_change":"2023-10-06T11:15:12.047976+0000","last_active":"2023-10-06T11:15:12.047976+0000","last_peered":"2023-10-06T11:15:12.047976+0000","last_clean":"2023-10-06T11:15:12.047976+0000","last_became_active":"2023-10-06T11:15:12.047649+0000","last_became_peered":"2023-10-06T11:15:12.047649+0000","last_unstale":"2023-10-06T11:15:12.047976+0000","last_undegraded":"2023-10-06T11:15:12.047976+0000","last_fullsized":"2023-10-06T11:15:12.047976+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:28.823418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.039782+0000","last_change":"2023-10-06T11:15:11.101865+0000","last_active":"2023-10-06T11:15:12.039782+0000","last_peered":"2023-10-06T11:15:12.039782+0000","last_clean":"2023-10-06T11:15:12.039782+0000","last_became_active":"2023-10-06T11:15:11.101591+0000","last_became_peered":"2023-10-06T11:15:11.101591+0000","last_unstale":"2023-10-06T11:15:12.039782+0000","last_undegraded":"2023-10-06T11:15:12.039782+0000","last_fullsized":"2023-10-06T11:15:12.039782+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:34.264602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057067+0000","last_change":"2023-10-06T11:15:12.049200+0000","last_active":"2023-10-06T11:15:12.057067+0000","last_peered":"2023-10-06T11:15:12.057067+0000","last_clean":"2023-10-06T11:15:12.057067+0000","last_became_active":"2023-10-06T11:15:12.048972+0000","last_became_peered":"2023-10-06T11:15:12.048972+0000","last_unstale":"2023-10-06T11:15:12.057067+0000","last_undegraded":"2023-10-06T11:15:12.057067+0000","last_fullsized":"2023-10-06T11:15:12.057067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:09.825629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037983+0000","last_change":"2023-10-06T11:15:11.095764+0000","last_active":"2023-10-06T11:15:12.037983+0000","last_peered":"2023-10-06T11:15:12.037983+0000","last_clean":"2023-10-06T11:15:12.037983+0000","last_became_active":"2023-10-06T11:15:11.095543+0000","last_became_peered":"2023-10-06T11:15:11.095543+0000","last_unstale":"2023-10-06T11:15:12.037983+0000","last_undegraded":"2023-10-06T11:15:12.037983+0000","last_fullsized":"2023-10-06T11:15:12.037983+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:05.498484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053969+0000","last_change":"2023-10-06T11:15:12.053969+0000","last_active":"2023-10-06T11:15:12.053969+0000","last_peered":"2023-10-06T11:15:12.053969+0000","last_clean":"2023-10-06T11:15:12.053969+0000","last_became_active":"2023-10-06T11:15:12.053698+0000","last_became_peered":"2023-10-06T11:15:12.053698+0000","last_unstale":"2023-10-06T11:15:12.053969+0000","last_undegraded":"2023-10-06T11:15:12.053969+0000","last_fullsized":"2023-10-06T11:15:12.053969+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:33.178980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040977+0000","last_change":"2023-10-06T11:15:11.099813+0000","last_active":"2023-10-06T11:15:12.040977+0000","last_peered":"2023-10-06T11:15:12.040977+0000","last_clean":"2023-10-06T11:15:12.040977+0000","last_became_active":"2023-10-06T11:15:11.099625+0000","last_became_peered":"2023-10-06T11:15:11.099625+0000","last_unstale":"2023-10-06T11:15:12.040977+0000","last_undegraded":"2023-10-06T11:15:12.040977+0000","last_fullsized":"2023-10-06T11:15:12.040977+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:57.296051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058229+0000","last_change":"2023-10-06T11:15:12.055042+0000","last_active":"2023-10-06T11:15:12.058229+0000","last_peered":"2023-10-06T11:15:12.058229+0000","last_clean":"2023-10-06T11:15:12.058229+0000","last_became_active":"2023-10-06T11:15:12.054638+0000","last_became_peered":"2023-10-06T11:15:12.054638+0000","last_unstale":"2023-10-06T11:15:12.058229+0000","last_undegraded":"2023-10-06T11:15:12.058229+0000","last_fullsized":"2023-10-06T11:15:12.058229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:18.411246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.118364+0000","last_change":"2023-10-06T11:15:11.094409+0000","last_active":"2023-10-06T11:15:12.118364+0000","last_peered":"2023-10-06T11:15:12.118364+0000","last_clean":"2023-10-06T11:15:12.118364+0000","last_became_active":"2023-10-06T11:15:11.094116+0000","last_became_peered":"2023-10-06T11:15:11.094116+0000","last_unstale":"2023-10-06T11:15:12.118364+0000","last_undegraded":"2023-10-06T11:15:12.118364+0000","last_fullsized":"2023-10-06T11:15:12.118364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:35.692849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053805+0000","last_change":"2023-10-06T11:15:12.050420+0000","last_active":"2023-10-06T11:15:12.053805+0000","last_peered":"2023-10-06T11:15:12.053805+0000","last_clean":"2023-10-06T11:15:12.053805+0000","last_became_active":"2023-10-06T11:15:12.050043+0000","last_became_peered":"2023-10-06T11:15:12.050043+0000","last_unstale":"2023-10-06T11:15:12.053805+0000","last_undegraded":"2023-10-06T11:15:12.053805+0000","last_fullsized":"2023-10-06T11:15:12.053805+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:58.298900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.117119+0000","last_change":"2023-10-06T11:15:11.098443+0000","last_active":"2023-10-06T11:15:12.117119+0000","last_peered":"2023-10-06T11:15:12.117119+0000","last_clean":"2023-10-06T11:15:12.117119+0000","last_became_active":"2023-10-06T11:15:11.098157+0000","last_became_peered":"2023-10-06T11:15:11.098157+0000","last_unstale":"2023-10-06T11:15:12.117119+0000","last_undegraded":"2023-10-06T11:15:12.117119+0000","last_fullsized":"2023-10-06T11:15:12.117119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:00.903985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052229+0000","last_change":"2023-10-06T11:15:12.052229+0000","last_active":"2023-10-06T11:15:12.052229+0000","last_peered":"2023-10-06T11:15:12.052229+0000","last_clean":"2023-10-06T11:15:12.052229+0000","last_became_active":"2023-10-06T11:15:12.051967+0000","last_became_peered":"2023-10-06T11:15:12.051967+0000","last_unstale":"2023-10-06T11:15:12.052229+0000","last_undegraded":"2023-10-06T11:15:12.052229+0000","last_fullsized":"2023-10-06T11:15:12.052229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:36.695698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.123020+0000","last_change":"2023-10-06T11:15:11.092311+0000","last_active":"2023-10-06T11:15:12.123020+0000","last_peered":"2023-10-06T11:15:12.123020+0000","last_clean":"2023-10-06T11:15:12.123020+0000","last_became_active":"2023-10-06T11:15:11.091982+0000","last_became_peered":"2023-10-06T11:15:11.091982+0000","last_unstale":"2023-10-06T11:15:12.123020+0000","last_undegraded":"2023-10-06T11:15:12.123020+0000","last_fullsized":"2023-10-06T11:15:12.123020+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:03.751582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.055538+0000","last_change":"2023-10-06T11:15:12.047944+0000","last_active":"2023-10-06T11:15:12.055538+0000","last_peered":"2023-10-06T11:15:12.055538+0000","last_clean":"2023-10-06T11:15:12.055538+0000","last_became_active":"2023-10-06T11:15:12.047664+0000","last_became_peered":"2023-10-06T11:15:12.047664+0000","last_unstale":"2023-10-06T11:15:12.055538+0000","last_undegraded":"2023-10-06T11:15:12.055538+0000","last_fullsized":"2023-10-06T11:15:12.055538+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:54.941688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041461+0000","last_change":"2023-10-06T11:15:11.099373+0000","last_active":"2023-10-06T11:15:12.041461+0000","last_peered":"2023-10-06T11:15:12.041461+0000","last_clean":"2023-10-06T11:15:12.041461+0000","last_became_active":"2023-10-06T11:15:11.099096+0000","last_became_peered":"2023-10-06T11:15:11.099096+0000","last_unstale":"2023-10-06T11:15:12.041461+0000","last_undegraded":"2023-10-06T11:15:12.041461+0000","last_fullsized":"2023-10-06T11:15:12.041461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:24.955210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.047088+0000","last_change":"2023-10-06T11:15:12.047088+0000","last_active":"2023-10-06T11:15:12.047088+0000","last_peered":"2023-10-06T11:15:12.047088+0000","last_clean":"2023-10-06T11:15:12.047088+0000","last_became_active":"2023-10-06T11:15:12.046821+0000","last_became_peered":"2023-10-06T11:15:12.046821+0000","last_unstale":"2023-10-06T11:15:12.047088+0000","last_undegraded":"2023-10-06T11:15:12.047088+0000","last_fullsized":"2023-10-06T11:15:12.047088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:31.204787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037232+0000","last_change":"2023-10-06T11:15:11.093987+0000","last_active":"2023-10-06T11:15:12.037232+0000","last_peered":"2023-10-06T11:15:12.037232+0000","last_clean":"2023-10-06T11:15:12.037232+0000","last_became_active":"2023-10-06T11:15:11.093419+0000","last_became_peered":"2023-10-06T11:15:11.093419+0000","last_unstale":"2023-10-06T11:15:12.037232+0000","last_undegraded":"2023-10-06T11:15:12.037232+0000","last_fullsized":"2023-10-06T11:15:12.037232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:07.689881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051988+0000","last_change":"2023-10-06T11:15:12.044856+0000","last_active":"2023-10-06T11:15:12.051988+0000","last_peered":"2023-10-06T11:15:12.051988+0000","last_clean":"2023-10-06T11:15:12.051988+0000","last_became_active":"2023-10-06T11:15:12.044589+0000","last_became_peered":"2023-10-06T11:15:12.044589+0000","last_unstale":"2023-10-06T11:15:12.051988+0000","last_undegraded":"2023-10-06T11:15:12.051988+0000","last_fullsized":"2023-10-06T11:15:12.051988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:33:30.067989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.123437+0000","last_change":"2023-10-06T11:15:11.091389+0000","last_active":"2023-10-06T11:15:12.123437+0000","last_peered":"2023-10-06T11:15:12.123437+0000","last_clean":"2023-10-06T11:15:12.123437+0000","last_became_active":"2023-10-06T11:15:11.091106+0000","last_became_peered":"2023-10-06T11:15:11.091106+0000","last_unstale":"2023-10-06T11:15:12.123437+0000","last_undegraded":"2023-10-06T11:15:12.123437+0000","last_fullsized":"2023-10-06T11:15:12.123437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:53.938839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.045777+0000","last_change":"2023-10-06T11:15:12.045777+0000","last_active":"2023-10-06T11:15:12.045777+0000","last_peered":"2023-10-06T11:15:12.045777+0000","last_clean":"2023-10-06T11:15:12.045777+0000","last_became_active":"2023-10-06T11:15:12.045482+0000","last_became_peered":"2023-10-06T11:15:12.045482+0000","last_unstale":"2023-10-06T11:15:12.045777+0000","last_undegraded":"2023-10-06T11:15:12.045777+0000","last_fullsized":"2023-10-06T11:15:12.045777+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:12.690575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120495+0000","last_change":"2023-10-06T11:15:11.099853+0000","last_active":"2023-10-06T11:15:12.120495+0000","last_peered":"2023-10-06T11:15:12.120495+0000","last_clean":"2023-10-06T11:15:12.120495+0000","last_became_active":"2023-10-06T11:15:11.099590+0000","last_became_peered":"2023-10-06T11:15:11.099590+0000","last_unstale":"2023-10-06T11:15:12.120495+0000","last_undegraded":"2023-10-06T11:15:12.120495+0000","last_fullsized":"2023-10-06T11:15:12.120495+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:03.751582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.057125+0000","last_change":"2023-10-06T11:15:12.050897+0000","last_active":"2023-10-06T11:15:12.057125+0000","last_peered":"2023-10-06T11:15:12.057125+0000","last_clean":"2023-10-06T11:15:12.057125+0000","last_became_active":"2023-10-06T11:15:12.050586+0000","last_became_peered":"2023-10-06T11:15:12.050586+0000","last_unstale":"2023-10-06T11:15:12.057125+0000","last_undegraded":"2023-10-06T11:15:12.057125+0000","last_fullsized":"2023-10-06T11:15:12.057125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:31.643901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037231+0000","last_change":"2023-10-06T11:15:11.089210+0000","last_active":"2023-10-06T11:15:12.037231+0000","last_peered":"2023-10-06T11:15:12.037231+0000","last_clean":"2023-10-06T11:15:12.037231+0000","last_became_active":"2023-10-06T11:15:11.088902+0000","last_became_peered":"2023-10-06T11:15:11.088902+0000","last_unstale":"2023-10-06T11:15:12.037231+0000","last_undegraded":"2023-10-06T11:15:12.037231+0000","last_fullsized":"2023-10-06T11:15:12.037231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:00.408769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052713+0000","last_change":"2023-10-06T11:15:12.052713+0000","last_active":"2023-10-06T11:15:12.052713+0000","last_peered":"2023-10-06T11:15:12.052713+0000","last_clean":"2023-10-06T11:15:12.052713+0000","last_became_active":"2023-10-06T11:15:12.052438+0000","last_became_peered":"2023-10-06T11:15:12.052438+0000","last_unstale":"2023-10-06T11:15:12.052713+0000","last_undegraded":"2023-10-06T11:15:12.052713+0000","last_fullsized":"2023-10-06T11:15:12.052713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:29.570575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040275+0000","last_change":"2023-10-06T11:15:11.098361+0000","last_active":"2023-10-06T11:15:12.040275+0000","last_peered":"2023-10-06T11:15:12.040275+0000","last_clean":"2023-10-06T11:15:12.040275+0000","last_became_active":"2023-10-06T11:15:11.097339+0000","last_became_peered":"2023-10-06T11:15:11.097339+0000","last_unstale":"2023-10-06T11:15:12.040275+0000","last_undegraded":"2023-10-06T11:15:12.040275+0000","last_fullsized":"2023-10-06T11:15:12.040275+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:34.052417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.048529+0000","last_change":"2023-10-06T11:15:12.048529+0000","last_active":"2023-10-06T11:15:12.048529+0000","last_peered":"2023-10-06T11:15:12.048529+0000","last_clean":"2023-10-06T11:15:12.048529+0000","last_became_active":"2023-10-06T11:15:12.048251+0000","last_became_peered":"2023-10-06T11:15:12.048251+0000","last_unstale":"2023-10-06T11:15:12.048529+0000","last_undegraded":"2023-10-06T11:15:12.048529+0000","last_fullsized":"2023-10-06T11:15:12.048529+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:31.643901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.096734+0000","last_change":"2023-10-06T11:15:11.090737+0000","last_active":"2023-10-06T11:15:11.096734+0000","last_peered":"2023-10-06T11:15:11.096734+0000","last_clean":"2023-10-06T11:15:11.096734+0000","last_became_active":"2023-10-06T11:15:11.090404+0000","last_became_peered":"2023-10-06T11:15:11.090404+0000","last_unstale":"2023-10-06T11:15:11.096734+0000","last_undegraded":"2023-10-06T11:15:11.096734+0000","last_fullsized":"2023-10-06T11:15:11.096734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:07:36.156512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053517+0000","last_change":"2023-10-06T11:15:12.048219+0000","last_active":"2023-10-06T11:15:12.053517+0000","last_peered":"2023-10-06T11:15:12.053517+0000","last_clean":"2023-10-06T11:15:12.053517+0000","last_became_active":"2023-10-06T11:15:12.047924+0000","last_became_peered":"2023-10-06T11:15:12.047924+0000","last_unstale":"2023-10-06T11:15:12.053517+0000","last_undegraded":"2023-10-06T11:15:12.053517+0000","last_fullsized":"2023-10-06T11:15:12.053517+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:24:46.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040237+0000","last_change":"2023-10-06T11:15:11.094176+0000","last_active":"2023-10-06T11:15:12.040237+0000","last_peered":"2023-10-06T11:15:12.040237+0000","last_clean":"2023-10-06T11:15:12.040237+0000","last_became_active":"2023-10-06T11:15:11.093891+0000","last_became_peered":"2023-10-06T11:15:11.093891+0000","last_unstale":"2023-10-06T11:15:12.040237+0000","last_undegraded":"2023-10-06T11:15:12.040237+0000","last_fullsized":"2023-10-06T11:15:12.040237+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:19.770544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051575+0000","last_change":"2023-10-06T11:15:12.048071+0000","last_active":"2023-10-06T11:15:12.051575+0000","last_peered":"2023-10-06T11:15:12.051575+0000","last_clean":"2023-10-06T11:15:12.051575+0000","last_became_active":"2023-10-06T11:15:12.047772+0000","last_became_peered":"2023-10-06T11:15:12.047772+0000","last_unstale":"2023-10-06T11:15:12.051575+0000","last_undegraded":"2023-10-06T11:15:12.051575+0000","last_fullsized":"2023-10-06T11:15:12.051575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:01.411618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041170+0000","last_change":"2023-10-06T11:15:11.093535+0000","last_active":"2023-10-06T11:15:12.041170+0000","last_peered":"2023-10-06T11:15:12.041170+0000","last_clean":"2023-10-06T11:15:12.041170+0000","last_became_active":"2023-10-06T11:15:11.093282+0000","last_became_peered":"2023-10-06T11:15:11.093282+0000","last_unstale":"2023-10-06T11:15:12.041170+0000","last_undegraded":"2023-10-06T11:15:12.041170+0000","last_fullsized":"2023-10-06T11:15:12.041170+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:58.511625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.055025+0000","last_change":"2023-10-06T11:15:12.051415+0000","last_active":"2023-10-06T11:15:12.055025+0000","last_peered":"2023-10-06T11:15:12.055025+0000","last_clean":"2023-10-06T11:15:12.055025+0000","last_became_active":"2023-10-06T11:15:12.051136+0000","last_became_peered":"2023-10-06T11:15:12.051136+0000","last_unstale":"2023-10-06T11:15:12.055025+0000","last_undegraded":"2023-10-06T11:15:12.055025+0000","last_fullsized":"2023-10-06T11:15:12.055025+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:46.317235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037517+0000","last_change":"2023-10-06T11:15:11.095257+0000","last_active":"2023-10-06T11:15:12.037517+0000","last_peered":"2023-10-06T11:15:12.037517+0000","last_clean":"2023-10-06T11:15:12.037517+0000","last_became_active":"2023-10-06T11:15:11.094709+0000","last_became_peered":"2023-10-06T11:15:11.094709+0000","last_unstale":"2023-10-06T11:15:12.037517+0000","last_undegraded":"2023-10-06T11:15:12.037517+0000","last_fullsized":"2023-10-06T11:15:12.037517+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:05.973186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051935+0000","last_change":"2023-10-06T11:15:12.048362+0000","last_active":"2023-10-06T11:15:12.051935+0000","last_peered":"2023-10-06T11:15:12.051935+0000","last_clean":"2023-10-06T11:15:12.051935+0000","last_became_active":"2023-10-06T11:15:12.048079+0000","last_became_peered":"2023-10-06T11:15:12.048079+0000","last_unstale":"2023-10-06T11:15:12.051935+0000","last_undegraded":"2023-10-06T11:15:12.051935+0000","last_fullsized":"2023-10-06T11:15:12.051935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:00.549566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040758+0000","last_change":"2023-10-06T11:15:11.097353+0000","last_active":"2023-10-06T11:15:12.040758+0000","last_peered":"2023-10-06T11:15:12.040758+0000","last_clean":"2023-10-06T11:15:12.040758+0000","last_became_active":"2023-10-06T11:15:11.097057+0000","last_became_peered":"2023-10-06T11:15:11.097057+0000","last_unstale":"2023-10-06T11:15:12.040758+0000","last_undegraded":"2023-10-06T11:15:12.040758+0000","last_fullsized":"2023-10-06T11:15:12.040758+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:04.533350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.051603+0000","last_change":"2023-10-06T11:15:12.047487+0000","last_active":"2023-10-06T11:15:12.051603+0000","last_peered":"2023-10-06T11:15:12.051603+0000","last_clean":"2023-10-06T11:15:12.051603+0000","last_became_active":"2023-10-06T11:15:12.047157+0000","last_became_peered":"2023-10-06T11:15:12.047157+0000","last_unstale":"2023-10-06T11:15:12.051603+0000","last_undegraded":"2023-10-06T11:15:12.051603+0000","last_fullsized":"2023-10-06T11:15:12.051603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:05.536200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.103540+0000","last_change":"2023-10-06T11:15:11.100307+0000","last_active":"2023-10-06T11:15:11.103540+0000","last_peered":"2023-10-06T11:15:11.103540+0000","last_clean":"2023-10-06T11:15:11.103540+0000","last_became_active":"2023-10-06T11:15:11.100068+0000","last_became_peered":"2023-10-06T11:15:11.100068+0000","last_unstale":"2023-10-06T11:15:11.103540+0000","last_undegraded":"2023-10-06T11:15:11.103540+0000","last_fullsized":"2023-10-06T11:15:11.103540+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:44:59.546716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041931+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:15:12.041931+0000","last_peered":"2023-10-06T11:15:12.041931+0000","last_clean":"2023-10-06T11:15:12.041931+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:15:12.041931+0000","last_undegraded":"2023-10-06T11:15:12.041931+0000","last_fullsized":"2023-10-06T11:15:12.041931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.053985+0000","last_change":"2023-10-06T11:15:12.050855+0000","last_active":"2023-10-06T11:15:12.053985+0000","last_peered":"2023-10-06T11:15:12.053985+0000","last_clean":"2023-10-06T11:15:12.053985+0000","last_became_active":"2023-10-06T11:15:12.050578+0000","last_became_peered":"2023-10-06T11:15:12.050578+0000","last_unstale":"2023-10-06T11:15:12.053985+0000","last_undegraded":"2023-10-06T11:15:12.053985+0000","last_fullsized":"2023-10-06T11:15:12.053985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:26:48.153418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041539+0000","last_change":"2023-10-06T11:15:11.097937+0000","last_active":"2023-10-06T11:15:12.041539+0000","last_peered":"2023-10-06T11:15:12.041539+0000","last_clean":"2023-10-06T11:15:12.041539+0000","last_became_active":"2023-10-06T11:15:11.097657+0000","last_became_peered":"2023-10-06T11:15:11.097657+0000","last_unstale":"2023-10-06T11:15:12.041539+0000","last_undegraded":"2023-10-06T11:15:12.041539+0000","last_fullsized":"2023-10-06T11:15:12.041539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:58.511625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.036943+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:15:12.036943+0000","last_peered":"2023-10-06T11:15:12.036943+0000","last_clean":"2023-10-06T11:15:12.036943+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:15:12.036943+0000","last_undegraded":"2023-10-06T11:15:12.036943+0000","last_fullsized":"2023-10-06T11:15:12.036943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.058980+0000","last_change":"2023-10-06T11:15:12.054900+0000","last_active":"2023-10-06T11:15:12.058980+0000","last_peered":"2023-10-06T11:15:12.058980+0000","last_clean":"2023-10-06T11:15:12.058980+0000","last_became_active":"2023-10-06T11:15:12.054488+0000","last_became_peered":"2023-10-06T11:15:12.054488+0000","last_unstale":"2023-10-06T11:15:12.058980+0000","last_undegraded":"2023-10-06T11:15:12.058980+0000","last_fullsized":"2023-10-06T11:15:12.058980+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:09.270538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037346+0000","last_change":"2023-10-06T11:15:11.094161+0000","last_active":"2023-10-06T11:15:12.037346+0000","last_peered":"2023-10-06T11:15:12.037346+0000","last_clean":"2023-10-06T11:15:12.037346+0000","last_became_active":"2023-10-06T11:15:11.093741+0000","last_became_peered":"2023-10-06T11:15:11.093741+0000","last_unstale":"2023-10-06T11:15:12.037346+0000","last_undegraded":"2023-10-06T11:15:12.037346+0000","last_fullsized":"2023-10-06T11:15:12.037346+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:44:59.546716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.040430+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:15:12.040430+0000","last_peered":"2023-10-06T11:15:12.040430+0000","last_clean":"2023-10-06T11:15:12.040430+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:15:12.040430+0000","last_undegraded":"2023-10-06T11:15:12.040430+0000","last_fullsized":"2023-10-06T11:15:12.040430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054012+0000","last_change":"2023-10-06T11:15:12.048580+0000","last_active":"2023-10-06T11:15:12.054012+0000","last_peered":"2023-10-06T11:15:12.054012+0000","last_clean":"2023-10-06T11:15:12.054012+0000","last_became_active":"2023-10-06T11:15:12.048256+0000","last_became_peered":"2023-10-06T11:15:12.048256+0000","last_unstale":"2023-10-06T11:15:12.054012+0000","last_undegraded":"2023-10-06T11:15:12.054012+0000","last_fullsized":"2023-10-06T11:15:12.054012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:39.744763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120576+0000","last_change":"2023-10-06T11:15:11.097396+0000","last_active":"2023-10-06T11:15:12.120576+0000","last_peered":"2023-10-06T11:15:12.120576+0000","last_clean":"2023-10-06T11:15:12.120576+0000","last_became_active":"2023-10-06T11:15:11.097149+0000","last_became_peered":"2023-10-06T11:15:11.097149+0000","last_unstale":"2023-10-06T11:15:12.120576+0000","last_undegraded":"2023-10-06T11:15:12.120576+0000","last_fullsized":"2023-10-06T11:15:12.120576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:45.441480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.037446+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:15:12.037446+0000","last_peered":"2023-10-06T11:15:12.037446+0000","last_clean":"2023-10-06T11:15:12.037446+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:15:12.037446+0000","last_undegraded":"2023-10-06T11:15:12.037446+0000","last_fullsized":"2023-10-06T11:15:12.037446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.090380+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:15:11.090380+0000","last_peered":"2023-10-06T11:15:11.090380+0000","last_clean":"2023-10-06T11:15:11.090380+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:15:11.090380+0000","last_undegraded":"2023-10-06T11:15:11.090380+0000","last_fullsized":"2023-10-06T11:15:11.090380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.052736+0000","last_change":"2023-10-06T11:15:12.049819+0000","last_active":"2023-10-06T11:15:12.052736+0000","last_peered":"2023-10-06T11:15:12.052736+0000","last_clean":"2023-10-06T11:15:12.052736+0000","last_became_active":"2023-10-06T11:15:12.049549+0000","last_became_peered":"2023-10-06T11:15:12.049549+0000","last_unstale":"2023-10-06T11:15:12.052736+0000","last_undegraded":"2023-10-06T11:15:12.052736+0000","last_fullsized":"2023-10-06T11:15:12.052736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:27.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.101194+0000","last_change":"2023-10-06T11:15:11.096588+0000","last_active":"2023-10-06T11:15:11.101194+0000","last_peered":"2023-10-06T11:15:11.101194+0000","last_clean":"2023-10-06T11:15:11.101194+0000","last_became_active":"2023-10-06T11:15:11.096313+0000","last_became_peered":"2023-10-06T11:15:11.096313+0000","last_unstale":"2023-10-06T11:15:11.101194+0000","last_undegraded":"2023-10-06T11:15:11.101194+0000","last_fullsized":"2023-10-06T11:15:11.101194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:03.810863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.090519+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:15:11.090519+0000","last_peered":"2023-10-06T11:15:11.090519+0000","last_clean":"2023-10-06T11:15:11.090519+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:15:11.090519+0000","last_undegraded":"2023-10-06T11:15:11.090519+0000","last_fullsized":"2023-10-06T11:15:11.090519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.059143+0000","last_change":"2023-10-06T11:15:12.053666+0000","last_active":"2023-10-06T11:15:12.059143+0000","last_peered":"2023-10-06T11:15:12.059143+0000","last_clean":"2023-10-06T11:15:12.059143+0000","last_became_active":"2023-10-06T11:15:12.053083+0000","last_became_peered":"2023-10-06T11:15:12.053083+0000","last_unstale":"2023-10-06T11:15:12.059143+0000","last_undegraded":"2023-10-06T11:15:12.059143+0000","last_fullsized":"2023-10-06T11:15:12.059143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:33.478075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120526+0000","last_change":"2023-10-06T11:15:11.097238+0000","last_active":"2023-10-06T11:15:12.120526+0000","last_peered":"2023-10-06T11:15:12.120526+0000","last_clean":"2023-10-06T11:15:12.120526+0000","last_became_active":"2023-10-06T11:15:11.096884+0000","last_became_peered":"2023-10-06T11:15:11.096884+0000","last_unstale":"2023-10-06T11:15:12.120526+0000","last_undegraded":"2023-10-06T11:15:12.120526+0000","last_fullsized":"2023-10-06T11:15:12.120526+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:37:02.733206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.090640+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:15:11.090640+0000","last_peered":"2023-10-06T11:15:11.090640+0000","last_clean":"2023-10-06T11:15:11.090640+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:15:11.090640+0000","last_undegraded":"2023-10-06T11:15:11.090640+0000","last_fullsized":"2023-10-06T11:15:11.090640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.050855+0000","last_change":"2023-10-06T11:15:12.050855+0000","last_active":"2023-10-06T11:15:12.050855+0000","last_peered":"2023-10-06T11:15:12.050855+0000","last_clean":"2023-10-06T11:15:12.050855+0000","last_became_active":"2023-10-06T11:15:12.050312+0000","last_became_peered":"2023-10-06T11:15:12.050312+0000","last_unstale":"2023-10-06T11:15:12.050855+0000","last_undegraded":"2023-10-06T11:15:12.050855+0000","last_fullsized":"2023-10-06T11:15:12.050855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:57.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120914+0000","last_change":"2023-10-06T11:15:11.095448+0000","last_active":"2023-10-06T11:15:12.120914+0000","last_peered":"2023-10-06T11:15:12.120914+0000","last_clean":"2023-10-06T11:15:12.120914+0000","last_became_active":"2023-10-06T11:15:11.094368+0000","last_became_peered":"2023-10-06T11:15:11.094368+0000","last_unstale":"2023-10-06T11:15:12.120914+0000","last_undegraded":"2023-10-06T11:15:12.120914+0000","last_fullsized":"2023-10-06T11:15:12.120914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:30.641052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.042284+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:15:12.042284+0000","last_peered":"2023-10-06T11:15:12.042284+0000","last_clean":"2023-10-06T11:15:12.042284+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:15:12.042284+0000","last_undegraded":"2023-10-06T11:15:12.042284+0000","last_fullsized":"2023-10-06T11:15:12.042284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.054561+0000","last_change":"2023-10-06T11:15:12.051023+0000","last_active":"2023-10-06T11:15:12.054561+0000","last_peered":"2023-10-06T11:15:12.054561+0000","last_clean":"2023-10-06T11:15:12.054561+0000","last_became_active":"2023-10-06T11:15:12.050769+0000","last_became_peered":"2023-10-06T11:15:12.050769+0000","last_unstale":"2023-10-06T11:15:12.054561+0000","last_undegraded":"2023-10-06T11:15:12.054561+0000","last_fullsized":"2023-10-06T11:15:12.054561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.074099+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.074099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:37.912016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.120595+0000","last_change":"2023-10-06T11:15:11.094583+0000","last_active":"2023-10-06T11:15:12.120595+0000","last_peered":"2023-10-06T11:15:12.120595+0000","last_clean":"2023-10-06T11:15:12.120595+0000","last_became_active":"2023-10-06T11:15:11.094326+0000","last_became_peered":"2023-10-06T11:15:11.094326+0000","last_unstale":"2023-10-06T11:15:12.120595+0000","last_undegraded":"2023-10-06T11:15:12.120595+0000","last_fullsized":"2023-10-06T11:15:12.120595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.071249+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.071249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:01.371488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.041670+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:15:12.041670+0000","last_peered":"2023-10-06T11:15:12.041670+0000","last_clean":"2023-10-06T11:15:12.041670+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:15:12.041670+0000","last_undegraded":"2023-10-06T11:15:12.041670+0000","last_fullsized":"2023-10-06T11:15:12.041670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":959634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.498,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.438}]},{"osd":1,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4319999999999999,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.036,"15min":1.117},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77800000000000002,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78200000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78600000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80300000000000005,"5min":0.872,"15min":0.872},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":375731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":377763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42299999999999999,"15min":0.436},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83399999999999996,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.375,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.4319999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.92700000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.627,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.4219999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.5150000000000001,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.748,"15min":0.71699999999999997},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":7.2400000000000002,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.626}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.6919999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.1799999999999999,"5min":1.508,"15min":1.508},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298648,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073192,"statfs":{"total":96636764160,"available":96330948608,"internally_reserved":0,"allocated":1392640,"data_stored":959046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.221,"5min":0.214,"15min":0.214},"max":{"1min":0.46000000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.251},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51900000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.499,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52700000000000002,"5min":0.626,"15min":0.626},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.54800000000000004,"5min":0.626,"15min":0.626},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44400000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0680000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":377175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.378},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.318},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298088,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073752,"statfs":{"total":96636764160,"available":96331522048,"internally_reserved":0,"allocated":819200,"data_stored":375751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.218},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.25800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.376},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.499}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":375709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":368768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:16.613 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:15:16.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:15:16.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.768+0000 7f5878475700 1 Processor -- start 2023-10-06T11:15:16.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.768+0000 7f5878475700 1 -- start start 2023-10-06T11:15:16.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5878475700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5870159470 0x7f58700ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5878475700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58700cd020 0x7f58700c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5878475700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700cbb80 con 0x7f5870159840 2023-10-06T11:15:16.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5878475700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58700c6f00 con 0x7f5870159470 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5878475700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700cb530 con 0x7f58700cd020 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5870159470 0x7f58700ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5870159470 0x7f58700ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58964/0 (socket says 172.21.15.55:58964) 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 -- 172.21.15.55:0/2974899243 learned_addr learned my addr 172.21.15.55:0/2974899243 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876a12700 1 --2- 172.21.15.55:0/2974899243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58700cd020 0x7f58700c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 -- 172.21.15.55:0/2974899243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58700cd020 msgr2=0x7f58700c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 --2- 172.21.15.55:0/2974899243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58700cd020 0x7f58700c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 -- 172.21.15.55:0/2974899243 >> v1:172.21.15.142:6789/0 conn(0x7f5870159840 legacy=0x7f58700c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.769+0000 7f5876211700 1 -- 172.21.15.55:0/2974899243 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700cb810 con 0x7f5870159470 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5876211700 1 --2- 172.21.15.55:0/2974899243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5870159470 0x7f58700ce980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5860009f70 tx=0x7f5860009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cbeee23234c443 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f587520f700 1 -- 172.21.15.55:0/2974899243 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000e070 con 0x7f5870159470 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f587520f700 1 -- 172.21.15.55:0/2974899243 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000ba20 con 0x7f5870159470 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f587520f700 1 -- 172.21.15.55:0/2974899243 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600092e0 con 0x7f5870159470 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 -- 172.21.15.55:0/2974899243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5870159470 msgr2=0x7f58700ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 --2- 172.21.15.55:0/2974899243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5870159470 0x7f58700ce980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5860009f70 tx=0x7f5860009840 comp rx=0 tx=0).stop 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 -- 172.21.15.55:0/2974899243 shutdown_connections 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 --2- 172.21.15.55:0/2974899243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58700cd020 0x7f58700c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 --2- 172.21.15.55:0/2974899243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5870159470 0x7f58700ce980 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 -- 172.21.15.55:0/2974899243 >> 172.21.15.55:0/2974899243 conn(0x7f58700996e0 msgr2=0x7f587006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 -- 172.21.15.55:0/2974899243 shutdown_connections 2023-10-06T11:15:16.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.770+0000 7f5878475700 1 -- 172.21.15.55:0/2974899243 wait complete. 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 Processor -- start 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 -- start start 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 0x7f58700c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5870159470 0x7f58701415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5870159840 0x7f5870169820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700ca3d0 con 0x7f58700cd020 2023-10-06T11:15:16.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700c8100 con 0x7f5870159470 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5878475700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700c83e0 con 0x7f5870159840 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5876211700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 0x7f58700c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5876211700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 0x7f58700c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58970/0 (socket says 172.21.15.55:58970) 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.772+0000 7f5876211700 1 -- 172.21.15.55:0/1059922350 learned_addr learned my addr 172.21.15.55:0/1059922350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876a12700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5870159840 0x7f5870169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5875a10700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5870159470 0x7f58701415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876211700 1 -- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5870159840 msgr2=0x7f5870169820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876211700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5870159840 0x7f5870169820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876211700 1 -- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5870159470 msgr2=0x7f58701415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876211700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5870159470 0x7f58701415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876211700 1 -- 172.21.15.55:0/1059922350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860009ae0 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5875a10700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5870159470 0x7f58701415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5876211700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 0x7f58700c9e90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f586000b6c0 tx=0x7f5860018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860008d00 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860008e60 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600266b0 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58700c86c0 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.773+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58700c8c80 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.774+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58700c8e70 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.774+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5860003040 con 0x7f58700cd020 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.775+0000 7f586e7fc700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f585c066f30 0x7f585c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.775+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5860086830 con 0x7f58700cd020 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.775+0000 7f5875a10700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f585c066f30 0x7f585c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.775+0000 7f5875a10700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f585c066f30 0x7f585c0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f587006a100 tx=0x7f5864009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:16.779+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5860053800 con 0x7f58700cd020 2023-10-06T11:15:17.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.053+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5870064a90 con 0x7f58700cd020 2023-10-06T11:15:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.061+0000 7f586e7fc700 1 -- 172.21.15.55:0/1059922350 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5860056e20 con 0x7f58700cd020 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f585c066f30 msgr2=0x7f585c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f585c066f30 0x7f585c0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f587006a100 tx=0x7f5864009040 comp rx=0 tx=0).stop 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 msgr2=0x7f58700c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 0x7f58700c9e90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f586000b6c0 tx=0x7f5860018000 comp rx=0 tx=0).stop 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 shutdown_connections 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f585c066f30 0x7f585c0693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58700cd020 0x7f58700c9e90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5870159840 0x7f5870169820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 --2- 172.21.15.55:0/1059922350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5870159470 0x7f58701415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 >> 172.21.15.55:0/1059922350 conn(0x7f58700996e0 msgr2=0x7f58700682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 shutdown_connections 2023-10-06T11:15:17.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.063+0000 7f5878475700 1 -- 172.21.15.55:0/1059922350 wait complete. 2023-10-06T11:15:17.066 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-10-06T11:15:17.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:17.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.194+0000 7fd3f034f700 1 Processor -- start 2023-10-06T11:15:17.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.194+0000 7fd3f034f700 1 -- start start 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.195+0000 7fd3f034f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 0x7fd3e8158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.195+0000 7fd3f034f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e8157de0 con 0x7fd3e80adb60 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.195+0000 7fd3f034f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e80cb5d0 con 0x7fd3e80ce8a0 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.195+0000 7fd3f034f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80cbb90 con 0x7fd3e80ca370 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed8ea700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd3e80adb60 0x7fd3e80ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35154/0 (socket says 172.21.15.55:35154) 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed8ea700 1 -- 172.21.15.55:0/885414203 learned_addr learned my addr 172.21.15.55:0/885414203 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ee0eb700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 0x7fd3e8158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857885435 0 0) 0x7fd3e8157de0 con 0x7fd3e80adb60 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d0003570 con 0x7fd3e80adb60 2023-10-06T11:15:17.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110088182 0 0) 0x7fd3d0003570 con 0x7fd3e80adb60 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 msgr2=0x7fd3e8158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 0x7fd3e8158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 >> v1:172.21.15.142:6789/0 conn(0x7fd3e80ce8a0 legacy=0x7fd3e815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e80cb8b0 con 0x7fd3e80adb60 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fd3dc001470 con 0x7fd3e80adb60 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 >> v1:172.21.15.55:6789/0 conn(0x7fd3e80adb60 legacy=0x7fd3e80ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d0003a90 0x7fd3d0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 0x7fd3d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80cbb90 con 0x7fd3d0004810 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d000bb40 con 0x7fd3d0003a90 2023-10-06T11:15:17.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d000bd00 con 0x7fd3e80ca370 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ee8ec700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 0x7fd3d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.196+0000 7fd3ee0eb700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d0003a90 0x7fd3d0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed8ea700 1 -- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 msgr2=0x7fd3d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e80ca370 0x7fd3d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed8ea700 1 -- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d0003a90 msgr2=0x7fd3d0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d0003a90 0x7fd3d0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed8ea700 1 -- 172.21.15.55:0/885414203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0003570 con 0x7fd3d0004810 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3d0004c80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c2d0 tx=0x7fd3dc001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4d079b992a6c5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00cba0 con 0x7fd3d0004810 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc00cd40 con 0x7fd3d0004810 2023-10-06T11:15:17.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ed0e9700 1 -- 172.21.15.55:0/885414203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc005b70 con 0x7fd3d0004810 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3f034f700 1 -- 172.21.15.55:0/885414203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 msgr2=0x7fd3d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3f034f700 1 --2- 172.21.15.55:0/885414203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3d0004c80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c2d0 tx=0x7fd3dc001da0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3ee8ec700 1 -- 172.21.15.55:0/885414203 reap_dead start 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3f034f700 1 -- 172.21.15.55:0/885414203 shutdown_connections 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.197+0000 7fd3f034f700 1 -- 172.21.15.55:0/885414203 >> 172.21.15.55:0/885414203 conn(0x7fd3e80707d0 msgr2=0x7fd3e8070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.198+0000 7fd3f034f700 1 -- 172.21.15.55:0/885414203 shutdown_connections 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.198+0000 7fd3f034f700 1 -- 172.21.15.55:0/885414203 wait complete. 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 Processor -- start 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 -- start start 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3e815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e8168bf0 0x7fd3e8149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e814ce80 0x7fd3e8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80c4b80 con 0x7fd3d0004810 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8149a50 con 0x7fd3e814ce80 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3f034f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8168760 con 0x7fd3e8168bf0 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3ee0eb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3e815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3ee0eb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3e815a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58986/0 (socket says 172.21.15.55:58986) 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.199+0000 7fd3ee0eb700 1 -- 172.21.15.55:0/1813842649 learned_addr learned my addr 172.21.15.55:0/1813842649 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee0eb700 1 -- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e8168bf0 msgr2=0x7fd3e8149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e8168bf0 0x7fd3e8149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee0eb700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e8168bf0 0x7fd3e8149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee8ec700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e814ce80 0x7fd3e8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee0eb700 1 -- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e814ce80 msgr2=0x7fd3e8159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee0eb700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e814ce80 0x7fd3e8159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee0eb700 1 -- 172.21.15.55:0/1813842649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e80b3f00 con 0x7fd3d0004810 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e8168bf0 0x7fd3e8149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee8ec700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e814ce80 0x7fd3e8159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3ee0eb700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3e815a330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8011f80 tx=0x7fd3d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800e040 con 0x7fd3d0004810 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d800f040 con 0x7fd3d0004810 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e8167ea0 con 0x7fd3d0004810 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8015430 con 0x7fd3d0004810 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.200+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e8168110 con 0x7fd3d0004810 2023-10-06T11:15:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.201+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e8064a90 con 0x7fd3d0004810 2023-10-06T11:15:17.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.201+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3d80157e0 con 0x7fd3d0004810 2023-10-06T11:15:17.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.202+0000 7fd3e67fc700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd3d4066f30 0x7fd3d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.202+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd3d8085580 con 0x7fd3d0004810 2023-10-06T11:15:17.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.202+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd3d4066f30 0x7fd3d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.203+0000 7fd3ed8ea700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd3d4066f30 0x7fd3d40693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c2d0 tx=0x7fd3dc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.206+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3d8055fe0 con 0x7fd3d0004810 2023-10-06T11:15:17.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.444+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3e8168a40 con 0x7fd3d0004810 2023-10-06T11:15:17.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.444+0000 7fd3e67fc700 1 -- 172.21.15.55:0/1813842649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd3d8055b70 con 0x7fd3d0004810 2023-10-06T11:15:17.446 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:17.446 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.489146+0000","modified":"2023-10-06T11:15:15.117701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1949751392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1949751392},{"type":"v1","addr":"172.21.15.142:6837","nonce":1949751392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd3d4066f30 msgr2=0x7fd3d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd3d4066f30 0x7fd3d40693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c2d0 tx=0x7fd3dc015000 comp rx=0 tx=0).stop 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 msgr2=0x7fd3e815a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3e815a330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8011f80 tx=0x7fd3d800b040 comp rx=0 tx=0).stop 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 shutdown_connections 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd3d4066f30 0x7fd3d40693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3d0004810 0x7fd3e815a330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e814ce80 0x7fd3e8159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 --2- 172.21.15.55:0/1813842649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3e8168bf0 0x7fd3e8149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 >> 172.21.15.55:0/1813842649 conn(0x7fd3e80707d0 msgr2=0x7fd3e80ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 shutdown_connections 2023-10-06T11:15:17.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.447+0000 7fd3f034f700 1 -- 172.21.15.55:0/1813842649 wait complete. 2023-10-06T11:15:17.450 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2023-10-06T11:15:17.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:15:11.489146+0000', 'modified': '2023-10-06T11:15:15.117701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5835}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5835': {'gid': 5835, 'name': 'd', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/1949751392', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 1949751392}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 1949751392}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:15:17.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:15:17.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T11:15:17.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.984+0000 7f0a340e8700 1 Processor -- start 2023-10-06T11:15:17.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.984+0000 7f0a340e8700 1 -- start start 2023-10-06T11:15:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a340e8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a2c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a340e8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0b0c60 con 0x7f0a2c0b49a0 2023-10-06T11:15:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a340e8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0b0f40 con 0x7f0a2c0b0760 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a340e8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b1220 con 0x7f0a2c159560 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a31683700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0a2c0b49a0 0x7f0a2c0aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35160/0 (socket says 172.21.15.55:35160) 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a31683700 1 -- 172.21.15.55:0/2576457 learned_addr learned my addr 172.21.15.55:0/2576457 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a31e84700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a2c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441985865 0 0) 0x7f0a2c0b0c60 con 0x7f0a2c0b49a0 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a14003570 con 0x7f0a2c0b49a0 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765527655 0 0) 0x7f0a2c0b0f40 con 0x7f0a2c0b0760 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a2c0b0c60 con 0x7f0a2c0b0760 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758489526 0 0) 0x7f0a14003570 con 0x7f0a2c0b49a0 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 msgr2=0x7f0a2c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a2c0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 >> v1:172.21.15.142:6789/0 conn(0x7f0a2c0b0760 legacy=0x7f0a2c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0b1500 con 0x7f0a2c0b49a0 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f0a20001470 con 0x7f0a2c0b49a0 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a31e84700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a2c0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 >> v1:172.21.15.55:6789/0 conn(0x7f0a2c0b49a0 legacy=0x7f0a2c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a14003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.985+0000 7f0a30e82700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a14004160 0x7f0a14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004d50 0x7f0a140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b1220 con 0x7f0a14004160 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1400bba0 con 0x7f0a14004d50 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1400bd60 con 0x7f0a2c159560 2023-10-06T11:15:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a14004160 0x7f0a14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31e84700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a14003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a32685700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004d50 0x7f0a140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 -- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 msgr2=0x7f0a14003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c159560 0x7f0a14003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 -- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004d50 msgr2=0x7f0a140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004d50 0x7f0a140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 -- 172.21.15.55:0/2576457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c009a20 con 0x7f0a14004160 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a31683700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a14004160 0x7f0a14004810 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c2a0 tx=0x7f0a20001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b973864db92187f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000cb70 con 0x7f0a14004160 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2000ccd0 con 0x7f0a14004160 2023-10-06T11:15:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.986+0000 7f0a30e82700 1 -- 172.21.15.55:0/2576457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20005b50 con 0x7f0a14004160 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a340e8700 1 -- 172.21.15.55:0/2576457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a14004160 msgr2=0x7f0a14004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a340e8700 1 --2- 172.21.15.55:0/2576457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a14004160 0x7f0a14004810 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c2a0 tx=0x7f0a20001e10 comp rx=0 tx=0).stop 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a32685700 1 -- 172.21.15.55:0/2576457 reap_dead start 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a340e8700 1 -- 172.21.15.55:0/2576457 shutdown_connections 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a340e8700 1 -- 172.21.15.55:0/2576457 >> 172.21.15.55:0/2576457 conn(0x7f0a2c0997f0 msgr2=0x7f0a2c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a340e8700 1 -- 172.21.15.55:0/2576457 shutdown_connections 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.987+0000 7f0a340e8700 1 -- 172.21.15.55:0/2576457 wait complete. 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.988+0000 7f0a340e8700 1 Processor -- start 2023-10-06T11:15:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.988+0000 7f0a340e8700 1 -- start start 2023-10-06T11:15:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a340e8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004160 0x7f0a2c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a340e8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 0x7f0a2c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a340e8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c069540 0x7f0a2c0699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a340e8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c069f00 con 0x7f0a2c153750 2023-10-06T11:15:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a340e8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c151f10 con 0x7f0a14004160 2023-10-06T11:15:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a340e8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c153be0 con 0x7f0a2c069540 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 0x7f0a2c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 0x7f0a2c1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59004/0 (socket says 172.21.15.55:59004) 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 -- 172.21.15.55:0/1859723697 learned_addr learned my addr 172.21.15.55:0/1859723697 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a32685700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c069540 0x7f0a2c0699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004160 0x7f0a2c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 -- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c069540 msgr2=0x7f0a2c0699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c069540 0x7f0a2c0699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 -- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004160 msgr2=0x7f0a2c1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004160 0x7f0a2c1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 -- 172.21.15.55:0/1859723697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c153ec0 con 0x7f0a2c153750 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004160 0x7f0a2c1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a31683700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 0x7f0a2c1552b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c890 tx=0x7f0a20015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.989+0000 7f0a29ffb700 1 -- 172.21.15.55:0/1859723697 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000cb70 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.990+0000 7f0a29ffb700 1 -- 172.21.15.55:0/1859723697 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20001b30 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.990+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c1541a0 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.990+0000 7f0a29ffb700 1 -- 172.21.15.55:0/1859723697 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20007530 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.990+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c1557f0 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.991+0000 7f0a29ffb700 1 -- 172.21.15.55:0/1859723697 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a20019030 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.991+0000 7f0a29ffb700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a18066f30 0x7f0a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.992+0000 7f0a29ffb700 1 -- 172.21.15.55:0/1859723697 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a200859d0 con 0x7f0a2c153750 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.992+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a18066f30 0x7f0a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.992+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a18066f30 0x7f0a180693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009390 tx=0x7f0a1c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.993+0000 7f0a3d3e0b80 1 Processor -- start 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 -- start start 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 0x55f97ab3ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97aaf3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf4bd0 0x55f97aaf3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97aa73c80 con 0x55f97ab3aa90 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97aa4aa70 con 0x55f97aaf4bd0 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f97aa48270 con 0x55f97aaf69a0 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a31e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 0x55f97ab3ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a31e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 0x55f97ab3ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59020/0 (socket says 172.21.15.55:59020) 2023-10-06T11:15:18.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a31e84700 1 -- 172.21.15.55:0/3404577605 learned_addr learned my addr 172.21.15.55:0/3404577605 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.994+0000 7f0a31683700 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97aaf3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a32685700 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf4bd0 0x55f97aaf3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a31e84700 1 -- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 msgr2=0x55f97aaf3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a31e84700 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97aaf3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a31e84700 1 -- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf4bd0 msgr2=0x55f97aaf3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a31e84700 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf4bd0 0x55f97aaf3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a31e84700 1 -- 172.21.15.55:0/3404577605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f97a8de270 con 0x55f97ab3aa90 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a32685700 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf4bd0 0x55f97aaf3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a31e84700 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 0x55f97ab3ae60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c016770 tx=0x7f0a1c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7948eaff6007e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a12ffd700 1 -- 172.21.15.55:0/3404577605 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00e040 con 0x55f97ab3aa90 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a12ffd700 1 -- 172.21.15.55:0/3404577605 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c00f040 con 0x55f97ab3aa90 2023-10-06T11:15:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a12ffd700 1 -- 172.21.15.55:0/3404577605 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c022830 con 0x55f97ab3aa90 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/3404577605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 msgr2=0x55f97ab3ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.995+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 0x55f97ab3ae60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c016770 tx=0x7f0a1c01b000 comp rx=0 tx=0).stop 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/3404577605 shutdown_connections 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97ab3aa90 0x55f97ab3ae60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf4bd0 0x55f97aaf3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/3404577605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97aaf3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/3404577605 >> 172.21.15.55:0/3404577605 conn(0x55f97aaf5070 msgr2=0x55f97aaf5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/3404577605 shutdown_connections 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/3404577605 wait complete. 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 -- start start 2023-10-06T11:15:18.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.996+0000 7f0a3d3e0b80 1 Processor -- start 2023-10-06T11:15:18.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf4bd0 0x55f97ab1a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 0x55f97ab49c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97aaf3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97aa44060 con 0x55f97aaf69a0 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97a9ef890 con 0x55f97ab3aa90 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f97aa0aea0 con 0x55f97aaf4bd0 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a3d3e0b80 10 client.0 _ll_register_callbacks cb 0x55f97a8e0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a31683700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 0x55f97ab49c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a31683700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 0x55f97ab49c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59030/0 (socket says 172.21.15.55:59030) 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a31683700 1 -- 172.21.15.55:0/4026064360 learned_addr learned my addr 172.21.15.55:0/4026064360 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a31e84700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf4bd0 0x55f97ab1a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.997+0000 7f0a32685700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97aaf3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31683700 1 -- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf4bd0 msgr2=0x55f97ab1a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31683700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf4bd0 0x55f97ab1a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31683700 1 -- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 msgr2=0x55f97aaf3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31683700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97aaf3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31683700 1 -- 172.21.15.55:0/4026064360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c016430 con 0x55f97aaf69a0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31e84700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf4bd0 0x55f97ab1a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a31683700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 0x55f97ab49c00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0a20005fd0 tx=0x7f0a20083b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b52980389ac995 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a0bfff700 1 -- 172.21.15.55:0/4026064360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2006c070 con 0x55f97aaf69a0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a0bfff700 1 -- 172.21.15.55:0/4026064360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a20059890 con 0x55f97aaf69a0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f97aae8690 con 0x55f97aaf69a0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a0bfff700 1 -- 172.21.15.55:0/4026064360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a200566c0 con 0x55f97aaf69a0 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 10 client.5976 fetch_fsmap learned FSMap version 35 2023-10-06T11:15:18.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55f97a880fe0 con 0x55f97aaf69a0 2023-10-06T11:15:18.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a0bfff700 1 -- 172.21.15.55:0/4026064360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f97aae8690 con 0x55f97aaf69a0 2023-10-06T11:15:18.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a0bfff700 1 -- 172.21.15.55:0/4026064360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a20055b30 con 0x55f97aaf69a0 2023-10-06T11:15:18.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 10 client.5976 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:15:18.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 10 client.5976 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:15:18.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 20 client.5976 populate_metadata read hostname 'smithi055' 2023-10-06T11:15:18.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab350c0 0x55f97ab35490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 4 client.5976 mds_command: new command op to 5835 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.998+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 --> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f97aac55c0 con 0x55f97ab350c0 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.999+0000 7f0a31e84700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab350c0 0x55f97ab35490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.999+0000 7f0a0bfff700 10 client.5976 ms_handle_connect on v2:172.21.15.142:6835/1949751392 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:17.999+0000 7f0a31e84700 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab350c0 0x55f97ab35490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caa6379da2850c62 server_cookie=f9529a5056db9ea6 in_seq=0 out_seq=0 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a0bfff700 1 -- 172.21.15.55:0/4026064360 <== mds.0 v2:172.21.15.142:6835/1949751392 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f97aac55c0 con 0x55f97ab350c0 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a0bfff700 10 client.5976 handle_command_reply: tid=0 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 client.5976 shutdown 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 msgr2=0x55f97ab49c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 0x55f97ab49c00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0a20005fd0 tx=0x7f0a20083b90 comp rx=0 tx=0).stop 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 shutdown_connections 2023-10-06T11:15:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab350c0 0x55f97ab35490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97aaf3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf4bd0 0x55f97ab1a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/4026064360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf69a0 0x55f97ab49c00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a0bfff700 0 client.5976 ms_handle_reset on v2:172.21.15.142:6835/1949751392 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 >> 172.21.15.55:0/4026064360 conn(0x55f97aaf5070 msgr2=0x55f97ab382f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 shutdown_connections 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/4026064360 wait complete. 2023-10-06T11:15:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.000+0000 7f0a3d3e0b80 20 client.5976 trim_cache size 0 max 16384 2023-10-06T11:15:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.017+0000 7f0a3d3e0b80 1 Processor -- start 2023-10-06T11:15:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.017+0000 7f0a3d3e0b80 1 -- start start 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab34500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf69a0 0x55f97ab3de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97ab3aa90 0x55f97ab3e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97a8c6e30 con 0x55f97aaf4bd0 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97ab19ed0 con 0x55f97aaf69a0 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f97ab20470 con 0x55f97ab3aa90 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab34500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab34500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59032/0 (socket says 172.21.15.55:59032) 2023-10-06T11:15:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 -- 172.21.15.55:0/263048317 learned_addr learned my addr 172.21.15.55:0/263048317 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 -- 172.21.15.55:0/263048317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97ab3aa90 msgr2=0x55f97ab3e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97ab3aa90 0x55f97ab3e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 -- 172.21.15.55:0/263048317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf69a0 msgr2=0x55f97ab3de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf69a0 0x55f97ab3de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 -- 172.21.15.55:0/263048317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f97aa12780 con 0x55f97aaf4bd0 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a31e84700 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab34500 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0094d0 tx=0x7f0a1c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dceb44a44045864 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a137fe700 1 -- 172.21.15.55:0/263048317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00e040 con 0x55f97aaf4bd0 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a137fe700 1 -- 172.21.15.55:0/263048317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c031040 con 0x55f97aaf4bd0 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.018+0000 7f0a137fe700 1 -- 172.21.15.55:0/263048317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0380f0 con 0x55f97aaf4bd0 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/263048317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 msgr2=0x55f97ab34500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab34500 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0094d0 tx=0x7f0a1c01d000 comp rx=0 tx=0).stop 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/263048317 shutdown_connections 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab34500 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97ab3aa90 0x55f97ab3e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/263048317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97aaf69a0 0x55f97ab3de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/263048317 >> 172.21.15.55:0/263048317 conn(0x55f97aaf5070 msgr2=0x55f97ab19030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/263048317 shutdown_connections 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/263048317 wait complete. 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 -- start start 2023-10-06T11:15:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.019+0000 7f0a3d3e0b80 1 Processor -- start 2023-10-06T11:15:18.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab9f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97ab1e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97ab42910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97ab53170 con 0x55f97aaf4bd0 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97ab37b40 con 0x55f97ab3aa90 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f97ab1ee50 con 0x55f97aaf69a0 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a3d3e0b80 10 client.0 _ll_register_callbacks cb 0x55f97a8e0f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a31e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab9f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a31e84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab9f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59042/0 (socket says 172.21.15.55:59042) 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.020+0000 7f0a31e84700 1 -- 172.21.15.55:0/1736102228 learned_addr learned my addr 172.21.15.55:0/1736102228 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a31e84700 1 -- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 msgr2=0x55f97ab1e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97ab1e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a31e84700 1 -- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 msgr2=0x55f97ab42910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a32685700 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97ab42910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97ab42910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a31e84700 1 -- 172.21.15.55:0/1736102228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f97a8de270 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a31e84700 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab9f5c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0094d0 tx=0x7f0a1c038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaf528635eb2d1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a0bfff700 1 -- 172.21.15.55:0/1736102228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00e070 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a0bfff700 1 -- 172.21.15.55:0/1736102228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a1c01c040 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a1c00f040 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a0bfff700 1 -- 172.21.15.55:0/1736102228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a1c038870 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a3d3e0b80 10 client.5982 fetch_fsmap learned FSMap version 35 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55f97a9f9470 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a0bfff700 1 -- 172.21.15.55:0/1736102228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c00f040 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a0bfff700 1 -- 172.21.15.55:0/1736102228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a1c040030 con 0x55f97aaf4bd0 2023-10-06T11:15:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a3d3e0b80 10 client.5982 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a3d3e0b80 10 client.5982 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.021+0000 7f0a3d3e0b80 20 client.5982 populate_metadata read hostname 'smithi055' 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab3de50 0x55f97ab3e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a3d3e0b80 4 client.5982 mds_command: new command op to 5835 tid=0[{"prefix": "status"}] 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 --> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f97a9e6e00 con 0x55f97ab3de50 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a31683700 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab3de50 0x55f97ab3e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a31683700 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab3de50 0x55f97ab3e240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e60e9ea3fda92e server_cookie=e69453670d918f6d in_seq=0 out_seq=0 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a0bfff700 10 client.5982 ms_handle_connect on v2:172.21.15.142:6835/1949751392 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a0bfff700 1 -- 172.21.15.55:0/1736102228 <== mds.0 v2:172.21.15.142:6835/1949751392 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f97a9e6e00 con 0x55f97ab3de50 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.022+0000 7f0a0bfff700 10 client.5982 handle_command_reply: tid=0 2023-10-06T11:15:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 client.5982 shutdown 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 msgr2=0x55f97ab9f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab9f5c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0094d0 tx=0x7f0a1c038000 comp rx=0 tx=0).stop 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 shutdown_connections 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:6835/1949751392,v1:172.21.15.142:6837/1949751392] conn(0x55f97ab3de50 0x55f97ab3e240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f97aaf4bd0 0x55f97ab9f5c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f97ab3aa90 0x55f97ab42910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a0bfff700 0 client.5982 ms_handle_reset on v2:172.21.15.142:6835/1949751392 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 --2- 172.21.15.55:0/1736102228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f97aaf69a0 0x55f97ab1e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 >> 172.21.15.55:0/1736102228 conn(0x55f97aaf5070 msgr2=0x55f97ab39280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 shutdown_connections 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 1 -- 172.21.15.55:0/1736102228 wait complete. 2023-10-06T11:15:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a3d3e0b80 20 client.5982 trim_cache size 0 max 16384 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5835, 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9159241839999996, 2023-10-06T11:15:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 35, 2023-10-06T11:15:18.033 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 67, 2023-10-06T11:15:18.033 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 67, 2023-10-06T11:15:18.033 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 11.990498802999999 2023-10-06T11:15:18.033 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a18066f30 msgr2=0x7f0a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a18066f30 0x7f0a180693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009390 tx=0x7f0a1c00b040 comp rx=0 tx=0).stop 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 msgr2=0x7f0a2c1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 0x7f0a2c1552b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c890 tx=0x7f0a20015000 comp rx=0 tx=0).stop 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 shutdown_connections 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0a18066f30 0x7f0a180693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a2c069540 0x7f0a2c0699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a14004160 0x7f0a2c1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 --2- 172.21.15.55:0/1859723697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a2c153750 0x7f0a2c1552b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.023+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 >> 172.21.15.55:0/1859723697 conn(0x7f0a2c0997f0 msgr2=0x7f0a2c157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.024+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 shutdown_connections 2023-10-06T11:15:18.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.024+0000 7f0a340e8700 1 -- 172.21.15.55:0/1859723697 wait complete. 2023-10-06T11:15:18.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:15:18.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.156+0000 7fae4e607700 1 Processor -- start 2023-10-06T11:15:18.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.156+0000 7fae4e607700 1 -- start start 2023-10-06T11:15:18.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae4e607700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae48069ab0 0x7fae480ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae4e607700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae4806d350 0x7fae4806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae4e607700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4806e6d0 con 0x7fae480696e0 2023-10-06T11:15:18.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae4e607700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae480cd000 con 0x7fae48069ab0 2023-10-06T11:15:18.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae4e607700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4806dac0 con 0x7fae4806d350 2023-10-06T11:15:18.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae47fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae480696e0 0x7fae480aeeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35174/0 (socket says 172.21.15.55:35174) 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae477fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae48069ab0 0x7fae480ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae47fff700 1 -- 172.21.15.55:0/2191674155 learned_addr learned my addr 172.21.15.55:0/2191674155 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae4cba4700 1 --2- 172.21.15.55:0/2191674155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae4806d350 0x7fae4806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae46ffd700 1 -- 172.21.15.55:0/2191674155 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033097848 0 0) 0x7fae4806e6d0 con 0x7fae480696e0 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae46ffd700 1 -- 172.21.15.55:0/2191674155 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae34003570 con 0x7fae480696e0 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae477fe700 1 -- 172.21.15.55:0/2191674155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae4806d350 msgr2=0x7fae4806eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae477fe700 1 --2- 172.21.15.55:0/2191674155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae4806d350 0x7fae4806eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae477fe700 1 -- 172.21.15.55:0/2191674155 >> v1:172.21.15.55:6789/0 conn(0x7fae480696e0 legacy=0x7fae480aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae477fe700 1 -- 172.21.15.55:0/2191674155 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4806dda0 con 0x7fae48069ab0 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae477fe700 1 --2- 172.21.15.55:0/2191674155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae48069ab0 0x7fae480ada60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fae380098e0 tx=0x7fae380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d95a9cac34a8e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae46ffd700 1 -- 172.21.15.55:0/2191674155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800b640 con 0x7fae48069ab0 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae46ffd700 1 -- 172.21.15.55:0/2191674155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800b7a0 con 0x7fae48069ab0 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.157+0000 7fae46ffd700 1 -- 172.21.15.55:0/2191674155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800bb40 con 0x7fae48069ab0 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 -- 172.21.15.55:0/2191674155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae48069ab0 msgr2=0x7fae480ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 --2- 172.21.15.55:0/2191674155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae48069ab0 0x7fae480ada60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fae380098e0 tx=0x7fae380091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 -- 172.21.15.55:0/2191674155 shutdown_connections 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 --2- 172.21.15.55:0/2191674155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae4806d350 0x7fae4806eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 --2- 172.21.15.55:0/2191674155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae48069ab0 0x7fae480ada60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 -- 172.21.15.55:0/2191674155 >> 172.21.15.55:0/2191674155 conn(0x7fae48068080 msgr2=0x7fae480cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 -- 172.21.15.55:0/2191674155 shutdown_connections 2023-10-06T11:15:18.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.158+0000 7fae4e607700 1 -- 172.21.15.55:0/2191674155 wait complete. 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.159+0000 7fae4e607700 1 Processor -- start 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.159+0000 7fae4e607700 1 -- start start 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4e607700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 0x7fae48156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4e607700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae48069ab0 0x7fae48146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4e607700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4806d350 0x7fae48157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4e607700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae480c10e0 con 0x7fae480696e0 2023-10-06T11:15:18.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4e607700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae480c0070 con 0x7fae4806d350 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4e607700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae480c0350 con 0x7fae48069ab0 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 0x7fae48156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 0x7fae48156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59050/0 (socket says 172.21.15.55:59050) 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 -- 172.21.15.55:0/1505863563 learned_addr learned my addr 172.21.15.55:0/1505863563 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae477fe700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae48069ab0 0x7fae48146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae4cba4700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4806d350 0x7fae48157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 -- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae48069ab0 msgr2=0x7fae48146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae48069ab0 0x7fae48146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 -- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4806d350 msgr2=0x7fae48157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4806d350 0x7fae48157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 -- 172.21.15.55:0/1505863563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38009420 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae477fe700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae48069ab0 0x7fae48146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.160+0000 7fae47fff700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 0x7fae48156f60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c7c0 tx=0x7fae30007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.161+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30005b30 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.161+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30005c90 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.161+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae480c0630 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.161+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30007340 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.161+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae481574a0 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.162+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae48064a90 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.162+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae3001b400 con 0x7fae480696e0 2023-10-06T11:15:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.162+0000 7fae3ffff700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fae28066f30 0x7fae280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.163+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fae300842e0 con 0x7fae480696e0 2023-10-06T11:15:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.163+0000 7fae477fe700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fae28066f30 0x7fae280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.163+0000 7fae477fe700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fae28066f30 0x7fae280693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae380093f0 tx=0x7fae38017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:18.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.167+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae30051330 con 0x7fae480696e0 2023-10-06T11:15:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.408+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae4804bb40 con 0x7fae480696e0 2023-10-06T11:15:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.409+0000 7fae3ffff700 1 -- 172.21.15.55:0/1505863563 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7fae30054950 con 0x7fae480696e0 2023-10-06T11:15:18.411 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fae28066f30 msgr2=0x7fae280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fae28066f30 0x7fae280693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae380093f0 tx=0x7fae38017000 comp rx=0 tx=0).stop 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 msgr2=0x7fae48156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 0x7fae48156f60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c7c0 tx=0x7fae30007e00 comp rx=0 tx=0).stop 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 shutdown_connections 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fae28066f30 0x7fae280693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae480696e0 0x7fae48156f60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae4806d350 0x7fae48157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 --2- 172.21.15.55:0/1505863563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae48069ab0 0x7fae48146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 >> 172.21.15.55:0/1505863563 conn(0x7fae48068080 msgr2=0x7fae480c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 shutdown_connections 2023-10-06T11:15:18.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:18.411+0000 7fae4e607700 1 -- 172.21.15.55:0/1505863563 wait complete. 2023-10-06T11:15:18.425 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:15:18.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:15:18.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:15:18.425 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:15:18.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:18.425 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:15:18.426 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:15:18.426 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:15:18.426 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:18.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.426 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:15:18.441 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:15:18.442 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:15:18.443 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:15:18.444 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:15:18.445 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:18.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.445 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:15:18.505 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:15:18.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.506 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:15:18.563 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:15:18.563 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:15:18.563 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:15:18.563 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:15:18.563 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:15:18.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.564 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:15:18.564 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:15:18.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:15:18.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:15:18.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:15:18.564 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:15:18.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.666 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:15:18.681 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:15:18.681 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:15:18.682 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:18.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.682 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:15:18.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:18.747 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:18.802 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:18.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:18.803 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:18.857 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:15:18.857 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:15:18.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:18.938 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:18.938 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:18.957 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:18.957 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:18.957 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:18.958 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:18.958 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:18.958 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:18.958 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:18.958 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:18.979 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:15:18.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:15:18.982 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:15:18.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:18.982 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:19.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:15:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.207+0000 7f6972dde700 1 Processor -- start 2023-10-06T11:15:19.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.207+0000 7f6972dde700 1 -- start start 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f6972dde700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f696c159560 0x7f696c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f6972dde700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c0b0c60 con 0x7f696c0b0760 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f6972dde700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c0b0f40 con 0x7f696c0b49a0 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f6972dde700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c0b1220 con 0x7f696c159560 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f697137b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f696c0b0760 0x7f696c0b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35176/0 (socket says 172.21.15.55:35176) 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f697137b700 1 -- 172.21.15.55:0/2884171204 learned_addr learned my addr 172.21.15.55:0/2884171204 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020238522 0 0) 0x7f696c0b0c60 con 0x7f696c0b0760 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f6970b7a700 1 --2- 172.21.15.55:0/2884171204 >> v2:172.21.15.142:3300/0 conn(0x7f696c159560 0x7f696c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6954003570 con 0x7f696c0b0760 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304440298 0 0) 0x7f6954003570 con 0x7f696c0b0760 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 >> v2:172.21.15.142:3300/0 conn(0x7f696c159560 msgr2=0x7f696c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 --2- 172.21.15.55:0/2884171204 >> v2:172.21.15.142:3300/0 conn(0x7f696c159560 0x7f696c0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 >> v1:172.21.15.142:6789/0 conn(0x7f696c0b49a0 legacy=0x7f696c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0b1500 con 0x7f696c0b0760 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f69640017f0 con 0x7f696c0b0760 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.208+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 >> v1:172.21.15.55:6789/0 conn(0x7f696c0b0760 legacy=0x7f696c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6954003a60 0x7f6954003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f6954004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69540051c0 0x7f695400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0b1220 con 0x7f6954004810 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695400c0d0 con 0x7f69540051c0 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695400c290 con 0x7f6954003a60 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f6954004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f697137b700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69540051c0 0x7f695400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f6970b7a700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6954003a60 0x7f6954003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 -- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6954003a60 msgr2=0x7f6954003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6954003a60 0x7f6954003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 -- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69540051c0 msgr2=0x7f695400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69540051c0 0x7f695400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 -- 172.21.15.55:0/2884171204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954003570 con 0x7f6954004810 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f6970b7a700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6954003a60 0x7f6954003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f697137b700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69540051c0 0x7f695400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f697137b700 1 -- 172.21.15.55:0/2884171204 reap_dead start 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696bfff700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f6954004c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f696c088de0 tx=0x7f6960007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15192a2b79daca5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960012420 con 0x7f6954004810 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69600125a0 con 0x7f6954004810 2023-10-06T11:15:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.209+0000 7f696b7fe700 1 -- 172.21.15.55:0/2884171204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960012960 con 0x7f6954004810 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 -- 172.21.15.55:0/2884171204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 msgr2=0x7f6954004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f6954004c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f696c088de0 tx=0x7f6960007d30 comp rx=0 tx=0).stop 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 -- 172.21.15.55:0/2884171204 shutdown_connections 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 --2- 172.21.15.55:0/2884171204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f6954004c80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 -- 172.21.15.55:0/2884171204 >> 172.21.15.55:0/2884171204 conn(0x7f696c0997f0 msgr2=0x7f696c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 -- 172.21.15.55:0/2884171204 shutdown_connections 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.210+0000 7f6972dde700 1 -- 172.21.15.55:0/2884171204 wait complete. 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.211+0000 7f6972dde700 1 Processor -- start 2023-10-06T11:15:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.211+0000 7f6972dde700 1 -- start start 2023-10-06T11:15:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6972dde700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f696c0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6972dde700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f696c152f20 0x7f696c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6972dde700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f696c15dd20 0x7f696c15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6972dde700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15e6e0 con 0x7f6954004810 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6972dde700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1540d0 con 0x7f696c152f20 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6972dde700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1534c0 con 0x7f696c15dd20 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f696c0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f696c0aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59074/0 (socket says 172.21.15.55:59074) 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 -- 172.21.15.55:0/1138117100 learned_addr learned my addr 172.21.15.55:0/1138117100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f697137b700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f696c15dd20 0x7f696c15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f696bfff700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f696c152f20 0x7f696c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 -- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f696c15dd20 msgr2=0x7f696c15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f696c15dd20 0x7f696c15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 -- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f696c152f20 msgr2=0x7f696c069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f696c152f20 0x7f696c069670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 -- 172.21.15.55:0/1138117100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c1537a0 con 0x7f6954004810 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f697137b700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f696c15dd20 0x7f696c15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.212+0000 7f6970b7a700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f696c0aef70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f695c011720 tx=0x7f695c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.213+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c005c10 con 0x7f6954004810 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.213+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c005d70 con 0x7f6954004810 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.213+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c153a80 con 0x7f6954004810 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.213+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c006280 con 0x7f6954004810 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.213+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c069bb0 con 0x7f6954004810 2023-10-06T11:15:19.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.213+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c064a90 con 0x7f6954004810 2023-10-06T11:15:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.214+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f695c0065f0 con 0x7f6954004810 2023-10-06T11:15:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.214+0000 7f6968ff9700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6958066f30 0x7f69580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.214+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f695c084a70 con 0x7f6954004810 2023-10-06T11:15:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.215+0000 7f696bfff700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6958066f30 0x7f69580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.215+0000 7f696bfff700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6958066f30 0x7f69580693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6960001370 tx=0x7f6960015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.219+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f695c051a40 con 0x7f6954004810 2023-10-06T11:15:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.456+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f696c0b17e0 con 0x7f6954004810 2023-10-06T11:15:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.457+0000 7f6968ff9700 1 -- 172.21.15.55:0/1138117100 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f695c022020 con 0x7f6954004810 2023-10-06T11:15:19.458 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:15:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6958066f30 msgr2=0x7f69580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6958066f30 0x7f69580693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6960001370 tx=0x7f6960015000 comp rx=0 tx=0).stop 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 msgr2=0x7f696c0aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f696c0aef70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f695c011720 tx=0x7f695c008040 comp rx=0 tx=0).stop 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 shutdown_connections 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6958066f30 0x7f69580693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6954004810 0x7f696c0aef70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f696c15dd20 0x7f696c15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 --2- 172.21.15.55:0/1138117100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f696c152f20 0x7f696c069670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 >> 172.21.15.55:0/1138117100 conn(0x7f696c0997f0 msgr2=0x7f696c151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 shutdown_connections 2023-10-06T11:15:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:19.459+0000 7f6972dde700 1 -- 172.21.15.55:0/1138117100 wait complete. 2023-10-06T11:15:19.472 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:15:19.473 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:15:19.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:19.473 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:15:19.491 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:15:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:15:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:19.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:19.495 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:15:19.558 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:15:19.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:19.560 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:15:19.617 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:15:19.618 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:15:19.618 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:15:19.618 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:15:19.618 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:15:19.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:19.618 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:15:19.618 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:15:19.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:15:19.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:15:19.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:15:19.619 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:15:19.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:19.722 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:15:19.737 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:15:19.737 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:15:19.737 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:15:19.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:19.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:15:19.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:19.801 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:19.857 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:15:19.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:19.857 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:19.911 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:15:19.911 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:15:19.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:19.990 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:19.990 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:20.009 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:20.009 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:20.009 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:20.010 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:20.010 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:20.010 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:20.010 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:20.010 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:20.031 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:20.031 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:20.031 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:15:20.032 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:15:20.033 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:15:20.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:20.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:20.098 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:15:20.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:20.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:20.186 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:15:20.186 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:15:20.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:20.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:20.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:15:20.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:20.231 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:15:20.247 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:15:20.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:20.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:20.290 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:15:20.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:20.290 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:15:20.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:20.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.469+0000 7f6e84bdc700 1 Processor -- start 2023-10-06T11:15:20.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.469+0000 7f6e84bdc700 1 -- start start 2023-10-06T11:15:20.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e84bdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e80159560 0x7f6e800aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e84bdc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e800b49a0 0x7f6e800aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e84bdc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e800b0c60 con 0x7f6e800b0760 2023-10-06T11:15:20.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e84bdc700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e800b0f40 con 0x7f6e800b49a0 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e84bdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800b1220 con 0x7f6e80159560 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e800b49a0 0x7f6e800aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e800b49a0 0x7f6e800aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59082/0 (socket says 172.21.15.55:59082) 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/2615988796 learned_addr learned my addr 172.21.15.55:0/2615988796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7e59c700 1 --2- 172.21.15.55:0/2615988796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e80159560 0x7f6e800aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/2615988796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e80159560 msgr2=0x7f6e800aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 --2- 172.21.15.55:0/2615988796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e80159560 0x7f6e800aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/2615988796 >> v1:172.21.15.142:6789/0 conn(0x7f6e800b0760 legacy=0x7f6e800b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.470+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/2615988796 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e800b1500 con 0x7f6e800b49a0 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e7dd9b700 1 --2- 172.21.15.55:0/2615988796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e800aaa70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6e680099b0 tx=0x7f6e68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5425dfbcb471c08c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e7d59a700 1 -- 172.21.15.55:0/2615988796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800b860 con 0x7f6e800b49a0 2023-10-06T11:15:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e7d59a700 1 -- 172.21.15.55:0/2615988796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800b9c0 con 0x7f6e800b49a0 2023-10-06T11:15:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e7d59a700 1 -- 172.21.15.55:0/2615988796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800bd60 con 0x7f6e800b49a0 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 -- 172.21.15.55:0/2615988796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 msgr2=0x7f6e800aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/2615988796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e800aaa70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6e680099b0 tx=0x7f6e68009250 comp rx=0 tx=0).stop 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 -- 172.21.15.55:0/2615988796 shutdown_connections 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/2615988796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e80159560 0x7f6e800aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/2615988796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e800aaa70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 -- 172.21.15.55:0/2615988796 >> 172.21.15.55:0/2615988796 conn(0x7f6e800997f0 msgr2=0x7f6e8006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:20.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 -- 172.21.15.55:0/2615988796 shutdown_connections 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.471+0000 7f6e84bdc700 1 -- 172.21.15.55:0/2615988796 wait complete. 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 Processor -- start 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 -- start start 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800b0760 0x7f6e801579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e8009c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e80159560 0x7f6e8009cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80157ee0 con 0x7f6e800b49a0 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800cbce0 con 0x7f6e80159560 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e84bdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800cc170 con 0x7f6e800b0760 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e7dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e8009c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e7dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e8009c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59088/0 (socket says 172.21.15.55:59088) 2023-10-06T11:15:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.473+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/3230081326 learned_addr learned my addr 172.21.15.55:0/3230081326 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7e59c700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800b0760 0x7f6e801579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800b0760 msgr2=0x7f6e801579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7dd9b700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800b0760 0x7f6e801579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e80159560 msgr2=0x7f6e8009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7ed9d700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e80159560 0x7f6e8009cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7dd9b700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e80159560 0x7f6e8009cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7dd9b700 1 -- 172.21.15.55:0/3230081326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680094f0 con 0x7f6e800b49a0 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7e59c700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800b0760 0x7f6e801579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7ed9d700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e80159560 0x7f6e8009cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e7dd9b700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e8009c7f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6e80067c20 tx=0x7f6e68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:20.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68024440 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e680245c0 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e800cb3b0 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68024980 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.474+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e800cb970 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.475+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e80064a90 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.475+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e6801a420 con 0x7f6e800b49a0 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.476+0000 7f6e767fc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6e60066f30 0x7f6e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.476+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6e680865a0 con 0x7f6e800b49a0 2023-10-06T11:15:20.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.476+0000 7f6e7e59c700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6e60066f30 0x7f6e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.476+0000 7f6e7e59c700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6e60066f30 0x7f6e600693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6e800af580 tx=0x7f6e7000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:20.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.480+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e68053570 con 0x7f6e800b49a0 2023-10-06T11:15:20.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.717+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e800cbe20 con 0x7f6e800b49a0 2023-10-06T11:15:20.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.718+0000 7f6e767fc700 1 -- 172.21.15.55:0/3230081326 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f6e68056b90 con 0x7f6e800b49a0 2023-10-06T11:15:20.720 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:20.720 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.489146+0000","modified":"2023-10-06T11:15:15.117701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1949751392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1949751392},{"type":"v1","addr":"172.21.15.142:6837","nonce":1949751392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:15:20.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6e60066f30 msgr2=0x7f6e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6e60066f30 0x7f6e600693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6e800af580 tx=0x7f6e7000b040 comp rx=0 tx=0).stop 2023-10-06T11:15:20.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 msgr2=0x7f6e8009c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e8009c7f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6e80067c20 tx=0x7f6e68017000 comp rx=0 tx=0).stop 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 shutdown_connections 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6e60066f30 0x7f6e600693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e80159560 0x7f6e8009cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800b0760 0x7f6e801579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 --2- 172.21.15.55:0/3230081326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e800b49a0 0x7f6e8009c7f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 >> 172.21.15.55:0/3230081326 conn(0x7f6e800997f0 msgr2=0x7f6e800d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 shutdown_connections 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.720+0000 7f6e84bdc700 1 -- 172.21.15.55:0/3230081326 wait complete. 2023-10-06T11:15:20.723 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2023-10-06T11:15:20.735 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:20.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.851+0000 7fad7c8d1700 1 Processor -- start 2023-10-06T11:15:20.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.851+0000 7fad7c8d1700 1 -- start start 2023-10-06T11:15:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.852+0000 7fad7c8d1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fad780cad80 0x7fad78159f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.852+0000 7fad7c8d1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad78068d10 con 0x7fad780cb5f0 2023-10-06T11:15:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.852+0000 7fad7c8d1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7815a670 con 0x7fad78159ad0 2023-10-06T11:15:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.852+0000 7fad7c8d1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7815a490 con 0x7fad780cad80 2023-10-06T11:15:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7659c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fad780cb5f0 0x7fad780691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35184/0 (socket says 172.21.15.55:35184) 2023-10-06T11:15:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7659c700 1 -- 172.21.15.55:0/3849445180 learned_addr learned my addr 172.21.15.55:0/3849445180 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad76d9d700 1 --2- 172.21.15.55:0/3849445180 >> v2:172.21.15.142:3300/0 conn(0x7fad780cad80 0x7fad78159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919185999 0 0) 0x7fad78068d10 con 0x7fad780cb5f0 2023-10-06T11:15:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad64003570 con 0x7fad780cb5f0 2023-10-06T11:15:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539636917 0 0) 0x7fad7815a670 con 0x7fad78159ad0 2023-10-06T11:15:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad78068d10 con 0x7fad78159ad0 2023-10-06T11:15:20.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad76d9d700 1 -- 172.21.15.55:0/3849445180 >> v1:172.21.15.142:6789/0 conn(0x7fad78159ad0 legacy=0x7fad780ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653446814 0 0) 0x7fad64003570 con 0x7fad780cb5f0 2023-10-06T11:15:20.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad76d9d700 1 -- 172.21.15.55:0/3849445180 >> v1:172.21.15.55:6789/0 conn(0x7fad780cb5f0 legacy=0x7fad780691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad76d9d700 1 -- 172.21.15.55:0/3849445180 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7815a950 con 0x7fad780cad80 2023-10-06T11:15:20.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad76d9d700 1 --2- 172.21.15.55:0/3849445180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad780cad80 0x7fad78159f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fad68009e60 tx=0x7fad68009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a991c4fa9c09311 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:20.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800e070 con 0x7fad780cad80 2023-10-06T11:15:20.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6800b7a0 con 0x7fad780cad80 2023-10-06T11:15:20.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.853+0000 7fad7559a700 1 -- 172.21.15.55:0/3849445180 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70001470 con 0x7fad780cad80 2023-10-06T11:15:20.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 -- 172.21.15.55:0/3849445180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad780cad80 msgr2=0x7fad78159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/3849445180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad780cad80 0x7fad78159f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fad68009e60 tx=0x7fad68009780 comp rx=0 tx=0).stop 2023-10-06T11:15:20.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 -- 172.21.15.55:0/3849445180 shutdown_connections 2023-10-06T11:15:20.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/3849445180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad780cad80 0x7fad78159f50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 -- 172.21.15.55:0/3849445180 >> 172.21.15.55:0/3849445180 conn(0x7fad780707d0 msgr2=0x7fad78070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:20.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 -- 172.21.15.55:0/3849445180 shutdown_connections 2023-10-06T11:15:20.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.854+0000 7fad7c8d1700 1 -- 172.21.15.55:0/3849445180 wait complete. 2023-10-06T11:15:20.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.855+0000 7fad7c8d1700 1 Processor -- start 2023-10-06T11:15:20.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.855+0000 7fad7c8d1700 1 -- start start 2023-10-06T11:15:20.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7c8d1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 0x7fad781517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7c8d1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad780cb5f0 0x7fad781697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7c8d1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad78159ad0 0x7fad780c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7c8d1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7816a7d0 con 0x7fad780cad80 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7c8d1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7816a210 con 0x7fad78159ad0 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7c8d1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7816a4f0 con 0x7fad780cb5f0 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 0x7fad781517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 0x7fad781517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59104/0 (socket says 172.21.15.55:59104) 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 -- 172.21.15.55:0/2613016067 learned_addr learned my addr 172.21.15.55:0/2613016067 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad75d9b700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad780cb5f0 0x7fad781697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad76d9d700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad78159ad0 0x7fad780c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 -- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad780cb5f0 msgr2=0x7fad781697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad780cb5f0 0x7fad781697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 -- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad78159ad0 msgr2=0x7fad780c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad78159ad0 0x7fad780c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad7659c700 1 -- 172.21.15.55:0/2613016067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009a20 con 0x7fad780cad80 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad75d9b700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad780cb5f0 0x7fad781697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.856+0000 7fad76d9d700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad78159ad0 0x7fad780c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.857+0000 7fad7659c700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 0x7fad781517a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fad7000cb60 tx=0x7fad70001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.857+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70007e90 con 0x7fad780cad80 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.857+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70007360 con 0x7fad780cad80 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.857+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad780b11b0 con 0x7fad780cad80 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.857+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70007700 con 0x7fad780cad80 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.857+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad780c4560 con 0x7fad780cad80 2023-10-06T11:15:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.858+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78064a90 con 0x7fad780cad80 2023-10-06T11:15:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.858+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad70004a40 con 0x7fad780cad80 2023-10-06T11:15:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.858+0000 7fad6e7fc700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad58066f30 0x7fad580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.859+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fad70083f40 con 0x7fad780cad80 2023-10-06T11:15:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.859+0000 7fad75d9b700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad58066f30 0x7fad580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.859+0000 7fad75d9b700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad58066f30 0x7fad580693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad780c86b0 tx=0x7fad60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:20.863+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad70054a20 con 0x7fad780cad80 2023-10-06T11:15:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.058+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad7804bb40 con 0x7fad780cad80 2023-10-06T11:15:21.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.059+0000 7fad6e7fc700 1 -- 172.21.15.55:0/2613016067 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fad70018090 con 0x7fad780cad80 2023-10-06T11:15:21.061 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:21.061 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:13.032147+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.335026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.468577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad58066f30 msgr2=0x7fad580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad58066f30 0x7fad580693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad780c86b0 tx=0x7fad60009040 comp rx=0 tx=0).stop 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 msgr2=0x7fad781517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 0x7fad781517a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fad7000cb60 tx=0x7fad70001ad0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 shutdown_connections 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fad58066f30 0x7fad580693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad780cad80 0x7fad781517a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad78159ad0 0x7fad780c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 --2- 172.21.15.55:0/2613016067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fad780cb5f0 0x7fad781697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.061+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 >> 172.21.15.55:0/2613016067 conn(0x7fad780707d0 msgr2=0x7fad78153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.062+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 shutdown_connections 2023-10-06T11:15:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.062+0000 7fad7c8d1700 1 -- 172.21.15.55:0/2613016067 wait complete. 2023-10-06T11:15:21.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:15:09.335026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:15:10.468577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:15:21.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:15:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.197+0000 7f58c0a2c700 1 Processor -- start 2023-10-06T11:15:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.197+0000 7f58c0a2c700 1 -- start start 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58c0a2c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58bc0cd3c0 0x7f58bc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58c0a2c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0cc970 con 0x7f58bc0b2620 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58c0a2c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0cbd60 con 0x7f58bc0b29f0 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58c0a2c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc0cc040 con 0x7f58bc0cd3c0 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58baffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58bc0cd3c0 0x7f58bc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58bb7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58bc0b2620 0x7f58bc0cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35188/0 (socket says 172.21.15.55:35188) 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.198+0000 7f58bb7fe700 1 -- 172.21.15.55:0/1228010010 learned_addr learned my addr 172.21.15.55:0/1228010010 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58baffd700 1 -- 172.21.15.55:0/1228010010 >> v1:172.21.15.142:6789/0 conn(0x7f58bc0b29f0 legacy=0x7f58bc0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58baffd700 1 -- 172.21.15.55:0/1228010010 >> v1:172.21.15.55:6789/0 conn(0x7f58bc0b2620 legacy=0x7f58bc0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58baffd700 1 -- 172.21.15.55:0/1228010010 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0cc320 con 0x7f58bc0cd3c0 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58ba7fc700 1 -- 172.21.15.55:0/1228010010 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425534864 0 0) 0x7f58bc0cc970 con 0x7f58bc0b2620 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58baffd700 1 --2- 172.21.15.55:0/1228010010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0ceaa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f58b00098e0 tx=0x7f58b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba713d375711e4fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58ba7fc700 1 -- 172.21.15.55:0/1228010010 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0009e80 con 0x7f58bc0cd3c0 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58ba7fc700 1 -- 172.21.15.55:0/1228010010 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b000b820 con 0x7f58bc0cd3c0 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58ba7fc700 1 -- 172.21.15.55:0/1228010010 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000bba0 con 0x7f58bc0cd3c0 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1228010010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0cd3c0 msgr2=0x7f58bc0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1228010010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0ceaa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f58b00098e0 tx=0x7f58b00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1228010010 shutdown_connections 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1228010010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0ceaa0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1228010010 >> 172.21.15.55:0/1228010010 conn(0x7f58bc099520 msgr2=0x7f58bc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.199+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1228010010 shutdown_connections 2023-10-06T11:15:21.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.200+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1228010010 wait complete. 2023-10-06T11:15:21.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.201+0000 7f58c0a2c700 1 Processor -- start 2023-10-06T11:15:21.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.201+0000 7f58c0a2c700 1 -- start start 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.201+0000 7f58c0a2c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58bc0b2620 0x7f58bc150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.201+0000 7f58c0a2c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 0x7f58bc169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58c0a2c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58c0a2c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc15afb0 con 0x7f58bc0b29f0 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58c0a2c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc15b250 con 0x7f58bc0cd3c0 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58c0a2c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc15b530 con 0x7f58bc0b2620 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 0x7f58bc169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 0x7f58bc169a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59128/0 (socket says 172.21.15.55:59128) 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 -- 172.21.15.55:0/1570119887 learned_addr learned my addr 172.21.15.55:0/1570119887 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58bbfff700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58bb7fe700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58bc0b2620 0x7f58bc150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 -- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58bc0b2620 msgr2=0x7f58bc150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58bc0b2620 0x7f58bc150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 -- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58bc0cd3c0 msgr2=0x7f58bc0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 -- 172.21.15.55:0/1570119887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b0009420 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58baffd700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 0x7f58bc169a40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f58b00030c0 tx=0x7f58b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000bba0 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b001c460 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc15b810 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b001c820 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.202+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc151230 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.203+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc05f230 con 0x7f58bc0b29f0 2023-10-06T11:15:21.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.204+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58b001cb90 con 0x7f58bc0b29f0 2023-10-06T11:15:21.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.204+0000 7f58a37fe700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58a8066f30 0x7f58a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.204+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f58b0086e50 con 0x7f58bc0b29f0 2023-10-06T11:15:21.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.204+0000 7f58bb7fe700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58a8066f30 0x7f58a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.205+0000 7f58bb7fe700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58a8066f30 0x7f58a80693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58bc15a1c0 tx=0x7f58ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.208+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58b0053e20 con 0x7f58bc0b29f0 2023-10-06T11:15:21.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.402+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58bc05f230 con 0x7f58bc0b29f0 2023-10-06T11:15:21.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.402+0000 7f58a37fe700 1 -- 172.21.15.55:0/1570119887 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58b0057440 con 0x7f58bc0b29f0 2023-10-06T11:15:21.404 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:15:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58a8066f30 msgr2=0x7f58a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58a8066f30 0x7f58a80693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58bc15a1c0 tx=0x7f58ac009040 comp rx=0 tx=0).stop 2023-10-06T11:15:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 msgr2=0x7f58bc169a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 0x7f58bc169a40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f58b00030c0 tx=0x7f58b0016000 comp rx=0 tx=0).stop 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 shutdown_connections 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58a8066f30 0x7f58a80693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58bc0cd3c0 0x7f58bc0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58bc0b2620 0x7f58bc150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 --2- 172.21.15.55:0/1570119887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58bc0b29f0 0x7f58bc169a40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 >> 172.21.15.55:0/1570119887 conn(0x7f58bc099520 msgr2=0x7f58bc0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 shutdown_connections 2023-10-06T11:15:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.404+0000 7f58c0a2c700 1 -- 172.21.15.55:0/1570119887 wait complete. 2023-10-06T11:15:21.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:15:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.538+0000 7f47e81b4700 1 Processor -- start 2023-10-06T11:15:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.538+0000 7f47e81b4700 1 -- start start 2023-10-06T11:15:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e81b4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47e00cc390 0x7f47e0068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e81b4700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e0067f80 con 0x7f47e01593f0 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e81b4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e0067650 con 0x7f47e006e350 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e81b4700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e006eac0 con 0x7f47e00cc390 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e5f50700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47e01593f0 0x7f47e006dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35192/0 (socket says 172.21.15.55:35192) 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e5f50700 1 -- 172.21.15.55:0/3966257906 learned_addr learned my addr 172.21.15.55:0/3966257906 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.539+0000 7f47e6751700 1 --2- 172.21.15.55:0/3966257906 >> v2:172.21.15.55:3300/0 conn(0x7f47e00cc390 0x7f47e0068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e6751700 1 -- 172.21.15.55:0/3966257906 >> v1:172.21.15.142:6789/0 conn(0x7f47e006e350 legacy=0x7f47e0068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e6751700 1 -- 172.21.15.55:0/3966257906 >> v1:172.21.15.55:6789/0 conn(0x7f47e01593f0 legacy=0x7f47e006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e4f4e700 1 -- 172.21.15.55:0/3966257906 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021018469 0 0) 0x7f47e0067f80 con 0x7f47e01593f0 2023-10-06T11:15:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e6751700 1 -- 172.21.15.55:0/3966257906 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0067930 con 0x7f47e00cc390 2023-10-06T11:15:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e6751700 1 --2- 172.21.15.55:0/3966257906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e00cc390 0x7f47e0068b20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f47d80098e0 tx=0x7f47d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4388c7dc83d0e71c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e4f4e700 1 -- 172.21.15.55:0/3966257906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8009e80 con 0x7f47e00cc390 2023-10-06T11:15:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e4f4e700 1 -- 172.21.15.55:0/3966257906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800b860 con 0x7f47e00cc390 2023-10-06T11:15:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.540+0000 7f47e4f4e700 1 -- 172.21.15.55:0/3966257906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800bbe0 con 0x7f47e00cc390 2023-10-06T11:15:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 -- 172.21.15.55:0/3966257906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e00cc390 msgr2=0x7f47e0068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 --2- 172.21.15.55:0/3966257906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e00cc390 0x7f47e0068b20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f47d80098e0 tx=0x7f47d80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 -- 172.21.15.55:0/3966257906 shutdown_connections 2023-10-06T11:15:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 --2- 172.21.15.55:0/3966257906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e00cc390 0x7f47e0068b20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 -- 172.21.15.55:0/3966257906 >> 172.21.15.55:0/3966257906 conn(0x7f47e00cd3d0 msgr2=0x7f47e00b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 -- 172.21.15.55:0/3966257906 shutdown_connections 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.541+0000 7f47e81b4700 1 -- 172.21.15.55:0/3966257906 wait complete. 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.542+0000 7f47e81b4700 1 Processor -- start 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.542+0000 7f47e81b4700 1 -- start start 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e81b4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47e006e350 0x7f47e0151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e81b4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00cc390 0x7f47e01535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e81b4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 0x7f47e01413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e81b4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0153ea0 con 0x7f47e01593f0 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e81b4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0154180 con 0x7f47e00cc390 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e81b4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e014e1d0 con 0x7f47e006e350 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 0x7f47e01413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 0x7f47e01413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59154/0 (socket says 172.21.15.55:59154) 2023-10-06T11:15:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 -- 172.21.15.55:0/4137954532 learned_addr learned my addr 172.21.15.55:0/4137954532 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e5f50700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47e006e350 0x7f47e0151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e574f700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00cc390 0x7f47e01535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 -- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47e006e350 msgr2=0x7f47e0151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47e006e350 0x7f47e0151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 -- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00cc390 msgr2=0x7f47e01535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00cc390 0x7f47e01535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 -- 172.21.15.55:0/4137954532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009420 con 0x7f47e01593f0 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47e6751700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 0x7f47e01413e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f47d80097b0 tx=0x7f47d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d801f070 con 0x7f47e01593f0 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.543+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800b9d0 con 0x7f47e01593f0 2023-10-06T11:15:21.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.544+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e014e4b0 con 0x7f47e01593f0 2023-10-06T11:15:21.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.544+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8025650 con 0x7f47e01593f0 2023-10-06T11:15:21.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.544+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e0153b30 con 0x7f47e01593f0 2023-10-06T11:15:21.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.545+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0064a90 con 0x7f47e01593f0 2023-10-06T11:15:21.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.545+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d8023070 con 0x7f47e01593f0 2023-10-06T11:15:21.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.545+0000 7f47ddffb700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.546+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f47d8085f20 con 0x7f47e01593f0 2023-10-06T11:15:21.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.546+0000 7f47e5f50700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.546+0000 7f47e5f50700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47cc066f30 0x7f47cc0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000f80 tx=0x7f47d0001950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.550+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d8052e50 con 0x7f47e01593f0 2023-10-06T11:15:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.743+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47e0067c10 con 0x7f47e01593f0 2023-10-06T11:15:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.744+0000 7f47ddffb700 1 -- 172.21.15.55:0/4137954532 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47d80150a0 con 0x7f47e01593f0 2023-10-06T11:15:21.746 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:15:21.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47cc066f30 msgr2=0x7f47cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47cc066f30 0x7f47cc0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000f80 tx=0x7f47d0001950 comp rx=0 tx=0).stop 2023-10-06T11:15:21.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 msgr2=0x7f47e01413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 0x7f47e01413e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f47d80097b0 tx=0x7f47d8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 shutdown_connections 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47e01593f0 0x7f47e01413e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47e006e350 0x7f47e0151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 --2- 172.21.15.55:0/4137954532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00cc390 0x7f47e01535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 >> 172.21.15.55:0/4137954532 conn(0x7f47e00cd3d0 msgr2=0x7f47e006dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 shutdown_connections 2023-10-06T11:15:21.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.746+0000 7f47e81b4700 1 -- 172.21.15.55:0/4137954532 wait complete. 2023-10-06T11:15:21.760 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:15:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.880+0000 7fafea992700 1 Processor -- start 2023-10-06T11:15:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.880+0000 7fafea992700 1 -- start start 2023-10-06T11:15:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.880+0000 7fafea992700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafe40cf090 0x7fafe40c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.880+0000 7fafea992700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe40cbb80 con 0x7fafe4159470 2023-10-06T11:15:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.880+0000 7fafea992700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe40c6f00 con 0x7fafe4159840 2023-10-06T11:15:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.880+0000 7fafea992700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe40cb530 con 0x7fafe40cf090 2023-10-06T11:15:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe8f2f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafe40cf090 0x7fafe40c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe3fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fafe4159470 0x7fafe40ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35196/0 (socket says 172.21.15.55:35196) 2023-10-06T11:15:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe3fff700 1 -- 172.21.15.55:0/3433819923 learned_addr learned my addr 172.21.15.55:0/3433819923 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe8f2f700 1 -- 172.21.15.55:0/3433819923 >> v1:172.21.15.142:6789/0 conn(0x7fafe4159840 legacy=0x7fafe40c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe8f2f700 1 -- 172.21.15.55:0/3433819923 >> v1:172.21.15.55:6789/0 conn(0x7fafe4159470 legacy=0x7fafe40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe2ffd700 1 -- 172.21.15.55:0/3433819923 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271369595 0 0) 0x7fafe40cbb80 con 0x7fafe4159470 2023-10-06T11:15:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe8f2f700 1 -- 172.21.15.55:0/3433819923 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40cb810 con 0x7fafe40cf090 2023-10-06T11:15:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe8f2f700 1 --2- 172.21.15.55:0/3433819923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe40cf090 0x7fafe40c6880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009e60 tx=0x7fafdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2dd82b64df1ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe2ffd700 1 -- 172.21.15.55:0/3433819923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00e070 con 0x7fafe40cf090 2023-10-06T11:15:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe2ffd700 1 -- 172.21.15.55:0/3433819923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc00bbf0 con 0x7fafe40cf090 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.881+0000 7fafe2ffd700 1 -- 172.21.15.55:0/3433819923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc012430 con 0x7fafe40cf090 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 -- 172.21.15.55:0/3433819923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe40cf090 msgr2=0x7fafe40c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 --2- 172.21.15.55:0/3433819923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe40cf090 0x7fafe40c6880 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009e60 tx=0x7fafdc009780 comp rx=0 tx=0).stop 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 -- 172.21.15.55:0/3433819923 shutdown_connections 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 --2- 172.21.15.55:0/3433819923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe40cf090 0x7fafe40c6880 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 -- 172.21.15.55:0/3433819923 >> 172.21.15.55:0/3433819923 conn(0x7fafe40996e0 msgr2=0x7fafe406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 -- 172.21.15.55:0/3433819923 shutdown_connections 2023-10-06T11:15:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.882+0000 7fafea992700 1 -- 172.21.15.55:0/3433819923 wait complete. 2023-10-06T11:15:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.883+0000 7fafea992700 1 Processor -- start 2023-10-06T11:15:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.883+0000 7fafea992700 1 -- start start 2023-10-06T11:15:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafea992700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafe40cf090 0x7fafe415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafea992700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 0x7fafe4157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafea992700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafe4159840 0x7fafe40cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafea992700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe415a540 con 0x7fafe4159470 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafea992700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe416aa50 con 0x7fafe4159840 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafea992700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4159c10 con 0x7fafe40cf090 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 0x7fafe4157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 0x7fafe4157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59174/0 (socket says 172.21.15.55:59174) 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 -- 172.21.15.55:0/2123650742 learned_addr learned my addr 172.21.15.55:0/2123650742 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe8f2f700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafe4159840 0x7fafe40cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe3fff700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafe40cf090 0x7fafe415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 -- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafe40cf090 msgr2=0x7fafe415a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafe40cf090 0x7fafe415a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 -- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafe4159840 msgr2=0x7fafe40cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafe4159840 0x7fafe40cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 -- 172.21.15.55:0/2123650742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009a20 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe3fff700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafe40cf090 0x7fafe415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.884+0000 7fafe37fe700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 0x7fafe4157120 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fafd800b5e0 tx=0x7fafd8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.885+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800f510 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.885+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800f670 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.885+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe4159ef0 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.885+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800fa30 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.885+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe40cd5f0 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.886+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe4064a90 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.886+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafd801a400 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.887+0000 7fafcbfff700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fafd0066f30 0x7fafd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.887+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fafd80842b0 con 0x7fafe4159470 2023-10-06T11:15:21.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.887+0000 7fafe3fff700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fafd0066f30 0x7fafd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.887+0000 7fafe3fff700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fafd0066f30 0x7fafd00693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fafd40018b0 tx=0x7fafd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:21.891+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafd8051300 con 0x7fafe4159470 2023-10-06T11:15:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.083+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafe40cb1e0 con 0x7fafe4159470 2023-10-06T11:15:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.084+0000 7fafcbfff700 1 -- 172.21.15.55:0/2123650742 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafd8054920 con 0x7fafe4159470 2023-10-06T11:15:22.085 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fafd0066f30 msgr2=0x7fafd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fafd0066f30 0x7fafd00693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fafd40018b0 tx=0x7fafd4009040 comp rx=0 tx=0).stop 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 msgr2=0x7fafe4157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 0x7fafe4157120 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fafd800b5e0 tx=0x7fafd8009120 comp rx=0 tx=0).stop 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 shutdown_connections 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fafd0066f30 0x7fafd00693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafe4159840 0x7fafe40cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafe40cf090 0x7fafe415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 --2- 172.21.15.55:0/2123650742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe4159470 0x7fafe4157120 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 >> 172.21.15.55:0/2123650742 conn(0x7fafe40996e0 msgr2=0x7fafe4068f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 shutdown_connections 2023-10-06T11:15:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.086+0000 7fafea992700 1 -- 172.21.15.55:0/2123650742 wait complete. 2023-10-06T11:15:22.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:15:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.219+0000 7f5878c90700 1 Processor -- start 2023-10-06T11:15:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.219+0000 7f5878c90700 1 -- start start 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.220+0000 7f5878c90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.220+0000 7f5878c90700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58740c4450 0x7f58740cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.220+0000 7f5878c90700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740c9670 con 0x7f58740cc740 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.220+0000 7f5878c90700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5874159c00 con 0x7f58740c4450 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.220+0000 7f5878c90700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c8a60 con 0x7f58740b0820 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5872d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58740cc740 0x7f58740ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35198/0 (socket says 172.21.15.55:35198) 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5872d9d700 1 -- 172.21.15.55:0/3970945633 learned_addr learned my addr 172.21.15.55:0/3970945633 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5871d9b700 1 --2- 172.21.15.55:0/3970945633 >> v2:172.21.15.142:3300/0 conn(0x7f58740c4450 0x7f58740cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f587259c700 1 --2- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f587159a700 1 -- 172.21.15.55:0/3970945633 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911255537 0 0) 0x7f58740c9670 con 0x7f58740cc740 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f587159a700 1 -- 172.21.15.55:0/3970945633 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860003570 con 0x7f58740cc740 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5871d9b700 1 -- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 msgr2=0x7f58740686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5871d9b700 1 --2- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5871d9b700 1 -- 172.21.15.55:0/3970945633 >> v1:172.21.15.55:6789/0 conn(0x7f58740cc740 legacy=0x7f58740ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f587159a700 1 -- 172.21.15.55:0/3970945633 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498730705 0 0) 0x7f5860003570 con 0x7f58740cc740 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5871d9b700 1 -- 172.21.15.55:0/3970945633 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740c8d40 con 0x7f58740c4450 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f5871d9b700 1 --2- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740c4450 0x7f58740cec30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f585c0098e0 tx=0x7f585c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1fb3972e106e5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.221+0000 7f587159a700 1 -- 172.21.15.55:0/3970945633 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640017f0 con 0x7f58740c4450 2023-10-06T11:15:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f587159a700 1 -- 172.21.15.55:0/3970945633 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c011420 con 0x7f58740c4450 2023-10-06T11:15:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f587159a700 1 -- 172.21.15.55:0/3970945633 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0117a0 con 0x7f58740c4450 2023-10-06T11:15:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 -- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740c4450 msgr2=0x7f58740cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 --2- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740c4450 0x7f58740cec30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f585c0098e0 tx=0x7f585c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 -- 172.21.15.55:0/3970945633 shutdown_connections 2023-10-06T11:15:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 --2- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 --2- 172.21.15.55:0/3970945633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740c4450 0x7f58740cec30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 -- 172.21.15.55:0/3970945633 >> 172.21.15.55:0/3970945633 conn(0x7f5874087fc0 msgr2=0x7f58740ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 -- 172.21.15.55:0/3970945633 shutdown_connections 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.222+0000 7f5878c90700 1 -- 172.21.15.55:0/3970945633 wait complete. 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.223+0000 7f5878c90700 1 Processor -- start 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.223+0000 7f5878c90700 1 -- start start 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5878c90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5878c90700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 0x7f58740c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5878c90700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740cc740 0x7f5874151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5878c90700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741503f0 con 0x7f58740c4450 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5878c90700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5874150c90 con 0x7f58740cc740 2023-10-06T11:15:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5878c90700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c62c0 con 0x7f58740b0820 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 0x7f58740c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 0x7f58740c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59180/0 (socket says 172.21.15.55:59180) 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 -- 172.21.15.55:0/3000212023 learned_addr learned my addr 172.21.15.55:0/3000212023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5872d9d700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740cc740 0x7f5874151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f587259c700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 -- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 msgr2=0x7f58740b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 -- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740cc740 msgr2=0x7f5874151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740cc740 0x7f5874151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 -- 172.21.15.55:0/3000212023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c009420 con 0x7f58740c4450 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.224+0000 7f5871d9b700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 0x7f58740c5d80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f587406e5f0 tx=0x7f585c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.225+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c01caf0 con 0x7f58740c4450 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.225+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c01cc50 con 0x7f58740c4450 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.225+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58740c6590 con 0x7f58740c4450 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.225+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c01a450 con 0x7f58740c4450 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.225+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874150920 con 0x7f58740c4450 2023-10-06T11:15:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.226+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5874150e00 con 0x7f58740c4450 2023-10-06T11:15:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.226+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f585c01a7e0 con 0x7f58740c4450 2023-10-06T11:15:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.226+0000 7f586a7fc700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5854066f30 0x7f58540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.226+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f585c0860c0 con 0x7f58740c4450 2023-10-06T11:15:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.227+0000 7f587259c700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5854066f30 0x7f58540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.227+0000 7f587259c700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5854066f30 0x7f58540693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f586c009da0 tx=0x7f586c009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.231+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f585c053090 con 0x7f58740c4450 2023-10-06T11:15:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.422+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5874064a90 con 0x7f58740c4450 2023-10-06T11:15:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.422+0000 7f586a7fc700 1 -- 172.21.15.55:0/3000212023 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f585c0566b0 con 0x7f58740c4450 2023-10-06T11:15:22.424 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:15:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5854066f30 msgr2=0x7f58540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5854066f30 0x7f58540693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f586c009da0 tx=0x7f586c009120 comp rx=0 tx=0).stop 2023-10-06T11:15:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 msgr2=0x7f58740c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 0x7f58740c5d80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f587406e5f0 tx=0x7f585c016000 comp rx=0 tx=0).stop 2023-10-06T11:15:22.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 shutdown_connections 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5854066f30 0x7f58540693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58740cc740 0x7f5874151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58740b0820 0x7f58740b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 --2- 172.21.15.55:0/3000212023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58740c4450 0x7f58740c5d80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 >> 172.21.15.55:0/3000212023 conn(0x7f5874087fc0 msgr2=0x7f58740695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 shutdown_connections 2023-10-06T11:15:22.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.424+0000 7f5878c90700 1 -- 172.21.15.55:0/3000212023 wait complete. 2023-10-06T11:15:22.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.556+0000 7fdc0ccaa700 1 Processor -- start 2023-10-06T11:15:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.556+0000 7fdc0ccaa700 1 -- start start 2023-10-06T11:15:22.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0ccaa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc080b49a0 0x7fdc080aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0ccaa700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc080b0c60 con 0x7fdc08159560 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0ccaa700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc080b0f40 con 0x7fdc080b0760 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0ccaa700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080b1220 con 0x7fdc080b49a0 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0659c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc08159560 0x7fdc080aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35212/0 (socket says 172.21.15.55:35212) 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0659c700 1 -- 172.21.15.55:0/2142684198 learned_addr learned my addr 172.21.15.55:0/2142684198 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.557+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665085339 0 0) 0x7fdc080b0c60 con 0x7fdc08159560 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf4003570 con 0x7fdc08159560 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/2142684198 >> v2:172.21.15.142:3300/0 conn(0x7fdc080b49a0 0x7fdc080aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834387653 0 0) 0x7fdbf4003570 con 0x7fdc08159560 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 >> v2:172.21.15.142:3300/0 conn(0x7fdc080b49a0 msgr2=0x7fdc080aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 --2- 172.21.15.55:0/2142684198 >> v2:172.21.15.142:3300/0 conn(0x7fdc080b49a0 0x7fdc080aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 >> v1:172.21.15.142:6789/0 conn(0x7fdc080b0760 legacy=0x7fdc080b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080b1500 con 0x7fdc08159560 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fdc00001970 con 0x7fdc08159560 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 >> v1:172.21.15.55:6789/0 conn(0x7fdc08159560 legacy=0x7fdc080aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf4003ae0 0x7fdbf4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdbf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4005230 0x7fdbf400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080b1220 con 0x7fdbf4004810 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf400c160 con 0x7fdbf4005230 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf400c320 con 0x7fdbf4003ae0 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdbf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0659c700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf4003ae0 0x7fdbf4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc06d9d700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4005230 0x7fdbf400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 -- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf4003ae0 msgr2=0x7fdbf4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf4003ae0 0x7fdbf4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 -- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4005230 msgr2=0x7fdbf400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbf4005230 0x7fdbf400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc06d9d700 1 -- 172.21.15.55:0/2142684198 reap_dead start 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 -- 172.21.15.55:0/2142684198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4003570 con 0x7fdbf4004810 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc0659c700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbf4003ae0 0x7fdbf4003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.558+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdbf4004c80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdc08099f20 tx=0x7fdbf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee1a1d6830d52ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000e6e0 con 0x7fdbf4004810 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf000e840 con 0x7fdbf4004810 2023-10-06T11:15:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0559a700 1 -- 172.21.15.55:0/2142684198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000ec00 con 0x7fdbf4004810 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/2142684198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 msgr2=0x7fdbf4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdbf4004c80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdc08099f20 tx=0x7fdbf00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/2142684198 shutdown_connections 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/2142684198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdbf4004c80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/2142684198 >> 172.21.15.55:0/2142684198 conn(0x7fdc080997f0 msgr2=0x7fdc0806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/2142684198 shutdown_connections 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.559+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/2142684198 wait complete. 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.560+0000 7fdc0ccaa700 1 Processor -- start 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.560+0000 7fdc0ccaa700 1 -- start start 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0ccaa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdc08157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0ccaa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0816b000 0x7fdc080cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0ccaa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0816b470 0x7fdc080cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0ccaa700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0809c3d0 con 0x7fdbf4004810 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0ccaa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080c5fa0 con 0x7fdc0816b470 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0ccaa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0809baa0 con 0x7fdc0816b000 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdc08157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdc08157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59210/0 (socket says 172.21.15.55:59210) 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc0659c700 1 -- 172.21.15.55:0/506684063 learned_addr learned my addr 172.21.15.55:0/506684063 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0816b000 0x7fdc080cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.561+0000 7fdc06d9d700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0816b470 0x7fdc080cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0659c700 1 -- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0816b000 msgr2=0x7fdc080cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0659c700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0816b000 0x7fdc080cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0659c700 1 -- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0816b470 msgr2=0x7fdc080cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0659c700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0816b470 0x7fdc080cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0659c700 1 -- 172.21.15.55:0/506684063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0809bd80 con 0x7fdbf4004810 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc06d9d700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0816b470 0x7fdc080cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0659c700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdc08157120 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdc00003120 tx=0x7fdc00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00017070 con 0x7fdbf4004810 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00005d80 con 0x7fdbf4004810 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0809c060 con 0x7fdbf4004810 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000c930 con 0x7fdbf4004810 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.562+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0809c860 con 0x7fdbf4004810 2023-10-06T11:15:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.563+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0809c6b0 con 0x7fdbf4004810 2023-10-06T11:15:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.563+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc0000cca0 con 0x7fdbf4004810 2023-10-06T11:15:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.564+0000 7fdbfe7fc700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe8066f30 0x7fdbe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.564+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc00001e40 con 0x7fdbf4004810 2023-10-06T11:15:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.564+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe8066f30 0x7fdbe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.565+0000 7fdc05d9b700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe8066f30 0x7fdbe80693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00091e0 tx=0x7fdbf001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.568+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc00051970 con 0x7fdbf4004810 2023-10-06T11:15:22.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.804+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc08064a90 con 0x7fdbf4004810 2023-10-06T11:15:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.804+0000 7fdbfe7fc700 1 -- 172.21.15.55:0/506684063 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fdc00054f90 con 0x7fdbf4004810 2023-10-06T11:15:22.806 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:22.806 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.489146+0000","modified":"2023-10-06T11:15:15.117701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1949751392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1949751392},{"type":"v1","addr":"172.21.15.142:6837","nonce":1949751392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:15:22.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe8066f30 msgr2=0x7fdbe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe8066f30 0x7fdbe80693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00091e0 tx=0x7fdbf001a000 comp rx=0 tx=0).stop 2023-10-06T11:15:22.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 msgr2=0x7fdc08157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdc08157120 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdc00003120 tx=0x7fdc00009040 comp rx=0 tx=0).stop 2023-10-06T11:15:22.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 shutdown_connections 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdbe8066f30 0x7fdbe80693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf4004810 0x7fdc08157120 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0816b470 0x7fdc080cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 --2- 172.21.15.55:0/506684063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0816b000 0x7fdc080cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 >> 172.21.15.55:0/506684063 conn(0x7fdc080997f0 msgr2=0x7fdc080b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 shutdown_connections 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.806+0000 7fdc0ccaa700 1 -- 172.21.15.55:0/506684063 wait complete. 2023-10-06T11:15:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2023-10-06T11:15:22.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.938+0000 7fc757c3c700 1 Processor -- start 2023-10-06T11:15:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.938+0000 7fc757c3c700 1 -- start start 2023-10-06T11:15:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc757c3c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7500b49a0 0x7fc7500aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc757c3c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 0x7fc7500b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc757c3c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500b0c60 con 0x7fc750159560 2023-10-06T11:15:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc757c3c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500b0f40 con 0x7fc7500b49a0 2023-10-06T11:15:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc757c3c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b1220 con 0x7fc7500b0760 2023-10-06T11:15:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7559d8700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc750159560 0x7fc7500aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35226/0 (socket says 172.21.15.55:35226) 2023-10-06T11:15:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7559d8700 1 -- 172.21.15.55:0/3577821631 learned_addr learned my addr 172.21.15.55:0/3577821631 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7561d9700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 0x7fc7500b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457408519 0 0) 0x7fc7500b0c60 con 0x7fc750159560 2023-10-06T11:15:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc738003570 con 0x7fc750159560 2023-10-06T11:15:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7551d7700 1 --2- 172.21.15.55:0/3577821631 >> v2:172.21.15.142:3300/0 conn(0x7fc7500b49a0 0x7fc7500aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221518287 0 0) 0x7fc738003570 con 0x7fc750159560 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 msgr2=0x7fc7500b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 0x7fc7500b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 >> v2:172.21.15.142:3300/0 conn(0x7fc7500b49a0 msgr2=0x7fc7500aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 --2- 172.21.15.55:0/3577821631 >> v2:172.21.15.142:3300/0 conn(0x7fc7500b49a0 0x7fc7500aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500b1500 con 0x7fc750159560 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fc7480015f0 con 0x7fc750159560 2023-10-06T11:15:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 >> v1:172.21.15.55:6789/0 conn(0x7fc750159560 legacy=0x7fc7500aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 0x7fc738003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc738003fe0 0x7fc738004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.939+0000 7fc7549d6700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc738004d50 0x7fc7380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b0f40 con 0x7fc738004d50 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500b1220 con 0x7fc738003fe0 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73800ba90 con 0x7fc7500b0760 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc738004d50 0x7fc7380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7559d8700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 0x7fc738003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7551d7700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc738003fe0 0x7fc738004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 -- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 msgr2=0x7fc738003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500b0760 0x7fc738003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 -- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc738003fe0 msgr2=0x7fc738004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc738003fe0 0x7fc738004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 -- 172.21.15.55:0/3577821631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738003570 con 0x7fc738004d50 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7561d9700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc738004d50 0x7fc7380051c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc7500b64b0 tx=0x7fc74000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e455c14ee2b8c88a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000ea30 con 0x7fc738004d50 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74000f040 con 0x7fc738004d50 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.940+0000 7fc7549d6700 1 -- 172.21.15.55:0/3577821631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000ede0 con 0x7fc738004d50 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc757c3c700 1 -- 172.21.15.55:0/3577821631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc738004d50 msgr2=0x7fc7380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc757c3c700 1 --2- 172.21.15.55:0/3577821631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc738004d50 0x7fc7380051c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc7500b64b0 tx=0x7fc74000b040 comp rx=0 tx=0).stop 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc7561d9700 1 -- 172.21.15.55:0/3577821631 reap_dead start 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc757c3c700 1 -- 172.21.15.55:0/3577821631 shutdown_connections 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc757c3c700 1 -- 172.21.15.55:0/3577821631 >> 172.21.15.55:0/3577821631 conn(0x7fc7500997f0 msgr2=0x7fc75006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc757c3c700 1 -- 172.21.15.55:0/3577821631 shutdown_connections 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.941+0000 7fc757c3c700 1 -- 172.21.15.55:0/3577821631 wait complete. 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.942+0000 7fc757c3c700 1 Processor -- start 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.942+0000 7fc757c3c700 1 -- start start 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 0x7fc7500cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc75009d650 0x7fc75016cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500c5230 0x7fc7500c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7501698a0 con 0x7fc75009d280 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750169b40 con 0x7fc75009d650 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75016d3e0 con 0x7fc7500c5230 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 0x7fc7500cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 0x7fc7500cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59226/0 (socket says 172.21.15.55:59226) 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 -- 172.21.15.55:0/484672016 learned_addr learned my addr 172.21.15.55:0/484672016 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7561d9700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500c5230 0x7fc7500c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7551d7700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc75009d650 0x7fc75016cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 -- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500c5230 msgr2=0x7fc7500c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500c5230 0x7fc7500c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 -- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc75009d650 msgr2=0x7fc75016cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc75009d650 0x7fc75016cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 -- 172.21.15.55:0/484672016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75016d640 con 0x7fc75009d280 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7561d9700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500c5230 0x7fc7500c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc7559d8700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 0x7fc7500cbde0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc74800fc00 tx=0x7fc748009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480072e0 con 0x7fc75009d280 2023-10-06T11:15:22.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748007460 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75016d920 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.943+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480057f0 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.944+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc750169fd0 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.945+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75016de40 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.945+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc748005b60 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.945+0000 7fc74dffb700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.945+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc748084bb0 con 0x7fc75009d280 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.945+0000 7fc7551d7700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.946+0000 7fc7551d7700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc73c066f30 0x7fc73c0693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc744006f00 tx=0x7fc744008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:22.950+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc75016de40 con 0x7fc75009d280 2023-10-06T11:15:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.149+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc75016de40 con 0x7fc75009d280 2023-10-06T11:15:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.149+0000 7fc74dffb700 1 -- 172.21.15.55:0/484672016 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fc74806be60 con 0x7fc75009d280 2023-10-06T11:15:23.151 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:23.151 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:13.032147+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.335026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.468577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc73c066f30 msgr2=0x7fc73c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc73c066f30 0x7fc73c0693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc744006f00 tx=0x7fc744008040 comp rx=0 tx=0).stop 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 msgr2=0x7fc7500cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 0x7fc7500cbde0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc74800fc00 tx=0x7fc748009040 comp rx=0 tx=0).stop 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 shutdown_connections 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc73c066f30 0x7fc73c0693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75009d280 0x7fc7500cbde0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7500c5230 0x7fc7500c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 --2- 172.21.15.55:0/484672016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc75009d650 0x7fc75016cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 >> 172.21.15.55:0/484672016 conn(0x7fc7500997f0 msgr2=0x7fc7500b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 shutdown_connections 2023-10-06T11:15:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.152+0000 7fc757c3c700 1 -- 172.21.15.55:0/484672016 wait complete. 2023-10-06T11:15:23.166 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:15:23.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.283+0000 7f8270ecc700 1 Processor -- start 2023-10-06T11:15:23.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.283+0000 7f8270ecc700 1 -- start start 2023-10-06T11:15:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f8270ecc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c157040 0x7f826c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f8270ecc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f826c157410 0x7f826c06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f8270ecc700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c15b1d0 con 0x7f826c15b660 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f8270ecc700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c06dae0 con 0x7f826c157410 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f8270ecc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0ce4b0 con 0x7f826c157040 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f826affd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f826c157410 0x7f826c06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f826bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f826c15b660 0x7f826c0c9f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35230/0 (socket says 172.21.15.55:35230) 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.284+0000 7f826bfff700 1 -- 172.21.15.55:0/4247196631 learned_addr learned my addr 172.21.15.55:0/4247196631 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826b7fe700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c157040 0x7f826c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826affd700 1 -- 172.21.15.55:0/4247196631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c157040 msgr2=0x7f826c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826affd700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c157040 0x7f826c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826affd700 1 -- 172.21.15.55:0/4247196631 >> v1:172.21.15.55:6789/0 conn(0x7f826c15b660 legacy=0x7f826c0c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826affd700 1 -- 172.21.15.55:0/4247196631 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0ce790 con 0x7f826c157410 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826a7fc700 1 -- 172.21.15.55:0/4247196631 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868446078 0 0) 0x7f826c15b1d0 con 0x7f826c15b660 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826b7fe700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c157040 0x7f826c0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826affd700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c06d5a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f82600098e0 tx=0x7f82600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17009f17f7d2db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826a7fc700 1 -- 172.21.15.55:0/4247196631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260009e80 con 0x7f826c157410 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826a7fc700 1 -- 172.21.15.55:0/4247196631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826000b860 con 0x7f826c157410 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f826a7fc700 1 -- 172.21.15.55:0/4247196631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000bbe0 con 0x7f826c157410 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f8270ecc700 1 -- 172.21.15.55:0/4247196631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 msgr2=0x7f826c06d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.285+0000 7f8270ecc700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c06d5a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f82600098e0 tx=0x7f82600091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.286+0000 7f8270ecc700 1 -- 172.21.15.55:0/4247196631 shutdown_connections 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.286+0000 7f8270ecc700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c157040 0x7f826c0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.286+0000 7f8270ecc700 1 --2- 172.21.15.55:0/4247196631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c06d5a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.286+0000 7f8270ecc700 1 -- 172.21.15.55:0/4247196631 >> 172.21.15.55:0/4247196631 conn(0x7f826c06b500 msgr2=0x7f826c06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:23.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.286+0000 7f8270ecc700 1 -- 172.21.15.55:0/4247196631 shutdown_connections 2023-10-06T11:15:23.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.286+0000 7f8270ecc700 1 -- 172.21.15.55:0/4247196631 wait complete. 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.287+0000 7f8270ecc700 1 Processor -- start 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.287+0000 7f8270ecc700 1 -- start start 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.287+0000 7f8270ecc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c157040 0x7f826c150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c168710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c15b660 0x7f826c0c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1551c0 con 0x7f826c157410 2023-10-06T11:15:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c168c50 con 0x7f826c157040 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0c3610 con 0x7f826c15b660 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c168710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59238/0 (socket says 172.21.15.55:59238) 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 -- 172.21.15.55:0/2606916594 learned_addr learned my addr 172.21.15.55:0/2606916594 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826bfff700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c15b660 0x7f826c0c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826b7fe700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c157040 0x7f826c150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 -- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c15b660 msgr2=0x7f826c0c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c15b660 0x7f826c0c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 -- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c157040 msgr2=0x7f826c150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c157040 0x7f826c150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 -- 172.21.15.55:0/2606916594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260009420 con 0x7f826c157410 2023-10-06T11:15:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f826affd700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c168710 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8260013000 tx=0x7f8260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000bbe0 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8260011420 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82600117c0 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c154ee0 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.288+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c0c32a0 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.289+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c0712a0 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.290+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8260011bb0 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.290+0000 7f82537fe700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.290+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8260086000 con 0x7f826c157410 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.290+0000 7f826b7fe700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.291+0000 7f826b7fe700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8258066f30 0x7f82580693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f825c006fd0 tx=0x7f825c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:23.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.294+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8260052fd0 con 0x7f826c157410 2023-10-06T11:15:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.531+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f826c0c3780 con 0x7f826c157410 2023-10-06T11:15:23.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.531+0000 7f82537fe700 1 -- 172.21.15.55:0/2606916594 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8260011e60 con 0x7f826c157410 2023-10-06T11:15:23.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:23.533 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.489146+0000","modified":"2023-10-06T11:15:15.117701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1949751392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1949751392},{"type":"v1","addr":"172.21.15.142:6837","nonce":1949751392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:15:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8258066f30 msgr2=0x7f82580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8258066f30 0x7f82580693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f825c006fd0 tx=0x7f825c008040 comp rx=0 tx=0).stop 2023-10-06T11:15:23.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 msgr2=0x7f826c168710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c168710 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8260013000 tx=0x7f8260017000 comp rx=0 tx=0).stop 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 shutdown_connections 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826c15b660 0x7f826c0c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f826c157040 0x7f826c150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 --2- 172.21.15.55:0/2606916594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f826c157410 0x7f826c168710 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 >> 172.21.15.55:0/2606916594 conn(0x7f826c06b500 msgr2=0x7f826c0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 shutdown_connections 2023-10-06T11:15:23.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.533+0000 7f8270ecc700 1 -- 172.21.15.55:0/2606916594 wait complete. 2023-10-06T11:15:23.537 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2023-10-06T11:15:23.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.664+0000 7ff1e6a10700 1 Processor -- start 2023-10-06T11:15:23.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.664+0000 7ff1e6a10700 1 -- start start 2023-10-06T11:15:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e6a10700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 0x7ff1e00cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e6a10700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e6a10700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e00c74a0 con 0x7ff1e00688e0 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e6a10700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e015df30 con 0x7ff1e0068cb0 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e6a10700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00cacb0 con 0x7ff1e015dab0 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e620f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e520d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 0x7ff1e00cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e620f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:33444/0 (socket says 172.21.15.55:33444) 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e520d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 0x7ff1e00cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:58630/0 (socket says 172.21.15.55:58630) 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e620f700 1 -- 172.21.15.55:0/1900833027 learned_addr learned my addr 172.21.15.55:0/1900833027 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:23.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.665+0000 7ff1e5a0e700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff1e00688e0 0x7ff1e00c6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:47366/0 (socket says 172.21.15.55:47366) 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e620f700 1 -- 172.21.15.55:0/1900833027 >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 msgr2=0x7ff1e00cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e620f700 1 --2- 172.21.15.55:0/1900833027 >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 0x7ff1e00cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e620f700 1 -- 172.21.15.55:0/1900833027 >> v1:172.21.15.142:6789/0 conn(0x7ff1e00688e0 legacy=0x7ff1e00c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e620f700 1 -- 172.21.15.55:0/1900833027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e015a7b0 con 0x7ff1e015dab0 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e520d700 1 --2- 172.21.15.55:0/1900833027 >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 0x7ff1e00cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e620f700 1 --2- 172.21.15.55:0/1900833027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00cb980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80099b0 tx=0x7ff1d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9957defaca834e64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e4a0c700 1 -- 172.21.15.55:0/1900833027 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8009ea0 con 0x7ff1e015dab0 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e4a0c700 1 -- 172.21.15.55:0/1900833027 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d800b860 con 0x7ff1e015dab0 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.666+0000 7ff1e4a0c700 1 -- 172.21.15.55:0/1900833027 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800bc00 con 0x7ff1e015dab0 2023-10-06T11:15:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1900833027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 msgr2=0x7ff1e00cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1900833027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00cb980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80099b0 tx=0x7ff1d8009250 comp rx=0 tx=0).stop 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1900833027 shutdown_connections 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1900833027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00cb980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1900833027 >> v2:172.21.15.142:3300/0 conn(0x7ff1e0068cb0 0x7ff1e00cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1900833027 >> 172.21.15.55:0/1900833027 conn(0x7ff1e00cd1f0 msgr2=0x7ff1e00c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1900833027 shutdown_connections 2023-10-06T11:15:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.667+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1900833027 wait complete. 2023-10-06T11:15:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.668+0000 7ff1e6a10700 1 Processor -- start 2023-10-06T11:15:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.668+0000 7ff1e6a10700 1 -- start start 2023-10-06T11:15:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 0x7ff1e0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0068cb0 0x7ff1e00afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015fe20 con 0x7ff1e00688e0 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015ef30 con 0x7ff1e0068cb0 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015f210 con 0x7ff1e015dab0 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 0x7ff1e0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 0x7ff1e0158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59246/0 (socket says 172.21.15.55:59246) 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 -- 172.21.15.55:0/1060076852 learned_addr learned my addr 172.21.15.55:0/1060076852 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e620f700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e520d700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0068cb0 0x7ff1e00afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 -- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 msgr2=0x7ff1e00b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 -- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0068cb0 msgr2=0x7ff1e00afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0068cb0 0x7ff1e00afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 -- 172.21.15.55:0/1060076852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4009420 con 0x7ff1e00688e0 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e5a0e700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 0x7ff1e0158d80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000cd80 tx=0x7ff1d0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0005df0 con 0x7ff1e00688e0 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000a8b0 con 0x7ff1e00688e0 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d80094f0 con 0x7ff1e00688e0 2023-10-06T11:15:23.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.669+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000ac70 con 0x7ff1e00688e0 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.670+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e015f7d0 con 0x7ff1e00688e0 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.671+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e005f230 con 0x7ff1e00688e0 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.671+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1d00070f0 con 0x7ff1e00688e0 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.671+0000 7ff1ddffb700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff1cc066f30 0x7ff1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.671+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff1d0084900 con 0x7ff1e00688e0 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.671+0000 7ff1e520d700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff1cc066f30 0x7ff1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:23.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.672+0000 7ff1e520d700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff1cc066f30 0x7ff1cc0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1e016ca90 tx=0x7ff1d40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.676+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d00518d0 con 0x7ff1e00688e0 2023-10-06T11:15:23.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.915+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1e00ca380 con 0x7ff1e00688e0 2023-10-06T11:15:23.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.915+0000 7ff1ddffb700 1 -- 172.21.15.55:0/1060076852 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4602 (secure 0 0 0) 0x7ff1d0054ef0 con 0x7ff1e00688e0 2023-10-06T11:15:23.953 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:23.953 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.489146+0000","modified":"2023-10-06T11:15:15.117701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5835},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5835":{"gid":5835,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/1949751392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1949751392},{"type":"v1","addr":"172.21.15.142:6837","nonce":1949751392}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:15:23.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff1cc066f30 msgr2=0x7ff1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff1cc066f30 0x7ff1cc0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1e016ca90 tx=0x7ff1d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 msgr2=0x7ff1e0158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 0x7ff1e0158d80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000cd80 tx=0x7ff1d0001b90 comp rx=0 tx=0).stop 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 shutdown_connections 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff1cc066f30 0x7ff1cc0693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1e00688e0 0x7ff1e0158d80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e015dab0 0x7ff1e00b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 --2- 172.21.15.55:0/1060076852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0068cb0 0x7ff1e00afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 >> 172.21.15.55:0/1060076852 conn(0x7ff1e00cd1f0 msgr2=0x7ff1e006ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 shutdown_connections 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:23.917+0000 7ff1e6a10700 1 -- 172.21.15.55:0/1060076852 wait complete. 2023-10-06T11:15:23.955 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2023-10-06T11:15:23.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.074+0000 7f0150f84700 1 Processor -- start 2023-10-06T11:15:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.074+0000 7f0150f84700 1 -- start start 2023-10-06T11:15:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f0150f84700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f0150f84700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0cb7a0 con 0x7f014c0b35d0 2023-10-06T11:15:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f0150f84700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0b0860 con 0x7f014c0b2100 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f0150f84700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0cb150 con 0x7f014c159440 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f014affd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f014c0b35d0 0x7f014c0cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35238/0 (socket says 172.21.15.55:35238) 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f014affd700 1 -- 172.21.15.55:0/3707204694 learned_addr learned my addr 172.21.15.55:0/3707204694 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f014b7fe700 1 --2- 172.21.15.55:0/3707204694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f014a7fc700 1 -- 172.21.15.55:0/3707204694 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401801104 0 0) 0x7f014c0cb7a0 con 0x7f014c0b35d0 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.075+0000 7f014a7fc700 1 -- 172.21.15.55:0/3707204694 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0134003570 con 0x7f014c0b35d0 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014a7fc700 1 -- 172.21.15.55:0/3707204694 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818174465 0 0) 0x7f014c0b0860 con 0x7f014c0b2100 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014b7fe700 1 -- 172.21.15.55:0/3707204694 >> v1:172.21.15.142:6789/0 conn(0x7f014c0b2100 legacy=0x7f014c0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014b7fe700 1 -- 172.21.15.55:0/3707204694 >> v1:172.21.15.55:6789/0 conn(0x7f014c0b35d0 legacy=0x7f014c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014b7fe700 1 -- 172.21.15.55:0/3707204694 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0cb430 con 0x7f014c159440 2023-10-06T11:15:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014b7fe700 1 --2- 172.21.15.55:0/3707204694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c0b3090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f013c009910 tx=0x7f013c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5116148dbce7f4d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014a7fc700 1 -- 172.21.15.55:0/3707204694 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400013f0 con 0x7f014c159440 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014a7fc700 1 -- 172.21.15.55:0/3707204694 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c011420 con 0x7f014c159440 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.076+0000 7f014a7fc700 1 -- 172.21.15.55:0/3707204694 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0117c0 con 0x7f014c159440 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 -- 172.21.15.55:0/3707204694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 msgr2=0x7f014c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 --2- 172.21.15.55:0/3707204694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c0b3090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f013c009910 tx=0x7f013c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 -- 172.21.15.55:0/3707204694 shutdown_connections 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 --2- 172.21.15.55:0/3707204694 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c0b3090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 -- 172.21.15.55:0/3707204694 >> 172.21.15.55:0/3707204694 conn(0x7f014c06ece0 msgr2=0x7f014c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 -- 172.21.15.55:0/3707204694 shutdown_connections 2023-10-06T11:15:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.077+0000 7f0150f84700 1 -- 172.21.15.55:0/3707204694 wait complete. 2023-10-06T11:15:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.078+0000 7f0150f84700 1 Processor -- start 2023-10-06T11:15:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.078+0000 7f0150f84700 1 -- start start 2023-10-06T11:15:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014c0b2100 0x7f014c16a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 0x7f014c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c14a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c16a580 con 0x7f014c0b35d0 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15bb10 con 0x7f014c0b2100 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15bdf0 con 0x7f014c159440 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 0x7f014c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 0x7f014c15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59252/0 (socket says 172.21.15.55:59252) 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 -- 172.21.15.55:0/2545940012 learned_addr learned my addr 172.21.15.55:0/2545940012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014b7fe700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014c0b2100 0x7f014c16a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014bfff700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c14a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 -- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 msgr2=0x7f014c14a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c14a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 -- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014c0b2100 msgr2=0x7f014c16a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014c0b2100 0x7f014c16a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 -- 172.21.15.55:0/2545940012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009420 con 0x7f014c0b35d0 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014b7fe700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014c0b2100 0x7f014c16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f014affd700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 0x7f014c15a610 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f014000cb60 tx=0x7f0140001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140007360 con 0x7f014c0b35d0 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01400074e0 con 0x7f014c0b35d0 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140004830 con 0x7f014c0b35d0 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.079+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c159b30 con 0x7f014c0b35d0 2023-10-06T11:15:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.080+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c15a0f0 con 0x7f014c0b35d0 2023-10-06T11:15:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.080+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c15a310 con 0x7f014c0b35d0 2023-10-06T11:15:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.081+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0140004ba0 con 0x7f014c0b35d0 2023-10-06T11:15:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.081+0000 7f01337fe700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0138066f30 0x7f01380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.081+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0140083fe0 con 0x7f014c0b35d0 2023-10-06T11:15:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.082+0000 7f014b7fe700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0138066f30 0x7f01380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.082+0000 7f014b7fe700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0138066f30 0x7f01380693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f014c155ff0 tx=0x7f013c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.085+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f014004c5a0 con 0x7f014c0b35d0 2023-10-06T11:15:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.281+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f014c05f230 con 0x7f014c0b35d0 2023-10-06T11:15:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.282+0000 7f01337fe700 1 -- 172.21.15.55:0/2545940012 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f01400510a0 con 0x7f014c0b35d0 2023-10-06T11:15:24.283 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:24.284 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:13.032147+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.335026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.468577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0138066f30 msgr2=0x7f01380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0138066f30 0x7f01380693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f014c155ff0 tx=0x7f013c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 msgr2=0x7f014c15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 0x7f014c15a610 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f014000cb60 tx=0x7f0140001b30 comp rx=0 tx=0).stop 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 shutdown_connections 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0138066f30 0x7f01380693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014c159440 0x7f014c14a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014c0b2100 0x7f014c16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 --2- 172.21.15.55:0/2545940012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f014c0b35d0 0x7f014c15a610 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 >> 172.21.15.55:0/2545940012 conn(0x7f014c06ece0 msgr2=0x7f014c0aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 shutdown_connections 2023-10-06T11:15:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.284+0000 7f0150f84700 1 -- 172.21.15.55:0/2545940012 wait complete. 2023-10-06T11:15:24.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:15:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.416+0000 7f6b1c900700 1 Processor -- start 2023-10-06T11:15:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.416+0000 7f6b1c900700 1 -- start start 2023-10-06T11:15:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.417+0000 7f6b1c900700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 0x7f6b180cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.417+0000 7f6b1c900700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180ccb80 con 0x7f6b180cc710 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.417+0000 7f6b1c900700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1806c9a0 con 0x7f6b1806c330 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.417+0000 7f6b1c900700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1806c790 con 0x7f6b18156350 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.417+0000 7f6b15d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b180cc710 0x7f6b1806bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33222/0 (socket says 172.21.15.55:33222) 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.417+0000 7f6b15d9b700 1 -- 172.21.15.55:0/560544529 learned_addr learned my addr 172.21.15.55:0/560544529 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1659c700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 0x7f6b180cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374193244 0 0) 0x7f6b180ccb80 con 0x7f6b180cc710 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b04003570 con 0x7f6b180cc710 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283851463 0 0) 0x7f6b04003570 con 0x7f6b180cc710 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 msgr2=0x7f6b180cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 0x7f6b180cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 >> v1:172.21.15.142:6789/0 conn(0x7f6b1806c330 legacy=0x7f6b180c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18156b20 con 0x7f6b180cc710 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f6b00001470 con 0x7f6b180cc710 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 >> v1:172.21.15.55:6789/0 conn(0x7f6b180cc710 legacy=0x7f6b1806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04003a90 0x7f6b04003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b04004810 0x7f6b04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 0x7f6b040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1806c790 con 0x7f6b04004810 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0400bb10 con 0x7f6b04003a90 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0400dee0 con 0x7f6b18156350 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b04004810 0x7f6b04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b1659c700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04003a90 0x7f6b04003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b16d9d700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 0x7f6b040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.418+0000 7f6b15d9b700 1 -- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 msgr2=0x7f6b040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b18156350 0x7f6b040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b15d9b700 1 -- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04003a90 msgr2=0x7f6b04003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04003a90 0x7f6b04003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b15d9b700 1 -- 172.21.15.55:0/560544529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04003570 con 0x7f6b04004810 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b04004810 0x7f6b04004c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c3c0 tx=0x7f6b00001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e14388ccaca4954 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000cc90 con 0x7f6b04004810 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0000cdf0 con 0x7f6b04004810 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1559a700 1 -- 172.21.15.55:0/560544529 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00005b70 con 0x7f6b04004810 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1c900700 1 -- 172.21.15.55:0/560544529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b04004810 msgr2=0x7f6b04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1c900700 1 --2- 172.21.15.55:0/560544529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b04004810 0x7f6b04004c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c3c0 tx=0x7f6b00001e70 comp rx=0 tx=0).stop 2023-10-06T11:15:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b16d9d700 1 -- 172.21.15.55:0/560544529 reap_dead start 2023-10-06T11:15:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1c900700 1 -- 172.21.15.55:0/560544529 shutdown_connections 2023-10-06T11:15:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1c900700 1 -- 172.21.15.55:0/560544529 >> 172.21.15.55:0/560544529 conn(0x7f6b180cdeb0 msgr2=0x7f6b180c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1c900700 1 -- 172.21.15.55:0/560544529 shutdown_connections 2023-10-06T11:15:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.419+0000 7f6b1c900700 1 -- 172.21.15.55:0/560544529 wait complete. 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 Processor -- start 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 -- start start 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04004810 0x7f6b180c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 0x7f6b180b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1814a240 0x7f6b180b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180c5a00 con 0x7f6b18149dd0 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180c62a0 con 0x7f6b04004810 2023-10-06T11:15:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b1c900700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18169a70 con 0x7f6b1814a240 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b15d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 0x7f6b180b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b15d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 0x7f6b180b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54332/0 (socket says 172.21.15.55:54332) 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.421+0000 7f6b15d9b700 1 -- 172.21.15.55:0/3996968800 learned_addr learned my addr 172.21.15.55:0/3996968800 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b1659c700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04004810 0x7f6b180c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b16d9d700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1814a240 0x7f6b180b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b15d9b700 1 -- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1814a240 msgr2=0x7f6b180b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1814a240 0x7f6b180b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b15d9b700 1 -- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04004810 msgr2=0x7f6b180c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04004810 0x7f6b180c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b15d9b700 1 -- 172.21.15.55:0/3996968800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180c5c50 con 0x7f6b18149dd0 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b15d9b700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 0x7f6b180b24a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c9b0 tx=0x7f6b00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000cc90 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000070d0 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b180c5f30 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b000074b0 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.422+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18168f00 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.423+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18064a90 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.424+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b00019030 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.424+0000 7f6b0e7fc700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6af8066f30 0x7f6af80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.424+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6b000859a0 con 0x7f6b18149dd0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.424+0000 7f6b1659c700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6af8066f30 0x7f6af80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.425+0000 7f6b1659c700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6af8066f30 0x7f6af80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b1814af80 tx=0x7f6b100091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.428+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b00052a20 con 0x7f6b18149dd0 2023-10-06T11:15:24.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.665+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6b180c63e0 con 0x7f6b18149dd0 2023-10-06T11:15:24.667 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:15:24.666+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:15:24.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.669+0000 7f6b0e7fc700 1 -- 172.21.15.55:0/3996968800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6b00056040 con 0x7f6b18149dd0 2023-10-06T11:15:24.671 INFO:tasks.ceph.mds.d.smithi142.stderr: -558> 2023-10-06T11:15:16.415+0000 7f746606a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:15:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6af8066f30 msgr2=0x7f6af80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6af8066f30 0x7f6af80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b1814af80 tx=0x7f6b100091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 msgr2=0x7f6b180b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 0x7f6b180b24a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c9b0 tx=0x7f6b00015000 comp rx=0 tx=0).stop 2023-10-06T11:15:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 shutdown_connections 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6af8066f30 0x7f6af80693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1814a240 0x7f6b180b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b04004810 0x7f6b180c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 --2- 172.21.15.55:0/3996968800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b18149dd0 0x7f6b180b24a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 >> 172.21.15.55:0/3996968800 conn(0x7f6b180cdeb0 msgr2=0x7f6b180cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 shutdown_connections 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.671+0000 7f6b1c900700 1 -- 172.21.15.55:0/3996968800 wait complete. 2023-10-06T11:15:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:15:24.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:15:24.694 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:15:24.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.805+0000 7f19ae289700 1 Processor -- start 2023-10-06T11:15:24.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.805+0000 7f19ae289700 1 -- start start 2023-10-06T11:15:24.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19ae289700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f19a813fe50 0x7f19a806e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19ae289700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a80c8000 0x7f19a815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19ae289700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a806e9e0 con 0x7f19a813fa80 2023-10-06T11:15:24.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19ae289700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a815af20 con 0x7f19a813fe50 2023-10-06T11:15:24.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19ae289700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a806ecc0 con 0x7f19a80c8000 2023-10-06T11:15:24.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a7fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f19a813fa80 0x7f19a80c78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33236/0 (socket says 172.21.15.55:33236) 2023-10-06T11:15:24.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a7fff700 1 -- 172.21.15.55:0/2251462794 learned_addr learned my addr 172.21.15.55:0/2251462794 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:24.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a77fe700 1 --2- 172.21.15.55:0/2251462794 >> v2:172.21.15.142:3300/0 conn(0x7f19a813fe50 0x7f19a806e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19ac826700 1 --2- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a80c8000 0x7f19a815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a6ffd700 1 -- 172.21.15.55:0/2251462794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089560394 0 0) 0x7f19a806e9e0 con 0x7f19a813fa80 2023-10-06T11:15:24.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a6ffd700 1 -- 172.21.15.55:0/2251462794 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1994003570 con 0x7f19a813fa80 2023-10-06T11:15:24.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a77fe700 1 -- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a80c8000 msgr2=0x7f19a815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:24.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a6ffd700 1 -- 172.21.15.55:0/2251462794 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3307126834 0 0) 0x7f1994003570 con 0x7f19a813fa80 2023-10-06T11:15:24.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a77fe700 1 --2- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a80c8000 0x7f19a815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a77fe700 1 -- 172.21.15.55:0/2251462794 >> v1:172.21.15.55:6789/0 conn(0x7f19a813fa80 legacy=0x7f19a80c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a77fe700 1 -- 172.21.15.55:0/2251462794 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a806efa0 con 0x7f19a813fe50 2023-10-06T11:15:24.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.806+0000 7f19a77fe700 1 --2- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a813fe50 0x7f19a806e400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19980098e0 tx=0x7f19980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e444d26136fae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19a6ffd700 1 -- 172.21.15.55:0/2251462794 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990001470 con 0x7f19a813fe50 2023-10-06T11:15:24.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19a6ffd700 1 -- 172.21.15.55:0/2251462794 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998011420 con 0x7f19a813fe50 2023-10-06T11:15:24.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19a6ffd700 1 -- 172.21.15.55:0/2251462794 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980117c0 con 0x7f19a813fe50 2023-10-06T11:15:24.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 -- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a813fe50 msgr2=0x7f19a806e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 --2- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a813fe50 0x7f19a806e400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19980098e0 tx=0x7f19980091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 -- 172.21.15.55:0/2251462794 shutdown_connections 2023-10-06T11:15:24.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 --2- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a80c8000 0x7f19a815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 --2- 172.21.15.55:0/2251462794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a813fe50 0x7f19a806e400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 -- 172.21.15.55:0/2251462794 >> 172.21.15.55:0/2251462794 conn(0x7f19a80cc090 msgr2=0x7f19a80cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 -- 172.21.15.55:0/2251462794 shutdown_connections 2023-10-06T11:15:24.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.807+0000 7f19ae289700 1 -- 172.21.15.55:0/2251462794 wait complete. 2023-10-06T11:15:24.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.808+0000 7f19ae289700 1 Processor -- start 2023-10-06T11:15:24.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 -- start start 2023-10-06T11:15:24.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a80c8000 0x7f19a80aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 0x7f19a8169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a813fe50 0x7f19a8158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a813d5c0 con 0x7f19a813fa80 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80acac0 con 0x7f19a80c8000 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19ae289700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80acd60 con 0x7f19a813fe50 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19a77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 0x7f19a8169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19a77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 0x7f19a8169e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54336/0 (socket says 172.21.15.55:54336) 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.809+0000 7f19a77fe700 1 -- 172.21.15.55:0/3299436598 learned_addr learned my addr 172.21.15.55:0/3299436598 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19ac826700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a813fe50 0x7f19a8158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a7fff700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a80c8000 0x7f19a80aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a77fe700 1 -- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a813fe50 msgr2=0x7f19a8158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a77fe700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a813fe50 0x7f19a8158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a77fe700 1 -- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a80c8000 msgr2=0x7f19a80aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a77fe700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a80c8000 0x7f19a80aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a77fe700 1 -- 172.21.15.55:0/3299436598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009420 con 0x7f19a813fa80 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a7fff700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a80c8000 0x7f19a80aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19a77fe700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 0x7f19a8169e10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f19980030c0 tx=0x7f1998016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199801cc90 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199801cdf0 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a80ad040 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199801a6a0 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.810+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a80ad600 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.811+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a80ad7f0 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.811+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f199801aad0 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.812+0000 7f199ffff700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1988066f30 0x7f19880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.812+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1998085ed0 con 0x7f19a813fa80 2023-10-06T11:15:24.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.812+0000 7f19a7fff700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1988066f30 0x7f19880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.813+0000 7f19a7fff700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1988066f30 0x7f19880693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19900011e0 tx=0x7f1990009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:24.816+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1998052e50 con 0x7f19a813fa80 2023-10-06T11:15:25.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.056+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19a8064a90 con 0x7f19a813fa80 2023-10-06T11:15:25.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.677+0000 7f199ffff700 1 -- 172.21.15.55:0/3299436598 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f19980290a0 con 0x7f19a813fa80 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1988066f30 msgr2=0x7f19880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1988066f30 0x7f19880693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19900011e0 tx=0x7f1990009040 comp rx=0 tx=0).stop 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 msgr2=0x7f19a8169e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 0x7f19a8169e10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f19980030c0 tx=0x7f1998016000 comp rx=0 tx=0).stop 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 shutdown_connections 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1988066f30 0x7f19880693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19a813fe50 0x7f19a8158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19a80c8000 0x7f19a80aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 --2- 172.21.15.55:0/3299436598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19a813fa80 0x7f19a8169e10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 >> 172.21.15.55:0/3299436598 conn(0x7f19a80cc090 msgr2=0x7f19a80c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 shutdown_connections 2023-10-06T11:15:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.680+0000 7f19ae289700 1 -- 172.21.15.55:0/3299436598 wait complete. 2023-10-06T11:15:25.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:15:25.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.825+0000 7fe0cede3700 1 Processor -- start 2023-10-06T11:15:25.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cede3700 1 -- start start 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cede3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe0c813fe40 0x7fe0c80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cede3700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0c806bb30 0x7fe0c80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cede3700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c80c7e30 con 0x7fe0c80c9080 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cede3700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c80c8ab0 con 0x7fe0c806bb30 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cede3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c806bfb0 con 0x7fe0c813fe40 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0ccb7f700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe0c80c9080 0x7fe0c813f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33238/0 (socket says 172.21.15.55:33238) 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0ccb7f700 1 -- 172.21.15.55:0/1386803138 learned_addr learned my addr 172.21.15.55:0/1386803138 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.826+0000 7fe0cd380700 1 --2- 172.21.15.55:0/1386803138 >> v2:172.21.15.55:3300/0 conn(0x7fe0c806bb30 0x7fe0c80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0c7fff700 1 --2- 172.21.15.55:0/1386803138 >> v2:172.21.15.142:3300/0 conn(0x7fe0c813fe40 0x7fe0c80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0c77fe700 1 -- 172.21.15.55:0/1386803138 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080050056 0 0) 0x7fe0c80c7e30 con 0x7fe0c80c9080 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0c77fe700 1 -- 172.21.15.55:0/1386803138 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b0003570 con 0x7fe0c80c9080 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0cd380700 1 -- 172.21.15.55:0/1386803138 >> v2:172.21.15.142:3300/0 conn(0x7fe0c813fe40 msgr2=0x7fe0c80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0cd380700 1 --2- 172.21.15.55:0/1386803138 >> v2:172.21.15.142:3300/0 conn(0x7fe0c813fe40 0x7fe0c80c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0cd380700 1 -- 172.21.15.55:0/1386803138 >> v1:172.21.15.55:6789/0 conn(0x7fe0c80c9080 legacy=0x7fe0c813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0cd380700 1 -- 172.21.15.55:0/1386803138 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80c8110 con 0x7fe0c806bb30 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0cd380700 1 --2- 172.21.15.55:0/1386803138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c806bb30 0x7fe0c80c77a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8070320 tx=0x7fe0c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1766576e2290337 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0c77fe700 1 -- 172.21.15.55:0/1386803138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0011630 con 0x7fe0c806bb30 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0c77fe700 1 -- 172.21.15.55:0/1386803138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00117b0 con 0x7fe0c806bb30 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.827+0000 7fe0c77fe700 1 -- 172.21.15.55:0/1386803138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0011b70 con 0x7fe0c806bb30 2023-10-06T11:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 -- 172.21.15.55:0/1386803138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c806bb30 msgr2=0x7fe0c80c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 --2- 172.21.15.55:0/1386803138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c806bb30 0x7fe0c80c77a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8070320 tx=0x7fe0c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 -- 172.21.15.55:0/1386803138 shutdown_connections 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 --2- 172.21.15.55:0/1386803138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c806bb30 0x7fe0c80c77a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 --2- 172.21.15.55:0/1386803138 >> v2:172.21.15.142:3300/0 conn(0x7fe0c813fe40 0x7fe0c80c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 -- 172.21.15.55:0/1386803138 >> 172.21.15.55:0/1386803138 conn(0x7fe0c80cdbc0 msgr2=0x7fe0c80c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 -- 172.21.15.55:0/1386803138 shutdown_connections 2023-10-06T11:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.828+0000 7fe0cede3700 1 -- 172.21.15.55:0/1386803138 wait complete. 2023-10-06T11:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.829+0000 7fe0cede3700 1 Processor -- start 2023-10-06T11:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.829+0000 7fe0cede3700 1 -- start start 2023-10-06T11:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cede3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0c806bb30 0x7fe0c80aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cede3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 0x7fe0c80c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cede3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0c813fe40 0x7fe0c812c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cede3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8157900 con 0x7fe0c80c9080 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cede3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8157be0 con 0x7fe0c813fe40 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cede3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8157ec0 con 0x7fe0c806bb30 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 0x7fe0c80c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 0x7fe0c80c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54362/0 (socket says 172.21.15.55:54362) 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 -- 172.21.15.55:0/3157195779 learned_addr learned my addr 172.21.15.55:0/3157195779 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0cd380700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0c813fe40 0x7fe0c812c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0ccb7f700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0c806bb30 0x7fe0c80aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 -- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0c806bb30 msgr2=0x7fe0c80aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0c806bb30 0x7fe0c80aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 -- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0c813fe40 msgr2=0x7fe0c812c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0c813fe40 0x7fe0c812c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 -- 172.21.15.55:0/3157195779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0009420 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.830+0000 7fe0c7fff700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 0x7fe0c80c6fa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00e900 tx=0x7fe0bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.831+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc013680 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.831+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc0137e0 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.831+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c81581a0 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.831+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc013ba0 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.831+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c8158760 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.831+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c8064a90 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.832+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0bc0123d0 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.832+0000 7fe0c4ff9700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0b4066f30 0x7fe0b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.832+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe0bc084620 con 0x7fe0c80c9080 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.833+0000 7fe0ccb7f700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0b4066f30 0x7fe0b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.833+0000 7fe0ccb7f700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0b4066f30 0x7fe0b40693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8005c50 tx=0x7fe0b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:25.837+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0bc0515a0 con 0x7fe0c80c9080 2023-10-06T11:15:26.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.029+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0c80c83f0 con 0x7fe0c80c9080 2023-10-06T11:15:26.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.684+0000 7fe0c4ff9700 1 -- 172.21.15.55:0/3157195779 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe0bc054bc0 con 0x7fe0c80c9080 2023-10-06T11:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.686+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0b4066f30 msgr2=0x7fe0b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.686+0000 7fe0cede3700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0b4066f30 0x7fe0b40693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8005c50 tx=0x7fe0b8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 msgr2=0x7fe0c80c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 0x7fe0c80c6fa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00e900 tx=0x7fe0bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 shutdown_connections 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0b4066f30 0x7fe0b40693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0c813fe40 0x7fe0c812c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0c806bb30 0x7fe0c80aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 --2- 172.21.15.55:0/3157195779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c80c9080 0x7fe0c80c6fa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 >> 172.21.15.55:0/3157195779 conn(0x7fe0c80cdbc0 msgr2=0x7fe0c80b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 shutdown_connections 2023-10-06T11:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.687+0000 7fe0cede3700 1 -- 172.21.15.55:0/3157195779 wait complete. 2023-10-06T11:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:15:26.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:15:26.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.830+0000 7f35def65700 1 Processor -- start 2023-10-06T11:15:26.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.830+0000 7f35def65700 1 -- start start 2023-10-06T11:15:26.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35def65700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35d806b5c0 0x7f35d80685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:26.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35def65700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d80c89e0 con 0x7f35d806ad30 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35def65700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d80aa6d0 con 0x7f35d806b990 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35def65700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d80c7dd0 con 0x7f35d806b5c0 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35dcd01700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35d806b5c0 0x7f35d80685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35dd502700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35d806ad30 0x7f35d80a9fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33246/0 (socket says 172.21.15.55:33246) 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.831+0000 7f35dd502700 1 -- 172.21.15.55:0/4135802565 learned_addr learned my addr 172.21.15.55:0/4135802565 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35dcd01700 1 -- 172.21.15.55:0/4135802565 >> v1:172.21.15.142:6789/0 conn(0x7f35d806b990 legacy=0x7f35d80a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35dcd01700 1 -- 172.21.15.55:0/4135802565 >> v1:172.21.15.55:6789/0 conn(0x7f35d806ad30 legacy=0x7f35d80a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35d77fe700 1 -- 172.21.15.55:0/4135802565 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322306713 0 0) 0x7f35d80c89e0 con 0x7f35d806ad30 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35dcd01700 1 -- 172.21.15.55:0/4135802565 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80c80b0 con 0x7f35d806b5c0 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35dcd01700 1 --2- 172.21.15.55:0/4135802565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80685c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f35c80098e0 tx=0x7f35c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1d43f61042681 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35d77fe700 1 -- 172.21.15.55:0/4135802565 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8009e80 con 0x7f35d806b5c0 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35d77fe700 1 -- 172.21.15.55:0/4135802565 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c800b860 con 0x7f35d806b5c0 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35d77fe700 1 -- 172.21.15.55:0/4135802565 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800bbe0 con 0x7f35d806b5c0 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35def65700 1 -- 172.21.15.55:0/4135802565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 msgr2=0x7f35d80685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35def65700 1 --2- 172.21.15.55:0/4135802565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80685c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f35c80098e0 tx=0x7f35c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35def65700 1 -- 172.21.15.55:0/4135802565 shutdown_connections 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35def65700 1 --2- 172.21.15.55:0/4135802565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80685c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.832+0000 7f35def65700 1 -- 172.21.15.55:0/4135802565 >> 172.21.15.55:0/4135802565 conn(0x7f35d80c9df0 msgr2=0x7f35d806db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.833+0000 7f35def65700 1 -- 172.21.15.55:0/4135802565 shutdown_connections 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.833+0000 7f35def65700 1 -- 172.21.15.55:0/4135802565 wait complete. 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.834+0000 7f35def65700 1 Processor -- start 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.834+0000 7f35def65700 1 -- start start 2023-10-06T11:15:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.834+0000 7f35def65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ad30 0x7f35d80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.834+0000 7f35def65700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35def65700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806b990 0x7f35d8156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35def65700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80b05f0 con 0x7f35d806b5c0 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35def65700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80c4a90 con 0x7f35d806b990 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35def65700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81574d0 con 0x7f35d806ad30 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54390/0 (socket says 172.21.15.55:54390) 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 -- 172.21.15.55:0/800222408 learned_addr learned my addr 172.21.15.55:0/800222408 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35dd502700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806b990 0x7f35d8156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35dcd01700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ad30 0x7f35d80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 -- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ad30 msgr2=0x7f35d80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ad30 0x7f35d80b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 -- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806b990 msgr2=0x7f35d8156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806b990 0x7f35d8156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 -- 172.21.15.55:0/800222408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8009420 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35dd502700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806b990 0x7f35d8156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d7fff700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80b00b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00c4e0 tx=0x7f35cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011590 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc011710 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d80c4760 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011ad0 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.835+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d80b0ae0 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.836+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d8064a90 con 0x7f35d806b5c0 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.837+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35cc01b3b0 con 0x7f35d806b5c0 2023-10-06T11:15:26.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.837+0000 7f35d4ff9700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35c4066f30 0x7f35c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:26.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.837+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6026+0+0 (secure 0 0 0) 0x7f35cc083b80 con 0x7f35d806b5c0 2023-10-06T11:15:26.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.837+0000 7f35dcd01700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35c4066f30 0x7f35c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:26.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.838+0000 7f35dcd01700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35c4066f30 0x7f35c40693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f35c80093f0 tx=0x7f35c8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:26.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:26.841+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35cc050cb0 con 0x7f35d806b5c0 2023-10-06T11:15:27.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:27.039+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35d804bb40 con 0x7f35d806b5c0 2023-10-06T11:15:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.041+0000 7f35d4ff9700 1 -- 172.21.15.55:0/800222408 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35cc017070 con 0x7f35d806b5c0 2023-10-06T11:15:28.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.044+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35c4066f30 msgr2=0x7f35c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.044+0000 7f35def65700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35c4066f30 0x7f35c40693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f35c80093f0 tx=0x7f35c8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:28.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.044+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 msgr2=0x7f35d80b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.044+0000 7f35def65700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80b00b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00c4e0 tx=0x7f35cc00c8a0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 shutdown_connections 2023-10-06T11:15:28.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f35c4066f30 0x7f35c40693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d806b990 0x7f35d8156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d806ad30 0x7f35d80b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 --2- 172.21.15.55:0/800222408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d806b5c0 0x7f35d80b00b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 >> 172.21.15.55:0/800222408 conn(0x7f35d80c9df0 msgr2=0x7f35d8158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:28.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 shutdown_connections 2023-10-06T11:15:28.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.045+0000 7f35def65700 1 -- 172.21.15.55:0/800222408 wait complete. 2023-10-06T11:15:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:15:28.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:15:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.191+0000 7f5bd5467700 1 Processor -- start 2023-10-06T11:15:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.191+0000 7f5bd5467700 1 -- start start 2023-10-06T11:15:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bd5467700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5bd006ce10 0x7f5bd0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bd5467700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bd006da40 0x7f5bd00b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bd5467700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd015ab50 con 0x7f5bd006d670 2023-10-06T11:15:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bd5467700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd015d650 con 0x7f5bd006ce10 2023-10-06T11:15:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bd5467700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd015a590 con 0x7f5bd006da40 2023-10-06T11:15:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5bd006ce10 0x7f5bd0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5bd006ce10 0x7f5bd0159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54406/0 (socket says 172.21.15.55:54406) 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 -- 172.21.15.55:0/2873387920 learned_addr learned my addr 172.21.15.55:0/2873387920 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bcf7fe700 1 --2- 172.21.15.55:0/2873387920 >> v2:172.21.15.142:3300/0 conn(0x7f5bd006da40 0x7f5bd00b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 -- 172.21.15.55:0/2873387920 >> v2:172.21.15.142:3300/0 conn(0x7f5bd006da40 msgr2=0x7f5bd00b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 --2- 172.21.15.55:0/2873387920 >> v2:172.21.15.142:3300/0 conn(0x7f5bd006da40 0x7f5bd00b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 -- 172.21.15.55:0/2873387920 >> v1:172.21.15.142:6789/0 conn(0x7f5bd006d670 legacy=0x7f5bd015dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 -- 172.21.15.55:0/2873387920 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd015a870 con 0x7f5bd006ce10 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bce7fc700 1 --2- 172.21.15.55:0/2873387920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006ce10 0x7f5bd0159af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80099b0 tx=0x7f5bb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78efe8e9398a944b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bcdffb700 1 -- 172.21.15.55:0/2873387920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800b820 con 0x7f5bd006ce10 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bcdffb700 1 -- 172.21.15.55:0/2873387920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb800b980 con 0x7f5bd006ce10 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.192+0000 7f5bcdffb700 1 -- 172.21.15.55:0/2873387920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800bd20 con 0x7f5bd006ce10 2023-10-06T11:15:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 -- 172.21.15.55:0/2873387920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006ce10 msgr2=0x7f5bd0159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 --2- 172.21.15.55:0/2873387920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006ce10 0x7f5bd0159af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80099b0 tx=0x7f5bb8009250 comp rx=0 tx=0).stop 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 -- 172.21.15.55:0/2873387920 shutdown_connections 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 --2- 172.21.15.55:0/2873387920 >> v2:172.21.15.142:3300/0 conn(0x7f5bd006da40 0x7f5bd00b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 --2- 172.21.15.55:0/2873387920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006ce10 0x7f5bd0159af0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 -- 172.21.15.55:0/2873387920 >> 172.21.15.55:0/2873387920 conn(0x7f5bd006b600 msgr2=0x7f5bd006ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 -- 172.21.15.55:0/2873387920 shutdown_connections 2023-10-06T11:15:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.193+0000 7f5bd5467700 1 -- 172.21.15.55:0/2873387920 wait complete. 2023-10-06T11:15:28.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.194+0000 7f5bd5467700 1 Processor -- start 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.194+0000 7f5bd5467700 1 -- start start 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bd5467700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 0x7f5bd013cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bd5467700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd006da40 0x7f5bd01553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bd5467700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd0155920 0x7f5bd014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bd5467700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0155d80 con 0x7f5bd006d670 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bd5467700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0150850 con 0x7f5bd006da40 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bd5467700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd0150b30 con 0x7f5bd0155920 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 0x7f5bd013cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 0x7f5bd013cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54418/0 (socket says 172.21.15.55:54418) 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 -- 172.21.15.55:0/3803747195 learned_addr learned my addr 172.21.15.55:0/3803747195 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:28.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bce7fc700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd006da40 0x7f5bd01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bcf7fe700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd0155920 0x7f5bd014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 -- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd0155920 msgr2=0x7f5bd014fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd0155920 0x7f5bd014fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 -- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd006da40 msgr2=0x7f5bd01553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd006da40 0x7f5bd01553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.195+0000 7f5bceffd700 1 -- 172.21.15.55:0/3803747195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80094f0 con 0x7f5bd006d670 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.196+0000 7f5bceffd700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 0x7f5bd013cba0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000cdb0 tx=0x7f5bc0001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.196+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000aac0 con 0x7f5bd006d670 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.196+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc000ac20 con 0x7f5bd006d670 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.196+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd0150e10 con 0x7f5bd006d670 2023-10-06T11:15:28.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.196+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0012420 con 0x7f5bd006d670 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.196+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd01513d0 con 0x7f5bd006d670 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.197+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd0064a90 con 0x7f5bd006d670 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.197+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bc0012810 con 0x7f5bd006d670 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.198+0000 7f5bc6ffd700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5bb0066f30 0x7f5bb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.198+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5bc00849b0 con 0x7f5bd006d670 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.198+0000 7f5bce7fc700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5bb0066f30 0x7f5bb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.199+0000 7f5bce7fc700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5bb0066f30 0x7f5bb00693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80099b0 tx=0x7f5bb8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:28.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.202+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bc0051c80 con 0x7f5bd006d670 2023-10-06T11:15:28.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.396+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5bd015ab50 con 0x7f5bd006d670 2023-10-06T11:15:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.399+0000 7f5bc6ffd700 1 -- 172.21.15.55:0/3803747195 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bd015ab50 con 0x7f5bd006d670 2023-10-06T11:15:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5bb0066f30 msgr2=0x7f5bb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5bb0066f30 0x7f5bb00693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80099b0 tx=0x7f5bb8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 msgr2=0x7f5bd013cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 0x7f5bd013cba0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000cdb0 tx=0x7f5bc0001be0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 shutdown_connections 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5bb0066f30 0x7f5bb00693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bd006d670 0x7f5bd013cba0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bd0155920 0x7f5bd014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 --2- 172.21.15.55:0/3803747195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bd006da40 0x7f5bd01553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 >> 172.21.15.55:0/3803747195 conn(0x7f5bd006b600 msgr2=0x7f5bd015b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 shutdown_connections 2023-10-06T11:15:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.401+0000 7f5bd5467700 1 -- 172.21.15.55:0/3803747195 wait complete. 2023-10-06T11:15:28.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2023-10-06T11:15:28.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.532+0000 7f31ba162700 1 Processor -- start 2023-10-06T11:15:28.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.532+0000 7f31ba162700 1 -- start start 2023-10-06T11:15:28.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31ba162700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f31b40cbc30 0x7f31b40cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31ba162700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b40b2100 0x7f31b40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31ba162700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40cb7a0 con 0x7f31b4159440 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31ba162700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b40b0860 con 0x7f31b40cbc30 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31ba162700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40cb150 con 0x7f31b40b2100 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31b9160700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f31b4159440 0x7f31b40b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33262/0 (socket says 172.21.15.55:33262) 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31b9160700 1 -- 172.21.15.55:0/3433497383 learned_addr learned my addr 172.21.15.55:0/3433497383 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31b9961700 1 --2- 172.21.15.55:0/3433497383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b40b2100 0x7f31b40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.533+0000 7f31b895f700 1 --2- 172.21.15.55:0/3433497383 >> v2:172.21.15.142:3300/0 conn(0x7f31b40cbc30 0x7f31b40cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b3fff700 1 -- 172.21.15.55:0/3433497383 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023121766 0 0) 0x7f31b40cb7a0 con 0x7f31b4159440 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b3fff700 1 -- 172.21.15.55:0/3433497383 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f319c003570 con 0x7f31b4159440 2023-10-06T11:15:28.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b9961700 1 -- 172.21.15.55:0/3433497383 >> v2:172.21.15.142:3300/0 conn(0x7f31b40cbc30 msgr2=0x7f31b40cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b9961700 1 --2- 172.21.15.55:0/3433497383 >> v2:172.21.15.142:3300/0 conn(0x7f31b40cbc30 0x7f31b40cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b9961700 1 -- 172.21.15.55:0/3433497383 >> v1:172.21.15.55:6789/0 conn(0x7f31b4159440 legacy=0x7f31b40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b9961700 1 -- 172.21.15.55:0/3433497383 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40cb430 con 0x7f31b40b2100 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b895f700 1 --2- 172.21.15.55:0/3433497383 >> v2:172.21.15.142:3300/0 conn(0x7f31b40cbc30 0x7f31b40cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b9961700 1 --2- 172.21.15.55:0/3433497383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b40b2100 0x7f31b40b2560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009e60 tx=0x7f31a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856775ab81211a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b3fff700 1 -- 172.21.15.55:0/3433497383 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400e070 con 0x7f31b40b2100 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b3fff700 1 -- 172.21.15.55:0/3433497383 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400bab0 con 0x7f31b40b2100 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.534+0000 7f31b3fff700 1 -- 172.21.15.55:0/3433497383 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400be70 con 0x7f31b40b2100 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 -- 172.21.15.55:0/3433497383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b40b2100 msgr2=0x7f31b40b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 --2- 172.21.15.55:0/3433497383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b40b2100 0x7f31b40b2560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009e60 tx=0x7f31a4009780 comp rx=0 tx=0).stop 2023-10-06T11:15:28.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 -- 172.21.15.55:0/3433497383 shutdown_connections 2023-10-06T11:15:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 --2- 172.21.15.55:0/3433497383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b40b2100 0x7f31b40b2560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 --2- 172.21.15.55:0/3433497383 >> v2:172.21.15.142:3300/0 conn(0x7f31b40cbc30 0x7f31b40cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 -- 172.21.15.55:0/3433497383 >> 172.21.15.55:0/3433497383 conn(0x7f31b406ece0 msgr2=0x7f31b406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 -- 172.21.15.55:0/3433497383 shutdown_connections 2023-10-06T11:15:28.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.535+0000 7f31ba162700 1 -- 172.21.15.55:0/3433497383 wait complete. 2023-10-06T11:15:28.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.536+0000 7f31ba162700 1 Processor -- start 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.536+0000 7f31ba162700 1 -- start start 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31ba162700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 0x7f31b40cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31ba162700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b40cbc30 0x7f31b40c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31ba162700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b4159440 0x7f31b4169770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31ba162700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40cf190 con 0x7f31b40b2100 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31ba162700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40ce580 con 0x7f31b40cbc30 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31ba162700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40ce860 con 0x7f31b4159440 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 0x7f31b40cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 0x7f31b40cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54422/0 (socket says 172.21.15.55:54422) 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 -- 172.21.15.55:0/883290412 learned_addr learned my addr 172.21.15.55:0/883290412 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b895f700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b40cbc30 0x7f31b40c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9961700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b4159440 0x7f31b4169770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 -- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b4159440 msgr2=0x7f31b4169770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b4159440 0x7f31b4169770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 -- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b40cbc30 msgr2=0x7f31b40c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b40cbc30 0x7f31b40c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.537+0000 7f31b9160700 1 -- 172.21.15.55:0/883290412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8009420 con 0x7f31b40b2100 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.538+0000 7f31b9160700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 0x7f31b40cdfa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00c590 tx=0x7f31ac007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.538+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac005b30 con 0x7f31b40b2100 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.538+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac005cb0 con 0x7f31b40b2100 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.538+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a4009a20 con 0x7f31b40b2100 2023-10-06T11:15:28.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.538+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac007320 con 0x7f31b40b2100 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.538+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40cee20 con 0x7f31b40b2100 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.539+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b405f230 con 0x7f31b40b2100 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.539+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31ac01b3b0 con 0x7f31b40b2100 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.539+0000 7f31b17fa700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31a0066f30 0x7f31a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.540+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f31ac083a20 con 0x7f31b40b2100 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.540+0000 7f31b895f700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31a0066f30 0x7f31a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.540+0000 7f31b895f700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31a0066f30 0x7f31a00693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f31b40cfdf0 tx=0x7f31a80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.544+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31ac050c50 con 0x7f31b40b2100 2023-10-06T11:15:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:28.818+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) v1 -- 0x7f31b40b2aa0 con 0x7f31b40b2100 2023-10-06T11:15:29.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.042+0000 7f31b17fa700 1 -- 172.21.15.55:0/883290412 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v154) v1 ==== 142+0+0 (secure 0 0 0) 0x7f31ac017020 con 0x7f31b40b2100 2023-10-06T11:15:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31a0066f30 msgr2=0x7f31a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31a0066f30 0x7f31a00693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f31b40cfdf0 tx=0x7f31a80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 msgr2=0x7f31b40cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 0x7f31b40cdfa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00c590 tx=0x7f31ac007e00 comp rx=0 tx=0).stop 2023-10-06T11:15:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 shutdown_connections 2023-10-06T11:15:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f31a0066f30 0x7f31a00693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b40b2100 0x7f31b40cdfa0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b4159440 0x7f31b4169770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 --2- 172.21.15.55:0/883290412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b40cbc30 0x7f31b40c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 >> 172.21.15.55:0/883290412 conn(0x7f31b406ece0 msgr2=0x7f31b40b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 shutdown_connections 2023-10-06T11:15:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.044+0000 7f31ba162700 1 -- 172.21.15.55:0/883290412 wait complete. 2023-10-06T11:15:29.058 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... skipped 'Requires FUSE client to inject client metadata' 2023-10-06T11:15:29.058 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2023-10-06T11:15:29.059 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T11:15:29.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2023-10-06T11:15:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.180+0000 7fc7aa33b700 1 Processor -- start 2023-10-06T11:15:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.180+0000 7fc7aa33b700 1 -- start start 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7aa33b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a40aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7aa33b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a40b49a0 0x7fc7a40aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7aa33b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7a40b0760 0x7fc7a40b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7aa33b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40b0c60 con 0x7fc7a40b0760 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7aa33b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40b0f40 con 0x7fc7a40b49a0 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7aa33b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40b1220 con 0x7fc7a4159560 2023-10-06T11:15:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7a40b0760 0x7fc7a40b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7a40b0760 0x7fc7a40b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54424/0 (socket says 172.21.15.55:54424) 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 -- 172.21.15.55:0/2428250337 learned_addr learned my addr 172.21.15.55:0/2428250337 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a37fe700 1 --2- 172.21.15.55:0/2428250337 >> v2:172.21.15.142:3300/0 conn(0x7fc7a40b49a0 0x7fc7a40aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a3fff700 1 --2- 172.21.15.55:0/2428250337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a40aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 -- 172.21.15.55:0/2428250337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 msgr2=0x7fc7a40aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 --2- 172.21.15.55:0/2428250337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a40aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 -- 172.21.15.55:0/2428250337 >> v2:172.21.15.142:3300/0 conn(0x7fc7a40b49a0 msgr2=0x7fc7a40aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 --2- 172.21.15.55:0/2428250337 >> v2:172.21.15.142:3300/0 conn(0x7fc7a40b49a0 0x7fc7a40aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 -- 172.21.15.55:0/2428250337 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40b1500 con 0x7fc7a40b0760 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a37fe700 1 --2- 172.21.15.55:0/2428250337 >> v2:172.21.15.142:3300/0 conn(0x7fc7a40b49a0 0x7fc7a40aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a88d8700 1 --2- 172.21.15.55:0/2428250337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b0760 0x7fc7a40b3890 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4089020 tx=0x7fc79c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d749595443ed7d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a2ffd700 1 -- 172.21.15.55:0/2428250337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00e070 con 0x7fc7a40b0760 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a2ffd700 1 -- 172.21.15.55:0/2428250337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c00ba50 con 0x7fc7a40b0760 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.181+0000 7fc7a2ffd700 1 -- 172.21.15.55:0/2428250337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0092e0 con 0x7fc7a40b0760 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 -- 172.21.15.55:0/2428250337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b0760 msgr2=0x7fc7a40b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/2428250337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b0760 0x7fc7a40b3890 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4089020 tx=0x7fc79c009840 comp rx=0 tx=0).stop 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 -- 172.21.15.55:0/2428250337 shutdown_connections 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/2428250337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b0760 0x7fc7a40b3890 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/2428250337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a40aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/2428250337 >> v2:172.21.15.142:3300/0 conn(0x7fc7a40b49a0 0x7fc7a40aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 -- 172.21.15.55:0/2428250337 >> 172.21.15.55:0/2428250337 conn(0x7fc7a40997f0 msgr2=0x7fc7a406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 -- 172.21.15.55:0/2428250337 shutdown_connections 2023-10-06T11:15:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.182+0000 7fc7aa33b700 1 -- 172.21.15.55:0/2428250337 wait complete. 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.183+0000 7fc7aa33b700 1 Processor -- start 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.183+0000 7fc7aa33b700 1 -- start start 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7aa33b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a40b0760 0x7fc7a40aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7aa33b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 0x7fc7a415e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7aa33b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7aa33b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a415e370 con 0x7fc7a40b49a0 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7aa33b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a409ae30 con 0x7fc7a40b0760 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7aa33b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a409b110 con 0x7fc7a4159560 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7a37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 0x7fc7a415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7a37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 0x7fc7a415e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54426/0 (socket says 172.21.15.55:54426) 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7a37fe700 1 -- 172.21.15.55:0/4278360915 learned_addr learned my addr 172.21.15.55:0/4278360915 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7a3fff700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a40b0760 0x7fc7a40aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.184+0000 7fc7a88d8700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7a37fe700 1 -- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 msgr2=0x7fc7a415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7a37fe700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a415bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7a37fe700 1 -- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a40b0760 msgr2=0x7fc7a40aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7a37fe700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a40b0760 0x7fc7a40aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7a37fe700 1 -- 172.21.15.55:0/4278360915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c009ae0 con 0x7fc7a40b49a0 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7a37fe700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 0x7fc7a415e800 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc79400c880 tx=0x7fc794008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794011600 con 0x7fc7a40b49a0 2023-10-06T11:15:29.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794011760 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794011ae0 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a415dd20 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.185+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a415ed40 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.186+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a415ef90 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.186+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7940193b0 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.187+0000 7fc78bfff700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.187+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc794084420 con 0x7fc7a40b49a0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.187+0000 7fc7a3fff700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:29.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.187+0000 7fc7a3fff700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc790066f30 0x7fc7900693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc79800ac00 tx=0x7fc798008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:29.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.191+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7940516f0 con 0x7fc7a40b49a0 2023-10-06T11:15:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:29.465+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7fc7a4064a90 con 0x7fc7a40b49a0 2023-10-06T11:15:30.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.045+0000 7fc78bfff700 1 -- 172.21.15.55:0/4278360915 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v155) v1 ==== 146+0+0 (secure 0 0 0) 0x7fc794054d10 con 0x7fc7a40b49a0 2023-10-06T11:15:30.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc790066f30 msgr2=0x7fc7900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc790066f30 0x7fc7900693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc79800ac00 tx=0x7fc798008040 comp rx=0 tx=0).stop 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 msgr2=0x7fc7a415e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 0x7fc7a415e800 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc79400c880 tx=0x7fc794008040 comp rx=0 tx=0).stop 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 shutdown_connections 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a4159560 0x7fc7a415bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a40b0760 0x7fc7a40aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 --2- 172.21.15.55:0/4278360915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7a40b49a0 0x7fc7a415e800 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 >> 172.21.15.55:0/4278360915 conn(0x7fc7a40997f0 msgr2=0x7fc7a4158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:30.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 shutdown_connections 2023-10-06T11:15:30.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.048+0000 7fc7aa33b700 1 -- 172.21.15.55:0/4278360915 wait complete. 2023-10-06T11:15:30.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:15:30.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 Processor -- start 2023-10-06T11:15:30.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 -- start start 2023-10-06T11:15:30.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd401593f0 0x7fcd400cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd4006e350 0x7fcd40068410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd40067f80 con 0x7fcd400c9ca0 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4006eac0 con 0x7fcd401593f0 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.185+0000 7fcd47068700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd400ca110 con 0x7fcd4006e350 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3ffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd400c9ca0 0x7fcd4006dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33268/0 (socket says 172.21.15.55:33268) 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3ffff700 1 -- 172.21.15.55:0/3826752698 learned_addr learned my addr 172.21.15.55:0/3826752698 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd44e04700 1 --2- 172.21.15.55:0/3826752698 >> v2:172.21.15.55:3300/0 conn(0x7fcd401593f0 0x7fcd400cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd45605700 1 --2- 172.21.15.55:0/3826752698 >> v2:172.21.15.142:3300/0 conn(0x7fcd4006e350 0x7fcd40068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3f7fe700 1 -- 172.21.15.55:0/3826752698 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205588118 0 0) 0x7fcd40067f80 con 0x7fcd400c9ca0 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3f7fe700 1 -- 172.21.15.55:0/3826752698 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c003570 con 0x7fcd400c9ca0 2023-10-06T11:15:30.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd44e04700 1 -- 172.21.15.55:0/3826752698 >> v2:172.21.15.142:3300/0 conn(0x7fcd4006e350 msgr2=0x7fcd40068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd44e04700 1 --2- 172.21.15.55:0/3826752698 >> v2:172.21.15.142:3300/0 conn(0x7fcd4006e350 0x7fcd40068410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd44e04700 1 -- 172.21.15.55:0/3826752698 >> v1:172.21.15.55:6789/0 conn(0x7fcd400c9ca0 legacy=0x7fcd4006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd44e04700 1 -- 172.21.15.55:0/3826752698 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40067650 con 0x7fcd401593f0 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd44e04700 1 --2- 172.21.15.55:0/3826752698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd401593f0 0x7fcd400cc390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcd400708f0 tx=0x7fcd280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a660bb93988d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3f7fe700 1 -- 172.21.15.55:0/3826752698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28011630 con 0x7fcd401593f0 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3f7fe700 1 -- 172.21.15.55:0/3826752698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd280117b0 con 0x7fcd401593f0 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.186+0000 7fcd3f7fe700 1 -- 172.21.15.55:0/3826752698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28011b70 con 0x7fcd401593f0 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 -- 172.21.15.55:0/3826752698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd401593f0 msgr2=0x7fcd400cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 --2- 172.21.15.55:0/3826752698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd401593f0 0x7fcd400cc390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcd400708f0 tx=0x7fcd280091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 -- 172.21.15.55:0/3826752698 shutdown_connections 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 --2- 172.21.15.55:0/3826752698 >> v2:172.21.15.142:3300/0 conn(0x7fcd4006e350 0x7fcd40068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 --2- 172.21.15.55:0/3826752698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd401593f0 0x7fcd400cc390 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 -- 172.21.15.55:0/3826752698 >> 172.21.15.55:0/3826752698 conn(0x7fcd400cd3d0 msgr2=0x7fcd400b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:30.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 -- 172.21.15.55:0/3826752698 shutdown_connections 2023-10-06T11:15:30.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.187+0000 7fcd47068700 1 -- 172.21.15.55:0/3826752698 wait complete. 2023-10-06T11:15:30.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.188+0000 7fcd47068700 1 Processor -- start 2023-10-06T11:15:30.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.188+0000 7fcd47068700 1 -- start start 2023-10-06T11:15:30.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd47068700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 0x7fcd400c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd47068700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd400c9ca0 0x7fcd40140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd47068700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd401593f0 0x7fcd401560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd47068700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c8410 con 0x7fcd4006e350 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd47068700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c7800 con 0x7fcd401593f0 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd47068700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c7ae0 con 0x7fcd400c9ca0 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 0x7fcd400c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 0x7fcd400c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54454/0 (socket says 172.21.15.55:54454) 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 -- 172.21.15.55:0/3540662173 learned_addr learned my addr 172.21.15.55:0/3540662173 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd45605700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd401593f0 0x7fcd401560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd3ffff700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd400c9ca0 0x7fcd40140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 -- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd400c9ca0 msgr2=0x7fcd40140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd400c9ca0 0x7fcd40140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 -- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd401593f0 msgr2=0x7fcd401560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd401593f0 0x7fcd401560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 -- 172.21.15.55:0/3540662173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009420 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd45605700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd401593f0 0x7fcd401560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd3ffff700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd400c9ca0 0x7fcd40140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.189+0000 7fcd44e04700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 0x7fcd400c88a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcd28013000 tx=0x7fcd28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.190+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2801f070 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.190+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28000c90 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.190+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd400c7dc0 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.190+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28011b50 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.190+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd40140770 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.190+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd40064a90 con 0x7fcd4006e350 2023-10-06T11:15:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.191+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd28023070 con 0x7fcd4006e350 2023-10-06T11:15:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.191+0000 7fcd3cff9700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd20066f30 0x7fcd200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.191+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fcd28085900 con 0x7fcd4006e350 2023-10-06T11:15:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.192+0000 7fcd3ffff700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd20066f30 0x7fcd200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.192+0000 7fcd3ffff700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd20066f30 0x7fcd200693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcd30005c50 tx=0x7fcd30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.196+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd28052bd0 con 0x7fcd4006e350 2023-10-06T11:15:30.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.390+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcd40067930 con 0x7fcd4006e350 2023-10-06T11:15:30.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.395+0000 7fcd3cff9700 1 -- 172.21.15.55:0/3540662173 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd2802a0c0 con 0x7fcd4006e350 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd20066f30 msgr2=0x7fcd200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd20066f30 0x7fcd200693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcd30005c50 tx=0x7fcd30009040 comp rx=0 tx=0).stop 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 msgr2=0x7fcd400c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 0x7fcd400c88a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcd28013000 tx=0x7fcd28017000 comp rx=0 tx=0).stop 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 shutdown_connections 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcd20066f30 0x7fcd200693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4006e350 0x7fcd400c88a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd401593f0 0x7fcd401560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 --2- 172.21.15.55:0/3540662173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd400c9ca0 0x7fcd40140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 >> 172.21.15.55:0/3540662173 conn(0x7fcd400cd3d0 msgr2=0x7fcd400c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:30.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 shutdown_connections 2023-10-06T11:15:30.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.397+0000 7fcd47068700 1 -- 172.21.15.55:0/3540662173 wait complete. 2023-10-06T11:15:30.411 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:15:30.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:30.450 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:30.492 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:15:30.492 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:15:30.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.610+0000 7fa688c20700 1 Processor -- start 2023-10-06T11:15:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.610+0000 7fa688c20700 1 -- start start 2023-10-06T11:15:30.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa688c20700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6840b25e0 0x7fa6840b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa688c20700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa684159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa688c20700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6840cbfa0 con 0x7fa684159660 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa688c20700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840cb390 con 0x7fa6840b25e0 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa688c20700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840cb670 con 0x7fa6840b29b0 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa68259c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6840b25e0 0x7fa6840b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa682d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa684159660 0x7fa684068540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33278/0 (socket says 172.21.15.55:33278) 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.611+0000 7fa682d9d700 1 -- 172.21.15.55:0/3939426249 learned_addr learned my addr 172.21.15.55:0/3939426249 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68259c700 1 -- 172.21.15.55:0/3939426249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 msgr2=0x7fa684159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa681d9b700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa684159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68159a700 1 -- 172.21.15.55:0/3939426249 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878641562 0 0) 0x7fa6840cbfa0 con 0x7fa684159660 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68259c700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa684159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68259c700 1 -- 172.21.15.55:0/3939426249 >> v1:172.21.15.55:6789/0 conn(0x7fa684159660 legacy=0x7fa684068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68259c700 1 -- 172.21.15.55:0/3939426249 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840cb950 con 0x7fa6840b25e0 2023-10-06T11:15:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa681d9b700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa684159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68259c700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa6840b0690 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009eb0 tx=0x7fa67c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ddaedb6a9040ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68159a700 1 -- 172.21.15.55:0/3939426249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00e070 con 0x7fa6840b25e0 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68159a700 1 -- 172.21.15.55:0/3939426249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c00bc30 con 0x7fa6840b25e0 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.612+0000 7fa68159a700 1 -- 172.21.15.55:0/3939426249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c012430 con 0x7fa6840b25e0 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 -- 172.21.15.55:0/3939426249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 msgr2=0x7fa6840b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa6840b0690 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009eb0 tx=0x7fa67c009780 comp rx=0 tx=0).stop 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 -- 172.21.15.55:0/3939426249 shutdown_connections 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa6840b0690 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 --2- 172.21.15.55:0/3939426249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa684159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 -- 172.21.15.55:0/3939426249 >> 172.21.15.55:0/3939426249 conn(0x7fa68406ece0 msgr2=0x7fa68406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 -- 172.21.15.55:0/3939426249 shutdown_connections 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.613+0000 7fa688c20700 1 -- 172.21.15.55:0/3939426249 wait complete. 2023-10-06T11:15:30.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.614+0000 7fa688c20700 1 Processor -- start 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.614+0000 7fa688c20700 1 -- start start 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa68416ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa6840b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa684159660 0x7fa6840b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841560f0 con 0x7fa6840b25e0 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68416d380 con 0x7fa684159660 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68416b0a0 con 0x7fa6840b29b0 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa68416ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa68416ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54474/0 (socket says 172.21.15.55:54474) 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 -- 172.21.15.55:0/1777166520 learned_addr learned my addr 172.21.15.55:0/1777166520 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:30.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa681d9b700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa6840b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa682d9d700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa684159660 0x7fa6840b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 -- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 msgr2=0x7fa6840b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa6840b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 -- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa684159660 msgr2=0x7fa6840b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa684159660 0x7fa6840b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 -- 172.21.15.55:0/1777166520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c009a20 con 0x7fa6840b25e0 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa681d9b700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa6840b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa682d9d700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa684159660 0x7fa6840b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa68259c700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa68416ce40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa67c013000 tx=0x7fa67c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c027470 con 0x7fa6840b25e0 2023-10-06T11:15:30.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c0275f0 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6841557c0 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.615+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0279b0 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.616+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684155d80 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.616+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa684064a90 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.617+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa67c024070 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.617+0000 7fa67a7fc700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa664066f30 0x7fa6640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.617+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa67c087000 con 0x7fa6840b25e0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.618+0000 7fa681d9b700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa664066f30 0x7fa6640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:30.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.618+0000 7fa681d9b700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa664066f30 0x7fa6640693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa6840b6560 tx=0x7fa66c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:30.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.622+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa67c0542d0 con 0x7fa6840b25e0 2023-10-06T11:15:30.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.860+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6840cbc30 con 0x7fa6840b25e0 2023-10-06T11:15:30.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.861+0000 7fa67a7fc700 1 -- 172.21.15.55:0/1777166520 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fa67c02cde0 con 0x7fa6840b25e0 2023-10-06T11:15:30.863 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:30.863 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1975656278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1975656278},{"type":"v1","addr":"172.21.15.55:6835","nonce":1975656278}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/2032482007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2032482007},{"type":"v1","addr":"172.21.15.142:6836","nonce":2032482007}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/4173708338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":4173708338},{"type":"v1","addr":"172.21.15.142:6837","nonce":4173708338}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5823,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/901785183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":901785183},{"type":"v1","addr":"172.21.15.55:6834","nonce":901785183}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[]} 2023-10-06T11:15:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.862+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa664066f30 msgr2=0x7fa6640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.862+0000 7fa688c20700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa664066f30 0x7fa6640693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa6840b6560 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 msgr2=0x7fa68416ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa68416ce40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa67c013000 tx=0x7fa67c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 shutdown_connections 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa664066f30 0x7fa6640693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6840b25e0 0x7fa68416ce40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa684159660 0x7fa6840b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 --2- 172.21.15.55:0/1777166520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6840b29b0 0x7fa6840b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 >> 172.21.15.55:0/1777166520 conn(0x7fa68406ece0 msgr2=0x7fa684153690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 shutdown_connections 2023-10-06T11:15:30.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:30.863+0000 7fa688c20700 1 -- 172.21.15.55:0/1777166520 wait complete. 2023-10-06T11:15:30.866 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 37 2023-10-06T11:15:30.876 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:15:30.877 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:15:30.877 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:15:30.877 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:30.877 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:15:30.877 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:15:30.877 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:15:30.878 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:30.878 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:15:30.878 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:15:30.878 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:15:30.878 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:30.878 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:15:30.879 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:15:30.879 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:15:30.879 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:30.886 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:15:30.886 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:15:30.887 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:15:30.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:15:30.889 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:15:30.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:15:30.890 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:15:30.891 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:15:30.929 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:15:30.929 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:30.930 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:15:30.930 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:30.932 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:15:30.932 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:30.932 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:15:30.933 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:30.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:15:31.005 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:15:31.006 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:15:31.011 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:15:31.011 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:15:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.064+0000 7f262dd5e700 1 Processor -- start 2023-10-06T11:15:31.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.064+0000 7f262dd5e700 1 -- start start 2023-10-06T11:15:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f262dd5e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26280b25e0 0x7f26280b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:31.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f262dd5e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f262dd5e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280cbfa0 con 0x7f26280b29b0 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f262dd5e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280cb390 con 0x7f26280b25e0 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f262dd5e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280cb670 con 0x7f2628159830 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26280b25e0 0x7f26280b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26280b25e0 0x7f26280b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54494/0 (socket says 172.21.15.55:54494) 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 -- 172.21.15.55:0/1937724824 learned_addr learned my addr 172.21.15.55:0/1937724824 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f2627fff700 1 --2- 172.21.15.55:0/1937724824 >> v2:172.21.15.142:3300/0 conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 -- 172.21.15.55:0/1937724824 >> v2:172.21.15.142:3300/0 conn(0x7f2628159830 msgr2=0x7f26280cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 --2- 172.21.15.55:0/1937724824 >> v2:172.21.15.142:3300/0 conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 -- 172.21.15.55:0/1937724824 >> v1:172.21.15.142:6789/0 conn(0x7f26280b29b0 legacy=0x7f2628159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:31.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.065+0000 7f26277fe700 1 -- 172.21.15.55:0/1937724824 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280cb950 con 0x7f26280b25e0 2023-10-06T11:15:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.066+0000 7f26277fe700 1 --2- 172.21.15.55:0/1937724824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26280b25e0 0x7f26280b0690 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f262815d190 tx=0x7f2618009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4b9d3b8b54b893 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.066+0000 7f26267fc700 1 -- 172.21.15.55:0/1937724824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618005c10 con 0x7f26280b25e0 2023-10-06T11:15:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.066+0000 7f26267fc700 1 -- 172.21.15.55:0/1937724824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618005d70 con 0x7f26280b25e0 2023-10-06T11:15:31.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.066+0000 7f26267fc700 1 -- 172.21.15.55:0/1937724824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618006260 con 0x7f26280b25e0 2023-10-06T11:15:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.066+0000 7f262dd5e700 1 -- 172.21.15.55:0/1937724824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26280b25e0 msgr2=0x7f26280b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.066+0000 7f262dd5e700 1 --2- 172.21.15.55:0/1937724824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26280b25e0 0x7f26280b0690 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f262815d190 tx=0x7f2618009220 comp rx=0 tx=0).stop 2023-10-06T11:15:31.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.067+0000 7f262dd5e700 1 -- 172.21.15.55:0/1937724824 shutdown_connections 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.067+0000 7f262dd5e700 1 --2- 172.21.15.55:0/1937724824 >> v2:172.21.15.142:3300/0 conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.067+0000 7f262dd5e700 1 --2- 172.21.15.55:0/1937724824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26280b25e0 0x7f26280b0690 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.067+0000 7f262dd5e700 1 -- 172.21.15.55:0/1937724824 >> 172.21.15.55:0/1937724824 conn(0x7f262806ece0 msgr2=0x7f262806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.067+0000 7f262dd5e700 1 -- 172.21.15.55:0/1937724824 shutdown_connections 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.067+0000 7f262dd5e700 1 -- 172.21.15.55:0/1937724824 wait complete. 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.068+0000 7f262dd5e700 1 Processor -- start 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.068+0000 7f262dd5e700 1 -- start start 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f262dd5e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26280b25e0 0x7f26281517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:31.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f262dd5e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26280b29b0 0x7f26280c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f262dd5e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f262dd5e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b4240 con 0x7f2628159830 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f262dd5e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b4520 con 0x7f26280b29b0 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f262dd5e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c5b90 con 0x7f26280b25e0 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54498/0 (socket says 172.21.15.55:54498) 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 -- 172.21.15.55:0/875702670 learned_addr learned my addr 172.21.15.55:0/875702670 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2626ffd700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26280b29b0 0x7f26280c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f26277fe700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26280b25e0 0x7f26281517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 -- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26280b25e0 msgr2=0x7f26281517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26280b25e0 0x7f26281517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:31.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 -- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26280b29b0 msgr2=0x7f26280c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26280b29b0 0x7f26280c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 -- 172.21.15.55:0/875702670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618009480 con 0x7f2628159830 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f2627fff700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 0x7f26280cc430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2620009df0 tx=0x7f262000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.069+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000caa0 con 0x7f2628159830 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.070+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000f040 con 0x7f2628159830 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280c5e70 con 0x7f2628159830 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.070+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000ce70 con 0x7f2628159830 2023-10-06T11:15:31.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2628152220 con 0x7f2628159830 2023-10-06T11:15:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.071+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280b4690 con 0x7f2628159830 2023-10-06T11:15:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.071+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2620014690 con 0x7f2628159830 2023-10-06T11:15:31.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.071+0000 7f260f7fe700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:31.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.072+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2620085090 con 0x7f2628159830 2023-10-06T11:15:31.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.072+0000 7f26277fe700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:31.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.072+0000 7f26277fe700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2614066f30 0x7f26140693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f26280ca8f0 tx=0x7f2618016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:31.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.076+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2620055d50 con 0x7f2628159830 2023-10-06T11:15:31.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:31.282+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2628064a90 con 0x7f2628159830 2023-10-06T11:15:32.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.067+0000 7f260f7fe700 1 -- 172.21.15.55:0/875702670 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f26200558e0 con 0x7f2628159830 2023-10-06T11:15:32.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2614066f30 msgr2=0x7f26140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2614066f30 0x7f26140693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f26280ca8f0 tx=0x7f2618016000 comp rx=0 tx=0).stop 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 msgr2=0x7f26280cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 0x7f26280cc430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2620009df0 tx=0x7f262000b040 comp rx=0 tx=0).stop 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 shutdown_connections 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2628159830 0x7f26280cc430 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26280b25e0 0x7f26281517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 --2- 172.21.15.55:0/875702670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26280b29b0 0x7f26280c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 >> 172.21.15.55:0/875702670 conn(0x7f262806ece0 msgr2=0x7f262815ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 shutdown_connections 2023-10-06T11:15:32.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.070+0000 7f262dd5e700 1 -- 172.21.15.55:0/875702670 wait complete. 2023-10-06T11:15:32.073 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-10-06T11:15:32.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:15:32.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.207+0000 7fd8db59e700 1 Processor -- start 2023-10-06T11:15:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.207+0000 7fd8db59e700 1 -- start start 2023-10-06T11:15:32.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8db59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8dc0af5c0 0x7fd8dc06af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8db59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 0x7fd8dc0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8db59e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc06aaa0 con 0x7fd8dc159490 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8db59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0aa290 con 0x7fd8dc0af5c0 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8db59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0aa570 con 0x7fd8dc06b470 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8da59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8dc159490 0x7fd8dc0a9ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33282/0 (socket says 172.21.15.55:33282) 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8da59c700 1 -- 172.21.15.55:0/307806941 learned_addr learned my addr 172.21.15.55:0/307806941 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8dad9d700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 0x7fd8dc0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8d9d9b700 1 --2- 172.21.15.55:0/307806941 >> v2:172.21.15.142:3300/0 conn(0x7fd8dc0af5c0 0x7fd8dc06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362947838 0 0) 0x7fd8dc06aaa0 con 0x7fd8dc159490 2023-10-06T11:15:32.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.208+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c8003570 con 0x7fd8dc159490 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970420602 0 0) 0x7fd8c8003570 con 0x7fd8dc159490 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 msgr2=0x7fd8dc0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 0x7fd8dc0675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 >> v2:172.21.15.142:3300/0 conn(0x7fd8dc0af5c0 msgr2=0x7fd8dc06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 --2- 172.21.15.55:0/307806941 >> v2:172.21.15.142:3300/0 conn(0x7fd8dc0af5c0 0x7fd8dc06af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc06a450 con 0x7fd8dc159490 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fd8cc0017f0 con 0x7fd8dc159490 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d9d9b700 1 --2- 172.21.15.55:0/307806941 >> v2:172.21.15.142:3300/0 conn(0x7fd8dc0af5c0 0x7fd8dc06af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 >> v1:172.21.15.55:6789/0 conn(0x7fd8dc159490 legacy=0x7fd8dc0a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c8003a60 0x7fd8c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 0x7fd8c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c8004d50 0x7fd8c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0aa290 con 0x7fd8c8003a60 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0aa570 con 0x7fd8c8004d50 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c800ba60 con 0x7fd8dc06b470 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c8003a60 0x7fd8c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d9d9b700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 0x7fd8c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8dad9d700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c8004d50 0x7fd8c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 -- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 msgr2=0x7fd8c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8dc06b470 0x7fd8c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 -- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c8004d50 msgr2=0x7fd8c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c8004d50 0x7fd8c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 -- 172.21.15.55:0/307806941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8003570 con 0x7fd8c8003a60 2023-10-06T11:15:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8dad9d700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c8004d50 0x7fd8c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8da59c700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c8003a60 0x7fd8c8003e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00a970 tx=0x7fd8cc002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63d9b76945f4b77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0070d0 con 0x7fd8c8003a60 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc007270 con 0x7fd8c8003a60 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.209+0000 7fd8d959a700 1 -- 172.21.15.55:0/307806941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc007630 con 0x7fd8c8003a60 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8db59e700 1 -- 172.21.15.55:0/307806941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c8003a60 msgr2=0x7fd8c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8db59e700 1 --2- 172.21.15.55:0/307806941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c8003a60 0x7fd8c8003e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00a970 tx=0x7fd8cc002210 comp rx=0 tx=0).stop 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8dad9d700 1 -- 172.21.15.55:0/307806941 reap_dead start 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8db59e700 1 -- 172.21.15.55:0/307806941 shutdown_connections 2023-10-06T11:15:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8db59e700 1 -- 172.21.15.55:0/307806941 >> 172.21.15.55:0/307806941 conn(0x7fd8dc069190 msgr2=0x7fd8dc0aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8db59e700 1 -- 172.21.15.55:0/307806941 shutdown_connections 2023-10-06T11:15:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.210+0000 7fd8db59e700 1 -- 172.21.15.55:0/307806941 wait complete. 2023-10-06T11:15:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.211+0000 7fd8db59e700 1 Processor -- start 2023-10-06T11:15:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.211+0000 7fd8db59e700 1 -- start start 2023-10-06T11:15:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8db59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8003a60 0x7fd8dc169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8db59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8dc1525b0 0x7fd8dc14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8db59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 0x7fd8dc0acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8db59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc150470 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8db59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0ad4d0 con 0x7fd8dc1525b0 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8db59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc16abd0 con 0x7fd8c8003a60 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 0x7fd8dc0acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 0x7fd8dc0acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54514/0 (socket says 172.21.15.55:54514) 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 -- 172.21.15.55:0/2731855540 learned_addr learned my addr 172.21.15.55:0/2731855540 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8da59c700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8003a60 0x7fd8dc169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8d9d9b700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8dc1525b0 0x7fd8dc14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 -- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8003a60 msgr2=0x7fd8dc169910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8003a60 0x7fd8dc169910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 -- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8dc1525b0 msgr2=0x7fd8dc14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8dc1525b0 0x7fd8dc14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.212+0000 7fd8dad9d700 1 -- 172.21.15.55:0/2731855540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc14b380 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.213+0000 7fd8dad9d700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 0x7fd8dc0acf90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0afbc0 tx=0x7fd8d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.213+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4015740 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.213+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40158a0 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.213+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4015c60 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.213+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc169f60 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.213+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc16a520 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.214+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc05f230 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.214+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8d4020460 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.214+0000 7fd8d27fc700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8bc066f30 0x7fd8bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.215+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd8d40846f0 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.215+0000 7fd8da59c700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8bc066f30 0x7fd8bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.215+0000 7fd8da59c700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8bc066f30 0x7fd8bc0693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00a970 tx=0x7fd8cc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.219+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8d4055400 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.488+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd8dc06a730 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.488+0000 7fd8d27fc700 1 -- 172.21.15.55:0/2731855540 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd8d4054f90 con 0x7fd8dc0acaf0 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ==", 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.490 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg==", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:32.491 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q==", 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.492 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag==", 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.493 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-10-06T11:15:32.494 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw==", 2023-10-06T11:15:32.494 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.494 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.494 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw==", 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.495 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA==", 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.496 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA==", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ==", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug==", 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw==", 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg==", 2023-10-06T11:15:32.499 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w==", 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-10-06T11:15:32.500 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg==", 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.501 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ==", 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-10-06T11:15:32.502 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA==", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9loAeQDxAAHRWvLBSoBR/HeRdtrvbGCw==", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:32.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA==", 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.504 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g==", 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:15:32.505 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8bc066f30 msgr2=0x7fd8bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8bc066f30 0x7fd8bc0693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00a970 tx=0x7fd8cc015000 comp rx=0 tx=0).stop 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 msgr2=0x7fd8dc0acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 0x7fd8dc0acf90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0afbc0 tx=0x7fd8d4008040 comp rx=0 tx=0).stop 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 shutdown_connections 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd8bc066f30 0x7fd8bc0693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8dc0acaf0 0x7fd8dc0acf90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8c8003a60 0x7fd8dc169910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 --2- 172.21.15.55:0/2731855540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8dc1525b0 0x7fd8dc14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 >> 172.21.15.55:0/2731855540 conn(0x7fd8dc069190 msgr2=0x7fd8dc154900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:32.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 shutdown_connections 2023-10-06T11:15:32.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.490+0000 7fd8db59e700 1 -- 172.21.15.55:0/2731855540 wait complete. 2023-10-06T11:15:32.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:32.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.626+0000 7f990d972700 1 Processor -- start 2023-10-06T11:15:32.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f990d972700 1 -- start start 2023-10-06T11:15:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f990d972700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99080b0760 0x7f99080ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f990d972700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99080b0c60 con 0x7f99080b49a0 2023-10-06T11:15:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f990d972700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99080b0f40 con 0x7f9908159560 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f990d972700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99080ab350 con 0x7f99080b0760 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f99067fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99080b49a0 0x7f99080aac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33284/0 (socket says 172.21.15.55:33284) 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.627+0000 7f99067fc700 1 -- 172.21.15.55:0/1145852086 learned_addr learned my addr 172.21.15.55:0/1145852086 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f99077fe700 1 --2- 172.21.15.55:0/1145852086 >> v2:172.21.15.142:3300/0 conn(0x7f99080b0760 0x7f99080ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141065845 0 0) 0x7f99080b0c60 con 0x7f99080b49a0 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f4003570 con 0x7f99080b49a0 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076233026 0 0) 0x7f98f4003570 con 0x7f99080b49a0 2023-10-06T11:15:32.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 >> v2:172.21.15.142:3300/0 conn(0x7f99080b0760 msgr2=0x7f99080ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 --2- 172.21.15.55:0/1145852086 >> v2:172.21.15.142:3300/0 conn(0x7f99080b0760 0x7f99080ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 >> v1:172.21.15.142:6789/0 conn(0x7f9908159560 legacy=0x7f99080aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99080b1220 con 0x7f99080b49a0 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f98f0001470 con 0x7f99080b49a0 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 >> v1:172.21.15.55:6789/0 conn(0x7f99080b49a0 legacy=0x7f99080aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f4003a60 0x7f98f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4004810 0x7f98f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f40051c0 0x7f98f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99080ab350 con 0x7f98f4003a60 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f400c0d0 con 0x7f98f40051c0 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f400c290 con 0x7f98f4004810 2023-10-06T11:15:32.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9906ffd700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f4003a60 0x7f98f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f99077fe700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f40051c0 0x7f98f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f99067fc700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4004810 0x7f98f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9906ffd700 1 -- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4004810 msgr2=0x7f98f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9906ffd700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4004810 0x7f98f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9906ffd700 1 -- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f40051c0 msgr2=0x7f98f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9906ffd700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f40051c0 0x7f98f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f9906ffd700 1 -- 172.21.15.55:0/1145852086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f4003570 con 0x7f98f4003a60 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.628+0000 7f99077fe700 1 -- 172.21.15.55:0/1145852086 reap_dead start 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f9906ffd700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f4003a60 0x7f98f4003e70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f990000c2d0 tx=0x7f9900001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21232c0d93b649b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900001d80 con 0x7f98f4003a60 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990000cba0 con 0x7f98f4003a60 2023-10-06T11:15:32.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f9905ffb700 1 -- 172.21.15.55:0/1145852086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900012400 con 0x7f98f4003a60 2023-10-06T11:15:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 -- 172.21.15.55:0/1145852086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f4003a60 msgr2=0x7f98f4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f4003a60 0x7f98f4003e70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f990000c2d0 tx=0x7f9900001a70 comp rx=0 tx=0).stop 2023-10-06T11:15:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 -- 172.21.15.55:0/1145852086 shutdown_connections 2023-10-06T11:15:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 --2- 172.21.15.55:0/1145852086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f4003a60 0x7f98f4003e70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 -- 172.21.15.55:0/1145852086 >> 172.21.15.55:0/1145852086 conn(0x7f99080997f0 msgr2=0x7f990806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:32.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 -- 172.21.15.55:0/1145852086 shutdown_connections 2023-10-06T11:15:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.629+0000 7f990d972700 1 -- 172.21.15.55:0/1145852086 wait complete. 2023-10-06T11:15:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 Processor -- start 2023-10-06T11:15:32.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 -- start start 2023-10-06T11:15:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4003a60 0x7f99080aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 0x7f990815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99080ae2f0 0x7f990815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99080af250 con 0x7f99080ade80 2023-10-06T11:15:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990816a300 con 0x7f99080ae2f0 2023-10-06T11:15:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f990d972700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990816a5e0 con 0x7f98f4003a60 2023-10-06T11:15:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f99067fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 0x7f990815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f99067fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 0x7f990815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54542/0 (socket says 172.21.15.55:54542) 2023-10-06T11:15:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.631+0000 7f99067fc700 1 -- 172.21.15.55:0/2782711651 learned_addr learned my addr 172.21.15.55:0/2782711651 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f9906ffd700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4003a60 0x7f99080aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99077fe700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99080ae2f0 0x7f990815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99067fc700 1 -- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4003a60 msgr2=0x7f99080aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99067fc700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4003a60 0x7f99080aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99067fc700 1 -- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99080ae2f0 msgr2=0x7f990815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99067fc700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99080ae2f0 0x7f990815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99067fc700 1 -- 172.21.15.55:0/2782711651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990816a8c0 con 0x7f99080ade80 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f99067fc700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 0x7f990815b940 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f98f000ebc0 tx=0x7f98f0000c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0005e70 con 0x7f99080ade80 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f000c5d0 con 0x7f99080ade80 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000c990 con 0x7f99080ade80 2023-10-06T11:15:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990816aba0 con 0x7f99080ade80 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.632+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990816a070 con 0x7f99080ade80 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.633+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9908064a90 con 0x7f99080ade80 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.634+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98f000cd00 con 0x7f99080ade80 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.634+0000 7f98feffd700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f98e8066f30 0x7f98e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.634+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f98f0084290 con 0x7f99080ade80 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.634+0000 7f9906ffd700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f98e8066f30 0x7f98e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.635+0000 7f9906ffd700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f98e8066f30 0x7f98e80693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99080ab130 tx=0x7f9900016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.638+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98f00515b0 con 0x7f99080ade80 2023-10-06T11:15:32.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.832+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99080b1500 con 0x7f99080ade80 2023-10-06T11:15:32.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.833+0000 7f98feffd700 1 -- 172.21.15.55:0/2782711651 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f98f0054bd0 con 0x7f99080ade80 2023-10-06T11:15:32.834 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:32.835 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:32.064913+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f98e8066f30 msgr2=0x7f98e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f98e8066f30 0x7f98e80693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99080ab130 tx=0x7f9900016000 comp rx=0 tx=0).stop 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 msgr2=0x7f990815b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 0x7f990815b940 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f98f000ebc0 tx=0x7f98f0000c50 comp rx=0 tx=0).stop 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 shutdown_connections 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f98e8066f30 0x7f98e80693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99080ae2f0 0x7f990815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f4003a60 0x7f99080aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 --2- 172.21.15.55:0/2782711651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99080ade80 0x7f990815b940 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 >> 172.21.15.55:0/2782711651 conn(0x7f99080997f0 msgr2=0x7f99080ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:32.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 shutdown_connections 2023-10-06T11:15:32.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.835+0000 7f990d972700 1 -- 172.21.15.55:0/2782711651 wait complete. 2023-10-06T11:15:32.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:15:32.850 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:15:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.970+0000 7f57b43e9700 1 Processor -- start 2023-10-06T11:15:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.970+0000 7f57b43e9700 1 -- start start 2023-10-06T11:15:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b43e9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57ac1598a0 0x7f57ac0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b43e9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0cf5d0 con 0x7f57ac0cbc70 2023-10-06T11:15:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b43e9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0cf8b0 con 0x7f57ac1594d0 2023-10-06T11:15:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b43e9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0cfb90 con 0x7f57ac1598a0 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b1984700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57ac1598a0 0x7f57ac0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b2986700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57ac0cbc70 0x7f57ac0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33290/0 (socket says 172.21.15.55:33290) 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b1984700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57ac1598a0 0x7f57ac0ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54548/0 (socket says 172.21.15.55:54548) 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.971+0000 7f57b2986700 1 -- 172.21.15.55:0/2957158047 learned_addr learned my addr 172.21.15.55:0/2957158047 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1984700 1 -- 172.21.15.55:0/2957158047 >> v1:172.21.15.142:6789/0 conn(0x7f57ac1594d0 legacy=0x7f57ac0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1984700 1 -- 172.21.15.55:0/2957158047 >> v1:172.21.15.55:6789/0 conn(0x7f57ac0cbc70 legacy=0x7f57ac0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1183700 1 -- 172.21.15.55:0/2957158047 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937407983 0 0) 0x7f57ac0cf5d0 con 0x7f57ac0cbc70 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1984700 1 -- 172.21.15.55:0/2957158047 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0cfe70 con 0x7f57ac1598a0 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1984700 1 --2- 172.21.15.55:0/2957158047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac1598a0 0x7f57ac0ce7e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f57a00098e0 tx=0x7f57a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a378981ff6daf4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1183700 1 -- 172.21.15.55:0/2957158047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0009e80 con 0x7f57ac1598a0 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1183700 1 -- 172.21.15.55:0/2957158047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a000b820 con 0x7f57ac1598a0 2023-10-06T11:15:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b1183700 1 -- 172.21.15.55:0/2957158047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000bba0 con 0x7f57ac1598a0 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b43e9700 1 -- 172.21.15.55:0/2957158047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac1598a0 msgr2=0x7f57ac0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.972+0000 7f57b43e9700 1 --2- 172.21.15.55:0/2957158047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac1598a0 0x7f57ac0ce7e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f57a00098e0 tx=0x7f57a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.973+0000 7f57b43e9700 1 -- 172.21.15.55:0/2957158047 shutdown_connections 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.973+0000 7f57b43e9700 1 --2- 172.21.15.55:0/2957158047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac1598a0 0x7f57ac0ce7e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.973+0000 7f57b43e9700 1 -- 172.21.15.55:0/2957158047 >> 172.21.15.55:0/2957158047 conn(0x7f57ac089e50 msgr2=0x7f57ac099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.973+0000 7f57b43e9700 1 -- 172.21.15.55:0/2957158047 shutdown_connections 2023-10-06T11:15:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.973+0000 7f57b43e9700 1 -- 172.21.15.55:0/2957158047 wait complete. 2023-10-06T11:15:32.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 Processor -- start 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 -- start start 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 0x7f57ac13be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57ac1594d0 0x7f57ac1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57ac1598a0 0x7f57ac069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0b37a0 con 0x7f57ac0cbc70 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac152960 con 0x7f57ac1594d0 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b43e9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac152c40 con 0x7f57ac1598a0 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b2185700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 0x7f57ac13be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b2185700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 0x7f57ac13be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54564/0 (socket says 172.21.15.55:54564) 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.974+0000 7f57b2185700 1 -- 172.21.15.55:0/3475174538 learned_addr learned my addr 172.21.15.55:0/3475174538 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b1984700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57ac1594d0 0x7f57ac1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2986700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57ac1598a0 0x7f57ac069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2185700 1 -- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57ac1598a0 msgr2=0x7f57ac069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2185700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57ac1598a0 0x7f57ac069580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2185700 1 -- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57ac1594d0 msgr2=0x7f57ac1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2185700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57ac1594d0 0x7f57ac1520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2185700 1 -- 172.21.15.55:0/3475174538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0009420 con 0x7f57ac0cbc70 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b1984700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57ac1594d0 0x7f57ac1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b2185700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 0x7f57ac13be50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c950 tx=0x7f579c002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00a870 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c00a9d0 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00ad90 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0b3430 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.975+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac152600 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.976+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac0b35c0 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.976+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f579c012630 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.977+0000 7f57aa7fc700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5798066f30 0x7f57980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.977+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f579c084aa0 con 0x7f57ac0cbc70 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.977+0000 7f57b1984700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5798066f30 0x7f57980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:32.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.978+0000 7f57b1984700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5798066f30 0x7f57980693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f57a00098e0 tx=0x7f57a0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:32.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:32.981+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f579c051dc0 con 0x7f57ac0cbc70 2023-10-06T11:15:33.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.174+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57ac064a90 con 0x7f57ac0cbc70 2023-10-06T11:15:33.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.174+0000 7f57aa7fc700 1 -- 172.21.15.55:0/3475174538 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f579c0553e0 con 0x7f57ac0cbc70 2023-10-06T11:15:33.176 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:15:33.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5798066f30 msgr2=0x7f57980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5798066f30 0x7f57980693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f57a00098e0 tx=0x7f57a0016000 comp rx=0 tx=0).stop 2023-10-06T11:15:33.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 msgr2=0x7f57ac13be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 0x7f57ac13be50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c950 tx=0x7f579c002760 comp rx=0 tx=0).stop 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 shutdown_connections 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5798066f30 0x7f57980693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ac0cbc70 0x7f57ac13be50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57ac1598a0 0x7f57ac069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 --2- 172.21.15.55:0/3475174538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57ac1594d0 0x7f57ac1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.176+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 >> 172.21.15.55:0/3475174538 conn(0x7f57ac089e50 msgr2=0x7f57ac0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.177+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 shutdown_connections 2023-10-06T11:15:33.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.177+0000 7f57b43e9700 1 -- 172.21.15.55:0/3475174538 wait complete. 2023-10-06T11:15:33.190 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:15:33.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.310+0000 7f7f0c9b0700 1 Processor -- start 2023-10-06T11:15:33.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.310+0000 7f7f0c9b0700 1 -- start start 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f0c9b0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f080b0820 0x7f7f080686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f0c9b0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080c4450 0x7f7f080cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f0c9b0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f080c9670 con 0x7f7f080cc740 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f0c9b0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f08159c00 con 0x7f7f080b0820 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f0c9b0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c8a60 con 0x7f7f080c4450 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f0659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f080b0820 0x7f7f080686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f05d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080c4450 0x7f7f080cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.311+0000 7f7f06d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7f080cc740 0x7f7f080ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:49124/0 (socket says 172.21.15.55:49124) 2023-10-06T11:15:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f06d9d700 1 -- 172.21.15.55:0/4096897184 learned_addr learned my addr 172.21.15.55:0/4096897184 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f05d9b700 1 -- 172.21.15.55:0/4096897184 >> v2:172.21.15.142:3300/0 conn(0x7f7f080b0820 msgr2=0x7f7f080686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f05d9b700 1 --2- 172.21.15.55:0/4096897184 >> v2:172.21.15.142:3300/0 conn(0x7f7f080b0820 0x7f7f080686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f05d9b700 1 -- 172.21.15.55:0/4096897184 >> v1:172.21.15.142:6789/0 conn(0x7f7f080cc740 legacy=0x7f7f080ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f05d9b700 1 -- 172.21.15.55:0/4096897184 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080c8d40 con 0x7f7f080c4450 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f0659c700 1 --2- 172.21.15.55:0/4096897184 >> v2:172.21.15.142:3300/0 conn(0x7f7f080b0820 0x7f7f080686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f05d9b700 1 --2- 172.21.15.55:0/4096897184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080c4450 0x7f7f080cec30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00098e0 tx=0x7f7ef00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2511114872c7c1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f0559a700 1 -- 172.21.15.55:0/4096897184 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000b640 con 0x7f7f080c4450 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f0559a700 1 -- 172.21.15.55:0/4096897184 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000b7a0 con 0x7f7f080c4450 2023-10-06T11:15:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.312+0000 7f7f0559a700 1 -- 172.21.15.55:0/4096897184 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000bb40 con 0x7f7f080c4450 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/4096897184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080c4450 msgr2=0x7f7f080cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/4096897184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080c4450 0x7f7f080cec30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00098e0 tx=0x7f7ef00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/4096897184 shutdown_connections 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/4096897184 >> v2:172.21.15.142:3300/0 conn(0x7f7f080b0820 0x7f7f080686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/4096897184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080c4450 0x7f7f080cec30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/4096897184 >> 172.21.15.55:0/4096897184 conn(0x7f7f08087fc0 msgr2=0x7f7f080ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/4096897184 shutdown_connections 2023-10-06T11:15:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.313+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/4096897184 wait complete. 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.314+0000 7f7f0c9b0700 1 Processor -- start 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.314+0000 7f7f0c9b0700 1 -- start start 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0c9b0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 0x7f7f080b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0c9b0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f080c4450 0x7f7f080c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0c9b0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080cc740 0x7f7f080c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0c9b0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c8360 con 0x7f7f080b0820 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0c9b0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f08158d90 con 0x7f7f080c4450 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0c9b0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c6bc0 con 0x7f7f080cc740 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 0x7f7f080b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 0x7f7f080b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54576/0 (socket says 172.21.15.55:54576) 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 -- 172.21.15.55:0/676740861 learned_addr learned my addr 172.21.15.55:0/676740861 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f06d9d700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080cc740 0x7f7f080c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f05d9b700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f080c4450 0x7f7f080c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 -- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080cc740 msgr2=0x7f7f080c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080cc740 0x7f7f080c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 -- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f080c4450 msgr2=0x7f7f080c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f080c4450 0x7f7f080c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 -- 172.21.15.55:0/676740861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009a20 con 0x7f7f080b0820 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.315+0000 7f7f0659c700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 0x7f7f080b35d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c170 tx=0x7f7f0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.316+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000cc50 con 0x7f7f080b0820 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.316+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0000f040 con 0x7f7f080b0820 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.316+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef0009420 con 0x7f7f080b0820 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.316+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00014480 con 0x7f7f080b0820 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.316+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f080c6290 con 0x7f7f080b0820 2023-10-06T11:15:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.316+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f08064a90 con 0x7f7f080b0820 2023-10-06T11:15:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.317+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f000147f0 con 0x7f7f080b0820 2023-10-06T11:15:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.317+0000 7f7efe7fc700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ee8066f30 0x7f7ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.317+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7f00085380 con 0x7f7f080b0820 2023-10-06T11:15:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.318+0000 7f7f05d9b700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ee8066f30 0x7f7ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.318+0000 7f7f05d9b700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ee8066f30 0x7f7ee80693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00093f0 tx=0x7f7ef0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.322+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f00056130 con 0x7f7f080b0820 2023-10-06T11:15:33.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.514+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f0804bb40 con 0x7f7f080b0820 2023-10-06T11:15:33.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.515+0000 7f7efe7fc700 1 -- 172.21.15.55:0/676740861 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7f00055cc0 con 0x7f7f080b0820 2023-10-06T11:15:33.517 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ee8066f30 msgr2=0x7f7ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ee8066f30 0x7f7ee80693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00093f0 tx=0x7f7ef0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 msgr2=0x7f7f080b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 0x7f7f080b35d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c170 tx=0x7f7f0000b040 comp rx=0 tx=0).stop 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 shutdown_connections 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7ee8066f30 0x7f7ee80693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f080b0820 0x7f7f080b35d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f080cc740 0x7f7f080c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 --2- 172.21.15.55:0/676740861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f080c4450 0x7f7f080c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 >> 172.21.15.55:0/676740861 conn(0x7f7f08087fc0 msgr2=0x7f7f08159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 shutdown_connections 2023-10-06T11:15:33.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.517+0000 7f7f0c9b0700 1 -- 172.21.15.55:0/676740861 wait complete. 2023-10-06T11:15:33.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:15:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.648+0000 7f8f7bc7f700 1 Processor -- start 2023-10-06T11:15:33.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.648+0000 7f8f7bc7f700 1 -- start start 2023-10-06T11:15:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f7bc7f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f74159560 0x7f8f740aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f7bc7f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f740b0c60 con 0x7f8f740b0760 2023-10-06T11:15:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f7bc7f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f740b0f40 con 0x7f8f740b49a0 2023-10-06T11:15:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f7bc7f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f740b1220 con 0x7f8f74159560 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f79a1b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f74159560 0x7f8f740aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f7a21c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f740b0760 0x7f8f740b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33296/0 (socket says 172.21.15.55:33296) 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f7a21c700 1 -- 172.21.15.55:0/1044067194 learned_addr learned my addr 172.21.15.55:0/1044067194 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f79a1b700 1 -- 172.21.15.55:0/1044067194 >> v1:172.21.15.142:6789/0 conn(0x7f8f740b49a0 legacy=0x7f8f740aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f79a1b700 1 -- 172.21.15.55:0/1044067194 >> v1:172.21.15.55:6789/0 conn(0x7f8f740b0760 legacy=0x7f8f740b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f79a1b700 1 -- 172.21.15.55:0/1044067194 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740b1500 con 0x7f8f74159560 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.649+0000 7f8f78a19700 1 -- 172.21.15.55:0/1044067194 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241337467 0 0) 0x7f8f740b0c60 con 0x7f8f740b0760 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f79a1b700 1 --2- 172.21.15.55:0/1044067194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f740aa530 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009900 tx=0x7f8f64009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ec6e8632e8d9a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f78a19700 1 -- 172.21.15.55:0/1044067194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64009ea0 con 0x7f8f74159560 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f78a19700 1 -- 172.21.15.55:0/1044067194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64005c10 con 0x7f8f74159560 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f78a19700 1 -- 172.21.15.55:0/1044067194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400b610 con 0x7f8f74159560 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/1044067194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 msgr2=0x7f8f740aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/1044067194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f740aa530 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009900 tx=0x7f8f64009120 comp rx=0 tx=0).stop 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/1044067194 shutdown_connections 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/1044067194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f740aa530 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/1044067194 >> 172.21.15.55:0/1044067194 conn(0x7f8f740997f0 msgr2=0x7f8f7406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/1044067194 shutdown_connections 2023-10-06T11:15:33.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.650+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/1044067194 wait complete. 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.651+0000 7f8f7bc7f700 1 Processor -- start 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.651+0000 7f8f7bc7f700 1 -- start start 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7bc7f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f740b0760 0x7f8f740acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7bc7f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f740b49a0 0x7f8f74157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7bc7f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f7409a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7bc7f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740ab290 con 0x7f8f74159560 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7bc7f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740abb30 con 0x7f8f740b49a0 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7bc7f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7409dd80 con 0x7f8f740b0760 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7a21c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f7409a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7a21c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f7409a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54592/0 (socket says 172.21.15.55:54592) 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7a21c700 1 -- 172.21.15.55:0/4160018900 learned_addr learned my addr 172.21.15.55:0/4160018900 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:33.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f79a1b700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f740b0760 0x7f8f740acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.652+0000 7f8f7921a700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f740b49a0 0x7f8f74157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7a21c700 1 -- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f740b0760 msgr2=0x7f8f740acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7a21c700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f740b0760 0x7f8f740acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7a21c700 1 -- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f740b49a0 msgr2=0x7f8f74157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7a21c700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f740b49a0 0x7f8f74157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7a21c700 1 -- 172.21.15.55:0/4160018900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640093c0 con 0x7f8f74159560 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7a21c700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f7409a260 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00cc90 tx=0x7f8f6c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00a8b0 con 0x7f8f74159560 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c00aa10 con 0x7f8f74159560 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f740ab4e0 con 0x7f8f74159560 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00add0 con 0x7f8f74159560 2023-10-06T11:15:33.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.653+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f74157fe0 con 0x7f8f74159560 2023-10-06T11:15:33.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.654+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f740abce0 con 0x7f8f74159560 2023-10-06T11:15:33.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.655+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f6c007300 con 0x7f8f74159560 2023-10-06T11:15:33.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.655+0000 7f8f69ffb700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f58066f30 0x7f8f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.655+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8f6c084760 con 0x7f8f74159560 2023-10-06T11:15:33.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.655+0000 7f8f79a1b700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f58066f30 0x7f8f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.656+0000 7f8f79a1b700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f58066f30 0x7f8f580693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009390 tx=0x7f8f64016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.659+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f740abce0 con 0x7f8f74159560 2023-10-06T11:15:33.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.855+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8f740abca0 con 0x7f8f74159560 2023-10-06T11:15:33.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.856+0000 7f8f69ffb700 1 -- 172.21.15.55:0/4160018900 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8f6c051b00 con 0x7f8f74159560 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:33.858 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:15:33.859 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:15:33.859 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:33.859 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f58066f30 msgr2=0x7f8f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f58066f30 0x7f8f580693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009390 tx=0x7f8f64016000 comp rx=0 tx=0).stop 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 msgr2=0x7f8f7409a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f7409a260 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00cc90 tx=0x7f8f6c001a80 comp rx=0 tx=0).stop 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 shutdown_connections 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f58066f30 0x7f8f580693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f74159560 0x7f8f7409a260 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f740b0760 0x7f8f740acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 --2- 172.21.15.55:0/4160018900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f740b49a0 0x7f8f74157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 >> 172.21.15.55:0/4160018900 conn(0x7f8f740997f0 msgr2=0x7f8f74158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:33.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 shutdown_connections 2023-10-06T11:15:33.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.858+0000 7f8f7bc7f700 1 -- 172.21.15.55:0/4160018900 wait complete. 2023-10-06T11:15:33.871 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:15:33.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:15:33.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.993+0000 7f204f447700 1 Processor -- start 2023-10-06T11:15:33.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.993+0000 7f204f447700 1 -- start start 2023-10-06T11:15:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204f447700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f204806ece0 0x7f20480b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204f447700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20480aede0 0x7f20480af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204f447700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480b2ce0 con 0x7f204806f0b0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204f447700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204806fb40 con 0x7f204806ece0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204f447700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b0410 con 0x7f20480aede0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204d1e3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f204806ece0 0x7f20480b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204c9e2700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f204806f0b0 0x7f20480b08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:49142/0 (socket says 172.21.15.55:49142) 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204d9e4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20480aede0 0x7f20480af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.994+0000 7f204c9e2700 1 -- 172.21.15.55:0/193944792 learned_addr learned my addr 172.21.15.55:0/193944792 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f2047fff700 1 -- 172.21.15.55:0/193944792 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048165913 0 0) 0x7f20480b2ce0 con 0x7f204806f0b0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f2047fff700 1 -- 172.21.15.55:0/193944792 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2030003570 con 0x7f204806f0b0 2023-10-06T11:15:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f204d1e3700 1 -- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20480aede0 msgr2=0x7f20480af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f204d1e3700 1 --2- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20480aede0 0x7f20480af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f204d1e3700 1 -- 172.21.15.55:0/193944792 >> v1:172.21.15.142:6789/0 conn(0x7f204806f0b0 legacy=0x7f20480b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f204d1e3700 1 -- 172.21.15.55:0/193944792 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480af780 con 0x7f204806ece0 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f204d1e3700 1 --2- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204806ece0 0x7f20480b2360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f20380098e0 tx=0x7f20380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85bfa3a0ba22c2a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f2047fff700 1 -- 172.21.15.55:0/193944792 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011630 con 0x7f204806ece0 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f2047fff700 1 -- 172.21.15.55:0/193944792 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038011790 con 0x7f204806ece0 2023-10-06T11:15:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.995+0000 7f2047fff700 1 -- 172.21.15.55:0/193944792 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011b10 con 0x7f204806ece0 2023-10-06T11:15:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 -- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204806ece0 msgr2=0x7f20480b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 --2- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204806ece0 0x7f20480b2360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f20380098e0 tx=0x7f20380091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 -- 172.21.15.55:0/193944792 shutdown_connections 2023-10-06T11:15:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 --2- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20480aede0 0x7f20480af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 --2- 172.21.15.55:0/193944792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204806ece0 0x7f20480b2360 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 -- 172.21.15.55:0/193944792 >> 172.21.15.55:0/193944792 conn(0x7f20480682f0 msgr2=0x7f20480686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 -- 172.21.15.55:0/193944792 shutdown_connections 2023-10-06T11:15:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.996+0000 7f204f447700 1 -- 172.21.15.55:0/193944792 wait complete. 2023-10-06T11:15:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.997+0000 7f204f447700 1 Processor -- start 2023-10-06T11:15:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.997+0000 7f204f447700 1 -- start start 2023-10-06T11:15:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204f447700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204806ece0 0x7f20480a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204f447700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 0x7f20480aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204f447700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20480aede0 0x7f20480ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204f447700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480aa1f0 con 0x7f204806f0b0 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204f447700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480a9570 con 0x7f20480aede0 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204f447700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480a9850 con 0x7f204806ece0 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 0x7f20480aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 0x7f20480aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54606/0 (socket says 172.21.15.55:54606) 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 -- 172.21.15.55:0/2101921143 learned_addr learned my addr 172.21.15.55:0/2101921143 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204d1e3700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204806ece0 0x7f20480a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204d9e4700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20480aede0 0x7f20480ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 -- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204806ece0 msgr2=0x7f20480a8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204806ece0 0x7f20480a8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 -- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20480aede0 msgr2=0x7f20480ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20480aede0 0x7f20480ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 -- 172.21.15.55:0/2101921143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009420 con 0x7f204806f0b0 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204d9e4700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20480aede0 0x7f20480ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f204c9e2700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 0x7f20480aafa0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f203c0011e0 tx=0x7f203c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.998+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c005b30 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.999+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c005c90 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.999+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c007320 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.999+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20480a9b30 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.999+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20481561a0 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:33.999+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20480aa330 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.000+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f203c007690 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.000+0000 7f20457fa700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2034066f30 0x7f20340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.000+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f203c083910 con 0x7f204806f0b0 2023-10-06T11:15:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.001+0000 7f204d1e3700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2034066f30 0x7f20340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.001+0000 7f204d1e3700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2034066f30 0x7f20340693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f20380091e0 tx=0x7f2038017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.005+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20480aa330 con 0x7f204806f0b0 2023-10-06T11:15:34.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:34.201+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f20480aa330 con 0x7f204806f0b0 2023-10-06T11:15:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.096+0000 7f20457fa700 1 -- 172.21.15.55:0/2101921143 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20480aa330 con 0x7f204806f0b0 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2034066f30 msgr2=0x7f20340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2034066f30 0x7f20340693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f20380091e0 tx=0x7f2038017000 comp rx=0 tx=0).stop 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 msgr2=0x7f20480aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 0x7f20480aafa0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f203c0011e0 tx=0x7f203c007df0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 shutdown_connections 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2034066f30 0x7f20340693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20480aede0 0x7f20480ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204806ece0 0x7f20480a8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 --2- 172.21.15.55:0/2101921143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806f0b0 0x7f20480aafa0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 >> 172.21.15.55:0/2101921143 conn(0x7f20480682f0 msgr2=0x7f20480ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.102+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 shutdown_connections 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.103+0000 7f204f447700 1 -- 172.21.15.55:0/2101921143 wait complete. 2023-10-06T11:15:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:15:35.120 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:15:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.251+0000 7fd860050700 1 Processor -- start 2023-10-06T11:15:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.252+0000 7fd860050700 1 -- start start 2023-10-06T11:15:35.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.252+0000 7fd860050700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd858067bd0 0x7fd8580cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.252+0000 7fd860050700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85815d860 con 0x7fd85815dcf0 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.252+0000 7fd860050700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85815a7f0 con 0x7fd85815a1f0 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.252+0000 7fd860050700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85815aad0 con 0x7fd858067bd0 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.252+0000 7fd85ddec700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd858067bd0 0x7fd8580cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85ddec700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd858067bd0 0x7fd8580cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35010/0 (socket says 172.21.15.55:35010) 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85d5eb700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd85815dcf0 0x7fd858159ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58902/0 (socket says 172.21.15.55:58902) 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85ddec700 1 -- 172.21.15.55:0/1196765417 learned_addr learned my addr 172.21.15.55:0/1196765417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:35.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85ddec700 1 -- 172.21.15.55:0/1196765417 >> v1:172.21.15.142:6789/0 conn(0x7fd85815a1f0 legacy=0x7fd85806a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85ddec700 1 -- 172.21.15.55:0/1196765417 >> v1:172.21.15.55:6789/0 conn(0x7fd85815dcf0 legacy=0x7fd858159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85ddec700 1 -- 172.21.15.55:0/1196765417 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85815d210 con 0x7fd858067bd0 2023-10-06T11:15:35.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85ddec700 1 --2- 172.21.15.55:0/1196765417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd858067bd0 0x7fd8580cad70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd8500099b0 tx=0x7fd850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da045e9941c5a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:35.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85cdea700 1 -- 172.21.15.55:0/1196765417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000b860 con 0x7fd858067bd0 2023-10-06T11:15:35.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85cdea700 1 -- 172.21.15.55:0/1196765417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85000b9c0 con 0x7fd858067bd0 2023-10-06T11:15:35.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.253+0000 7fd85cdea700 1 -- 172.21.15.55:0/1196765417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000bd60 con 0x7fd858067bd0 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 -- 172.21.15.55:0/1196765417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd858067bd0 msgr2=0x7fd8580cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 --2- 172.21.15.55:0/1196765417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd858067bd0 0x7fd8580cad70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd8500099b0 tx=0x7fd850009250 comp rx=0 tx=0).stop 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 -- 172.21.15.55:0/1196765417 shutdown_connections 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 --2- 172.21.15.55:0/1196765417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd858067bd0 0x7fd8580cad70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 -- 172.21.15.55:0/1196765417 >> 172.21.15.55:0/1196765417 conn(0x7fd8580cd1a0 msgr2=0x7fd8580cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 -- 172.21.15.55:0/1196765417 shutdown_connections 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.254+0000 7fd860050700 1 -- 172.21.15.55:0/1196765417 wait complete. 2023-10-06T11:15:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.255+0000 7fd860050700 1 Processor -- start 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.255+0000 7fd860050700 1 -- start start 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd860050700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd858067bd0 0x7fd85814ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd860050700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 0x7fd85815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd860050700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd85815dcf0 0x7fd85815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd860050700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85816a710 con 0x7fd85815a1f0 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd860050700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858169de0 con 0x7fd858067bd0 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd860050700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85816a0c0 con 0x7fd85815dcf0 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 0x7fd85815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 0x7fd85815bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35022/0 (socket says 172.21.15.55:35022) 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 -- 172.21.15.55:0/3706839568 learned_addr learned my addr 172.21.15.55:0/3706839568 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85ddec700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd858067bd0 0x7fd85814ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85e5ed700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd85815dcf0 0x7fd85815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 -- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd85815dcf0 msgr2=0x7fd85815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd85815dcf0 0x7fd85815c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 -- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd858067bd0 msgr2=0x7fd85814ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd858067bd0 0x7fd85814ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 -- 172.21.15.55:0/3706839568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500094f0 con 0x7fd85815a1f0 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85e5ed700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd85815dcf0 0x7fd85815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85ddec700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd858067bd0 0x7fd85814ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd85d5eb700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 0x7fd85815bbd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c560 tx=0x7fd84c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c005a70 con 0x7fd85815a1f0 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.256+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c005bd0 con 0x7fd85815a1f0 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.257+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85816a3a0 con 0x7fd85815a1f0 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.257+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0070d0 con 0x7fd85815a1f0 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.257+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8580c66a0 con 0x7fd85815a1f0 2023-10-06T11:15:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.258+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd858064a90 con 0x7fd85815a1f0 2023-10-06T11:15:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.258+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd84c0074c0 con 0x7fd85815a1f0 2023-10-06T11:15:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.258+0000 7fd855ffb700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd844066f30 0x7fd8440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.259+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fd84c083b20 con 0x7fd85815a1f0 2023-10-06T11:15:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.259+0000 7fd85ddec700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd844066f30 0x7fd8440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.259+0000 7fd85ddec700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd844066f30 0x7fd8440693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8500099b0 tx=0x7fd850017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:35.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.263+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd84c050c30 con 0x7fd85815a1f0 2023-10-06T11:15:35.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:35.458+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd85816a850 con 0x7fd85815a1f0 2023-10-06T11:15:36.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.112+0000 7fd855ffb700 1 -- 172.21.15.55:0/3706839568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd84c017070 con 0x7fd85815a1f0 2023-10-06T11:15:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.118+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd844066f30 msgr2=0x7fd8440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.118+0000 7fd860050700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd844066f30 0x7fd8440693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8500099b0 tx=0x7fd850017000 comp rx=0 tx=0).stop 2023-10-06T11:15:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.118+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 msgr2=0x7fd85815bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.118+0000 7fd860050700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 0x7fd85815bbd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c560 tx=0x7fd84c007f70 comp rx=0 tx=0).stop 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.119+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 shutdown_connections 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.119+0000 7fd860050700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd844066f30 0x7fd8440693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.119+0000 7fd860050700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd85815dcf0 0x7fd85815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.119+0000 7fd860050700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd858067bd0 0x7fd85814ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.119+0000 7fd860050700 1 --2- 172.21.15.55:0/3706839568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd85815a1f0 0x7fd85815bbd0 secure :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c560 tx=0x7fd84c007f70 comp rx=0 tx=0).stop 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.119+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 >> 172.21.15.55:0/3706839568 conn(0x7fd8580cd1a0 msgr2=0x7fd858151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.120+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 shutdown_connections 2023-10-06T11:15:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.121+0000 7fd860050700 1 -- 172.21.15.55:0/3706839568 wait complete. 2023-10-06T11:15:36.129 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:15:36.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:15:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.267+0000 7f8f6b7b5700 1 Processor -- start 2023-10-06T11:15:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.268+0000 7f8f6b7b5700 1 -- start start 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.268+0000 7f8f6b7b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640cd940 0x7f8f64159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.268+0000 7f8f6b7b5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640b5ef0 con 0x7f8f640b4a20 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.268+0000 7f8f6b7b5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640b3600 con 0x7f8f640d09e0 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.268+0000 7f8f6b7b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b6380 con 0x7f8f640cd940 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f68d50700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f640b4a20 0x7f8f640d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58914/0 (socket says 172.21.15.55:58914) 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f68d50700 1 -- 172.21.15.55:0/2770480992 learned_addr learned my addr 172.21.15.55:0/2770480992 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f69551700 1 --2- 172.21.15.55:0/2770480992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640cd940 0x7f8f64159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955350935 0 0) 0x7f8f640b5ef0 con 0x7f8f640b4a20 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f50003570 con 0x7f8f640b4a20 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974088032 0 0) 0x7f8f640b3600 con 0x7f8f640d09e0 2023-10-06T11:15:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f640b5ef0 con 0x7f8f640d09e0 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f69551700 1 -- 172.21.15.55:0/2770480992 >> v1:172.21.15.142:6789/0 conn(0x7f8f640d09e0 legacy=0x7f8f64163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f69551700 1 -- 172.21.15.55:0/2770480992 >> v1:172.21.15.55:6789/0 conn(0x7f8f640b4a20 legacy=0x7f8f640d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f69551700 1 -- 172.21.15.55:0/2770480992 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640b52e0 con 0x7f8f640cd940 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f69551700 1 --2- 172.21.15.55:0/2770480992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640cd940 0x7f8f64159bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009910 tx=0x7f8f600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0dd847cdad7ba47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60011630 con 0x7f8f640cd940 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.269+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60011790 con 0x7f8f640cd940 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f5bfff700 1 -- 172.21.15.55:0/2770480992 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60011b30 con 0x7f8f640cd940 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2770480992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640cd940 msgr2=0x7f8f64159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2770480992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640cd940 0x7f8f64159bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009910 tx=0x7f8f600091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2770480992 shutdown_connections 2023-10-06T11:15:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2770480992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640cd940 0x7f8f64159bd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2770480992 >> 172.21.15.55:0/2770480992 conn(0x7f8f6406ece0 msgr2=0x7f8f6406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2770480992 shutdown_connections 2023-10-06T11:15:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.270+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2770480992 wait complete. 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.271+0000 7f8f6b7b5700 1 Processor -- start 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.271+0000 7f8f6b7b5700 1 -- start start 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f6b7b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640b4a20 0x7f8f640ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f6b7b5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 0x7f8f64157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f6b7b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f640d09e0 0x7f8f641578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f6b7b5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64150b90 con 0x7f8f640cd940 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f6b7b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6415e750 con 0x7f8f640d09e0 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f6b7b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640cd070 con 0x7f8f640b4a20 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f68d50700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 0x7f8f64157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f68d50700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 0x7f8f64157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35030/0 (socket says 172.21.15.55:35030) 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f68d50700 1 -- 172.21.15.55:0/2231927119 learned_addr learned my addr 172.21.15.55:0/2231927119 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f69d52700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f640d09e0 0x7f8f641578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.272+0000 7f8f69551700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640b4a20 0x7f8f640ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f68d50700 1 -- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640b4a20 msgr2=0x7f8f640ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f68d50700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640b4a20 0x7f8f640ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f68d50700 1 -- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f640d09e0 msgr2=0x7f8f641578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f68d50700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f640d09e0 0x7f8f641578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f68d50700 1 -- 172.21.15.55:0/2231927119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60009420 con 0x7f8f640cd940 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f69d52700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f640d09e0 0x7f8f641578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f68d50700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 0x7f8f64157360 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c7c0 tx=0x7f8f54007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54005b30 con 0x7f8f640cd940 2023-10-06T11:15:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54005cd0 con 0x7f8f640cd940 2023-10-06T11:15:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6415db40 con 0x7f8f640cd940 2023-10-06T11:15:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54007320 con 0x7f8f640cd940 2023-10-06T11:15:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.273+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6415e100 con 0x7f8f640cd940 2023-10-06T11:15:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.274+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f64169fb0 con 0x7f8f640cd940 2023-10-06T11:15:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.274+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f54012400 con 0x7f8f640cd940 2023-10-06T11:15:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.275+0000 7f8f597fa700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.275+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f8f54083ac0 con 0x7f8f640cd940 2023-10-06T11:15:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.275+0000 7f8f69551700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.275+0000 7f8f69551700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009860 tx=0x7f8f60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:36.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.279+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f5404b5a0 con 0x7f8f640cd940 2023-10-06T11:15:36.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:36.515+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f64064a90 con 0x7f8f640cd940 2023-10-06T11:15:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.110+0000 7f8f597fa700 1 -- 172.21.15.55:0/2231927119 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8f54083e60 con 0x7f8f640cd940 2023-10-06T11:15:37.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.114+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 msgr2=0x7f8f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.114+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009860 tx=0x7f8f60017000 comp rx=0 tx=0).stop 2023-10-06T11:15:37.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.114+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 msgr2=0x7f8f64157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.114+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 0x7f8f64157360 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c7c0 tx=0x7f8f54007e80 comp rx=0 tx=0).stop 2023-10-06T11:15:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 shutdown_connections 2023-10-06T11:15:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8f48066f30 0x7f8f480693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f640d09e0 0x7f8f641578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f640b4a20 0x7f8f640ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 --2- 172.21.15.55:0/2231927119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f640cd940 0x7f8f64157360 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 >> 172.21.15.55:0/2231927119 conn(0x7f8f6406ece0 msgr2=0x7f8f640cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 shutdown_connections 2023-10-06T11:15:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.115+0000 7f8f6b7b5700 1 -- 172.21.15.55:0/2231927119 wait complete. 2023-10-06T11:15:37.121 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 12 and data pool 13 2023-10-06T11:15:37.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:37.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.253+0000 7f40d3dcd700 1 Processor -- start 2023-10-06T11:15:37.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d3dcd700 1 -- start start 2023-10-06T11:15:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d3dcd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40cc0ac440 0x7f40cc155600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d3dcd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40cc068be0 0x7f40cc155b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d3dcd700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0ac8d0 con 0x7f40cc068810 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d3dcd700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0af110 con 0x7f40cc0ac440 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d3dcd700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0acbb0 con 0x7f40cc068be0 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d1b69700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f40cc068810 0x7f40cc0afb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58920/0 (socket says 172.21.15.55:58920) 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.254+0000 7f40d1b69700 1 -- 172.21.15.55:0/2136071335 learned_addr learned my addr 172.21.15.55:0/2136071335 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d1368700 1 --2- 172.21.15.55:0/2136071335 >> v2:172.21.15.55:3300/0 conn(0x7f40cc0ac440 0x7f40cc155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d236a700 1 --2- 172.21.15.55:0/2136071335 >> v2:172.21.15.142:3300/0 conn(0x7f40cc068be0 0x7f40cc155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d1368700 1 -- 172.21.15.55:0/2136071335 >> v2:172.21.15.142:3300/0 conn(0x7f40cc068be0 msgr2=0x7f40cc155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d1368700 1 --2- 172.21.15.55:0/2136071335 >> v2:172.21.15.142:3300/0 conn(0x7f40cc068be0 0x7f40cc155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d1368700 1 -- 172.21.15.55:0/2136071335 >> v1:172.21.15.55:6789/0 conn(0x7f40cc068810 legacy=0x7f40cc0afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d1368700 1 -- 172.21.15.55:0/2136071335 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0ace90 con 0x7f40cc0ac440 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d236a700 1 --2- 172.21.15.55:0/2136071335 >> v2:172.21.15.142:3300/0 conn(0x7f40cc068be0 0x7f40cc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d0b67700 1 -- 172.21.15.55:0/2136071335 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285888609 0 0) 0x7f40cc0ac8d0 con 0x7f40cc068810 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d1368700 1 --2- 172.21.15.55:0/2136071335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc155600 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0b1b10 tx=0x7f40c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86372911063116c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d0b67700 1 -- 172.21.15.55:0/2136071335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000b6b0 con 0x7f40cc0ac440 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d0b67700 1 -- 172.21.15.55:0/2136071335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000b810 con 0x7f40cc0ac440 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.255+0000 7f40d0b67700 1 -- 172.21.15.55:0/2136071335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000bbb0 con 0x7f40cc0ac440 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 -- 172.21.15.55:0/2136071335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 msgr2=0x7f40cc155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/2136071335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc155600 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0b1b10 tx=0x7f40c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 -- 172.21.15.55:0/2136071335 shutdown_connections 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/2136071335 >> v2:172.21.15.142:3300/0 conn(0x7f40cc068be0 0x7f40cc155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/2136071335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc155600 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 -- 172.21.15.55:0/2136071335 >> 172.21.15.55:0/2136071335 conn(0x7f40cc06de40 msgr2=0x7f40cc06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 -- 172.21.15.55:0/2136071335 shutdown_connections 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.256+0000 7f40d3dcd700 1 -- 172.21.15.55:0/2136071335 wait complete. 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.257+0000 7f40d3dcd700 1 Processor -- start 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.257+0000 7f40d3dcd700 1 -- start start 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d3dcd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40cc068810 0x7f40cc0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d3dcd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40cc068be0 0x7f40cc16d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d3dcd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc16dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d3dcd700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc153ed0 con 0x7f40cc0ac440 2023-10-06T11:15:37.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d3dcd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc154170 con 0x7f40cc068810 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d3dcd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc154450 con 0x7f40cc068be0 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc16dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc16dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35060/0 (socket says 172.21.15.55:35060) 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 -- 172.21.15.55:0/1676364020 learned_addr learned my addr 172.21.15.55:0/1676364020 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d1368700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40cc068be0 0x7f40cc16d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d1b69700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40cc068810 0x7f40cc0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 -- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40cc068be0 msgr2=0x7f40cc16d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40cc068be0 0x7f40cc16d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 -- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40cc068810 msgr2=0x7f40cc0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40cc068810 0x7f40cc0c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 -- 172.21.15.55:0/1676364020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009420 con 0x7f40cc0ac440 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40d236a700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc16dc60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f40c400d180 tx=0x7f40c4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.258+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400dd50 con 0x7f40cc0ac440 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.259+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400f040 con 0x7f40cc0ac440 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.259+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc154730 con 0x7f40cc0ac440 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.259+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4015690 con 0x7f40cc0ac440 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.259+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc151640 con 0x7f40cc0ac440 2023-10-06T11:15:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.260+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc0b1f10 con 0x7f40cc0ac440 2023-10-06T11:15:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.260+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40c401e3b0 con 0x7f40cc0ac440 2023-10-06T11:15:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.261+0000 7f40c9ffb700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.261+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f40c4084cf0 con 0x7f40cc0ac440 2023-10-06T11:15:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.261+0000 7f40d1b69700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.261+0000 7f40d1b69700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f40b8066f30 0x7f40b80693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f40cc15de00 tx=0x7f40bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.265+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40c4089070 con 0x7f40cc0ac440 2023-10-06T11:15:37.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.459+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40cc064a90 con 0x7f40cc0ac440 2023-10-06T11:15:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.460+0000 7f40c9ffb700 1 -- 172.21.15.55:0/1676364020 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f40c401a090 con 0x7f40cc0ac440 2023-10-06T11:15:37.462 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:37.462 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":78,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:36.517174+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:34.232138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:35.489479+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f40b8066f30 msgr2=0x7f40b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f40b8066f30 0x7f40b80693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f40cc15de00 tx=0x7f40bc009040 comp rx=0 tx=0).stop 2023-10-06T11:15:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 msgr2=0x7f40cc16dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc16dc60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f40c400d180 tx=0x7f40c4009a50 comp rx=0 tx=0).stop 2023-10-06T11:15:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 shutdown_connections 2023-10-06T11:15:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40cc0ac440 0x7f40cc16dc60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40cc068810 0x7f40cc0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 --2- 172.21.15.55:0/1676364020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40cc068be0 0x7f40cc16d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 >> 172.21.15.55:0/1676364020 conn(0x7f40cc06de40 msgr2=0x7f40cc06e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 shutdown_connections 2023-10-06T11:15:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.462+0000 7f40d3dcd700 1 -- 172.21.15.55:0/1676364020 wait complete. 2023-10-06T11:15:37.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:37.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.594+0000 7f4bbf06e700 1 Processor -- start 2023-10-06T11:15:37.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.594+0000 7f4bbf06e700 1 -- start start 2023-10-06T11:15:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbf06e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4bb80b25e0 0x7f4bb80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbf06e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bb8159830 0x7f4bb80cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbf06e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb80cbfa0 con 0x7f4bb80b29b0 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbf06e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb80cb390 con 0x7f4bb8159830 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbf06e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb80cb670 con 0x7f4bb80b25e0 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbd60b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bb8159830 0x7f4bb80cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbd60b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bb8159830 0x7f4bb80cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35062/0 (socket says 172.21.15.55:35062) 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.595+0000 7f4bbd60b700 1 -- 172.21.15.55:0/1180555500 learned_addr learned my addr 172.21.15.55:0/1180555500 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbce0a700 1 --2- 172.21.15.55:0/1180555500 >> v2:172.21.15.142:3300/0 conn(0x7f4bb80b25e0 0x7f4bb80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbd60b700 1 -- 172.21.15.55:0/1180555500 >> v2:172.21.15.142:3300/0 conn(0x7f4bb80b25e0 msgr2=0x7f4bb80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbd60b700 1 --2- 172.21.15.55:0/1180555500 >> v2:172.21.15.142:3300/0 conn(0x7f4bb80b25e0 0x7f4bb80b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbd60b700 1 -- 172.21.15.55:0/1180555500 >> v1:172.21.15.142:6789/0 conn(0x7f4bb80b29b0 legacy=0x7f4bb8159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbd60b700 1 -- 172.21.15.55:0/1180555500 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80cb950 con 0x7f4bb8159830 2023-10-06T11:15:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbd60b700 1 --2- 172.21.15.55:0/1180555500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb8159830 0x7f4bb80cc430 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80d0420 tx=0x7f4bb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cad3daa50a5f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bb77fe700 1 -- 172.21.15.55:0/1180555500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000b860 con 0x7f4bb8159830 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bb77fe700 1 -- 172.21.15.55:0/1180555500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000b9c0 con 0x7f4bb8159830 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bb77fe700 1 -- 172.21.15.55:0/1180555500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000bd60 con 0x7f4bb8159830 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbf06e700 1 -- 172.21.15.55:0/1180555500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb8159830 msgr2=0x7f4bb80cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.596+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/1180555500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb8159830 0x7f4bb80cc430 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80d0420 tx=0x7f4bb0009250 comp rx=0 tx=0).stop 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.597+0000 7f4bbf06e700 1 -- 172.21.15.55:0/1180555500 shutdown_connections 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.597+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/1180555500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb8159830 0x7f4bb80cc430 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.597+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/1180555500 >> v2:172.21.15.142:3300/0 conn(0x7f4bb80b25e0 0x7f4bb80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.597+0000 7f4bbf06e700 1 -- 172.21.15.55:0/1180555500 >> 172.21.15.55:0/1180555500 conn(0x7f4bb806ece0 msgr2=0x7f4bb806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.597+0000 7f4bbf06e700 1 -- 172.21.15.55:0/1180555500 shutdown_connections 2023-10-06T11:15:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.597+0000 7f4bbf06e700 1 -- 172.21.15.55:0/1180555500 wait complete. 2023-10-06T11:15:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.598+0000 7f4bbf06e700 1 Processor -- start 2023-10-06T11:15:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.598+0000 7f4bbf06e700 1 -- start start 2023-10-06T11:15:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb80b25e0 0x7f4bb815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 0x7f4bb815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb8159830 0x7f4bb815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80c3a70 con 0x7f4bb80b29b0 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb815a590 con 0x7f4bb80b25e0 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb815cc10 con 0x7f4bb8159830 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 0x7f4bb815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 0x7f4bb815c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35074/0 (socket says 172.21.15.55:35074) 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 -- 172.21.15.55:0/3511049881 learned_addr learned my addr 172.21.15.55:0/3511049881 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbce0a700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb80b25e0 0x7f4bb815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbd60b700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb8159830 0x7f4bb815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 -- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb8159830 msgr2=0x7f4bb815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb8159830 0x7f4bb815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 -- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb80b25e0 msgr2=0x7f4bb815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb80b25e0 0x7f4bb815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 -- 172.21.15.55:0/3511049881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00094f0 con 0x7f4bb80b29b0 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbd60b700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb8159830 0x7f4bb815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb7fff700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 0x7f4bb815c0f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800cb10 tx=0x7f4ba80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba80020c0 con 0x7f4bb80b29b0 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba800a7e0 con 0x7f4bb80b29b0 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb80c7a50 con 0x7f4bb80b29b0 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800ab80 con 0x7f4bb80b29b0 2023-10-06T11:15:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.599+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb80c8010 con 0x7f4bb80b29b0 2023-10-06T11:15:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.600+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb80c8200 con 0x7f4bb80b29b0 2023-10-06T11:15:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.601+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ba8003030 con 0x7f4bb80b29b0 2023-10-06T11:15:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.601+0000 7f4bb4ff9700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b98066f30 0x7f4b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.601+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4ba80848c0 con 0x7f4bb80b29b0 2023-10-06T11:15:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.601+0000 7f4bbce0a700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b98066f30 0x7f4b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.602+0000 7f4bbce0a700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b98066f30 0x7f4b980693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8153860 tx=0x7f4ba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.606+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ba80517f0 con 0x7f4bb80b29b0 2023-10-06T11:15:37.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.799+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bb8064a90 con 0x7f4bb80b29b0 2023-10-06T11:15:37.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.800+0000 7f4bb4ff9700 1 -- 172.21.15.55:0/3511049881 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f4ba8054e10 con 0x7f4bb80b29b0 2023-10-06T11:15:37.802 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:37.802 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":78,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:36.517174+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:34.232138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:35.489479+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b98066f30 msgr2=0x7f4b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b98066f30 0x7f4b980693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8153860 tx=0x7f4ba0008040 comp rx=0 tx=0).stop 2023-10-06T11:15:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 msgr2=0x7f4bb815c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 0x7f4bb815c0f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800cb10 tx=0x7f4ba80017b0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 shutdown_connections 2023-10-06T11:15:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4b98066f30 0x7f4b980693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb8159830 0x7f4bb815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb80b25e0 0x7f4bb815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 --2- 172.21.15.55:0/3511049881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bb80b29b0 0x7f4bb815c0f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 >> 172.21.15.55:0/3511049881 conn(0x7f4bb806ece0 msgr2=0x7f4bb80b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 shutdown_connections 2023-10-06T11:15:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.802+0000 7f4bbf06e700 1 -- 172.21.15.55:0/3511049881 wait complete. 2023-10-06T11:15:37.816 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:15:37.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.936+0000 7f3d27618700 1 Processor -- start 2023-10-06T11:15:37.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.937+0000 7f3d27618700 1 -- start start 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.937+0000 7f3d27618700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d201539c0 0x7f3d20069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.937+0000 7f3d27618700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2015db90 con 0x7f3d20153d90 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d27618700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2015de70 con 0x7f3d20069a90 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d27618700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2015ab70 con 0x7f3d201539c0 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d25bb5700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3d20153d90 0x7f3d200cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58930/0 (socket says 172.21.15.55:58930) 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d25bb5700 1 -- 172.21.15.55:0/3080069614 learned_addr learned my addr 172.21.15.55:0/3080069614 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d253b4700 1 --2- 172.21.15.55:0/3080069614 >> v2:172.21.15.142:3300/0 conn(0x7f3d201539c0 0x7f3d20069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d1ffff700 1 -- 172.21.15.55:0/3080069614 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891038334 0 0) 0x7f3d2015db90 con 0x7f3d20153d90 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d1ffff700 1 -- 172.21.15.55:0/3080069614 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d08003570 con 0x7f3d20153d90 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d253b4700 1 -- 172.21.15.55:0/3080069614 >> v1:172.21.15.142:6789/0 conn(0x7f3d20069a90 legacy=0x7f3d2015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d253b4700 1 -- 172.21.15.55:0/3080069614 >> v1:172.21.15.55:6789/0 conn(0x7f3d20153d90 legacy=0x7f3d200cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d1ffff700 1 -- 172.21.15.55:0/3080069614 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183457544 0 0) 0x7f3d2015de70 con 0x7f3d20069a90 2023-10-06T11:15:37.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d253b4700 1 -- 172.21.15.55:0/3080069614 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20068d50 con 0x7f3d201539c0 2023-10-06T11:15:37.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.938+0000 7f3d253b4700 1 --2- 172.21.15.55:0/3080069614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d20069550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d180098e0 tx=0x7f3d180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=354010832cf8ca6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d1ffff700 1 -- 172.21.15.55:0/3080069614 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800b640 con 0x7f3d201539c0 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d1ffff700 1 -- 172.21.15.55:0/3080069614 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1800b7a0 con 0x7f3d201539c0 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d1ffff700 1 -- 172.21.15.55:0/3080069614 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800bb40 con 0x7f3d201539c0 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 -- 172.21.15.55:0/3080069614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 msgr2=0x7f3d20069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 --2- 172.21.15.55:0/3080069614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d20069550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d180098e0 tx=0x7f3d180091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 -- 172.21.15.55:0/3080069614 shutdown_connections 2023-10-06T11:15:37.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 --2- 172.21.15.55:0/3080069614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d20069550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 -- 172.21.15.55:0/3080069614 >> 172.21.15.55:0/3080069614 conn(0x7f3d2006b610 msgr2=0x7f3d2006ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 -- 172.21.15.55:0/3080069614 shutdown_connections 2023-10-06T11:15:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.939+0000 7f3d27618700 1 -- 172.21.15.55:0/3080069614 wait complete. 2023-10-06T11:15:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.940+0000 7f3d27618700 1 Processor -- start 2023-10-06T11:15:37.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.940+0000 7f3d27618700 1 -- start start 2023-10-06T11:15:37.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d27618700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d20069a90 0x7f3d20144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d27618700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d2006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d27618700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 0x7f3d2006d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d27618700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d201553d0 con 0x7f3d20153d90 2023-10-06T11:15:37.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d27618700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d201556b0 con 0x7f3d201539c0 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d27618700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20155990 con 0x7f3d20069a90 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d25bb5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 0x7f3d2006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d25bb5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 0x7f3d2006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35080/0 (socket says 172.21.15.55:35080) 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.941+0000 7f3d25bb5700 1 -- 172.21.15.55:0/3281727601 learned_addr learned my addr 172.21.15.55:0/3281727601 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d253b4700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d20069a90 0x7f3d20144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d24bb3700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d2006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d25bb5700 1 -- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d20069a90 msgr2=0x7f3d20144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d25bb5700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d20069a90 0x7f3d20144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d25bb5700 1 -- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 msgr2=0x7f3d2006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:37.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d25bb5700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d2006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d25bb5700 1 -- 172.21.15.55:0/3281727601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18009420 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d25bb5700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 0x7f3d2006d170 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3d10001460 tx=0x7f3d10001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000a990 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000aaf0 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d20155c70 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000ae70 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.942+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d20145200 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.943+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d20064a90 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.943+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d10007300 con 0x7f3d20153d90 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.944+0000 7f3d1d7fa700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.944+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3d10084cd0 con 0x7f3d20153d90 2023-10-06T11:15:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.944+0000 7f3d253b4700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.945+0000 7f3d253b4700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3d0c066f30 0x7f3d0c0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d180093f0 tx=0x7f3d18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:37.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:37.948+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d10051c90 con 0x7f3d20153d90 2023-10-06T11:15:38.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:38.193+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3d2004bb40 con 0x7f3d20153d90 2023-10-06T11:15:38.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:38.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:39.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.124+0000 7f3d1d7fa700 1 -- 172.21.15.55:0/3281727601 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3d100552b0 con 0x7f3d20153d90 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3d0c066f30 msgr2=0x7f3d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3d0c066f30 0x7f3d0c0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d180093f0 tx=0x7f3d18017000 comp rx=0 tx=0).stop 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 msgr2=0x7f3d2006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 0x7f3d2006d170 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3d10001460 tx=0x7f3d10001a80 comp rx=0 tx=0).stop 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 shutdown_connections 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d20153d90 0x7f3d2006d170 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d20069a90 0x7f3d20144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 --2- 172.21.15.55:0/3281727601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d201539c0 0x7f3d2006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 >> 172.21.15.55:0/3281727601 conn(0x7f3d2006b610 msgr2=0x7f3d20150d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:39.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 shutdown_connections 2023-10-06T11:15:39.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.127+0000 7f3d27618700 1 -- 172.21.15.55:0/3281727601 wait complete. 2023-10-06T11:15:39.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:15:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.271+0000 7f2b19341700 1 Processor -- start 2023-10-06T11:15:39.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.271+0000 7f2b19341700 1 -- start start 2023-10-06T11:15:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b19341700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b141598a0 0x7f2b140ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b19341700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b140cbc70 0x7f2b140ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b19341700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b140cf5d0 con 0x7f2b141594d0 2023-10-06T11:15:39.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b19341700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b140cf8b0 con 0x7f2b141598a0 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b19341700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140cfb90 con 0x7f2b140cbc70 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b12ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2b141594d0 0x7f2b140cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58944/0 (socket says 172.21.15.55:58944) 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b127fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b141598a0 0x7f2b140ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.272+0000 7f2b12ffd700 1 -- 172.21.15.55:0/1846229063 learned_addr learned my addr 172.21.15.55:0/1846229063 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b137fe700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b140cbc70 0x7f2b140ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b127fc700 1 -- 172.21.15.55:0/1846229063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b140cbc70 msgr2=0x7f2b140ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b127fc700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b140cbc70 0x7f2b140ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b127fc700 1 -- 172.21.15.55:0/1846229063 >> v1:172.21.15.55:6789/0 conn(0x7f2b141594d0 legacy=0x7f2b140cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b127fc700 1 -- 172.21.15.55:0/1846229063 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b140cfe70 con 0x7f2b141598a0 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b11ffb700 1 -- 172.21.15.55:0/1846229063 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484570995 0 0) 0x7f2b140cf5d0 con 0x7f2b141594d0 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b137fe700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b140cbc70 0x7f2b140ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b127fc700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b141598a0 0x7f2b140ce7e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0098e0 tx=0x7f2afc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bec8e8e1f5b29e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b11ffb700 1 -- 172.21.15.55:0/1846229063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc009e80 con 0x7f2b141598a0 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b11ffb700 1 -- 172.21.15.55:0/1846229063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc00b860 con 0x7f2b141598a0 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.273+0000 7f2b11ffb700 1 -- 172.21.15.55:0/1846229063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00bbe0 con 0x7f2b141598a0 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 -- 172.21.15.55:0/1846229063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b141598a0 msgr2=0x7f2b140ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b141598a0 0x7f2b140ce7e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0098e0 tx=0x7f2afc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 -- 172.21.15.55:0/1846229063 shutdown_connections 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b140cbc70 0x7f2b140ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 --2- 172.21.15.55:0/1846229063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b141598a0 0x7f2b140ce7e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 -- 172.21.15.55:0/1846229063 >> 172.21.15.55:0/1846229063 conn(0x7f2b14089e50 msgr2=0x7f2b14099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 -- 172.21.15.55:0/1846229063 shutdown_connections 2023-10-06T11:15:39.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.274+0000 7f2b19341700 1 -- 172.21.15.55:0/1846229063 wait complete. 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.275+0000 7f2b19341700 1 Processor -- start 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.275+0000 7f2b19341700 1 -- start start 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 0x7f2b1414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b141594d0 0x7f2b1414db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b141598a0 0x7f2b14148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b14149930 con 0x7f2b140cbc70 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1414ef00 con 0x7f2b141594d0 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1414e060 con 0x7f2b141598a0 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 0x7f2b1414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 0x7f2b1414cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35098/0 (socket says 172.21.15.55:35098) 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 -- 172.21.15.55:0/1707672691 learned_addr learned my addr 172.21.15.55:0/1707672691 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:39.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b137fe700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b141598a0 0x7f2b14148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b127fc700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b141594d0 0x7f2b1414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 -- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b141598a0 msgr2=0x7f2b14148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b141598a0 0x7f2b14148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 -- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b141594d0 msgr2=0x7f2b1414db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b141594d0 0x7f2b1414db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 -- 172.21.15.55:0/1707672691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009420 con 0x7f2b140cbc70 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b12ffd700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 0x7f2b1414cb60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400cd80 tx=0x7f2b04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400ab10 con 0x7f2b140cbc70 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400ac70 con 0x7f2b140cbc70 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1414e2f0 con 0x7f2b140cbc70 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.276+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b040070f0 con 0x7f2b140cbc70 2023-10-06T11:15:39.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.277+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1414e8b0 con 0x7f2b140cbc70 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.277+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b14064a90 con 0x7f2b140cbc70 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.278+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b040074a0 con 0x7f2b140cbc70 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.278+0000 7f2b0affd700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2af4066f30 0x7f2af40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.278+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2b04084cf0 con 0x7f2b140cbc70 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.278+0000 7f2b127fc700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2af4066f30 0x7f2af40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.279+0000 7f2b127fc700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2af4066f30 0x7f2af40693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0098e0 tx=0x7f2afc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.283+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b04089070 con 0x7f2b140cbc70 2023-10-06T11:15:39.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:39.523+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2b140cf260 con 0x7f2b140cbc70 2023-10-06T11:15:40.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.124+0000 7f2b0affd700 1 -- 172.21.15.55:0/1707672691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2b04051d40 con 0x7f2b140cbc70 2023-10-06T11:15:40.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2af4066f30 msgr2=0x7f2af40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2af4066f30 0x7f2af40693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0098e0 tx=0x7f2afc017000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 msgr2=0x7f2b1414cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 0x7f2b1414cb60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400cd80 tx=0x7f2b04001ae0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 shutdown_connections 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2af4066f30 0x7f2af40693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b140cbc70 0x7f2b1414cb60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b141598a0 0x7f2b14148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 --2- 172.21.15.55:0/1707672691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b141594d0 0x7f2b1414db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 >> 172.21.15.55:0/1707672691 conn(0x7f2b14089e50 msgr2=0x7f2b140c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 shutdown_connections 2023-10-06T11:15:40.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.127+0000 7f2b19341700 1 -- 172.21.15.55:0/1707672691 wait complete. 2023-10-06T11:15:40.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:40.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.268+0000 7f5b659c5700 1 Processor -- start 2023-10-06T11:15:40.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.268+0000 7f5b659c5700 1 -- start start 2023-10-06T11:15:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b659c5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b60159560 0x7f5b600aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b659c5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b600b49a0 0x7f5b600aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b659c5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600b0c60 con 0x7f5b600b0760 2023-10-06T11:15:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b659c5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600b0f40 con 0x7f5b600b49a0 2023-10-06T11:15:40.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b659c5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600b1220 con 0x7f5b60159560 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b5e7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b600b49a0 0x7f5b600aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b5e7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b600b49a0 0x7f5b600aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35100/0 (socket says 172.21.15.55:35100) 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.269+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3838385854 learned_addr learned my addr 172.21.15.55:0/3838385854 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5effd700 1 --2- 172.21.15.55:0/3838385854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b60159560 0x7f5b600aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3838385854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b60159560 msgr2=0x7f5b600aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5e7fc700 1 --2- 172.21.15.55:0/3838385854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b60159560 0x7f5b600aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3838385854 >> v1:172.21.15.142:6789/0 conn(0x7f5b600b0760 legacy=0x7f5b600b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3838385854 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600b1500 con 0x7f5b600b49a0 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5e7fc700 1 --2- 172.21.15.55:0/3838385854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b600aaa70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5b480099b0 tx=0x7f5b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892f2ed9cc9f2fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5dffb700 1 -- 172.21.15.55:0/3838385854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800b860 con 0x7f5b600b49a0 2023-10-06T11:15:40.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5dffb700 1 -- 172.21.15.55:0/3838385854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800b9c0 con 0x7f5b600b49a0 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b5dffb700 1 -- 172.21.15.55:0/3838385854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800bd60 con 0x7f5b600b49a0 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b659c5700 1 -- 172.21.15.55:0/3838385854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 msgr2=0x7f5b600aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3838385854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b600aaa70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5b480099b0 tx=0x7f5b48009250 comp rx=0 tx=0).stop 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.270+0000 7f5b659c5700 1 -- 172.21.15.55:0/3838385854 shutdown_connections 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.271+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3838385854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b60159560 0x7f5b600aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.271+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3838385854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b600aaa70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.271+0000 7f5b659c5700 1 -- 172.21.15.55:0/3838385854 >> 172.21.15.55:0/3838385854 conn(0x7f5b600997f0 msgr2=0x7f5b6006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.271+0000 7f5b659c5700 1 -- 172.21.15.55:0/3838385854 shutdown_connections 2023-10-06T11:15:40.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.271+0000 7f5b659c5700 1 -- 172.21.15.55:0/3838385854 wait complete. 2023-10-06T11:15:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.272+0000 7f5b659c5700 1 Processor -- start 2023-10-06T11:15:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.272+0000 7f5b659c5700 1 -- start start 2023-10-06T11:15:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b600b0760 0x7f5b6014b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b6014ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b60159560 0x7f5b600c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c8320 con 0x7f5b600b49a0 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c7710 con 0x7f5b60159560 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c79f0 con 0x7f5b600b0760 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b6014ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b6014ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35114/0 (socket says 172.21.15.55:35114) 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3455020353 learned_addr learned my addr 172.21.15.55:0/3455020353 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5f7fe700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b60159560 0x7f5b600c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5effd700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b600b0760 0x7f5b6014b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b600b0760 msgr2=0x7f5b6014b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b600b0760 0x7f5b6014b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b60159560 msgr2=0x7f5b600c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b60159560 0x7f5b600c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 -- 172.21.15.55:0/3455020353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480094f0 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5f7fe700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b60159560 0x7f5b600c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b5e7fc700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b6014ac00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5b60067c20 tx=0x7f5b48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48024440 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b480245c0 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b600c7cd0 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48024980 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.273+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6014b140 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.274+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b60064a90 con 0x7f5b600b49a0 2023-10-06T11:15:40.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.275+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b4801a420 con 0x7f5b600b49a0 2023-10-06T11:15:40.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.275+0000 7f5b56ffd700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b40066f30 0x7f5b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.275+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5b48086630 con 0x7f5b600b49a0 2023-10-06T11:15:40.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.275+0000 7f5b5effd700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b40066f30 0x7f5b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.276+0000 7f5b5effd700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b40066f30 0x7f5b400693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006520 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.279+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b48053600 con 0x7f5b600b49a0 2023-10-06T11:15:40.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.517+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b600c8460 con 0x7f5b600b49a0 2023-10-06T11:15:40.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.517+0000 7f5b56ffd700 1 -- 172.21.15.55:0/3455020353 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f5b48056c20 con 0x7f5b600b49a0 2023-10-06T11:15:40.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:40.519 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:40.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b40066f30 msgr2=0x7f5b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b40066f30 0x7f5b400693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006520 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 msgr2=0x7f5b6014ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b6014ac00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5b60067c20 tx=0x7f5b48017000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 shutdown_connections 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b40066f30 0x7f5b400693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b60159560 0x7f5b600c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b600b0760 0x7f5b6014b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 --2- 172.21.15.55:0/3455020353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b600b49a0 0x7f5b6014ac00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 >> 172.21.15.55:0/3455020353 conn(0x7f5b600997f0 msgr2=0x7f5b600cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 shutdown_connections 2023-10-06T11:15:40.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.520+0000 7f5b659c5700 1 -- 172.21.15.55:0/3455020353 wait complete. 2023-10-06T11:15:40.523 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:40.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.650+0000 7f240913d700 1 Processor -- start 2023-10-06T11:15:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.650+0000 7f240913d700 1 -- start start 2023-10-06T11:15:40.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240913d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040ca370 0x7f2404158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240913d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f24040adb60 0x7f24040ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240913d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24040ce6d0 0x7f240415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240913d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040cbb90 con 0x7f24040ce6d0 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240913d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2404157de0 con 0x7f24040adb60 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240913d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040ceaf0 con 0x7f24040ca370 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24040ce6d0 0x7f240415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24040ce6d0 0x7f240415aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35126/0 (socket says 172.21.15.55:35126) 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.651+0000 7f240359e700 1 -- 172.21.15.55:0/360966409 learned_addr learned my addr 172.21.15.55:0/360966409 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240359e700 1 -- 172.21.15.55:0/360966409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040ca370 msgr2=0x7f2404158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240359e700 1 --2- 172.21.15.55:0/360966409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040ca370 0x7f2404158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240359e700 1 -- 172.21.15.55:0/360966409 >> v2:172.21.15.142:3300/0 conn(0x7f24040adb60 msgr2=0x7f24040ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240359e700 1 --2- 172.21.15.55:0/360966409 >> v2:172.21.15.142:3300/0 conn(0x7f24040adb60 0x7f24040ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240359e700 1 -- 172.21.15.55:0/360966409 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040cb5d0 con 0x7f24040ce6d0 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240359e700 1 --2- 172.21.15.55:0/360966409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ce6d0 0x7f240415aed0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f240406f220 tx=0x7f23f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8980a31095fc76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f2401d9b700 1 -- 172.21.15.55:0/360966409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400b860 con 0x7f24040ce6d0 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f2401d9b700 1 -- 172.21.15.55:0/360966409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400b9c0 con 0x7f24040ce6d0 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f2401d9b700 1 -- 172.21.15.55:0/360966409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400bd60 con 0x7f24040ce6d0 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 -- 172.21.15.55:0/360966409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ce6d0 msgr2=0x7f240415aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 --2- 172.21.15.55:0/360966409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ce6d0 0x7f240415aed0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f240406f220 tx=0x7f23f4009250 comp rx=0 tx=0).stop 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 -- 172.21.15.55:0/360966409 shutdown_connections 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 --2- 172.21.15.55:0/360966409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ce6d0 0x7f240415aed0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 --2- 172.21.15.55:0/360966409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040ca370 0x7f2404158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 --2- 172.21.15.55:0/360966409 >> v2:172.21.15.142:3300/0 conn(0x7f24040adb60 0x7f24040ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 -- 172.21.15.55:0/360966409 >> 172.21.15.55:0/360966409 conn(0x7f24040707d0 msgr2=0x7f2404070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 -- 172.21.15.55:0/360966409 shutdown_connections 2023-10-06T11:15:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.652+0000 7f240913d700 1 -- 172.21.15.55:0/360966409 wait complete. 2023-10-06T11:15:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 Processor -- start 2023-10-06T11:15:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 -- start start 2023-10-06T11:15:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040adb60 0x7f24041499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 0x7f24040b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24040ce6d0 0x7f24040c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404152020 con 0x7f24040ca370 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404149f00 con 0x7f24040ce6d0 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.654+0000 7f240913d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040b31b0 con 0x7f24040adb60 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 0x7f24040b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 0x7f24040b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35132/0 (socket says 172.21.15.55:35132) 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 -- 172.21.15.55:0/416287135 learned_addr learned my addr 172.21.15.55:0/416287135 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240359e700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24040ce6d0 0x7f24040c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f2402d9d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040adb60 0x7f24041499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 -- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040adb60 msgr2=0x7f24041499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040adb60 0x7f24041499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 -- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24040ce6d0 msgr2=0x7f24040c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24040ce6d0 0x7f24040c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 -- 172.21.15.55:0/416287135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40094f0 con 0x7f24040ca370 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240259c700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 0x7f24040b1e30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00b810 tx=0x7f23ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00f570 con 0x7f24040ca370 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec00f6d0 con 0x7f24040ca370 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24040b2910 con 0x7f24040ca370 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00fa90 con 0x7f24040ca370 2023-10-06T11:15:40.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.655+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24040b2ed0 con 0x7f24040ca370 2023-10-06T11:15:40.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.656+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2404152190 con 0x7f24040ca370 2023-10-06T11:15:40.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.657+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23ec01a460 con 0x7f24040ca370 2023-10-06T11:15:40.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.657+0000 7f23faffd700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f23e4066f30 0x7f23e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.657+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f23ec084550 con 0x7f24040ca370 2023-10-06T11:15:40.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.657+0000 7f2402d9d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f23e4066f30 0x7f23e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.658+0000 7f2402d9d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f23e4066f30 0x7f23e40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f23fc001250 tx=0x7f23fc009620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.661+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23ec051500 con 0x7f24040ca370 2023-10-06T11:15:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.856+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2404064a90 con 0x7f24040ca370 2023-10-06T11:15:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.857+0000 7f23faffd700 1 -- 172.21.15.55:0/416287135 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f23ec054b20 con 0x7f24040ca370 2023-10-06T11:15:40.859 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:40.859 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:38.035759+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:34.232138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:35.489479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:40.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f23e4066f30 msgr2=0x7f23e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f23e4066f30 0x7f23e40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f23fc001250 tx=0x7f23fc009620 comp rx=0 tx=0).stop 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 msgr2=0x7f24040b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 0x7f24040b1e30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00b810 tx=0x7f23ec0091d0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 shutdown_connections 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f23e4066f30 0x7f23e40693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24040ce6d0 0x7f24040c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24040adb60 0x7f24041499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 --2- 172.21.15.55:0/416287135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24040ca370 0x7f24040b1e30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 >> 172.21.15.55:0/416287135 conn(0x7f24040707d0 msgr2=0x7f24040b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 shutdown_connections 2023-10-06T11:15:40.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.859+0000 7f240913d700 1 -- 172.21.15.55:0/416287135 wait complete. 2023-10-06T11:15:40.873 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:15:40.873 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.990+0000 7f70dd32b700 1 Processor -- start 2023-10-06T11:15:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.990+0000 7f70dd32b700 1 -- start start 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70dd32b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 0x7f70d80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70dd32b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80cb7a0 con 0x7f70d80b2100 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70dd32b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80b0860 con 0x7f70d80b35d0 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70dd32b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80cb150 con 0x7f70d8159440 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70dcb2a700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f70d80b2100 0x7f70d80b2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58954/0 (socket says 172.21.15.55:58954) 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70dcb2a700 1 -- 172.21.15.55:0/1031305376 learned_addr learned my addr 172.21.15.55:0/1031305376 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d7fff700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 0x7f70d80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287578930 0 0) 0x7f70d80cb7a0 con 0x7f70d80b2100 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c4003570 con 0x7f70d80b2100 2023-10-06T11:15:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709680569 0 0) 0x7f70d80b0860 con 0x7f70d80b35d0 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d80cb7a0 con 0x7f70d80b35d0 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762879896 0 0) 0x7f70c4003570 con 0x7f70d80b2100 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 msgr2=0x7f70d80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 0x7f70d80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 >> v1:172.21.15.142:6789/0 conn(0x7f70d80b35d0 legacy=0x7f70d80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.991+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80cb430 con 0x7f70d80b2100 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f70d00017f0 con 0x7f70d80b2100 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 >> v1:172.21.15.55:6789/0 conn(0x7f70d80b2100 legacy=0x7f70d80b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70c4003c20 0x7f70c4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4004810 0x7f70c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 0x7f70c4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80cb150 con 0x7f70c4003c20 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c400bbf0 con 0x7f70c4004810 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c400bdb0 con 0x7f70d8159440 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70c4003c20 0x7f70c4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d77fe700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4004810 0x7f70c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70dcb2a700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 0x7f70c4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 -- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 msgr2=0x7f70c4005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8159440 0x7f70c4005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 -- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4004810 msgr2=0x7f70c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4004810 0x7f70c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 -- 172.21.15.55:0/1031305376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4003570 con 0x7f70c4003c20 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d77fe700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4004810 0x7f70c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d7fff700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70c4003c20 0x7f70c4004010 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f70c0006f00 tx=0x7f70c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bf0fe1505d6e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000e710 con 0x7f70c4003c20 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000e870 con 0x7f70c4003c20 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.992+0000 7f70d6ffd700 1 -- 172.21.15.55:0/1031305376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000ec30 con 0x7f70c4003c20 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dd32b700 1 -- 172.21.15.55:0/1031305376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70c4003c20 msgr2=0x7f70c4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dd32b700 1 --2- 172.21.15.55:0/1031305376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70c4003c20 0x7f70c4004010 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f70c0006f00 tx=0x7f70c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dcb2a700 1 -- 172.21.15.55:0/1031305376 reap_dead start 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dd32b700 1 -- 172.21.15.55:0/1031305376 shutdown_connections 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dd32b700 1 -- 172.21.15.55:0/1031305376 >> 172.21.15.55:0/1031305376 conn(0x7f70d806ece0 msgr2=0x7f70d806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dd32b700 1 -- 172.21.15.55:0/1031305376 shutdown_connections 2023-10-06T11:15:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.993+0000 7f70dd32b700 1 -- 172.21.15.55:0/1031305376 wait complete. 2023-10-06T11:15:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.994+0000 7f70dd32b700 1 Processor -- start 2023-10-06T11:15:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.994+0000 7f70dd32b700 1 -- start start 2023-10-06T11:15:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4003c20 0x7f70d80c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 0x7f70d81542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8155690 0x7f70d8155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8156070 con 0x7f70d80c6980 2023-10-06T11:15:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d816d300 con 0x7f70c4003c20 2023-10-06T11:15:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d816d5e0 con 0x7f70d8155690 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 0x7f70d81542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 0x7f70d81542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35158/0 (socket says 172.21.15.55:35158) 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 -- 172.21.15.55:0/816726602 learned_addr learned my addr 172.21.15.55:0/816726602 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d7fff700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4003c20 0x7f70d80c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dcb2a700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8155690 0x7f70d8155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 -- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8155690 msgr2=0x7f70d8155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8155690 0x7f70d8155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 -- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4003c20 msgr2=0x7f70d80c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4003c20 0x7f70d80c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 -- 172.21.15.55:0/816726602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d816d8c0 con 0x7f70d80c6980 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dcb2a700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8155690 0x7f70d8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70d77fe700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 0x7f70d81542e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f70c8007fd0 tx=0x7f70c8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8012590 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c80126f0 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.995+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d816dba0 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.996+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8012a90 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.996+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d8154cd0 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.996+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8068f00 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.997+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70c801d460 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.997+0000 7f70cffff700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f70b8066f30 0x7f70b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.997+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f70c8084bd0 con 0x7f70d80c6980 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.998+0000 7f70d7fff700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f70b8066f30 0x7f70b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:40.998+0000 7f70d7fff700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f70b8066f30 0x7f70b80693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f70c00091e0 tx=0x7f70c001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.002+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70c8051b00 con 0x7f70d80c6980 2023-10-06T11:15:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.191+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70d805f230 con 0x7f70b8066f30 2023-10-06T11:15:41.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.200+0000 7f70cffff700 1 -- 172.21.15.55:0/816726602 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311110 (secure 0 0 0) 0x7f70d805f230 con 0x7f70b8066f30 2023-10-06T11:15:41.205 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f70b8066f30 msgr2=0x7f70b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f70b8066f30 0x7f70b80693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f70c00091e0 tx=0x7f70c001a000 comp rx=0 tx=0).stop 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 msgr2=0x7f70d81542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 0x7f70d81542e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f70c8007fd0 tx=0x7f70c8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 shutdown_connections 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f70b8066f30 0x7f70b80693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70d8155690 0x7f70d8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c4003c20 0x7f70d80c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 --2- 172.21.15.55:0/816726602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d80c6980 0x7f70d81542e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.203+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 >> 172.21.15.55:0/816726602 conn(0x7f70d806ece0 msgr2=0x7f70d8158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.204+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 shutdown_connections 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.204+0000 7f70dd32b700 1 -- 172.21.15.55:0/816726602 wait complete. 2023-10-06T11:15:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:15:41.217 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-10-06T11:15:40.875967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387080,"kb_used_data":8776,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752587640,"statfs":{"total":773094113280,"available":770649743360,"internally_reserved":0,"allocated":8986624,"data_stored":4802036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.780567"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060753+0000","last_change":"2023-10-06T11:15:37.054744+0000","last_active":"2023-10-06T11:15:37.060753+0000","last_peered":"2023-10-06T11:15:37.060753+0000","last_clean":"2023-10-06T11:15:37.060753+0000","last_became_active":"2023-10-06T11:15:37.054504+0000","last_became_peered":"2023-10-06T11:15:37.054504+0000","last_unstale":"2023-10-06T11:15:37.060753+0000","last_undegraded":"2023-10-06T11:15:37.060753+0000","last_fullsized":"2023-10-06T11:15:37.060753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:59.167930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063084+0000","last_change":"2023-10-06T11:15:37.058147+0000","last_active":"2023-10-06T11:15:37.063084+0000","last_peered":"2023-10-06T11:15:37.063084+0000","last_clean":"2023-10-06T11:15:37.063084+0000","last_became_active":"2023-10-06T11:15:37.057826+0000","last_became_peered":"2023-10-06T11:15:37.057826+0000","last_unstale":"2023-10-06T11:15:37.063084+0000","last_undegraded":"2023-10-06T11:15:37.063084+0000","last_fullsized":"2023-10-06T11:15:37.063084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:00.114991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062385+0000","last_change":"2023-10-06T11:15:37.058358+0000","last_active":"2023-10-06T11:15:37.062385+0000","last_peered":"2023-10-06T11:15:37.062385+0000","last_clean":"2023-10-06T11:15:37.062385+0000","last_became_active":"2023-10-06T11:15:37.058079+0000","last_became_peered":"2023-10-06T11:15:37.058079+0000","last_unstale":"2023-10-06T11:15:37.062385+0000","last_undegraded":"2023-10-06T11:15:37.062385+0000","last_fullsized":"2023-10-06T11:15:37.062385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:30.319797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062597+0000","last_change":"2023-10-06T11:15:37.053652+0000","last_active":"2023-10-06T11:15:37.062597+0000","last_peered":"2023-10-06T11:15:37.062597+0000","last_clean":"2023-10-06T11:15:37.062597+0000","last_became_active":"2023-10-06T11:15:37.053195+0000","last_became_peered":"2023-10-06T11:15:37.053195+0000","last_unstale":"2023-10-06T11:15:37.062597+0000","last_undegraded":"2023-10-06T11:15:37.062597+0000","last_fullsized":"2023-10-06T11:15:37.062597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:24:57.479042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062111+0000","last_change":"2023-10-06T11:15:37.058797+0000","last_active":"2023-10-06T11:15:37.062111+0000","last_peered":"2023-10-06T11:15:37.062111+0000","last_clean":"2023-10-06T11:15:37.062111+0000","last_became_active":"2023-10-06T11:15:37.058409+0000","last_became_peered":"2023-10-06T11:15:37.058409+0000","last_unstale":"2023-10-06T11:15:37.062111+0000","last_undegraded":"2023-10-06T11:15:37.062111+0000","last_fullsized":"2023-10-06T11:15:37.062111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:27.729934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060521+0000","last_change":"2023-10-06T11:15:37.055356+0000","last_active":"2023-10-06T11:15:37.060521+0000","last_peered":"2023-10-06T11:15:37.060521+0000","last_clean":"2023-10-06T11:15:37.060521+0000","last_became_active":"2023-10-06T11:15:37.054916+0000","last_became_peered":"2023-10-06T11:15:37.054916+0000","last_unstale":"2023-10-06T11:15:37.060521+0000","last_undegraded":"2023-10-06T11:15:37.060521+0000","last_fullsized":"2023-10-06T11:15:37.060521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.728342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062617+0000","last_change":"2023-10-06T11:15:37.052464+0000","last_active":"2023-10-06T11:15:37.062617+0000","last_peered":"2023-10-06T11:15:37.062617+0000","last_clean":"2023-10-06T11:15:37.062617+0000","last_became_active":"2023-10-06T11:15:37.052192+0000","last_became_peered":"2023-10-06T11:15:37.052192+0000","last_unstale":"2023-10-06T11:15:37.062617+0000","last_undegraded":"2023-10-06T11:15:37.062617+0000","last_fullsized":"2023-10-06T11:15:37.062617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:37.711281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060570+0000","last_change":"2023-10-06T11:15:37.058137+0000","last_active":"2023-10-06T11:15:37.060570+0000","last_peered":"2023-10-06T11:15:37.060570+0000","last_clean":"2023-10-06T11:15:37.060570+0000","last_became_active":"2023-10-06T11:15:37.057841+0000","last_became_peered":"2023-10-06T11:15:37.057841+0000","last_unstale":"2023-10-06T11:15:37.060570+0000","last_undegraded":"2023-10-06T11:15:37.060570+0000","last_fullsized":"2023-10-06T11:15:37.060570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:28.275662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060600+0000","last_change":"2023-10-06T11:15:37.058431+0000","last_active":"2023-10-06T11:15:37.060600+0000","last_peered":"2023-10-06T11:15:37.060600+0000","last_clean":"2023-10-06T11:15:37.060600+0000","last_became_active":"2023-10-06T11:15:37.058171+0000","last_became_peered":"2023-10-06T11:15:37.058171+0000","last_unstale":"2023-10-06T11:15:37.060600+0000","last_undegraded":"2023-10-06T11:15:37.060600+0000","last_fullsized":"2023-10-06T11:15:37.060600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:49.916891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060672+0000","last_change":"2023-10-06T11:15:37.053480+0000","last_active":"2023-10-06T11:15:37.060672+0000","last_peered":"2023-10-06T11:15:37.060672+0000","last_clean":"2023-10-06T11:15:37.060672+0000","last_became_active":"2023-10-06T11:15:37.053201+0000","last_became_peered":"2023-10-06T11:15:37.053201+0000","last_unstale":"2023-10-06T11:15:37.060672+0000","last_undegraded":"2023-10-06T11:15:37.060672+0000","last_fullsized":"2023-10-06T11:15:37.060672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:22:07.407403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062846+0000","last_change":"2023-10-06T11:15:37.057438+0000","last_active":"2023-10-06T11:15:37.062846+0000","last_peered":"2023-10-06T11:15:37.062846+0000","last_clean":"2023-10-06T11:15:37.062846+0000","last_became_active":"2023-10-06T11:15:37.057178+0000","last_became_peered":"2023-10-06T11:15:37.057178+0000","last_unstale":"2023-10-06T11:15:37.062846+0000","last_undegraded":"2023-10-06T11:15:37.062846+0000","last_fullsized":"2023-10-06T11:15:37.062846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:18.881104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060733+0000","last_change":"2023-10-06T11:15:37.054132+0000","last_active":"2023-10-06T11:15:37.060733+0000","last_peered":"2023-10-06T11:15:37.060733+0000","last_clean":"2023-10-06T11:15:37.060733+0000","last_became_active":"2023-10-06T11:15:37.053871+0000","last_became_peered":"2023-10-06T11:15:37.053871+0000","last_unstale":"2023-10-06T11:15:37.060733+0000","last_undegraded":"2023-10-06T11:15:37.060733+0000","last_fullsized":"2023-10-06T11:15:37.060733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:54.076601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062291+0000","last_change":"2023-10-06T11:15:37.055506+0000","last_active":"2023-10-06T11:15:37.062291+0000","last_peered":"2023-10-06T11:15:37.062291+0000","last_clean":"2023-10-06T11:15:37.062291+0000","last_became_active":"2023-10-06T11:15:37.055236+0000","last_became_peered":"2023-10-06T11:15:37.055236+0000","last_unstale":"2023-10-06T11:15:37.062291+0000","last_undegraded":"2023-10-06T11:15:37.062291+0000","last_fullsized":"2023-10-06T11:15:37.062291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:54.076601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062862+0000","last_change":"2023-10-06T11:15:37.059150+0000","last_active":"2023-10-06T11:15:37.062862+0000","last_peered":"2023-10-06T11:15:37.062862+0000","last_clean":"2023-10-06T11:15:37.062862+0000","last_became_active":"2023-10-06T11:15:37.058873+0000","last_became_peered":"2023-10-06T11:15:37.058873+0000","last_unstale":"2023-10-06T11:15:37.062862+0000","last_undegraded":"2023-10-06T11:15:37.062862+0000","last_fullsized":"2023-10-06T11:15:37.062862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:27:13.174125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062557+0000","last_change":"2023-10-06T11:15:37.053934+0000","last_active":"2023-10-06T11:15:37.062557+0000","last_peered":"2023-10-06T11:15:37.062557+0000","last_clean":"2023-10-06T11:15:37.062557+0000","last_became_active":"2023-10-06T11:15:37.053615+0000","last_became_peered":"2023-10-06T11:15:37.053615+0000","last_unstale":"2023-10-06T11:15:37.062557+0000","last_undegraded":"2023-10-06T11:15:37.062557+0000","last_fullsized":"2023-10-06T11:15:37.062557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:56.884452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054140+0000","last_change":"2023-10-06T11:15:37.050163+0000","last_active":"2023-10-06T11:15:37.054140+0000","last_peered":"2023-10-06T11:15:37.054140+0000","last_clean":"2023-10-06T11:15:37.054140+0000","last_became_active":"2023-10-06T11:15:37.049902+0000","last_became_peered":"2023-10-06T11:15:37.049902+0000","last_unstale":"2023-10-06T11:15:37.054140+0000","last_undegraded":"2023-10-06T11:15:37.054140+0000","last_fullsized":"2023-10-06T11:15:37.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:06.218538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.048100+0000","last_change":"2023-10-06T11:15:37.045043+0000","last_active":"2023-10-06T11:15:37.048100+0000","last_peered":"2023-10-06T11:15:37.048100+0000","last_clean":"2023-10-06T11:15:37.048100+0000","last_became_active":"2023-10-06T11:15:37.044709+0000","last_became_peered":"2023-10-06T11:15:37.044709+0000","last_unstale":"2023-10-06T11:15:37.048100+0000","last_undegraded":"2023-10-06T11:15:37.048100+0000","last_fullsized":"2023-10-06T11:15:37.048100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:45.266361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062483+0000","last_change":"2023-10-06T11:15:37.051612+0000","last_active":"2023-10-06T11:15:37.062483+0000","last_peered":"2023-10-06T11:15:37.062483+0000","last_clean":"2023-10-06T11:15:37.062483+0000","last_became_active":"2023-10-06T11:15:37.051318+0000","last_became_peered":"2023-10-06T11:15:37.051318+0000","last_unstale":"2023-10-06T11:15:37.062483+0000","last_undegraded":"2023-10-06T11:15:37.062483+0000","last_fullsized":"2023-10-06T11:15:37.062483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:06.987074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062318+0000","last_change":"2023-10-06T11:15:37.054222+0000","last_active":"2023-10-06T11:15:37.062318+0000","last_peered":"2023-10-06T11:15:37.062318+0000","last_clean":"2023-10-06T11:15:37.062318+0000","last_became_active":"2023-10-06T11:15:37.053942+0000","last_became_peered":"2023-10-06T11:15:37.053942+0000","last_unstale":"2023-10-06T11:15:37.062318+0000","last_undegraded":"2023-10-06T11:15:37.062318+0000","last_fullsized":"2023-10-06T11:15:37.062318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:54.898509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.052853+0000","last_change":"2023-10-06T11:15:37.048801+0000","last_active":"2023-10-06T11:15:37.052853+0000","last_peered":"2023-10-06T11:15:37.052853+0000","last_clean":"2023-10-06T11:15:37.052853+0000","last_became_active":"2023-10-06T11:15:37.048482+0000","last_became_peered":"2023-10-06T11:15:37.048482+0000","last_unstale":"2023-10-06T11:15:37.052853+0000","last_undegraded":"2023-10-06T11:15:37.052853+0000","last_fullsized":"2023-10-06T11:15:37.052853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:34.291245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.052887+0000","last_change":"2023-10-06T11:15:37.047183+0000","last_active":"2023-10-06T11:15:37.052887+0000","last_peered":"2023-10-06T11:15:37.052887+0000","last_clean":"2023-10-06T11:15:37.052887+0000","last_became_active":"2023-10-06T11:15:37.046914+0000","last_became_peered":"2023-10-06T11:15:37.046914+0000","last_unstale":"2023-10-06T11:15:37.052887+0000","last_undegraded":"2023-10-06T11:15:37.052887+0000","last_fullsized":"2023-10-06T11:15:37.052887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:30.904840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063168+0000","last_change":"2023-10-06T11:15:37.060059+0000","last_active":"2023-10-06T11:15:37.063168+0000","last_peered":"2023-10-06T11:15:37.063168+0000","last_clean":"2023-10-06T11:15:37.063168+0000","last_became_active":"2023-10-06T11:15:37.058725+0000","last_became_peered":"2023-10-06T11:15:37.058725+0000","last_unstale":"2023-10-06T11:15:37.063168+0000","last_undegraded":"2023-10-06T11:15:37.063168+0000","last_fullsized":"2023-10-06T11:15:37.063168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:11.728543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057372+0000","last_change":"2023-10-06T11:15:37.048221+0000","last_active":"2023-10-06T11:15:37.057372+0000","last_peered":"2023-10-06T11:15:37.057372+0000","last_clean":"2023-10-06T11:15:37.057372+0000","last_became_active":"2023-10-06T11:15:37.047976+0000","last_became_peered":"2023-10-06T11:15:37.047976+0000","last_unstale":"2023-10-06T11:15:37.057372+0000","last_undegraded":"2023-10-06T11:15:37.057372+0000","last_fullsized":"2023-10-06T11:15:37.057372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.728342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.051972+0000","last_change":"2023-10-06T11:15:37.048380+0000","last_active":"2023-10-06T11:15:37.051972+0000","last_peered":"2023-10-06T11:15:37.051972+0000","last_clean":"2023-10-06T11:15:37.051972+0000","last_became_active":"2023-10-06T11:15:37.047240+0000","last_became_peered":"2023-10-06T11:15:37.047240+0000","last_unstale":"2023-10-06T11:15:37.051972+0000","last_undegraded":"2023-10-06T11:15:37.051972+0000","last_fullsized":"2023-10-06T11:15:37.051972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:53.844125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062447+0000","last_change":"2023-10-06T11:15:37.055002+0000","last_active":"2023-10-06T11:15:37.062447+0000","last_peered":"2023-10-06T11:15:37.062447+0000","last_clean":"2023-10-06T11:15:37.062447+0000","last_became_active":"2023-10-06T11:15:37.054732+0000","last_became_peered":"2023-10-06T11:15:37.054732+0000","last_unstale":"2023-10-06T11:15:37.062447+0000","last_undegraded":"2023-10-06T11:15:37.062447+0000","last_fullsized":"2023-10-06T11:15:37.062447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:54.021893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.064925+0000","last_change":"2023-10-06T11:15:37.063257+0000","last_active":"2023-10-06T11:15:37.064925+0000","last_peered":"2023-10-06T11:15:37.064925+0000","last_clean":"2023-10-06T11:15:37.064925+0000","last_became_active":"2023-10-06T11:15:37.062909+0000","last_became_peered":"2023-10-06T11:15:37.062909+0000","last_unstale":"2023-10-06T11:15:37.064925+0000","last_undegraded":"2023-10-06T11:15:37.064925+0000","last_fullsized":"2023-10-06T11:15:37.064925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:28.275662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054655+0000","last_change":"2023-10-06T11:15:37.050829+0000","last_active":"2023-10-06T11:15:37.054655+0000","last_peered":"2023-10-06T11:15:37.054655+0000","last_clean":"2023-10-06T11:15:37.054655+0000","last_became_active":"2023-10-06T11:15:37.050583+0000","last_became_peered":"2023-10-06T11:15:37.050583+0000","last_unstale":"2023-10-06T11:15:37.054655+0000","last_undegraded":"2023-10-06T11:15:37.054655+0000","last_fullsized":"2023-10-06T11:15:37.054655+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:35:35.939421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060755+0000","last_change":"2023-10-06T11:15:37.054211+0000","last_active":"2023-10-06T11:15:37.060755+0000","last_peered":"2023-10-06T11:15:37.060755+0000","last_clean":"2023-10-06T11:15:37.060755+0000","last_became_active":"2023-10-06T11:15:37.053911+0000","last_became_peered":"2023-10-06T11:15:37.053911+0000","last_unstale":"2023-10-06T11:15:37.060755+0000","last_undegraded":"2023-10-06T11:15:37.060755+0000","last_fullsized":"2023-10-06T11:15:37.060755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:50.053456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062874+0000","last_change":"2023-10-06T11:15:37.057595+0000","last_active":"2023-10-06T11:15:37.062874+0000","last_peered":"2023-10-06T11:15:37.062874+0000","last_clean":"2023-10-06T11:15:37.062874+0000","last_became_active":"2023-10-06T11:15:37.057309+0000","last_became_peered":"2023-10-06T11:15:37.057309+0000","last_unstale":"2023-10-06T11:15:37.062874+0000","last_undegraded":"2023-10-06T11:15:37.062874+0000","last_fullsized":"2023-10-06T11:15:37.062874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:25.736590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062342+0000","last_change":"2023-10-06T11:15:37.053735+0000","last_active":"2023-10-06T11:15:37.062342+0000","last_peered":"2023-10-06T11:15:37.062342+0000","last_clean":"2023-10-06T11:15:37.062342+0000","last_became_active":"2023-10-06T11:15:37.053423+0000","last_became_peered":"2023-10-06T11:15:37.053423+0000","last_unstale":"2023-10-06T11:15:37.062342+0000","last_undegraded":"2023-10-06T11:15:37.062342+0000","last_fullsized":"2023-10-06T11:15:37.062342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:35.525397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054327+0000","last_change":"2023-10-06T11:15:37.049415+0000","last_active":"2023-10-06T11:15:37.054327+0000","last_peered":"2023-10-06T11:15:37.054327+0000","last_clean":"2023-10-06T11:15:37.054327+0000","last_became_active":"2023-10-06T11:15:37.049092+0000","last_became_peered":"2023-10-06T11:15:37.049092+0000","last_unstale":"2023-10-06T11:15:37.054327+0000","last_undegraded":"2023-10-06T11:15:37.054327+0000","last_fullsized":"2023-10-06T11:15:37.054327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:54.898509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.064902+0000","last_change":"2023-10-06T11:15:37.063150+0000","last_active":"2023-10-06T11:15:37.064902+0000","last_peered":"2023-10-06T11:15:37.064902+0000","last_clean":"2023-10-06T11:15:37.064902+0000","last_became_active":"2023-10-06T11:15:37.062907+0000","last_became_peered":"2023-10-06T11:15:37.062907+0000","last_unstale":"2023-10-06T11:15:37.064902+0000","last_undegraded":"2023-10-06T11:15:37.064902+0000","last_fullsized":"2023-10-06T11:15:37.064902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:27.132776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.056643+0000","last_change":"2023-10-06T11:15:37.055364+0000","last_active":"2023-10-06T11:15:37.056643+0000","last_peered":"2023-10-06T11:15:37.056643+0000","last_clean":"2023-10-06T11:15:37.056643+0000","last_became_active":"2023-10-06T11:15:37.055113+0000","last_became_peered":"2023-10-06T11:15:37.055113+0000","last_unstale":"2023-10-06T11:15:37.056643+0000","last_undegraded":"2023-10-06T11:15:37.056643+0000","last_fullsized":"2023-10-06T11:15:37.056643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:21.980770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120167+0000","last_change":"2023-10-06T11:15:36.137806+0000","last_active":"2023-10-06T11:15:37.120167+0000","last_peered":"2023-10-06T11:15:37.120167+0000","last_clean":"2023-10-06T11:15:37.120167+0000","last_became_active":"2023-10-06T11:15:36.137582+0000","last_became_peered":"2023-10-06T11:15:36.137582+0000","last_unstale":"2023-10-06T11:15:37.120167+0000","last_undegraded":"2023-10-06T11:15:37.120167+0000","last_fullsized":"2023-10-06T11:15:37.120167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:51.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060488+0000","last_change":"2023-10-06T11:15:37.053295+0000","last_active":"2023-10-06T11:15:37.060488+0000","last_peered":"2023-10-06T11:15:37.060488+0000","last_clean":"2023-10-06T11:15:37.060488+0000","last_became_active":"2023-10-06T11:15:37.052847+0000","last_became_peered":"2023-10-06T11:15:37.052847+0000","last_unstale":"2023-10-06T11:15:37.060488+0000","last_undegraded":"2023-10-06T11:15:37.060488+0000","last_fullsized":"2023-10-06T11:15:37.060488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:49.916891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117551+0000","last_change":"2023-10-06T11:15:36.122208+0000","last_active":"2023-10-06T11:15:37.117551+0000","last_peered":"2023-10-06T11:15:37.117551+0000","last_clean":"2023-10-06T11:15:37.117551+0000","last_became_active":"2023-10-06T11:15:36.121958+0000","last_became_peered":"2023-10-06T11:15:36.121958+0000","last_unstale":"2023-10-06T11:15:37.117551+0000","last_undegraded":"2023-10-06T11:15:37.117551+0000","last_fullsized":"2023-10-06T11:15:37.117551+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062438+0000","last_change":"2023-10-06T11:15:37.059379+0000","last_active":"2023-10-06T11:15:37.062438+0000","last_peered":"2023-10-06T11:15:37.062438+0000","last_clean":"2023-10-06T11:15:37.062438+0000","last_became_active":"2023-10-06T11:15:37.059070+0000","last_became_peered":"2023-10-06T11:15:37.059070+0000","last_unstale":"2023-10-06T11:15:37.062438+0000","last_undegraded":"2023-10-06T11:15:37.062438+0000","last_fullsized":"2023-10-06T11:15:37.062438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:30.319797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119761+0000","last_change":"2023-10-06T11:15:36.126734+0000","last_active":"2023-10-06T11:15:37.119761+0000","last_peered":"2023-10-06T11:15:37.119761+0000","last_clean":"2023-10-06T11:15:37.119761+0000","last_became_active":"2023-10-06T11:15:36.124721+0000","last_became_peered":"2023-10-06T11:15:36.124721+0000","last_unstale":"2023-10-06T11:15:37.119761+0000","last_undegraded":"2023-10-06T11:15:37.119761+0000","last_fullsized":"2023-10-06T11:15:37.119761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:23.751162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063078+0000","last_change":"2023-10-06T11:15:37.059722+0000","last_active":"2023-10-06T11:15:37.063078+0000","last_peered":"2023-10-06T11:15:37.063078+0000","last_clean":"2023-10-06T11:15:37.063078+0000","last_became_active":"2023-10-06T11:15:37.059434+0000","last_became_peered":"2023-10-06T11:15:37.059434+0000","last_unstale":"2023-10-06T11:15:37.063078+0000","last_undegraded":"2023-10-06T11:15:37.063078+0000","last_fullsized":"2023-10-06T11:15:37.063078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:06.837995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119830+0000","last_change":"2023-10-06T11:15:36.124774+0000","last_active":"2023-10-06T11:15:37.119830+0000","last_peered":"2023-10-06T11:15:37.119830+0000","last_clean":"2023-10-06T11:15:37.119830+0000","last_became_active":"2023-10-06T11:15:36.124498+0000","last_became_peered":"2023-10-06T11:15:36.124498+0000","last_unstale":"2023-10-06T11:15:37.119830+0000","last_undegraded":"2023-10-06T11:15:37.119830+0000","last_fullsized":"2023-10-06T11:15:37.119830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:14.110807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063188+0000","last_change":"2023-10-06T11:15:37.060523+0000","last_active":"2023-10-06T11:15:37.063188+0000","last_peered":"2023-10-06T11:15:37.063188+0000","last_clean":"2023-10-06T11:15:37.063188+0000","last_became_active":"2023-10-06T11:15:37.060183+0000","last_became_peered":"2023-10-06T11:15:37.060183+0000","last_unstale":"2023-10-06T11:15:37.063188+0000","last_undegraded":"2023-10-06T11:15:37.063188+0000","last_fullsized":"2023-10-06T11:15:37.063188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:39.415302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117877+0000","last_change":"2023-10-06T11:15:36.123154+0000","last_active":"2023-10-06T11:15:37.117877+0000","last_peered":"2023-10-06T11:15:37.117877+0000","last_clean":"2023-10-06T11:15:37.117877+0000","last_became_active":"2023-10-06T11:15:36.122952+0000","last_became_peered":"2023-10-06T11:15:36.122952+0000","last_unstale":"2023-10-06T11:15:37.117877+0000","last_undegraded":"2023-10-06T11:15:37.117877+0000","last_fullsized":"2023-10-06T11:15:37.117877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:26.118855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.048000+0000","last_change":"2023-10-06T11:15:37.043230+0000","last_active":"2023-10-06T11:15:37.048000+0000","last_peered":"2023-10-06T11:15:37.048000+0000","last_clean":"2023-10-06T11:15:37.048000+0000","last_became_active":"2023-10-06T11:15:37.042907+0000","last_became_peered":"2023-10-06T11:15:37.042907+0000","last_unstale":"2023-10-06T11:15:37.048000+0000","last_undegraded":"2023-10-06T11:15:37.048000+0000","last_fullsized":"2023-10-06T11:15:37.048000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:28.159969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117709+0000","last_change":"2023-10-06T11:15:36.126663+0000","last_active":"2023-10-06T11:15:37.117709+0000","last_peered":"2023-10-06T11:15:37.117709+0000","last_clean":"2023-10-06T11:15:37.117709+0000","last_became_active":"2023-10-06T11:15:36.126269+0000","last_became_peered":"2023-10-06T11:15:36.126269+0000","last_unstale":"2023-10-06T11:15:37.117709+0000","last_undegraded":"2023-10-06T11:15:37.117709+0000","last_fullsized":"2023-10-06T11:15:37.117709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.948234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062428+0000","last_change":"2023-10-06T11:15:37.058907+0000","last_active":"2023-10-06T11:15:37.062428+0000","last_peered":"2023-10-06T11:15:37.062428+0000","last_clean":"2023-10-06T11:15:37.062428+0000","last_became_active":"2023-10-06T11:15:37.058626+0000","last_became_peered":"2023-10-06T11:15:37.058626+0000","last_unstale":"2023-10-06T11:15:37.062428+0000","last_undegraded":"2023-10-06T11:15:37.062428+0000","last_fullsized":"2023-10-06T11:15:37.062428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.532675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.042379+0000","last_change":"2023-10-06T11:15:36.122436+0000","last_active":"2023-10-06T11:15:37.042379+0000","last_peered":"2023-10-06T11:15:37.042379+0000","last_clean":"2023-10-06T11:15:37.042379+0000","last_became_active":"2023-10-06T11:15:36.122186+0000","last_became_peered":"2023-10-06T11:15:36.122186+0000","last_unstale":"2023-10-06T11:15:37.042379+0000","last_undegraded":"2023-10-06T11:15:37.042379+0000","last_fullsized":"2023-10-06T11:15:37.042379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:56.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057013+0000","last_change":"2023-10-06T11:15:37.052635+0000","last_active":"2023-10-06T11:15:37.057013+0000","last_peered":"2023-10-06T11:15:37.057013+0000","last_clean":"2023-10-06T11:15:37.057013+0000","last_became_active":"2023-10-06T11:15:37.052392+0000","last_became_peered":"2023-10-06T11:15:37.052392+0000","last_unstale":"2023-10-06T11:15:37.057013+0000","last_undegraded":"2023-10-06T11:15:37.057013+0000","last_fullsized":"2023-10-06T11:15:37.057013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:36.431764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044330+0000","last_change":"2023-10-06T11:15:36.121327+0000","last_active":"2023-10-06T11:15:37.044330+0000","last_peered":"2023-10-06T11:15:37.044330+0000","last_clean":"2023-10-06T11:15:37.044330+0000","last_became_active":"2023-10-06T11:15:36.121047+0000","last_became_peered":"2023-10-06T11:15:36.121047+0000","last_unstale":"2023-10-06T11:15:37.044330+0000","last_undegraded":"2023-10-06T11:15:37.044330+0000","last_fullsized":"2023-10-06T11:15:37.044330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:55.211572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063307+0000","last_change":"2023-10-06T11:15:37.059020+0000","last_active":"2023-10-06T11:15:37.063307+0000","last_peered":"2023-10-06T11:15:37.063307+0000","last_clean":"2023-10-06T11:15:37.063307+0000","last_became_active":"2023-10-06T11:15:37.058746+0000","last_became_peered":"2023-10-06T11:15:37.058746+0000","last_unstale":"2023-10-06T11:15:37.063307+0000","last_undegraded":"2023-10-06T11:15:37.063307+0000","last_fullsized":"2023-10-06T11:15:37.063307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:28.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.045031+0000","last_change":"2023-10-06T11:15:36.125233+0000","last_active":"2023-10-06T11:15:37.045031+0000","last_peered":"2023-10-06T11:15:37.045031+0000","last_clean":"2023-10-06T11:15:37.045031+0000","last_became_active":"2023-10-06T11:15:36.124982+0000","last_became_peered":"2023-10-06T11:15:36.124982+0000","last_unstale":"2023-10-06T11:15:37.045031+0000","last_undegraded":"2023-10-06T11:15:37.045031+0000","last_fullsized":"2023-10-06T11:15:37.045031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:12:46.747585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054536+0000","last_change":"2023-10-06T11:15:37.053080+0000","last_active":"2023-10-06T11:15:37.054536+0000","last_peered":"2023-10-06T11:15:37.054536+0000","last_clean":"2023-10-06T11:15:37.054536+0000","last_became_active":"2023-10-06T11:15:37.052677+0000","last_became_peered":"2023-10-06T11:15:37.052677+0000","last_unstale":"2023-10-06T11:15:37.054536+0000","last_undegraded":"2023-10-06T11:15:37.054536+0000","last_fullsized":"2023-10-06T11:15:37.054536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:25.962155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044778+0000","last_change":"2023-10-06T11:15:36.123158+0000","last_active":"2023-10-06T11:15:37.044778+0000","last_peered":"2023-10-06T11:15:37.044778+0000","last_clean":"2023-10-06T11:15:37.044778+0000","last_became_active":"2023-10-06T11:15:36.122901+0000","last_became_peered":"2023-10-06T11:15:36.122901+0000","last_unstale":"2023-10-06T11:15:37.044778+0000","last_undegraded":"2023-10-06T11:15:37.044778+0000","last_fullsized":"2023-10-06T11:15:37.044778+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:35.759945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062245+0000","last_change":"2023-10-06T11:15:37.051499+0000","last_active":"2023-10-06T11:15:37.062245+0000","last_peered":"2023-10-06T11:15:37.062245+0000","last_clean":"2023-10-06T11:15:37.062245+0000","last_became_active":"2023-10-06T11:15:37.050015+0000","last_became_peered":"2023-10-06T11:15:37.050015+0000","last_unstale":"2023-10-06T11:15:37.062245+0000","last_undegraded":"2023-10-06T11:15:37.062245+0000","last_fullsized":"2023-10-06T11:15:37.062245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:28.159969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119091+0000","last_change":"2023-10-06T11:15:36.124153+0000","last_active":"2023-10-06T11:15:37.119091+0000","last_peered":"2023-10-06T11:15:37.119091+0000","last_clean":"2023-10-06T11:15:37.119091+0000","last_became_active":"2023-10-06T11:15:36.123525+0000","last_became_peered":"2023-10-06T11:15:36.123525+0000","last_unstale":"2023-10-06T11:15:37.119091+0000","last_undegraded":"2023-10-06T11:15:37.119091+0000","last_fullsized":"2023-10-06T11:15:37.119091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:59.101070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054639+0000","last_change":"2023-10-06T11:15:37.049449+0000","last_active":"2023-10-06T11:15:37.054639+0000","last_peered":"2023-10-06T11:15:37.054639+0000","last_clean":"2023-10-06T11:15:37.054639+0000","last_became_active":"2023-10-06T11:15:37.048871+0000","last_became_peered":"2023-10-06T11:15:37.048871+0000","last_unstale":"2023-10-06T11:15:37.054639+0000","last_undegraded":"2023-10-06T11:15:37.054639+0000","last_fullsized":"2023-10-06T11:15:37.054639+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:44.470711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"78'6","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120412+0000","last_change":"2023-10-06T11:15:36.122354+0000","last_active":"2023-10-06T11:15:37.120412+0000","last_peered":"2023-10-06T11:15:37.120412+0000","last_clean":"2023-10-06T11:15:37.120412+0000","last_became_active":"2023-10-06T11:15:36.122071+0000","last_became_peered":"2023-10-06T11:15:36.122071+0000","last_unstale":"2023-10-06T11:15:37.120412+0000","last_undegraded":"2023-10-06T11:15:37.120412+0000","last_fullsized":"2023-10-06T11:15:37.120412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:20.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.050965+0000","last_change":"2023-10-06T11:15:37.045266+0000","last_active":"2023-10-06T11:15:37.050965+0000","last_peered":"2023-10-06T11:15:37.050965+0000","last_clean":"2023-10-06T11:15:37.050965+0000","last_became_active":"2023-10-06T11:15:37.044984+0000","last_became_peered":"2023-10-06T11:15:37.044984+0000","last_unstale":"2023-10-06T11:15:37.050965+0000","last_undegraded":"2023-10-06T11:15:37.050965+0000","last_fullsized":"2023-10-06T11:15:37.050965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:45.266361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120265+0000","last_change":"2023-10-06T11:15:36.124324+0000","last_active":"2023-10-06T11:15:37.120265+0000","last_peered":"2023-10-06T11:15:37.120265+0000","last_clean":"2023-10-06T11:15:37.120265+0000","last_became_active":"2023-10-06T11:15:36.123818+0000","last_became_peered":"2023-10-06T11:15:36.123818+0000","last_unstale":"2023-10-06T11:15:37.120265+0000","last_undegraded":"2023-10-06T11:15:37.120265+0000","last_fullsized":"2023-10-06T11:15:37.120265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:09.591556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063053+0000","last_change":"2023-10-06T11:15:37.059948+0000","last_active":"2023-10-06T11:15:37.063053+0000","last_peered":"2023-10-06T11:15:37.063053+0000","last_clean":"2023-10-06T11:15:37.063053+0000","last_became_active":"2023-10-06T11:15:37.059652+0000","last_became_peered":"2023-10-06T11:15:37.059652+0000","last_unstale":"2023-10-06T11:15:37.063053+0000","last_undegraded":"2023-10-06T11:15:37.063053+0000","last_fullsized":"2023-10-06T11:15:37.063053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:39.490991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.041452+0000","last_change":"2023-10-06T11:15:36.131293+0000","last_active":"2023-10-06T11:15:37.041452+0000","last_peered":"2023-10-06T11:15:37.041452+0000","last_clean":"2023-10-06T11:15:37.041452+0000","last_became_active":"2023-10-06T11:15:36.131007+0000","last_became_peered":"2023-10-06T11:15:36.131007+0000","last_unstale":"2023-10-06T11:15:37.041452+0000","last_undegraded":"2023-10-06T11:15:37.041452+0000","last_fullsized":"2023-10-06T11:15:37.041452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:53.062680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062399+0000","last_change":"2023-10-06T11:15:37.054674+0000","last_active":"2023-10-06T11:15:37.062399+0000","last_peered":"2023-10-06T11:15:37.062399+0000","last_clean":"2023-10-06T11:15:37.062399+0000","last_became_active":"2023-10-06T11:15:37.053965+0000","last_became_peered":"2023-10-06T11:15:37.053965+0000","last_unstale":"2023-10-06T11:15:37.062399+0000","last_undegraded":"2023-10-06T11:15:37.062399+0000","last_fullsized":"2023-10-06T11:15:37.062399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:49.623661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044133+0000","last_change":"2023-10-06T11:15:36.119816+0000","last_active":"2023-10-06T11:15:37.044133+0000","last_peered":"2023-10-06T11:15:37.044133+0000","last_clean":"2023-10-06T11:15:37.044133+0000","last_became_active":"2023-10-06T11:15:36.119078+0000","last_became_peered":"2023-10-06T11:15:36.119078+0000","last_unstale":"2023-10-06T11:15:37.044133+0000","last_undegraded":"2023-10-06T11:15:37.044133+0000","last_fullsized":"2023-10-06T11:15:37.044133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:51.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062949+0000","last_change":"2023-10-06T11:15:37.057911+0000","last_active":"2023-10-06T11:15:37.062949+0000","last_peered":"2023-10-06T11:15:37.062949+0000","last_clean":"2023-10-06T11:15:37.062949+0000","last_became_active":"2023-10-06T11:15:37.057143+0000","last_became_peered":"2023-10-06T11:15:37.057143+0000","last_unstale":"2023-10-06T11:15:37.062949+0000","last_undegraded":"2023-10-06T11:15:37.062949+0000","last_fullsized":"2023-10-06T11:15:37.062949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:52.795862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"78'8","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.121540+0000","last_change":"2023-10-06T11:15:36.122034+0000","last_active":"2023-10-06T11:15:37.121540+0000","last_peered":"2023-10-06T11:15:37.121540+0000","last_clean":"2023-10-06T11:15:37.121540+0000","last_became_active":"2023-10-06T11:15:36.121731+0000","last_became_peered":"2023-10-06T11:15:36.121731+0000","last_unstale":"2023-10-06T11:15:37.121540+0000","last_undegraded":"2023-10-06T11:15:37.121540+0000","last_fullsized":"2023-10-06T11:15:37.121540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:38.477070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.052410+0000","last_change":"2023-10-06T11:15:37.048728+0000","last_active":"2023-10-06T11:15:37.052410+0000","last_peered":"2023-10-06T11:15:37.052410+0000","last_clean":"2023-10-06T11:15:37.052410+0000","last_became_active":"2023-10-06T11:15:37.048445+0000","last_became_peered":"2023-10-06T11:15:37.048445+0000","last_unstale":"2023-10-06T11:15:37.052410+0000","last_undegraded":"2023-10-06T11:15:37.052410+0000","last_fullsized":"2023-10-06T11:15:37.052410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:24.169552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.118501+0000","last_change":"2023-10-06T11:15:36.122822+0000","last_active":"2023-10-06T11:15:37.118501+0000","last_peered":"2023-10-06T11:15:37.118501+0000","last_clean":"2023-10-06T11:15:37.118501+0000","last_became_active":"2023-10-06T11:15:36.122553+0000","last_became_peered":"2023-10-06T11:15:36.122553+0000","last_unstale":"2023-10-06T11:15:37.118501+0000","last_undegraded":"2023-10-06T11:15:37.118501+0000","last_fullsized":"2023-10-06T11:15:37.118501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:52.830204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062377+0000","last_change":"2023-10-06T11:15:37.058325+0000","last_active":"2023-10-06T11:15:37.062377+0000","last_peered":"2023-10-06T11:15:37.062377+0000","last_clean":"2023-10-06T11:15:37.062377+0000","last_became_active":"2023-10-06T11:15:37.058053+0000","last_became_peered":"2023-10-06T11:15:37.058053+0000","last_unstale":"2023-10-06T11:15:37.062377+0000","last_undegraded":"2023-10-06T11:15:37.062377+0000","last_fullsized":"2023-10-06T11:15:37.062377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.728342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.050386+0000","last_change":"2023-10-06T11:15:36.128795+0000","last_active":"2023-10-06T11:15:37.050386+0000","last_peered":"2023-10-06T11:15:37.050386+0000","last_clean":"2023-10-06T11:15:37.050386+0000","last_became_active":"2023-10-06T11:15:36.125293+0000","last_became_peered":"2023-10-06T11:15:36.125293+0000","last_unstale":"2023-10-06T11:15:37.050386+0000","last_undegraded":"2023-10-06T11:15:37.050386+0000","last_fullsized":"2023-10-06T11:15:37.050386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:29.890919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057415+0000","last_change":"2023-10-06T11:15:37.050805+0000","last_active":"2023-10-06T11:15:37.057415+0000","last_peered":"2023-10-06T11:15:37.057415+0000","last_clean":"2023-10-06T11:15:37.057415+0000","last_became_active":"2023-10-06T11:15:37.050535+0000","last_became_peered":"2023-10-06T11:15:37.050535+0000","last_unstale":"2023-10-06T11:15:37.057415+0000","last_undegraded":"2023-10-06T11:15:37.057415+0000","last_fullsized":"2023-10-06T11:15:37.057415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:39.490991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043435+0000","last_change":"2023-10-06T11:15:36.124167+0000","last_active":"2023-10-06T11:15:37.043435+0000","last_peered":"2023-10-06T11:15:37.043435+0000","last_clean":"2023-10-06T11:15:37.043435+0000","last_became_active":"2023-10-06T11:15:36.123897+0000","last_became_peered":"2023-10-06T11:15:36.123897+0000","last_unstale":"2023-10-06T11:15:37.043435+0000","last_undegraded":"2023-10-06T11:15:37.043435+0000","last_fullsized":"2023-10-06T11:15:37.043435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:10.714622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054621+0000","last_change":"2023-10-06T11:15:37.049482+0000","last_active":"2023-10-06T11:15:37.054621+0000","last_peered":"2023-10-06T11:15:37.054621+0000","last_clean":"2023-10-06T11:15:37.054621+0000","last_became_active":"2023-10-06T11:15:37.049238+0000","last_became_peered":"2023-10-06T11:15:37.049238+0000","last_unstale":"2023-10-06T11:15:37.054621+0000","last_undegraded":"2023-10-06T11:15:37.054621+0000","last_fullsized":"2023-10-06T11:15:37.054621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:00.659381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043894+0000","last_change":"2023-10-06T11:15:36.124009+0000","last_active":"2023-10-06T11:15:37.043894+0000","last_peered":"2023-10-06T11:15:37.043894+0000","last_clean":"2023-10-06T11:15:37.043894+0000","last_became_active":"2023-10-06T11:15:36.123728+0000","last_became_peered":"2023-10-06T11:15:36.123728+0000","last_unstale":"2023-10-06T11:15:37.043894+0000","last_undegraded":"2023-10-06T11:15:37.043894+0000","last_fullsized":"2023-10-06T11:15:37.043894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:38.401381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060502+0000","last_change":"2023-10-06T11:15:37.055186+0000","last_active":"2023-10-06T11:15:37.060502+0000","last_peered":"2023-10-06T11:15:37.060502+0000","last_clean":"2023-10-06T11:15:37.060502+0000","last_became_active":"2023-10-06T11:15:37.054584+0000","last_became_peered":"2023-10-06T11:15:37.054584+0000","last_unstale":"2023-10-06T11:15:37.060502+0000","last_undegraded":"2023-10-06T11:15:37.060502+0000","last_fullsized":"2023-10-06T11:15:37.060502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:59.167930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043137+0000","last_change":"2023-10-06T11:15:36.125387+0000","last_active":"2023-10-06T11:15:37.043137+0000","last_peered":"2023-10-06T11:15:37.043137+0000","last_clean":"2023-10-06T11:15:37.043137+0000","last_became_active":"2023-10-06T11:15:36.124949+0000","last_became_peered":"2023-10-06T11:15:36.124949+0000","last_unstale":"2023-10-06T11:15:37.043137+0000","last_undegraded":"2023-10-06T11:15:37.043137+0000","last_fullsized":"2023-10-06T11:15:37.043137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.948234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.058365+0000","last_change":"2023-10-06T11:15:37.049074+0000","last_active":"2023-10-06T11:15:37.058365+0000","last_peered":"2023-10-06T11:15:37.058365+0000","last_clean":"2023-10-06T11:15:37.058365+0000","last_became_active":"2023-10-06T11:15:37.048797+0000","last_became_peered":"2023-10-06T11:15:37.048797+0000","last_unstale":"2023-10-06T11:15:37.058365+0000","last_undegraded":"2023-10-06T11:15:37.058365+0000","last_fullsized":"2023-10-06T11:15:37.058365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:44.470711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.040006+0000","last_change":"2023-10-06T11:15:36.125888+0000","last_active":"2023-10-06T11:15:37.040006+0000","last_peered":"2023-10-06T11:15:37.040006+0000","last_clean":"2023-10-06T11:15:37.040006+0000","last_became_active":"2023-10-06T11:15:36.125656+0000","last_became_peered":"2023-10-06T11:15:36.125656+0000","last_unstale":"2023-10-06T11:15:37.040006+0000","last_undegraded":"2023-10-06T11:15:37.040006+0000","last_fullsized":"2023-10-06T11:15:37.040006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:29.305876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.064909+0000","last_change":"2023-10-06T11:15:37.063116+0000","last_active":"2023-10-06T11:15:37.064909+0000","last_peered":"2023-10-06T11:15:37.064909+0000","last_clean":"2023-10-06T11:15:37.064909+0000","last_became_active":"2023-10-06T11:15:37.062820+0000","last_became_peered":"2023-10-06T11:15:37.062820+0000","last_unstale":"2023-10-06T11:15:37.064909+0000","last_undegraded":"2023-10-06T11:15:37.064909+0000","last_fullsized":"2023-10-06T11:15:37.064909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:49.916891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043720+0000","last_change":"2023-10-06T11:15:36.122358+0000","last_active":"2023-10-06T11:15:37.043720+0000","last_peered":"2023-10-06T11:15:37.043720+0000","last_clean":"2023-10-06T11:15:37.043720+0000","last_became_active":"2023-10-06T11:15:36.122096+0000","last_became_peered":"2023-10-06T11:15:36.122096+0000","last_unstale":"2023-10-06T11:15:37.043720+0000","last_undegraded":"2023-10-06T11:15:37.043720+0000","last_fullsized":"2023-10-06T11:15:37.043720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:53.007972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057396+0000","last_change":"2023-10-06T11:15:37.050231+0000","last_active":"2023-10-06T11:15:37.057396+0000","last_peered":"2023-10-06T11:15:37.057396+0000","last_clean":"2023-10-06T11:15:37.057396+0000","last_became_active":"2023-10-06T11:15:37.049955+0000","last_became_peered":"2023-10-06T11:15:37.049955+0000","last_unstale":"2023-10-06T11:15:37.057396+0000","last_undegraded":"2023-10-06T11:15:37.057396+0000","last_fullsized":"2023-10-06T11:15:37.057396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:28.275662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.040809+0000","last_change":"2023-10-06T11:15:36.116400+0000","last_active":"2023-10-06T11:15:37.040809+0000","last_peered":"2023-10-06T11:15:37.040809+0000","last_clean":"2023-10-06T11:15:37.040809+0000","last_became_active":"2023-10-06T11:15:36.116160+0000","last_became_peered":"2023-10-06T11:15:36.116160+0000","last_unstale":"2023-10-06T11:15:37.040809+0000","last_undegraded":"2023-10-06T11:15:37.040809+0000","last_fullsized":"2023-10-06T11:15:37.040809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:58.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060448+0000","last_change":"2023-10-06T11:15:37.054597+0000","last_active":"2023-10-06T11:15:37.060448+0000","last_peered":"2023-10-06T11:15:37.060448+0000","last_clean":"2023-10-06T11:15:37.060448+0000","last_became_active":"2023-10-06T11:15:37.053581+0000","last_became_peered":"2023-10-06T11:15:37.053581+0000","last_unstale":"2023-10-06T11:15:37.060448+0000","last_undegraded":"2023-10-06T11:15:37.060448+0000","last_fullsized":"2023-10-06T11:15:37.060448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:30.319797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.038666+0000","last_change":"2023-10-06T11:15:36.127703+0000","last_active":"2023-10-06T11:15:37.038666+0000","last_peered":"2023-10-06T11:15:37.038666+0000","last_clean":"2023-10-06T11:15:37.038666+0000","last_became_active":"2023-10-06T11:15:36.127455+0000","last_became_peered":"2023-10-06T11:15:36.127455+0000","last_unstale":"2023-10-06T11:15:37.038666+0000","last_undegraded":"2023-10-06T11:15:37.038666+0000","last_fullsized":"2023-10-06T11:15:37.038666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:23.467332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.047498+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:15:37.047498+0000","last_peered":"2023-10-06T11:15:37.047498+0000","last_clean":"2023-10-06T11:15:37.047498+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:15:37.047498+0000","last_undegraded":"2023-10-06T11:15:37.047498+0000","last_fullsized":"2023-10-06T11:15:37.047498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060222+0000","last_change":"2023-10-06T11:15:37.058675+0000","last_active":"2023-10-06T11:15:37.060222+0000","last_peered":"2023-10-06T11:15:37.060222+0000","last_clean":"2023-10-06T11:15:37.060222+0000","last_became_active":"2023-10-06T11:15:37.058337+0000","last_became_peered":"2023-10-06T11:15:37.058337+0000","last_unstale":"2023-10-06T11:15:37.060222+0000","last_undegraded":"2023-10-06T11:15:37.060222+0000","last_fullsized":"2023-10-06T11:15:37.060222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:35.292084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043050+0000","last_change":"2023-10-06T11:15:36.121233+0000","last_active":"2023-10-06T11:15:37.043050+0000","last_peered":"2023-10-06T11:15:37.043050+0000","last_clean":"2023-10-06T11:15:37.043050+0000","last_became_active":"2023-10-06T11:15:36.120958+0000","last_became_peered":"2023-10-06T11:15:36.120958+0000","last_unstale":"2023-10-06T11:15:37.043050+0000","last_undegraded":"2023-10-06T11:15:37.043050+0000","last_fullsized":"2023-10-06T11:15:37.043050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:05.824074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043816+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:15:37.043816+0000","last_peered":"2023-10-06T11:15:37.043816+0000","last_clean":"2023-10-06T11:15:37.043816+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:15:37.043816+0000","last_undegraded":"2023-10-06T11:15:37.043816+0000","last_fullsized":"2023-10-06T11:15:37.043816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.055331+0000","last_change":"2023-10-06T11:15:37.052374+0000","last_active":"2023-10-06T11:15:37.055331+0000","last_peered":"2023-10-06T11:15:37.055331+0000","last_clean":"2023-10-06T11:15:37.055331+0000","last_became_active":"2023-10-06T11:15:37.052106+0000","last_became_peered":"2023-10-06T11:15:37.052106+0000","last_unstale":"2023-10-06T11:15:37.055331+0000","last_undegraded":"2023-10-06T11:15:37.055331+0000","last_fullsized":"2023-10-06T11:15:37.055331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:59.167930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117951+0000","last_change":"2023-10-06T11:15:36.124455+0000","last_active":"2023-10-06T11:15:37.117951+0000","last_peered":"2023-10-06T11:15:37.117951+0000","last_clean":"2023-10-06T11:15:37.117951+0000","last_became_active":"2023-10-06T11:15:36.123994+0000","last_became_peered":"2023-10-06T11:15:36.123994+0000","last_unstale":"2023-10-06T11:15:37.117951+0000","last_undegraded":"2023-10-06T11:15:37.117951+0000","last_fullsized":"2023-10-06T11:15:37.117951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:34.511475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.037658+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:15:37.037658+0000","last_peered":"2023-10-06T11:15:37.037658+0000","last_clean":"2023-10-06T11:15:37.037658+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:15:37.037658+0000","last_undegraded":"2023-10-06T11:15:37.037658+0000","last_fullsized":"2023-10-06T11:15:37.037658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062930+0000","last_change":"2023-10-06T11:15:37.057800+0000","last_active":"2023-10-06T11:15:37.062930+0000","last_peered":"2023-10-06T11:15:37.062930+0000","last_clean":"2023-10-06T11:15:37.062930+0000","last_became_active":"2023-10-06T11:15:37.057488+0000","last_became_peered":"2023-10-06T11:15:37.057488+0000","last_unstale":"2023-10-06T11:15:37.062930+0000","last_undegraded":"2023-10-06T11:15:37.062930+0000","last_fullsized":"2023-10-06T11:15:37.062930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:12:47.761506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.118609+0000","last_change":"2023-10-06T11:15:36.131064+0000","last_active":"2023-10-06T11:15:37.118609+0000","last_peered":"2023-10-06T11:15:37.118609+0000","last_clean":"2023-10-06T11:15:37.118609+0000","last_became_active":"2023-10-06T11:15:36.130843+0000","last_became_peered":"2023-10-06T11:15:36.130843+0000","last_unstale":"2023-10-06T11:15:37.118609+0000","last_undegraded":"2023-10-06T11:15:37.118609+0000","last_fullsized":"2023-10-06T11:15:37.118609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:20.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044203+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:15:37.044203+0000","last_peered":"2023-10-06T11:15:37.044203+0000","last_clean":"2023-10-06T11:15:37.044203+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:15:37.044203+0000","last_undegraded":"2023-10-06T11:15:37.044203+0000","last_fullsized":"2023-10-06T11:15:37.044203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.047382+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:15:37.047382+0000","last_peered":"2023-10-06T11:15:37.047382+0000","last_clean":"2023-10-06T11:15:37.047382+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:15:37.047382+0000","last_undegraded":"2023-10-06T11:15:37.047382+0000","last_fullsized":"2023-10-06T11:15:37.047382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060470+0000","last_change":"2023-10-06T11:15:37.053128+0000","last_active":"2023-10-06T11:15:37.060470+0000","last_peered":"2023-10-06T11:15:37.060470+0000","last_clean":"2023-10-06T11:15:37.060470+0000","last_became_active":"2023-10-06T11:15:37.052536+0000","last_became_peered":"2023-10-06T11:15:37.052536+0000","last_unstale":"2023-10-06T11:15:37.060470+0000","last_undegraded":"2023-10-06T11:15:37.060470+0000","last_fullsized":"2023-10-06T11:15:37.060470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:25.962155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119680+0000","last_change":"2023-10-06T11:15:36.120546+0000","last_active":"2023-10-06T11:15:37.119680+0000","last_peered":"2023-10-06T11:15:37.119680+0000","last_clean":"2023-10-06T11:15:37.119680+0000","last_became_active":"2023-10-06T11:15:36.120286+0000","last_became_peered":"2023-10-06T11:15:36.120286+0000","last_unstale":"2023-10-06T11:15:37.119680+0000","last_undegraded":"2023-10-06T11:15:37.119680+0000","last_fullsized":"2023-10-06T11:15:37.119680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.047472+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:15:37.047472+0000","last_peered":"2023-10-06T11:15:37.047472+0000","last_clean":"2023-10-06T11:15:37.047472+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:15:37.047472+0000","last_undegraded":"2023-10-06T11:15:37.047472+0000","last_fullsized":"2023-10-06T11:15:37.047472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062825+0000","last_change":"2023-10-06T11:15:37.058898+0000","last_active":"2023-10-06T11:15:37.062825+0000","last_peered":"2023-10-06T11:15:37.062825+0000","last_clean":"2023-10-06T11:15:37.062825+0000","last_became_active":"2023-10-06T11:15:37.058668+0000","last_became_peered":"2023-10-06T11:15:37.058668+0000","last_unstale":"2023-10-06T11:15:37.062825+0000","last_undegraded":"2023-10-06T11:15:37.062825+0000","last_fullsized":"2023-10-06T11:15:37.062825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:04.765470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120109+0000","last_change":"2023-10-06T11:15:36.129558+0000","last_active":"2023-10-06T11:15:37.120109+0000","last_peered":"2023-10-06T11:15:37.120109+0000","last_clean":"2023-10-06T11:15:37.120109+0000","last_became_active":"2023-10-06T11:15:36.129273+0000","last_became_peered":"2023-10-06T11:15:36.129273+0000","last_unstale":"2023-10-06T11:15:37.120109+0000","last_undegraded":"2023-10-06T11:15:37.120109+0000","last_fullsized":"2023-10-06T11:15:37.120109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:05.824074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.048346+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:15:37.048346+0000","last_peered":"2023-10-06T11:15:37.048346+0000","last_clean":"2023-10-06T11:15:37.048346+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:15:37.048346+0000","last_undegraded":"2023-10-06T11:15:37.048346+0000","last_fullsized":"2023-10-06T11:15:37.048346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060074+0000","last_change":"2023-10-06T11:15:37.053325+0000","last_active":"2023-10-06T11:15:37.060074+0000","last_peered":"2023-10-06T11:15:37.060074+0000","last_clean":"2023-10-06T11:15:37.060074+0000","last_became_active":"2023-10-06T11:15:37.053005+0000","last_became_peered":"2023-10-06T11:15:37.053005+0000","last_unstale":"2023-10-06T11:15:37.060074+0000","last_undegraded":"2023-10-06T11:15:37.060074+0000","last_fullsized":"2023-10-06T11:15:37.060074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:27.132776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.041399+0000","last_change":"2023-10-06T11:15:36.129700+0000","last_active":"2023-10-06T11:15:37.041399+0000","last_peered":"2023-10-06T11:15:37.041399+0000","last_clean":"2023-10-06T11:15:37.041399+0000","last_became_active":"2023-10-06T11:15:36.129398+0000","last_became_peered":"2023-10-06T11:15:36.129398+0000","last_unstale":"2023-10-06T11:15:37.041399+0000","last_undegraded":"2023-10-06T11:15:37.041399+0000","last_fullsized":"2023-10-06T11:15:37.041399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:38.477070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.050474+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:15:37.050474+0000","last_peered":"2023-10-06T11:15:37.050474+0000","last_clean":"2023-10-06T11:15:37.050474+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:15:37.050474+0000","last_undegraded":"2023-10-06T11:15:37.050474+0000","last_fullsized":"2023-10-06T11:15:37.050474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.051990+0000","last_change":"2023-10-06T11:15:37.048563+0000","last_active":"2023-10-06T11:15:37.051990+0000","last_peered":"2023-10-06T11:15:37.051990+0000","last_clean":"2023-10-06T11:15:37.051990+0000","last_became_active":"2023-10-06T11:15:37.047603+0000","last_became_peered":"2023-10-06T11:15:37.047603+0000","last_unstale":"2023-10-06T11:15:37.051990+0000","last_undegraded":"2023-10-06T11:15:37.051990+0000","last_fullsized":"2023-10-06T11:15:37.051990+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:52.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.037566+0000","last_change":"2023-10-06T11:15:36.127190+0000","last_active":"2023-10-06T11:15:37.037566+0000","last_peered":"2023-10-06T11:15:37.037566+0000","last_clean":"2023-10-06T11:15:37.037566+0000","last_became_active":"2023-10-06T11:15:36.126951+0000","last_became_peered":"2023-10-06T11:15:36.126951+0000","last_unstale":"2023-10-06T11:15:37.037566+0000","last_undegraded":"2023-10-06T11:15:37.037566+0000","last_fullsized":"2023-10-06T11:15:37.037566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:48.461464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.045046+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:15:37.045046+0000","last_peered":"2023-10-06T11:15:37.045046+0000","last_clean":"2023-10-06T11:15:37.045046+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:15:37.045046+0000","last_undegraded":"2023-10-06T11:15:37.045046+0000","last_fullsized":"2023-10-06T11:15:37.045046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073024,"statfs":{"total":96636764160,"available":96330776576,"internally_reserved":0,"allocated":1564672,"data_stored":1042524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.498,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.503},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4319999999999999,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.036,"15min":1.117},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77800000000000002,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78200000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78600000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.438},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80300000000000005,"5min":0.872,"15min":0.872},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":452752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":452280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42299999999999999,"15min":0.436},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83399999999999996,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.375,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.4319999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.311},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.92700000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.627,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.4219999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.5150000000000001,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.748,"15min":0.71699999999999997},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":7.2400000000000002,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.62},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.6919999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.495},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.1799999999999999,"5min":1.508,"15min":1.508},"last":0.54200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073024,"statfs":{"total":96636764160,"available":96330776576,"internally_reserved":0,"allocated":1564672,"data_stored":1042488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.221,"5min":0.214,"15min":0.214},"max":{"1min":0.46000000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.252},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51900000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.499,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52700000000000002,"5min":0.626,"15min":0.626},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.54800000000000004,"5min":0.626,"15min":0.626},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.495},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44400000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0680000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":452640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.23799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.79600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":453622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.496}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":452086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.439},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":983040,"data_stored":453644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.501},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.438}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:41.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.376+0000 7f267899c700 1 Processor -- start 2023-10-06T11:15:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.376+0000 7f267899c700 1 -- start start 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f267899c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26740b49a0 0x7f26740aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f267899c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26740b0760 0x7f26740b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f267899c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26740b0c60 con 0x7f2674159560 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f267899c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740b0f40 con 0x7f26740b0760 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f267899c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26740b1220 con 0x7f26740b49a0 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26740b0760 0x7f26740b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26740b0760 0x7f26740b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35164/0 (socket says 172.21.15.55:35164) 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 -- 172.21.15.55:0/2252019486 learned_addr learned my addr 172.21.15.55:0/2252019486 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2671d9b700 1 --2- 172.21.15.55:0/2252019486 >> v2:172.21.15.142:3300/0 conn(0x7f26740b49a0 0x7f26740aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 -- 172.21.15.55:0/2252019486 >> v2:172.21.15.142:3300/0 conn(0x7f26740b49a0 msgr2=0x7f26740aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 --2- 172.21.15.55:0/2252019486 >> v2:172.21.15.142:3300/0 conn(0x7f26740b49a0 0x7f26740aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 -- 172.21.15.55:0/2252019486 >> v1:172.21.15.142:6789/0 conn(0x7f2674159560 legacy=0x7f26740aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 -- 172.21.15.55:0/2252019486 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740b1500 con 0x7f26740b0760 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.377+0000 7f2672d9d700 1 --2- 172.21.15.55:0/2252019486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26740b1bc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f266c009f20 tx=0x7f266c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a6514235abaa9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267159a700 1 -- 172.21.15.55:0/2252019486 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00e070 con 0x7f26740b0760 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267159a700 1 -- 172.21.15.55:0/2252019486 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00b990 con 0x7f26740b0760 2023-10-06T11:15:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267159a700 1 -- 172.21.15.55:0/2252019486 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0092e0 con 0x7f26740b0760 2023-10-06T11:15:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 -- 172.21.15.55:0/2252019486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 msgr2=0x7f26740b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 --2- 172.21.15.55:0/2252019486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26740b1bc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f266c009f20 tx=0x7f266c009840 comp rx=0 tx=0).stop 2023-10-06T11:15:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 -- 172.21.15.55:0/2252019486 shutdown_connections 2023-10-06T11:15:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 --2- 172.21.15.55:0/2252019486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26740b1bc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 --2- 172.21.15.55:0/2252019486 >> v2:172.21.15.142:3300/0 conn(0x7f26740b49a0 0x7f26740aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 -- 172.21.15.55:0/2252019486 >> 172.21.15.55:0/2252019486 conn(0x7f26740997f0 msgr2=0x7f267406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 -- 172.21.15.55:0/2252019486 shutdown_connections 2023-10-06T11:15:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.378+0000 7f267899c700 1 -- 172.21.15.55:0/2252019486 wait complete. 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.379+0000 7f267899c700 1 Processor -- start 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.379+0000 7f267899c700 1 -- start start 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267899c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26741579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267899c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26740b49a0 0x7f26740ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267899c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674159560 0x7f26740cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267899c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740aec60 con 0x7f26740b0760 2023-10-06T11:15:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267899c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26740af0f0 con 0x7f26740b49a0 2023-10-06T11:15:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267899c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26740ae050 con 0x7f2674159560 2023-10-06T11:15:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26741579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26741579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35170/0 (socket says 172.21.15.55:35170) 2023-10-06T11:15:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 -- 172.21.15.55:0/3641814398 learned_addr learned my addr 172.21.15.55:0/3641814398 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f2671d9b700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26740b49a0 0x7f26740ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f2672d9d700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674159560 0x7f26740cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 -- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674159560 msgr2=0x7f26740cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674159560 0x7f26740cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 -- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26740b49a0 msgr2=0x7f26740ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26740b49a0 0x7f26740ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f267259c700 1 -- 172.21.15.55:0/3641814398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c009ae0 con 0x7f26740b0760 2023-10-06T11:15:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.380+0000 7f2672d9d700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674159560 0x7f26740cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.381+0000 7f267259c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26741579a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f266400c540 tx=0x7f2664001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.381+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011590 con 0x7f26740b0760 2023-10-06T11:15:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.381+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640116f0 con 0x7f26740b0760 2023-10-06T11:15:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.381+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26740ae330 con 0x7f26740b0760 2023-10-06T11:15:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.381+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011ab0 con 0x7f26740b0760 2023-10-06T11:15:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.381+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26740ae8f0 con 0x7f26740b0760 2023-10-06T11:15:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.382+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26740aef40 con 0x7f26740b0760 2023-10-06T11:15:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.382+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f266401b3b0 con 0x7f26740b0760 2023-10-06T11:15:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.382+0000 7f26627fc700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2654066f30 0x7f26540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.383+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2664083b50 con 0x7f26740b0760 2023-10-06T11:15:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.383+0000 7f2671d9b700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2654066f30 0x7f26540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.383+0000 7f2671d9b700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2654066f30 0x7f26540693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26740b2070 tx=0x7f26680091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.387+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2664050bd0 con 0x7f26740b0760 2023-10-06T11:15:41.407 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-10-06T11:15:41.405+0000 7f2c33217700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:15:41.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.576+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26740aeda0 con 0x7f2654066f30 2023-10-06T11:15:41.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.585+0000 7f26627fc700 1 -- 172.21.15.55:0/3641814398 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311110 (secure 0 0 0) 0x7f2668011a20 con 0x7f2654066f30 2023-10-06T11:15:41.590 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:41.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2654066f30 msgr2=0x7f26540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2654066f30 0x7f26540693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26740b2070 tx=0x7f26680091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 msgr2=0x7f26741579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26741579a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f266400c540 tx=0x7f2664001070 comp rx=0 tx=0).stop 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 shutdown_connections 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2654066f30 0x7f26540693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740b0760 0x7f26741579a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2674159560 0x7f26740cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.588+0000 7f267899c700 1 --2- 172.21.15.55:0/3641814398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26740b49a0 0x7f26740ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.589+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 >> 172.21.15.55:0/3641814398 conn(0x7f26740997f0 msgr2=0x7f2674069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.589+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 shutdown_connections 2023-10-06T11:15:41.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.589+0000 7f267899c700 1 -- 172.21.15.55:0/3641814398 wait complete. 2023-10-06T11:15:41.594 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:15:41.602 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-10-06T11:15:40.875967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387080,"kb_used_data":8776,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752587640,"statfs":{"total":773094113280,"available":770649743360,"internally_reserved":0,"allocated":8986624,"data_stored":4802036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.780567"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060753+0000","last_change":"2023-10-06T11:15:37.054744+0000","last_active":"2023-10-06T11:15:37.060753+0000","last_peered":"2023-10-06T11:15:37.060753+0000","last_clean":"2023-10-06T11:15:37.060753+0000","last_became_active":"2023-10-06T11:15:37.054504+0000","last_became_peered":"2023-10-06T11:15:37.054504+0000","last_unstale":"2023-10-06T11:15:37.060753+0000","last_undegraded":"2023-10-06T11:15:37.060753+0000","last_fullsized":"2023-10-06T11:15:37.060753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:59.167930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063084+0000","last_change":"2023-10-06T11:15:37.058147+0000","last_active":"2023-10-06T11:15:37.063084+0000","last_peered":"2023-10-06T11:15:37.063084+0000","last_clean":"2023-10-06T11:15:37.063084+0000","last_became_active":"2023-10-06T11:15:37.057826+0000","last_became_peered":"2023-10-06T11:15:37.057826+0000","last_unstale":"2023-10-06T11:15:37.063084+0000","last_undegraded":"2023-10-06T11:15:37.063084+0000","last_fullsized":"2023-10-06T11:15:37.063084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:00.114991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062385+0000","last_change":"2023-10-06T11:15:37.058358+0000","last_active":"2023-10-06T11:15:37.062385+0000","last_peered":"2023-10-06T11:15:37.062385+0000","last_clean":"2023-10-06T11:15:37.062385+0000","last_became_active":"2023-10-06T11:15:37.058079+0000","last_became_peered":"2023-10-06T11:15:37.058079+0000","last_unstale":"2023-10-06T11:15:37.062385+0000","last_undegraded":"2023-10-06T11:15:37.062385+0000","last_fullsized":"2023-10-06T11:15:37.062385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:30.319797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062597+0000","last_change":"2023-10-06T11:15:37.053652+0000","last_active":"2023-10-06T11:15:37.062597+0000","last_peered":"2023-10-06T11:15:37.062597+0000","last_clean":"2023-10-06T11:15:37.062597+0000","last_became_active":"2023-10-06T11:15:37.053195+0000","last_became_peered":"2023-10-06T11:15:37.053195+0000","last_unstale":"2023-10-06T11:15:37.062597+0000","last_undegraded":"2023-10-06T11:15:37.062597+0000","last_fullsized":"2023-10-06T11:15:37.062597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:24:57.479042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062111+0000","last_change":"2023-10-06T11:15:37.058797+0000","last_active":"2023-10-06T11:15:37.062111+0000","last_peered":"2023-10-06T11:15:37.062111+0000","last_clean":"2023-10-06T11:15:37.062111+0000","last_became_active":"2023-10-06T11:15:37.058409+0000","last_became_peered":"2023-10-06T11:15:37.058409+0000","last_unstale":"2023-10-06T11:15:37.062111+0000","last_undegraded":"2023-10-06T11:15:37.062111+0000","last_fullsized":"2023-10-06T11:15:37.062111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:27.729934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060521+0000","last_change":"2023-10-06T11:15:37.055356+0000","last_active":"2023-10-06T11:15:37.060521+0000","last_peered":"2023-10-06T11:15:37.060521+0000","last_clean":"2023-10-06T11:15:37.060521+0000","last_became_active":"2023-10-06T11:15:37.054916+0000","last_became_peered":"2023-10-06T11:15:37.054916+0000","last_unstale":"2023-10-06T11:15:37.060521+0000","last_undegraded":"2023-10-06T11:15:37.060521+0000","last_fullsized":"2023-10-06T11:15:37.060521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.728342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062617+0000","last_change":"2023-10-06T11:15:37.052464+0000","last_active":"2023-10-06T11:15:37.062617+0000","last_peered":"2023-10-06T11:15:37.062617+0000","last_clean":"2023-10-06T11:15:37.062617+0000","last_became_active":"2023-10-06T11:15:37.052192+0000","last_became_peered":"2023-10-06T11:15:37.052192+0000","last_unstale":"2023-10-06T11:15:37.062617+0000","last_undegraded":"2023-10-06T11:15:37.062617+0000","last_fullsized":"2023-10-06T11:15:37.062617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:37.711281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060570+0000","last_change":"2023-10-06T11:15:37.058137+0000","last_active":"2023-10-06T11:15:37.060570+0000","last_peered":"2023-10-06T11:15:37.060570+0000","last_clean":"2023-10-06T11:15:37.060570+0000","last_became_active":"2023-10-06T11:15:37.057841+0000","last_became_peered":"2023-10-06T11:15:37.057841+0000","last_unstale":"2023-10-06T11:15:37.060570+0000","last_undegraded":"2023-10-06T11:15:37.060570+0000","last_fullsized":"2023-10-06T11:15:37.060570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:28.275662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060600+0000","last_change":"2023-10-06T11:15:37.058431+0000","last_active":"2023-10-06T11:15:37.060600+0000","last_peered":"2023-10-06T11:15:37.060600+0000","last_clean":"2023-10-06T11:15:37.060600+0000","last_became_active":"2023-10-06T11:15:37.058171+0000","last_became_peered":"2023-10-06T11:15:37.058171+0000","last_unstale":"2023-10-06T11:15:37.060600+0000","last_undegraded":"2023-10-06T11:15:37.060600+0000","last_fullsized":"2023-10-06T11:15:37.060600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:49.916891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060672+0000","last_change":"2023-10-06T11:15:37.053480+0000","last_active":"2023-10-06T11:15:37.060672+0000","last_peered":"2023-10-06T11:15:37.060672+0000","last_clean":"2023-10-06T11:15:37.060672+0000","last_became_active":"2023-10-06T11:15:37.053201+0000","last_became_peered":"2023-10-06T11:15:37.053201+0000","last_unstale":"2023-10-06T11:15:37.060672+0000","last_undegraded":"2023-10-06T11:15:37.060672+0000","last_fullsized":"2023-10-06T11:15:37.060672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:22:07.407403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062846+0000","last_change":"2023-10-06T11:15:37.057438+0000","last_active":"2023-10-06T11:15:37.062846+0000","last_peered":"2023-10-06T11:15:37.062846+0000","last_clean":"2023-10-06T11:15:37.062846+0000","last_became_active":"2023-10-06T11:15:37.057178+0000","last_became_peered":"2023-10-06T11:15:37.057178+0000","last_unstale":"2023-10-06T11:15:37.062846+0000","last_undegraded":"2023-10-06T11:15:37.062846+0000","last_fullsized":"2023-10-06T11:15:37.062846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:18.881104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060733+0000","last_change":"2023-10-06T11:15:37.054132+0000","last_active":"2023-10-06T11:15:37.060733+0000","last_peered":"2023-10-06T11:15:37.060733+0000","last_clean":"2023-10-06T11:15:37.060733+0000","last_became_active":"2023-10-06T11:15:37.053871+0000","last_became_peered":"2023-10-06T11:15:37.053871+0000","last_unstale":"2023-10-06T11:15:37.060733+0000","last_undegraded":"2023-10-06T11:15:37.060733+0000","last_fullsized":"2023-10-06T11:15:37.060733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:54.076601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062291+0000","last_change":"2023-10-06T11:15:37.055506+0000","last_active":"2023-10-06T11:15:37.062291+0000","last_peered":"2023-10-06T11:15:37.062291+0000","last_clean":"2023-10-06T11:15:37.062291+0000","last_became_active":"2023-10-06T11:15:37.055236+0000","last_became_peered":"2023-10-06T11:15:37.055236+0000","last_unstale":"2023-10-06T11:15:37.062291+0000","last_undegraded":"2023-10-06T11:15:37.062291+0000","last_fullsized":"2023-10-06T11:15:37.062291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:54.076601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062862+0000","last_change":"2023-10-06T11:15:37.059150+0000","last_active":"2023-10-06T11:15:37.062862+0000","last_peered":"2023-10-06T11:15:37.062862+0000","last_clean":"2023-10-06T11:15:37.062862+0000","last_became_active":"2023-10-06T11:15:37.058873+0000","last_became_peered":"2023-10-06T11:15:37.058873+0000","last_unstale":"2023-10-06T11:15:37.062862+0000","last_undegraded":"2023-10-06T11:15:37.062862+0000","last_fullsized":"2023-10-06T11:15:37.062862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:27:13.174125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062557+0000","last_change":"2023-10-06T11:15:37.053934+0000","last_active":"2023-10-06T11:15:37.062557+0000","last_peered":"2023-10-06T11:15:37.062557+0000","last_clean":"2023-10-06T11:15:37.062557+0000","last_became_active":"2023-10-06T11:15:37.053615+0000","last_became_peered":"2023-10-06T11:15:37.053615+0000","last_unstale":"2023-10-06T11:15:37.062557+0000","last_undegraded":"2023-10-06T11:15:37.062557+0000","last_fullsized":"2023-10-06T11:15:37.062557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:56.884452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054140+0000","last_change":"2023-10-06T11:15:37.050163+0000","last_active":"2023-10-06T11:15:37.054140+0000","last_peered":"2023-10-06T11:15:37.054140+0000","last_clean":"2023-10-06T11:15:37.054140+0000","last_became_active":"2023-10-06T11:15:37.049902+0000","last_became_peered":"2023-10-06T11:15:37.049902+0000","last_unstale":"2023-10-06T11:15:37.054140+0000","last_undegraded":"2023-10-06T11:15:37.054140+0000","last_fullsized":"2023-10-06T11:15:37.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:06.218538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.048100+0000","last_change":"2023-10-06T11:15:37.045043+0000","last_active":"2023-10-06T11:15:37.048100+0000","last_peered":"2023-10-06T11:15:37.048100+0000","last_clean":"2023-10-06T11:15:37.048100+0000","last_became_active":"2023-10-06T11:15:37.044709+0000","last_became_peered":"2023-10-06T11:15:37.044709+0000","last_unstale":"2023-10-06T11:15:37.048100+0000","last_undegraded":"2023-10-06T11:15:37.048100+0000","last_fullsized":"2023-10-06T11:15:37.048100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:45.266361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062483+0000","last_change":"2023-10-06T11:15:37.051612+0000","last_active":"2023-10-06T11:15:37.062483+0000","last_peered":"2023-10-06T11:15:37.062483+0000","last_clean":"2023-10-06T11:15:37.062483+0000","last_became_active":"2023-10-06T11:15:37.051318+0000","last_became_peered":"2023-10-06T11:15:37.051318+0000","last_unstale":"2023-10-06T11:15:37.062483+0000","last_undegraded":"2023-10-06T11:15:37.062483+0000","last_fullsized":"2023-10-06T11:15:37.062483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:06.987074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062318+0000","last_change":"2023-10-06T11:15:37.054222+0000","last_active":"2023-10-06T11:15:37.062318+0000","last_peered":"2023-10-06T11:15:37.062318+0000","last_clean":"2023-10-06T11:15:37.062318+0000","last_became_active":"2023-10-06T11:15:37.053942+0000","last_became_peered":"2023-10-06T11:15:37.053942+0000","last_unstale":"2023-10-06T11:15:37.062318+0000","last_undegraded":"2023-10-06T11:15:37.062318+0000","last_fullsized":"2023-10-06T11:15:37.062318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:54.898509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.052853+0000","last_change":"2023-10-06T11:15:37.048801+0000","last_active":"2023-10-06T11:15:37.052853+0000","last_peered":"2023-10-06T11:15:37.052853+0000","last_clean":"2023-10-06T11:15:37.052853+0000","last_became_active":"2023-10-06T11:15:37.048482+0000","last_became_peered":"2023-10-06T11:15:37.048482+0000","last_unstale":"2023-10-06T11:15:37.052853+0000","last_undegraded":"2023-10-06T11:15:37.052853+0000","last_fullsized":"2023-10-06T11:15:37.052853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:34.291245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.052887+0000","last_change":"2023-10-06T11:15:37.047183+0000","last_active":"2023-10-06T11:15:37.052887+0000","last_peered":"2023-10-06T11:15:37.052887+0000","last_clean":"2023-10-06T11:15:37.052887+0000","last_became_active":"2023-10-06T11:15:37.046914+0000","last_became_peered":"2023-10-06T11:15:37.046914+0000","last_unstale":"2023-10-06T11:15:37.052887+0000","last_undegraded":"2023-10-06T11:15:37.052887+0000","last_fullsized":"2023-10-06T11:15:37.052887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:30.904840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063168+0000","last_change":"2023-10-06T11:15:37.060059+0000","last_active":"2023-10-06T11:15:37.063168+0000","last_peered":"2023-10-06T11:15:37.063168+0000","last_clean":"2023-10-06T11:15:37.063168+0000","last_became_active":"2023-10-06T11:15:37.058725+0000","last_became_peered":"2023-10-06T11:15:37.058725+0000","last_unstale":"2023-10-06T11:15:37.063168+0000","last_undegraded":"2023-10-06T11:15:37.063168+0000","last_fullsized":"2023-10-06T11:15:37.063168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:11.728543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057372+0000","last_change":"2023-10-06T11:15:37.048221+0000","last_active":"2023-10-06T11:15:37.057372+0000","last_peered":"2023-10-06T11:15:37.057372+0000","last_clean":"2023-10-06T11:15:37.057372+0000","last_became_active":"2023-10-06T11:15:37.047976+0000","last_became_peered":"2023-10-06T11:15:37.047976+0000","last_unstale":"2023-10-06T11:15:37.057372+0000","last_undegraded":"2023-10-06T11:15:37.057372+0000","last_fullsized":"2023-10-06T11:15:37.057372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.728342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.051972+0000","last_change":"2023-10-06T11:15:37.048380+0000","last_active":"2023-10-06T11:15:37.051972+0000","last_peered":"2023-10-06T11:15:37.051972+0000","last_clean":"2023-10-06T11:15:37.051972+0000","last_became_active":"2023-10-06T11:15:37.047240+0000","last_became_peered":"2023-10-06T11:15:37.047240+0000","last_unstale":"2023-10-06T11:15:37.051972+0000","last_undegraded":"2023-10-06T11:15:37.051972+0000","last_fullsized":"2023-10-06T11:15:37.051972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:53.844125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062447+0000","last_change":"2023-10-06T11:15:37.055002+0000","last_active":"2023-10-06T11:15:37.062447+0000","last_peered":"2023-10-06T11:15:37.062447+0000","last_clean":"2023-10-06T11:15:37.062447+0000","last_became_active":"2023-10-06T11:15:37.054732+0000","last_became_peered":"2023-10-06T11:15:37.054732+0000","last_unstale":"2023-10-06T11:15:37.062447+0000","last_undegraded":"2023-10-06T11:15:37.062447+0000","last_fullsized":"2023-10-06T11:15:37.062447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:54.021893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.064925+0000","last_change":"2023-10-06T11:15:37.063257+0000","last_active":"2023-10-06T11:15:37.064925+0000","last_peered":"2023-10-06T11:15:37.064925+0000","last_clean":"2023-10-06T11:15:37.064925+0000","last_became_active":"2023-10-06T11:15:37.062909+0000","last_became_peered":"2023-10-06T11:15:37.062909+0000","last_unstale":"2023-10-06T11:15:37.064925+0000","last_undegraded":"2023-10-06T11:15:37.064925+0000","last_fullsized":"2023-10-06T11:15:37.064925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:28.275662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054655+0000","last_change":"2023-10-06T11:15:37.050829+0000","last_active":"2023-10-06T11:15:37.054655+0000","last_peered":"2023-10-06T11:15:37.054655+0000","last_clean":"2023-10-06T11:15:37.054655+0000","last_became_active":"2023-10-06T11:15:37.050583+0000","last_became_peered":"2023-10-06T11:15:37.050583+0000","last_unstale":"2023-10-06T11:15:37.054655+0000","last_undegraded":"2023-10-06T11:15:37.054655+0000","last_fullsized":"2023-10-06T11:15:37.054655+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:35:35.939421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060755+0000","last_change":"2023-10-06T11:15:37.054211+0000","last_active":"2023-10-06T11:15:37.060755+0000","last_peered":"2023-10-06T11:15:37.060755+0000","last_clean":"2023-10-06T11:15:37.060755+0000","last_became_active":"2023-10-06T11:15:37.053911+0000","last_became_peered":"2023-10-06T11:15:37.053911+0000","last_unstale":"2023-10-06T11:15:37.060755+0000","last_undegraded":"2023-10-06T11:15:37.060755+0000","last_fullsized":"2023-10-06T11:15:37.060755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:50.053456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062874+0000","last_change":"2023-10-06T11:15:37.057595+0000","last_active":"2023-10-06T11:15:37.062874+0000","last_peered":"2023-10-06T11:15:37.062874+0000","last_clean":"2023-10-06T11:15:37.062874+0000","last_became_active":"2023-10-06T11:15:37.057309+0000","last_became_peered":"2023-10-06T11:15:37.057309+0000","last_unstale":"2023-10-06T11:15:37.062874+0000","last_undegraded":"2023-10-06T11:15:37.062874+0000","last_fullsized":"2023-10-06T11:15:37.062874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:25.736590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062342+0000","last_change":"2023-10-06T11:15:37.053735+0000","last_active":"2023-10-06T11:15:37.062342+0000","last_peered":"2023-10-06T11:15:37.062342+0000","last_clean":"2023-10-06T11:15:37.062342+0000","last_became_active":"2023-10-06T11:15:37.053423+0000","last_became_peered":"2023-10-06T11:15:37.053423+0000","last_unstale":"2023-10-06T11:15:37.062342+0000","last_undegraded":"2023-10-06T11:15:37.062342+0000","last_fullsized":"2023-10-06T11:15:37.062342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:35.525397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054327+0000","last_change":"2023-10-06T11:15:37.049415+0000","last_active":"2023-10-06T11:15:37.054327+0000","last_peered":"2023-10-06T11:15:37.054327+0000","last_clean":"2023-10-06T11:15:37.054327+0000","last_became_active":"2023-10-06T11:15:37.049092+0000","last_became_peered":"2023-10-06T11:15:37.049092+0000","last_unstale":"2023-10-06T11:15:37.054327+0000","last_undegraded":"2023-10-06T11:15:37.054327+0000","last_fullsized":"2023-10-06T11:15:37.054327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:54.898509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.064902+0000","last_change":"2023-10-06T11:15:37.063150+0000","last_active":"2023-10-06T11:15:37.064902+0000","last_peered":"2023-10-06T11:15:37.064902+0000","last_clean":"2023-10-06T11:15:37.064902+0000","last_became_active":"2023-10-06T11:15:37.062907+0000","last_became_peered":"2023-10-06T11:15:37.062907+0000","last_unstale":"2023-10-06T11:15:37.064902+0000","last_undegraded":"2023-10-06T11:15:37.064902+0000","last_fullsized":"2023-10-06T11:15:37.064902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:27.132776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.056643+0000","last_change":"2023-10-06T11:15:37.055364+0000","last_active":"2023-10-06T11:15:37.056643+0000","last_peered":"2023-10-06T11:15:37.056643+0000","last_clean":"2023-10-06T11:15:37.056643+0000","last_became_active":"2023-10-06T11:15:37.055113+0000","last_became_peered":"2023-10-06T11:15:37.055113+0000","last_unstale":"2023-10-06T11:15:37.056643+0000","last_undegraded":"2023-10-06T11:15:37.056643+0000","last_fullsized":"2023-10-06T11:15:37.056643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:21.980770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120167+0000","last_change":"2023-10-06T11:15:36.137806+0000","last_active":"2023-10-06T11:15:37.120167+0000","last_peered":"2023-10-06T11:15:37.120167+0000","last_clean":"2023-10-06T11:15:37.120167+0000","last_became_active":"2023-10-06T11:15:36.137582+0000","last_became_peered":"2023-10-06T11:15:36.137582+0000","last_unstale":"2023-10-06T11:15:37.120167+0000","last_undegraded":"2023-10-06T11:15:37.120167+0000","last_fullsized":"2023-10-06T11:15:37.120167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:51.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060488+0000","last_change":"2023-10-06T11:15:37.053295+0000","last_active":"2023-10-06T11:15:37.060488+0000","last_peered":"2023-10-06T11:15:37.060488+0000","last_clean":"2023-10-06T11:15:37.060488+0000","last_became_active":"2023-10-06T11:15:37.052847+0000","last_became_peered":"2023-10-06T11:15:37.052847+0000","last_unstale":"2023-10-06T11:15:37.060488+0000","last_undegraded":"2023-10-06T11:15:37.060488+0000","last_fullsized":"2023-10-06T11:15:37.060488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:49.916891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117551+0000","last_change":"2023-10-06T11:15:36.122208+0000","last_active":"2023-10-06T11:15:37.117551+0000","last_peered":"2023-10-06T11:15:37.117551+0000","last_clean":"2023-10-06T11:15:37.117551+0000","last_became_active":"2023-10-06T11:15:36.121958+0000","last_became_peered":"2023-10-06T11:15:36.121958+0000","last_unstale":"2023-10-06T11:15:37.117551+0000","last_undegraded":"2023-10-06T11:15:37.117551+0000","last_fullsized":"2023-10-06T11:15:37.117551+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062438+0000","last_change":"2023-10-06T11:15:37.059379+0000","last_active":"2023-10-06T11:15:37.062438+0000","last_peered":"2023-10-06T11:15:37.062438+0000","last_clean":"2023-10-06T11:15:37.062438+0000","last_became_active":"2023-10-06T11:15:37.059070+0000","last_became_peered":"2023-10-06T11:15:37.059070+0000","last_unstale":"2023-10-06T11:15:37.062438+0000","last_undegraded":"2023-10-06T11:15:37.062438+0000","last_fullsized":"2023-10-06T11:15:37.062438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:30.319797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119761+0000","last_change":"2023-10-06T11:15:36.126734+0000","last_active":"2023-10-06T11:15:37.119761+0000","last_peered":"2023-10-06T11:15:37.119761+0000","last_clean":"2023-10-06T11:15:37.119761+0000","last_became_active":"2023-10-06T11:15:36.124721+0000","last_became_peered":"2023-10-06T11:15:36.124721+0000","last_unstale":"2023-10-06T11:15:37.119761+0000","last_undegraded":"2023-10-06T11:15:37.119761+0000","last_fullsized":"2023-10-06T11:15:37.119761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:23.751162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063078+0000","last_change":"2023-10-06T11:15:37.059722+0000","last_active":"2023-10-06T11:15:37.063078+0000","last_peered":"2023-10-06T11:15:37.063078+0000","last_clean":"2023-10-06T11:15:37.063078+0000","last_became_active":"2023-10-06T11:15:37.059434+0000","last_became_peered":"2023-10-06T11:15:37.059434+0000","last_unstale":"2023-10-06T11:15:37.063078+0000","last_undegraded":"2023-10-06T11:15:37.063078+0000","last_fullsized":"2023-10-06T11:15:37.063078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:06.837995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119830+0000","last_change":"2023-10-06T11:15:36.124774+0000","last_active":"2023-10-06T11:15:37.119830+0000","last_peered":"2023-10-06T11:15:37.119830+0000","last_clean":"2023-10-06T11:15:37.119830+0000","last_became_active":"2023-10-06T11:15:36.124498+0000","last_became_peered":"2023-10-06T11:15:36.124498+0000","last_unstale":"2023-10-06T11:15:37.119830+0000","last_undegraded":"2023-10-06T11:15:37.119830+0000","last_fullsized":"2023-10-06T11:15:37.119830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:14.110807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063188+0000","last_change":"2023-10-06T11:15:37.060523+0000","last_active":"2023-10-06T11:15:37.063188+0000","last_peered":"2023-10-06T11:15:37.063188+0000","last_clean":"2023-10-06T11:15:37.063188+0000","last_became_active":"2023-10-06T11:15:37.060183+0000","last_became_peered":"2023-10-06T11:15:37.060183+0000","last_unstale":"2023-10-06T11:15:37.063188+0000","last_undegraded":"2023-10-06T11:15:37.063188+0000","last_fullsized":"2023-10-06T11:15:37.063188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:39.415302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117877+0000","last_change":"2023-10-06T11:15:36.123154+0000","last_active":"2023-10-06T11:15:37.117877+0000","last_peered":"2023-10-06T11:15:37.117877+0000","last_clean":"2023-10-06T11:15:37.117877+0000","last_became_active":"2023-10-06T11:15:36.122952+0000","last_became_peered":"2023-10-06T11:15:36.122952+0000","last_unstale":"2023-10-06T11:15:37.117877+0000","last_undegraded":"2023-10-06T11:15:37.117877+0000","last_fullsized":"2023-10-06T11:15:37.117877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:26.118855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.048000+0000","last_change":"2023-10-06T11:15:37.043230+0000","last_active":"2023-10-06T11:15:37.048000+0000","last_peered":"2023-10-06T11:15:37.048000+0000","last_clean":"2023-10-06T11:15:37.048000+0000","last_became_active":"2023-10-06T11:15:37.042907+0000","last_became_peered":"2023-10-06T11:15:37.042907+0000","last_unstale":"2023-10-06T11:15:37.048000+0000","last_undegraded":"2023-10-06T11:15:37.048000+0000","last_fullsized":"2023-10-06T11:15:37.048000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:28.159969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117709+0000","last_change":"2023-10-06T11:15:36.126663+0000","last_active":"2023-10-06T11:15:37.117709+0000","last_peered":"2023-10-06T11:15:37.117709+0000","last_clean":"2023-10-06T11:15:37.117709+0000","last_became_active":"2023-10-06T11:15:36.126269+0000","last_became_peered":"2023-10-06T11:15:36.126269+0000","last_unstale":"2023-10-06T11:15:37.117709+0000","last_undegraded":"2023-10-06T11:15:37.117709+0000","last_fullsized":"2023-10-06T11:15:37.117709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.948234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062428+0000","last_change":"2023-10-06T11:15:37.058907+0000","last_active":"2023-10-06T11:15:37.062428+0000","last_peered":"2023-10-06T11:15:37.062428+0000","last_clean":"2023-10-06T11:15:37.062428+0000","last_became_active":"2023-10-06T11:15:37.058626+0000","last_became_peered":"2023-10-06T11:15:37.058626+0000","last_unstale":"2023-10-06T11:15:37.062428+0000","last_undegraded":"2023-10-06T11:15:37.062428+0000","last_fullsized":"2023-10-06T11:15:37.062428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.532675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.042379+0000","last_change":"2023-10-06T11:15:36.122436+0000","last_active":"2023-10-06T11:15:37.042379+0000","last_peered":"2023-10-06T11:15:37.042379+0000","last_clean":"2023-10-06T11:15:37.042379+0000","last_became_active":"2023-10-06T11:15:36.122186+0000","last_became_peered":"2023-10-06T11:15:36.122186+0000","last_unstale":"2023-10-06T11:15:37.042379+0000","last_undegraded":"2023-10-06T11:15:37.042379+0000","last_fullsized":"2023-10-06T11:15:37.042379+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:56.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057013+0000","last_change":"2023-10-06T11:15:37.052635+0000","last_active":"2023-10-06T11:15:37.057013+0000","last_peered":"2023-10-06T11:15:37.057013+0000","last_clean":"2023-10-06T11:15:37.057013+0000","last_became_active":"2023-10-06T11:15:37.052392+0000","last_became_peered":"2023-10-06T11:15:37.052392+0000","last_unstale":"2023-10-06T11:15:37.057013+0000","last_undegraded":"2023-10-06T11:15:37.057013+0000","last_fullsized":"2023-10-06T11:15:37.057013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:36.431764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044330+0000","last_change":"2023-10-06T11:15:36.121327+0000","last_active":"2023-10-06T11:15:37.044330+0000","last_peered":"2023-10-06T11:15:37.044330+0000","last_clean":"2023-10-06T11:15:37.044330+0000","last_became_active":"2023-10-06T11:15:36.121047+0000","last_became_peered":"2023-10-06T11:15:36.121047+0000","last_unstale":"2023-10-06T11:15:37.044330+0000","last_undegraded":"2023-10-06T11:15:37.044330+0000","last_fullsized":"2023-10-06T11:15:37.044330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:55.211572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063307+0000","last_change":"2023-10-06T11:15:37.059020+0000","last_active":"2023-10-06T11:15:37.063307+0000","last_peered":"2023-10-06T11:15:37.063307+0000","last_clean":"2023-10-06T11:15:37.063307+0000","last_became_active":"2023-10-06T11:15:37.058746+0000","last_became_peered":"2023-10-06T11:15:37.058746+0000","last_unstale":"2023-10-06T11:15:37.063307+0000","last_undegraded":"2023-10-06T11:15:37.063307+0000","last_fullsized":"2023-10-06T11:15:37.063307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:28.786679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.045031+0000","last_change":"2023-10-06T11:15:36.125233+0000","last_active":"2023-10-06T11:15:37.045031+0000","last_peered":"2023-10-06T11:15:37.045031+0000","last_clean":"2023-10-06T11:15:37.045031+0000","last_became_active":"2023-10-06T11:15:36.124982+0000","last_became_peered":"2023-10-06T11:15:36.124982+0000","last_unstale":"2023-10-06T11:15:37.045031+0000","last_undegraded":"2023-10-06T11:15:37.045031+0000","last_fullsized":"2023-10-06T11:15:37.045031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:12:46.747585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054536+0000","last_change":"2023-10-06T11:15:37.053080+0000","last_active":"2023-10-06T11:15:37.054536+0000","last_peered":"2023-10-06T11:15:37.054536+0000","last_clean":"2023-10-06T11:15:37.054536+0000","last_became_active":"2023-10-06T11:15:37.052677+0000","last_became_peered":"2023-10-06T11:15:37.052677+0000","last_unstale":"2023-10-06T11:15:37.054536+0000","last_undegraded":"2023-10-06T11:15:37.054536+0000","last_fullsized":"2023-10-06T11:15:37.054536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:25.962155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044778+0000","last_change":"2023-10-06T11:15:36.123158+0000","last_active":"2023-10-06T11:15:37.044778+0000","last_peered":"2023-10-06T11:15:37.044778+0000","last_clean":"2023-10-06T11:15:37.044778+0000","last_became_active":"2023-10-06T11:15:36.122901+0000","last_became_peered":"2023-10-06T11:15:36.122901+0000","last_unstale":"2023-10-06T11:15:37.044778+0000","last_undegraded":"2023-10-06T11:15:37.044778+0000","last_fullsized":"2023-10-06T11:15:37.044778+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:35.759945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062245+0000","last_change":"2023-10-06T11:15:37.051499+0000","last_active":"2023-10-06T11:15:37.062245+0000","last_peered":"2023-10-06T11:15:37.062245+0000","last_clean":"2023-10-06T11:15:37.062245+0000","last_became_active":"2023-10-06T11:15:37.050015+0000","last_became_peered":"2023-10-06T11:15:37.050015+0000","last_unstale":"2023-10-06T11:15:37.062245+0000","last_undegraded":"2023-10-06T11:15:37.062245+0000","last_fullsized":"2023-10-06T11:15:37.062245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:28.159969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119091+0000","last_change":"2023-10-06T11:15:36.124153+0000","last_active":"2023-10-06T11:15:37.119091+0000","last_peered":"2023-10-06T11:15:37.119091+0000","last_clean":"2023-10-06T11:15:37.119091+0000","last_became_active":"2023-10-06T11:15:36.123525+0000","last_became_peered":"2023-10-06T11:15:36.123525+0000","last_unstale":"2023-10-06T11:15:37.119091+0000","last_undegraded":"2023-10-06T11:15:37.119091+0000","last_fullsized":"2023-10-06T11:15:37.119091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:59.101070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054639+0000","last_change":"2023-10-06T11:15:37.049449+0000","last_active":"2023-10-06T11:15:37.054639+0000","last_peered":"2023-10-06T11:15:37.054639+0000","last_clean":"2023-10-06T11:15:37.054639+0000","last_became_active":"2023-10-06T11:15:37.048871+0000","last_became_peered":"2023-10-06T11:15:37.048871+0000","last_unstale":"2023-10-06T11:15:37.054639+0000","last_undegraded":"2023-10-06T11:15:37.054639+0000","last_fullsized":"2023-10-06T11:15:37.054639+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:44.470711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"78'6","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120412+0000","last_change":"2023-10-06T11:15:36.122354+0000","last_active":"2023-10-06T11:15:37.120412+0000","last_peered":"2023-10-06T11:15:37.120412+0000","last_clean":"2023-10-06T11:15:37.120412+0000","last_became_active":"2023-10-06T11:15:36.122071+0000","last_became_peered":"2023-10-06T11:15:36.122071+0000","last_unstale":"2023-10-06T11:15:37.120412+0000","last_undegraded":"2023-10-06T11:15:37.120412+0000","last_fullsized":"2023-10-06T11:15:37.120412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:20.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.050965+0000","last_change":"2023-10-06T11:15:37.045266+0000","last_active":"2023-10-06T11:15:37.050965+0000","last_peered":"2023-10-06T11:15:37.050965+0000","last_clean":"2023-10-06T11:15:37.050965+0000","last_became_active":"2023-10-06T11:15:37.044984+0000","last_became_peered":"2023-10-06T11:15:37.044984+0000","last_unstale":"2023-10-06T11:15:37.050965+0000","last_undegraded":"2023-10-06T11:15:37.050965+0000","last_fullsized":"2023-10-06T11:15:37.050965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:45.266361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120265+0000","last_change":"2023-10-06T11:15:36.124324+0000","last_active":"2023-10-06T11:15:37.120265+0000","last_peered":"2023-10-06T11:15:37.120265+0000","last_clean":"2023-10-06T11:15:37.120265+0000","last_became_active":"2023-10-06T11:15:36.123818+0000","last_became_peered":"2023-10-06T11:15:36.123818+0000","last_unstale":"2023-10-06T11:15:37.120265+0000","last_undegraded":"2023-10-06T11:15:37.120265+0000","last_fullsized":"2023-10-06T11:15:37.120265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:09.591556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.063053+0000","last_change":"2023-10-06T11:15:37.059948+0000","last_active":"2023-10-06T11:15:37.063053+0000","last_peered":"2023-10-06T11:15:37.063053+0000","last_clean":"2023-10-06T11:15:37.063053+0000","last_became_active":"2023-10-06T11:15:37.059652+0000","last_became_peered":"2023-10-06T11:15:37.059652+0000","last_unstale":"2023-10-06T11:15:37.063053+0000","last_undegraded":"2023-10-06T11:15:37.063053+0000","last_fullsized":"2023-10-06T11:15:37.063053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:39.490991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.041452+0000","last_change":"2023-10-06T11:15:36.131293+0000","last_active":"2023-10-06T11:15:37.041452+0000","last_peered":"2023-10-06T11:15:37.041452+0000","last_clean":"2023-10-06T11:15:37.041452+0000","last_became_active":"2023-10-06T11:15:36.131007+0000","last_became_peered":"2023-10-06T11:15:36.131007+0000","last_unstale":"2023-10-06T11:15:37.041452+0000","last_undegraded":"2023-10-06T11:15:37.041452+0000","last_fullsized":"2023-10-06T11:15:37.041452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:53.062680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062399+0000","last_change":"2023-10-06T11:15:37.054674+0000","last_active":"2023-10-06T11:15:37.062399+0000","last_peered":"2023-10-06T11:15:37.062399+0000","last_clean":"2023-10-06T11:15:37.062399+0000","last_became_active":"2023-10-06T11:15:37.053965+0000","last_became_peered":"2023-10-06T11:15:37.053965+0000","last_unstale":"2023-10-06T11:15:37.062399+0000","last_undegraded":"2023-10-06T11:15:37.062399+0000","last_fullsized":"2023-10-06T11:15:37.062399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:49.623661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044133+0000","last_change":"2023-10-06T11:15:36.119816+0000","last_active":"2023-10-06T11:15:37.044133+0000","last_peered":"2023-10-06T11:15:37.044133+0000","last_clean":"2023-10-06T11:15:37.044133+0000","last_became_active":"2023-10-06T11:15:36.119078+0000","last_became_peered":"2023-10-06T11:15:36.119078+0000","last_unstale":"2023-10-06T11:15:37.044133+0000","last_undegraded":"2023-10-06T11:15:37.044133+0000","last_fullsized":"2023-10-06T11:15:37.044133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:51.560566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062949+0000","last_change":"2023-10-06T11:15:37.057911+0000","last_active":"2023-10-06T11:15:37.062949+0000","last_peered":"2023-10-06T11:15:37.062949+0000","last_clean":"2023-10-06T11:15:37.062949+0000","last_became_active":"2023-10-06T11:15:37.057143+0000","last_became_peered":"2023-10-06T11:15:37.057143+0000","last_unstale":"2023-10-06T11:15:37.062949+0000","last_undegraded":"2023-10-06T11:15:37.062949+0000","last_fullsized":"2023-10-06T11:15:37.062949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:52.795862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"78'8","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.121540+0000","last_change":"2023-10-06T11:15:36.122034+0000","last_active":"2023-10-06T11:15:37.121540+0000","last_peered":"2023-10-06T11:15:37.121540+0000","last_clean":"2023-10-06T11:15:37.121540+0000","last_became_active":"2023-10-06T11:15:36.121731+0000","last_became_peered":"2023-10-06T11:15:36.121731+0000","last_unstale":"2023-10-06T11:15:37.121540+0000","last_undegraded":"2023-10-06T11:15:37.121540+0000","last_fullsized":"2023-10-06T11:15:37.121540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:38.477070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.052410+0000","last_change":"2023-10-06T11:15:37.048728+0000","last_active":"2023-10-06T11:15:37.052410+0000","last_peered":"2023-10-06T11:15:37.052410+0000","last_clean":"2023-10-06T11:15:37.052410+0000","last_became_active":"2023-10-06T11:15:37.048445+0000","last_became_peered":"2023-10-06T11:15:37.048445+0000","last_unstale":"2023-10-06T11:15:37.052410+0000","last_undegraded":"2023-10-06T11:15:37.052410+0000","last_fullsized":"2023-10-06T11:15:37.052410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:24.169552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.118501+0000","last_change":"2023-10-06T11:15:36.122822+0000","last_active":"2023-10-06T11:15:37.118501+0000","last_peered":"2023-10-06T11:15:37.118501+0000","last_clean":"2023-10-06T11:15:37.118501+0000","last_became_active":"2023-10-06T11:15:36.122553+0000","last_became_peered":"2023-10-06T11:15:36.122553+0000","last_unstale":"2023-10-06T11:15:37.118501+0000","last_undegraded":"2023-10-06T11:15:37.118501+0000","last_fullsized":"2023-10-06T11:15:37.118501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:52.830204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062377+0000","last_change":"2023-10-06T11:15:37.058325+0000","last_active":"2023-10-06T11:15:37.062377+0000","last_peered":"2023-10-06T11:15:37.062377+0000","last_clean":"2023-10-06T11:15:37.062377+0000","last_became_active":"2023-10-06T11:15:37.058053+0000","last_became_peered":"2023-10-06T11:15:37.058053+0000","last_unstale":"2023-10-06T11:15:37.062377+0000","last_undegraded":"2023-10-06T11:15:37.062377+0000","last_fullsized":"2023-10-06T11:15:37.062377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.728342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.050386+0000","last_change":"2023-10-06T11:15:36.128795+0000","last_active":"2023-10-06T11:15:37.050386+0000","last_peered":"2023-10-06T11:15:37.050386+0000","last_clean":"2023-10-06T11:15:37.050386+0000","last_became_active":"2023-10-06T11:15:36.125293+0000","last_became_peered":"2023-10-06T11:15:36.125293+0000","last_unstale":"2023-10-06T11:15:37.050386+0000","last_undegraded":"2023-10-06T11:15:37.050386+0000","last_fullsized":"2023-10-06T11:15:37.050386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:29.890919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057415+0000","last_change":"2023-10-06T11:15:37.050805+0000","last_active":"2023-10-06T11:15:37.057415+0000","last_peered":"2023-10-06T11:15:37.057415+0000","last_clean":"2023-10-06T11:15:37.057415+0000","last_became_active":"2023-10-06T11:15:37.050535+0000","last_became_peered":"2023-10-06T11:15:37.050535+0000","last_unstale":"2023-10-06T11:15:37.057415+0000","last_undegraded":"2023-10-06T11:15:37.057415+0000","last_fullsized":"2023-10-06T11:15:37.057415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:39.490991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043435+0000","last_change":"2023-10-06T11:15:36.124167+0000","last_active":"2023-10-06T11:15:37.043435+0000","last_peered":"2023-10-06T11:15:37.043435+0000","last_clean":"2023-10-06T11:15:37.043435+0000","last_became_active":"2023-10-06T11:15:36.123897+0000","last_became_peered":"2023-10-06T11:15:36.123897+0000","last_unstale":"2023-10-06T11:15:37.043435+0000","last_undegraded":"2023-10-06T11:15:37.043435+0000","last_fullsized":"2023-10-06T11:15:37.043435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:10.714622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.054621+0000","last_change":"2023-10-06T11:15:37.049482+0000","last_active":"2023-10-06T11:15:37.054621+0000","last_peered":"2023-10-06T11:15:37.054621+0000","last_clean":"2023-10-06T11:15:37.054621+0000","last_became_active":"2023-10-06T11:15:37.049238+0000","last_became_peered":"2023-10-06T11:15:37.049238+0000","last_unstale":"2023-10-06T11:15:37.054621+0000","last_undegraded":"2023-10-06T11:15:37.054621+0000","last_fullsized":"2023-10-06T11:15:37.054621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:00.659381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043894+0000","last_change":"2023-10-06T11:15:36.124009+0000","last_active":"2023-10-06T11:15:37.043894+0000","last_peered":"2023-10-06T11:15:37.043894+0000","last_clean":"2023-10-06T11:15:37.043894+0000","last_became_active":"2023-10-06T11:15:36.123728+0000","last_became_peered":"2023-10-06T11:15:36.123728+0000","last_unstale":"2023-10-06T11:15:37.043894+0000","last_undegraded":"2023-10-06T11:15:37.043894+0000","last_fullsized":"2023-10-06T11:15:37.043894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:38.401381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060502+0000","last_change":"2023-10-06T11:15:37.055186+0000","last_active":"2023-10-06T11:15:37.060502+0000","last_peered":"2023-10-06T11:15:37.060502+0000","last_clean":"2023-10-06T11:15:37.060502+0000","last_became_active":"2023-10-06T11:15:37.054584+0000","last_became_peered":"2023-10-06T11:15:37.054584+0000","last_unstale":"2023-10-06T11:15:37.060502+0000","last_undegraded":"2023-10-06T11:15:37.060502+0000","last_fullsized":"2023-10-06T11:15:37.060502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:59.167930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043137+0000","last_change":"2023-10-06T11:15:36.125387+0000","last_active":"2023-10-06T11:15:37.043137+0000","last_peered":"2023-10-06T11:15:37.043137+0000","last_clean":"2023-10-06T11:15:37.043137+0000","last_became_active":"2023-10-06T11:15:36.124949+0000","last_became_peered":"2023-10-06T11:15:36.124949+0000","last_unstale":"2023-10-06T11:15:37.043137+0000","last_undegraded":"2023-10-06T11:15:37.043137+0000","last_fullsized":"2023-10-06T11:15:37.043137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:24.948234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.058365+0000","last_change":"2023-10-06T11:15:37.049074+0000","last_active":"2023-10-06T11:15:37.058365+0000","last_peered":"2023-10-06T11:15:37.058365+0000","last_clean":"2023-10-06T11:15:37.058365+0000","last_became_active":"2023-10-06T11:15:37.048797+0000","last_became_peered":"2023-10-06T11:15:37.048797+0000","last_unstale":"2023-10-06T11:15:37.058365+0000","last_undegraded":"2023-10-06T11:15:37.058365+0000","last_fullsized":"2023-10-06T11:15:37.058365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:44.470711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.040006+0000","last_change":"2023-10-06T11:15:36.125888+0000","last_active":"2023-10-06T11:15:37.040006+0000","last_peered":"2023-10-06T11:15:37.040006+0000","last_clean":"2023-10-06T11:15:37.040006+0000","last_became_active":"2023-10-06T11:15:36.125656+0000","last_became_peered":"2023-10-06T11:15:36.125656+0000","last_unstale":"2023-10-06T11:15:37.040006+0000","last_undegraded":"2023-10-06T11:15:37.040006+0000","last_fullsized":"2023-10-06T11:15:37.040006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:29.305876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.064909+0000","last_change":"2023-10-06T11:15:37.063116+0000","last_active":"2023-10-06T11:15:37.064909+0000","last_peered":"2023-10-06T11:15:37.064909+0000","last_clean":"2023-10-06T11:15:37.064909+0000","last_became_active":"2023-10-06T11:15:37.062820+0000","last_became_peered":"2023-10-06T11:15:37.062820+0000","last_unstale":"2023-10-06T11:15:37.064909+0000","last_undegraded":"2023-10-06T11:15:37.064909+0000","last_fullsized":"2023-10-06T11:15:37.064909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:49.916891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043720+0000","last_change":"2023-10-06T11:15:36.122358+0000","last_active":"2023-10-06T11:15:37.043720+0000","last_peered":"2023-10-06T11:15:37.043720+0000","last_clean":"2023-10-06T11:15:37.043720+0000","last_became_active":"2023-10-06T11:15:36.122096+0000","last_became_peered":"2023-10-06T11:15:36.122096+0000","last_unstale":"2023-10-06T11:15:37.043720+0000","last_undegraded":"2023-10-06T11:15:37.043720+0000","last_fullsized":"2023-10-06T11:15:37.043720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:53.007972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.057396+0000","last_change":"2023-10-06T11:15:37.050231+0000","last_active":"2023-10-06T11:15:37.057396+0000","last_peered":"2023-10-06T11:15:37.057396+0000","last_clean":"2023-10-06T11:15:37.057396+0000","last_became_active":"2023-10-06T11:15:37.049955+0000","last_became_peered":"2023-10-06T11:15:37.049955+0000","last_unstale":"2023-10-06T11:15:37.057396+0000","last_undegraded":"2023-10-06T11:15:37.057396+0000","last_fullsized":"2023-10-06T11:15:37.057396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:28.275662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.040809+0000","last_change":"2023-10-06T11:15:36.116400+0000","last_active":"2023-10-06T11:15:37.040809+0000","last_peered":"2023-10-06T11:15:37.040809+0000","last_clean":"2023-10-06T11:15:37.040809+0000","last_became_active":"2023-10-06T11:15:36.116160+0000","last_became_peered":"2023-10-06T11:15:36.116160+0000","last_unstale":"2023-10-06T11:15:37.040809+0000","last_undegraded":"2023-10-06T11:15:37.040809+0000","last_fullsized":"2023-10-06T11:15:37.040809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:58.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060448+0000","last_change":"2023-10-06T11:15:37.054597+0000","last_active":"2023-10-06T11:15:37.060448+0000","last_peered":"2023-10-06T11:15:37.060448+0000","last_clean":"2023-10-06T11:15:37.060448+0000","last_became_active":"2023-10-06T11:15:37.053581+0000","last_became_peered":"2023-10-06T11:15:37.053581+0000","last_unstale":"2023-10-06T11:15:37.060448+0000","last_undegraded":"2023-10-06T11:15:37.060448+0000","last_fullsized":"2023-10-06T11:15:37.060448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:30.319797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.038666+0000","last_change":"2023-10-06T11:15:36.127703+0000","last_active":"2023-10-06T11:15:37.038666+0000","last_peered":"2023-10-06T11:15:37.038666+0000","last_clean":"2023-10-06T11:15:37.038666+0000","last_became_active":"2023-10-06T11:15:36.127455+0000","last_became_peered":"2023-10-06T11:15:36.127455+0000","last_unstale":"2023-10-06T11:15:37.038666+0000","last_undegraded":"2023-10-06T11:15:37.038666+0000","last_fullsized":"2023-10-06T11:15:37.038666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:23.467332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.047498+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:15:37.047498+0000","last_peered":"2023-10-06T11:15:37.047498+0000","last_clean":"2023-10-06T11:15:37.047498+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:15:37.047498+0000","last_undegraded":"2023-10-06T11:15:37.047498+0000","last_fullsized":"2023-10-06T11:15:37.047498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060222+0000","last_change":"2023-10-06T11:15:37.058675+0000","last_active":"2023-10-06T11:15:37.060222+0000","last_peered":"2023-10-06T11:15:37.060222+0000","last_clean":"2023-10-06T11:15:37.060222+0000","last_became_active":"2023-10-06T11:15:37.058337+0000","last_became_peered":"2023-10-06T11:15:37.058337+0000","last_unstale":"2023-10-06T11:15:37.060222+0000","last_undegraded":"2023-10-06T11:15:37.060222+0000","last_fullsized":"2023-10-06T11:15:37.060222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:35.292084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043050+0000","last_change":"2023-10-06T11:15:36.121233+0000","last_active":"2023-10-06T11:15:37.043050+0000","last_peered":"2023-10-06T11:15:37.043050+0000","last_clean":"2023-10-06T11:15:37.043050+0000","last_became_active":"2023-10-06T11:15:36.120958+0000","last_became_peered":"2023-10-06T11:15:36.120958+0000","last_unstale":"2023-10-06T11:15:37.043050+0000","last_undegraded":"2023-10-06T11:15:37.043050+0000","last_fullsized":"2023-10-06T11:15:37.043050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:05.824074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.043816+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:15:37.043816+0000","last_peered":"2023-10-06T11:15:37.043816+0000","last_clean":"2023-10-06T11:15:37.043816+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:15:37.043816+0000","last_undegraded":"2023-10-06T11:15:37.043816+0000","last_fullsized":"2023-10-06T11:15:37.043816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.055331+0000","last_change":"2023-10-06T11:15:37.052374+0000","last_active":"2023-10-06T11:15:37.055331+0000","last_peered":"2023-10-06T11:15:37.055331+0000","last_clean":"2023-10-06T11:15:37.055331+0000","last_became_active":"2023-10-06T11:15:37.052106+0000","last_became_peered":"2023-10-06T11:15:37.052106+0000","last_unstale":"2023-10-06T11:15:37.055331+0000","last_undegraded":"2023-10-06T11:15:37.055331+0000","last_fullsized":"2023-10-06T11:15:37.055331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:59.167930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.117951+0000","last_change":"2023-10-06T11:15:36.124455+0000","last_active":"2023-10-06T11:15:37.117951+0000","last_peered":"2023-10-06T11:15:37.117951+0000","last_clean":"2023-10-06T11:15:37.117951+0000","last_became_active":"2023-10-06T11:15:36.123994+0000","last_became_peered":"2023-10-06T11:15:36.123994+0000","last_unstale":"2023-10-06T11:15:37.117951+0000","last_undegraded":"2023-10-06T11:15:37.117951+0000","last_fullsized":"2023-10-06T11:15:37.117951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:34.511475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.037658+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:15:37.037658+0000","last_peered":"2023-10-06T11:15:37.037658+0000","last_clean":"2023-10-06T11:15:37.037658+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:15:37.037658+0000","last_undegraded":"2023-10-06T11:15:37.037658+0000","last_fullsized":"2023-10-06T11:15:37.037658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062930+0000","last_change":"2023-10-06T11:15:37.057800+0000","last_active":"2023-10-06T11:15:37.062930+0000","last_peered":"2023-10-06T11:15:37.062930+0000","last_clean":"2023-10-06T11:15:37.062930+0000","last_became_active":"2023-10-06T11:15:37.057488+0000","last_became_peered":"2023-10-06T11:15:37.057488+0000","last_unstale":"2023-10-06T11:15:37.062930+0000","last_undegraded":"2023-10-06T11:15:37.062930+0000","last_fullsized":"2023-10-06T11:15:37.062930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:12:47.761506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.118609+0000","last_change":"2023-10-06T11:15:36.131064+0000","last_active":"2023-10-06T11:15:37.118609+0000","last_peered":"2023-10-06T11:15:37.118609+0000","last_clean":"2023-10-06T11:15:37.118609+0000","last_became_active":"2023-10-06T11:15:36.130843+0000","last_became_peered":"2023-10-06T11:15:36.130843+0000","last_unstale":"2023-10-06T11:15:37.118609+0000","last_undegraded":"2023-10-06T11:15:37.118609+0000","last_fullsized":"2023-10-06T11:15:37.118609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:20.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.044203+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:15:37.044203+0000","last_peered":"2023-10-06T11:15:37.044203+0000","last_clean":"2023-10-06T11:15:37.044203+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:15:37.044203+0000","last_undegraded":"2023-10-06T11:15:37.044203+0000","last_fullsized":"2023-10-06T11:15:37.044203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.047382+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:15:37.047382+0000","last_peered":"2023-10-06T11:15:37.047382+0000","last_clean":"2023-10-06T11:15:37.047382+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:15:37.047382+0000","last_undegraded":"2023-10-06T11:15:37.047382+0000","last_fullsized":"2023-10-06T11:15:37.047382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060470+0000","last_change":"2023-10-06T11:15:37.053128+0000","last_active":"2023-10-06T11:15:37.060470+0000","last_peered":"2023-10-06T11:15:37.060470+0000","last_clean":"2023-10-06T11:15:37.060470+0000","last_became_active":"2023-10-06T11:15:37.052536+0000","last_became_peered":"2023-10-06T11:15:37.052536+0000","last_unstale":"2023-10-06T11:15:37.060470+0000","last_undegraded":"2023-10-06T11:15:37.060470+0000","last_fullsized":"2023-10-06T11:15:37.060470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:25.962155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.119680+0000","last_change":"2023-10-06T11:15:36.120546+0000","last_active":"2023-10-06T11:15:37.119680+0000","last_peered":"2023-10-06T11:15:37.119680+0000","last_clean":"2023-10-06T11:15:37.119680+0000","last_became_active":"2023-10-06T11:15:36.120286+0000","last_became_peered":"2023-10-06T11:15:36.120286+0000","last_unstale":"2023-10-06T11:15:37.119680+0000","last_undegraded":"2023-10-06T11:15:37.119680+0000","last_fullsized":"2023-10-06T11:15:37.119680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.047472+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:15:37.047472+0000","last_peered":"2023-10-06T11:15:37.047472+0000","last_clean":"2023-10-06T11:15:37.047472+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:15:37.047472+0000","last_undegraded":"2023-10-06T11:15:37.047472+0000","last_fullsized":"2023-10-06T11:15:37.047472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.062825+0000","last_change":"2023-10-06T11:15:37.058898+0000","last_active":"2023-10-06T11:15:37.062825+0000","last_peered":"2023-10-06T11:15:37.062825+0000","last_clean":"2023-10-06T11:15:37.062825+0000","last_became_active":"2023-10-06T11:15:37.058668+0000","last_became_peered":"2023-10-06T11:15:37.058668+0000","last_unstale":"2023-10-06T11:15:37.062825+0000","last_undegraded":"2023-10-06T11:15:37.062825+0000","last_fullsized":"2023-10-06T11:15:37.062825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:04.765470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.120109+0000","last_change":"2023-10-06T11:15:36.129558+0000","last_active":"2023-10-06T11:15:37.120109+0000","last_peered":"2023-10-06T11:15:37.120109+0000","last_clean":"2023-10-06T11:15:37.120109+0000","last_became_active":"2023-10-06T11:15:36.129273+0000","last_became_peered":"2023-10-06T11:15:36.129273+0000","last_unstale":"2023-10-06T11:15:37.120109+0000","last_undegraded":"2023-10-06T11:15:37.120109+0000","last_fullsized":"2023-10-06T11:15:37.120109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:00:05.824074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.048346+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:15:37.048346+0000","last_peered":"2023-10-06T11:15:37.048346+0000","last_clean":"2023-10-06T11:15:37.048346+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:15:37.048346+0000","last_undegraded":"2023-10-06T11:15:37.048346+0000","last_fullsized":"2023-10-06T11:15:37.048346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.060074+0000","last_change":"2023-10-06T11:15:37.053325+0000","last_active":"2023-10-06T11:15:37.060074+0000","last_peered":"2023-10-06T11:15:37.060074+0000","last_clean":"2023-10-06T11:15:37.060074+0000","last_became_active":"2023-10-06T11:15:37.053005+0000","last_became_peered":"2023-10-06T11:15:37.053005+0000","last_unstale":"2023-10-06T11:15:37.060074+0000","last_undegraded":"2023-10-06T11:15:37.060074+0000","last_fullsized":"2023-10-06T11:15:37.060074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:27.132776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.041399+0000","last_change":"2023-10-06T11:15:36.129700+0000","last_active":"2023-10-06T11:15:37.041399+0000","last_peered":"2023-10-06T11:15:37.041399+0000","last_clean":"2023-10-06T11:15:37.041399+0000","last_became_active":"2023-10-06T11:15:36.129398+0000","last_became_peered":"2023-10-06T11:15:36.129398+0000","last_unstale":"2023-10-06T11:15:37.041399+0000","last_undegraded":"2023-10-06T11:15:37.041399+0000","last_fullsized":"2023-10-06T11:15:37.041399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:38.477070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.050474+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:15:37.050474+0000","last_peered":"2023-10-06T11:15:37.050474+0000","last_clean":"2023-10-06T11:15:37.050474+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:15:37.050474+0000","last_undegraded":"2023-10-06T11:15:37.050474+0000","last_fullsized":"2023-10-06T11:15:37.050474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.051990+0000","last_change":"2023-10-06T11:15:37.048563+0000","last_active":"2023-10-06T11:15:37.051990+0000","last_peered":"2023-10-06T11:15:37.051990+0000","last_clean":"2023-10-06T11:15:37.051990+0000","last_became_active":"2023-10-06T11:15:37.047603+0000","last_became_peered":"2023-10-06T11:15:37.047603+0000","last_unstale":"2023-10-06T11:15:37.051990+0000","last_undegraded":"2023-10-06T11:15:37.051990+0000","last_fullsized":"2023-10-06T11:15:37.051990+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:36.094805+0000","last_clean_scrub_stamp":"2023-10-06T11:15:36.094805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:52.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.037566+0000","last_change":"2023-10-06T11:15:36.127190+0000","last_active":"2023-10-06T11:15:37.037566+0000","last_peered":"2023-10-06T11:15:37.037566+0000","last_clean":"2023-10-06T11:15:37.037566+0000","last_became_active":"2023-10-06T11:15:36.126951+0000","last_became_peered":"2023-10-06T11:15:36.126951+0000","last_unstale":"2023-10-06T11:15:37.037566+0000","last_undegraded":"2023-10-06T11:15:37.037566+0000","last_fullsized":"2023-10-06T11:15:37.037566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:35.080884+0000","last_clean_scrub_stamp":"2023-10-06T11:15:35.080884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:48.461464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-06T11:15:37.045046+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:15:37.045046+0000","last_peered":"2023-10-06T11:15:37.045046+0000","last_clean":"2023-10-06T11:15:37.045046+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:15:37.045046+0000","last_undegraded":"2023-10-06T11:15:37.045046+0000","last_fullsized":"2023-10-06T11:15:37.045046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073024,"statfs":{"total":96636764160,"available":96330776576,"internally_reserved":0,"allocated":1564672,"data_stored":1042524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.498,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.503},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.39000000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4319999999999999,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":1.036,"15min":1.117},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77800000000000002,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60099999999999998,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.78200000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78600000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.438},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80300000000000005,"5min":0.872,"15min":0.872},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":452752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.629}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":452280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.42299999999999999,"15min":0.436},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83399999999999996,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42399999999999999,"15min":0.42699999999999999},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.255},"max":{"1min":1.375,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41399999999999998,"15min":0.41799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.4319999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.311},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.48899999999999999,"15min":0.502},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.92700000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.627,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.4219999999999999,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.5150000000000001,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.748,"15min":0.71699999999999997},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":7.2400000000000002,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.62},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.3809999999999998,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.6919999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.495},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.1799999999999999,"5min":1.508,"15min":1.508},"last":0.54200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298816,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073024,"statfs":{"total":96636764160,"available":96330776576,"internally_reserved":0,"allocated":1564672,"data_stored":1042488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.221,"5min":0.214,"15min":0.214},"max":{"1min":0.46000000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.252},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51900000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.499,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.37,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52700000000000002,"5min":0.626,"15min":0.626},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.54800000000000004,"5min":0.626,"15min":0.626},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.495},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44400000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0680000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073604,"statfs":{"total":96636764160,"available":96331370496,"internally_reserved":0,"allocated":970752,"data_stored":452640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.23799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.79600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":978944,"data_stored":453622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.496}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":452086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.439},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":983040,"data_stored":453644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.501},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.438}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:41.610 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:15:41.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:15:41.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.767+0000 7fb75d583700 1 Processor -- start 2023-10-06T11:15:41.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.767+0000 7fb75d583700 1 -- start start 2023-10-06T11:15:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb75d583700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb758159150 0x7fb7580cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb75d583700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75815b8b0 con 0x7fb7580cd3d0 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb75d583700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75815aca0 con 0x7fb7580cd940 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb75d583700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75815af80 con 0x7fb758159150 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb7577fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7580cd3d0 0x7fb75815bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58958/0 (socket says 172.21.15.55:58958) 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb7577fe700 1 -- 172.21.15.55:0/1251455279 learned_addr learned my addr 172.21.15.55:0/1251455279 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb756ffd700 1 --2- 172.21.15.55:0/1251455279 >> v2:172.21.15.142:3300/0 conn(0x7fb758159150 0x7fb7580cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb755ffb700 1 -- 172.21.15.55:0/1251455279 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477990024 0 0) 0x7fb75815b8b0 con 0x7fb7580cd3d0 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.768+0000 7fb755ffb700 1 -- 172.21.15.55:0/1251455279 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744003570 con 0x7fb7580cd3d0 2023-10-06T11:15:41.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb756ffd700 1 -- 172.21.15.55:0/1251455279 >> v1:172.21.15.142:6789/0 conn(0x7fb7580cd940 legacy=0x7fb7580cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb756ffd700 1 -- 172.21.15.55:0/1251455279 >> v1:172.21.15.55:6789/0 conn(0x7fb7580cd3d0 legacy=0x7fb75815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb756ffd700 1 -- 172.21.15.55:0/1251455279 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75815b260 con 0x7fb758159150 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb756ffd700 1 --2- 172.21.15.55:0/1251455279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb758159150 0x7fb7580cb3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb748009910 tx=0x7fb7480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19ca4efffb140c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb755ffb700 1 -- 172.21.15.55:0/1251455279 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800b640 con 0x7fb758159150 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb755ffb700 1 -- 172.21.15.55:0/1251455279 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74800b7a0 con 0x7fb758159150 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb755ffb700 1 -- 172.21.15.55:0/1251455279 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800bb60 con 0x7fb758159150 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb75d583700 1 -- 172.21.15.55:0/1251455279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb758159150 msgr2=0x7fb7580cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.769+0000 7fb75d583700 1 --2- 172.21.15.55:0/1251455279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb758159150 0x7fb7580cb3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb748009910 tx=0x7fb7480091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.770+0000 7fb75d583700 1 -- 172.21.15.55:0/1251455279 shutdown_connections 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.770+0000 7fb75d583700 1 --2- 172.21.15.55:0/1251455279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb758159150 0x7fb7580cb3a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.770+0000 7fb75d583700 1 -- 172.21.15.55:0/1251455279 >> 172.21.15.55:0/1251455279 conn(0x7fb75806ece0 msgr2=0x7fb75806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.770+0000 7fb75d583700 1 -- 172.21.15.55:0/1251455279 shutdown_connections 2023-10-06T11:15:41.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.770+0000 7fb75d583700 1 -- 172.21.15.55:0/1251455279 wait complete. 2023-10-06T11:15:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.771+0000 7fb75d583700 1 Processor -- start 2023-10-06T11:15:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.771+0000 7fb75d583700 1 -- start start 2023-10-06T11:15:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.771+0000 7fb75d583700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7580cd3d0 0x7fb758157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.771+0000 7fb75d583700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7580cd940 0x7fb7580c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb75d583700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 0x7fb7581560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb75d583700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758155c60 con 0x7fb758159150 2023-10-06T11:15:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb75d583700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758154e00 con 0x7fb7580cd3d0 2023-10-06T11:15:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb75d583700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb758155050 con 0x7fb7580cd940 2023-10-06T11:15:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 0x7fb7581560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 0x7fb7581560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35184/0 (socket says 172.21.15.55:35184) 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 -- 172.21.15.55:0/26270053 learned_addr learned my addr 172.21.15.55:0/26270053 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7567fc700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7580cd940 0x7fb7580c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb756ffd700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7580cd3d0 0x7fb758157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 -- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7580cd940 msgr2=0x7fb7580c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7580cd940 0x7fb7580c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 -- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7580cd3d0 msgr2=0x7fb758157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7580cd3d0 0x7fb758157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 -- 172.21.15.55:0/26270053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748009420 con 0x7fb758159150 2023-10-06T11:15:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb7577fe700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 0x7fb7581560f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb75000cc40 tx=0x7fb750001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000a960 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75000aac0 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb758155330 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000ae40 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.772+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7581558f0 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.773+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb758155e10 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.774+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb750007300 con 0x7fb758159150 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.774+0000 7fb74effd700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb738066f30 0x7fb7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.774+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb750084be0 con 0x7fb758159150 2023-10-06T11:15:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.774+0000 7fb756ffd700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb738066f30 0x7fb7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.775+0000 7fb756ffd700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb738066f30 0x7fb7380693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb7480093f0 tx=0x7fb748017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:41.779+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb750051ba0 con 0x7fb758159150 2023-10-06T11:15:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.052+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb75805f230 con 0x7fb758159150 2023-10-06T11:15:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.059+0000 7fb74effd700 1 -- 172.21.15.55:0/26270053 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb7500551c0 con 0x7fb758159150 2023-10-06T11:15:42.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb738066f30 msgr2=0x7fb7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb738066f30 0x7fb7380693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb7480093f0 tx=0x7fb748017000 comp rx=0 tx=0).stop 2023-10-06T11:15:42.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 msgr2=0x7fb7581560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 0x7fb7581560f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb75000cc40 tx=0x7fb750001a00 comp rx=0 tx=0).stop 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 shutdown_connections 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb738066f30 0x7fb7380693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb758159150 0x7fb7581560f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7580cd3d0 0x7fb758157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 --2- 172.21.15.55:0/26270053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7580cd940 0x7fb7580c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 >> 172.21.15.55:0/26270053 conn(0x7fb75806ece0 msgr2=0x7fb758159520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 shutdown_connections 2023-10-06T11:15:42.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.061+0000 7fb75d583700 1 -- 172.21.15.55:0/26270053 wait complete. 2023-10-06T11:15:42.065 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-10-06T11:15:42.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:42.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.192+0000 7f5318d67700 1 Processor -- start 2023-10-06T11:15:42.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.192+0000 7f5318d67700 1 -- start start 2023-10-06T11:15:42.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f5318d67700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53140cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f5318d67700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53140ad5e0 0x7f53140ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f5318d67700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140ca600 con 0x7f53140ad210 2023-10-06T11:15:42.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f5318d67700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140cecf0 con 0x7f53140ad5e0 2023-10-06T11:15:42.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f5318d67700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140cefd0 con 0x7f531415db10 2023-10-06T11:15:42.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f531259c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f53140ad210 0x7f531415d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58960/0 (socket says 172.21.15.55:58960) 2023-10-06T11:15:42.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.193+0000 7f531259c700 1 -- 172.21.15.55:0/1456585655 learned_addr learned my addr 172.21.15.55:0/1456585655 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:42.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f5312d9d700 1 --2- 172.21.15.55:0/1456585655 >> v2:172.21.15.142:3300/0 conn(0x7f53140ad5e0 0x7f53140ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f5311d9b700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53140cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847846449 0 0) 0x7f53140ca600 con 0x7f53140ad210 2023-10-06T11:15:42.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5300003570 con 0x7f53140ad210 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685823252 0 0) 0x7f5300003570 con 0x7f53140ad210 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 msgr2=0x7f53140cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53140cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 >> v2:172.21.15.142:3300/0 conn(0x7f53140ad5e0 msgr2=0x7f53140ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 --2- 172.21.15.55:0/1456585655 >> v2:172.21.15.142:3300/0 conn(0x7f53140ad5e0 0x7f53140ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140cca90 con 0x7f53140ad210 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f5304001970 con 0x7f53140ad210 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 >> v1:172.21.15.55:6789/0 conn(0x7f53140ad210 legacy=0x7f531415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f5300003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5300004810 0x7f5300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140cecf0 con 0x7f5300003a60 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140cefd0 con 0x7f5300004810 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530000ba60 con 0x7f531415db10 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531259c700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f5300003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f5311d9b700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5300004810 0x7f5300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f5312d9d700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531259c700 1 -- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 msgr2=0x7f53000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531259c700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531259c700 1 -- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5300004810 msgr2=0x7f5300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531259c700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5300004810 0x7f5300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f531259c700 1 -- 172.21.15.55:0/1456585655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300003570 con 0x7f5300003a60 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.194+0000 7f5312d9d700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f531415db10 0x7f53000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f531259c700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f5300003e70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f530400c6e0 tx=0x7f5304007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15d01899caf357d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304005b70 con 0x7f5300003a60 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304005cf0 con 0x7f5300003a60 2023-10-06T11:15:42.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f531159a700 1 -- 172.21.15.55:0/1456585655 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304007360 con 0x7f5300003a60 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5318d67700 1 -- 172.21.15.55:0/1456585655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 msgr2=0x7f5300003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5318d67700 1 --2- 172.21.15.55:0/1456585655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f5300003e70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f530400c6e0 tx=0x7f5304007ca0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5312d9d700 1 -- 172.21.15.55:0/1456585655 reap_dead start 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5318d67700 1 -- 172.21.15.55:0/1456585655 shutdown_connections 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5318d67700 1 -- 172.21.15.55:0/1456585655 >> 172.21.15.55:0/1456585655 conn(0x7f5314067d90 msgr2=0x7f53140ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5318d67700 1 -- 172.21.15.55:0/1456585655 shutdown_connections 2023-10-06T11:15:42.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.195+0000 7f5318d67700 1 -- 172.21.15.55:0/1456585655 wait complete. 2023-10-06T11:15:42.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.196+0000 7f5318d67700 1 Processor -- start 2023-10-06T11:15:42.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 -- start start 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f531416a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53140c5280 0x7f53140b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53140c75a0 0x7f53140c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140c6a50 con 0x7f5300003a60 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531415a090 con 0x7f53140c5280 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5318d67700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140c65c0 con 0x7f53140c75a0 2023-10-06T11:15:42.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f531259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f531416a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f531259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f531416a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35198/0 (socket says 172.21.15.55:35198) 2023-10-06T11:15:42.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f531259c700 1 -- 172.21.15.55:0/3734848482 learned_addr learned my addr 172.21.15.55:0/3734848482 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:42.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.197+0000 7f5311d9b700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53140c5280 0x7f53140b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f5312d9d700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53140c75a0 0x7f53140c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f531259c700 1 -- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53140c75a0 msgr2=0x7f53140c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f531259c700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53140c75a0 0x7f53140c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f531259c700 1 -- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53140c5280 msgr2=0x7f53140b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f531259c700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53140c5280 0x7f53140b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f531259c700 1 -- 172.21.15.55:0/3734848482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140c7f30 con 0x7f5300003a60 2023-10-06T11:15:42.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f531259c700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f531416a2c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f53000046d0 tx=0x7f5304015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304005e60 con 0x7f5300003a60 2023-10-06T11:15:42.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304001b40 con 0x7f5300003a60 2023-10-06T11:15:42.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53140b3bf0 con 0x7f5300003a60 2023-10-06T11:15:42.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304014670 con 0x7f5300003a60 2023-10-06T11:15:42.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.198+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53140c5c90 con 0x7f5300003a60 2023-10-06T11:15:42.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.199+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314069d90 con 0x7f5300003a60 2023-10-06T11:15:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.199+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53040149e0 con 0x7f5300003a60 2023-10-06T11:15:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.200+0000 7f530a7fc700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f52f4066f60 0x7f52f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.200+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f53040869d0 con 0x7f5300003a60 2023-10-06T11:15:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.200+0000 7f5311d9b700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f52f4066f60 0x7f52f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.200+0000 7f5311d9b700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f52f4066f60 0x7f52f4069410 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f531406bc80 tx=0x7f52fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.204+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5304053900 con 0x7f5300003a60 2023-10-06T11:15:42.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.443+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5314069d90 con 0x7f5300003a60 2023-10-06T11:15:42.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.444+0000 7f530a7fc700 1 -- 172.21.15.55:0/3734848482 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f5304056f20 con 0x7f5300003a60 2023-10-06T11:15:42.446 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:42.446 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:42.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f52f4066f60 msgr2=0x7f52f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f52f4066f60 0x7f52f4069410 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f531406bc80 tx=0x7f52fc008040 comp rx=0 tx=0).stop 2023-10-06T11:15:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 msgr2=0x7f531416a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f531416a2c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f53000046d0 tx=0x7f5304015000 comp rx=0 tx=0).stop 2023-10-06T11:15:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 shutdown_connections 2023-10-06T11:15:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f52f4066f60 0x7f52f4069410 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300003a60 0x7f531416a2c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53140c75a0 0x7f53140c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 --2- 172.21.15.55:0/3734848482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53140c5280 0x7f53140b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 >> 172.21.15.55:0/3734848482 conn(0x7f5314067d90 msgr2=0x7f53140ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 shutdown_connections 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.446+0000 7f5318d67700 1 -- 172.21.15.55:0/3734848482 wait complete. 2023-10-06T11:15:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:42.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:15:36.517477+0000', 'modified': '2023-10-06T11:15:40.121525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6165}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6165': {'gid': 6165, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/1038778559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 1038778559}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1038778559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:15:42.863 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:15:42.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:15:42.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.986+0000 7f7401988700 1 Processor -- start 2023-10-06T11:15:42.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.986+0000 7f7401988700 1 -- start start 2023-10-06T11:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f7401988700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73fc159560 0x7f73fc0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f7401988700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73fc0b49a0 0x7f73fc0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f7401988700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b0760 0x7f73fc0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f7401988700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73fc0b0c60 con 0x7f73fc159560 2023-10-06T11:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f7401988700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73fc0b0f40 con 0x7f73fc0b49a0 2023-10-06T11:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f7401988700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0b1220 con 0x7f73fc0b0760 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73fc159560 0x7f73fc0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73fc159560 0x7f73fc0aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35204/0 (socket says 172.21.15.55:35204) 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 -- 172.21.15.55:0/4114219197 learned_addr learned my addr 172.21.15.55:0/4114219197 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/4114219197 >> v2:172.21.15.142:3300/0 conn(0x7f73fc0b49a0 0x7f73fc0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/4114219197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b0760 0x7f73fc0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 -- 172.21.15.55:0/4114219197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b0760 msgr2=0x7f73fc0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 --2- 172.21.15.55:0/4114219197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b0760 0x7f73fc0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 -- 172.21.15.55:0/4114219197 >> v2:172.21.15.142:3300/0 conn(0x7f73fc0b49a0 msgr2=0x7f73fc0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 --2- 172.21.15.55:0/4114219197 >> v2:172.21.15.142:3300/0 conn(0x7f73fc0b49a0 0x7f73fc0aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 -- 172.21.15.55:0/4114219197 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc0b1500 con 0x7f73fc159560 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73faffd700 1 --2- 172.21.15.55:0/4114219197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc159560 0x7f73fc0aa530 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009f70 tx=0x7f73ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d94eb132180458 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73f9ffb700 1 -- 172.21.15.55:0/4114219197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00e070 con 0x7f73fc159560 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73f9ffb700 1 -- 172.21.15.55:0/4114219197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00ba90 con 0x7f73fc159560 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.987+0000 7f73f9ffb700 1 -- 172.21.15.55:0/4114219197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0092e0 con 0x7f73fc159560 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 -- 172.21.15.55:0/4114219197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc159560 msgr2=0x7f73fc0aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 --2- 172.21.15.55:0/4114219197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc159560 0x7f73fc0aa530 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009f70 tx=0x7f73ec009840 comp rx=0 tx=0).stop 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 -- 172.21.15.55:0/4114219197 shutdown_connections 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 --2- 172.21.15.55:0/4114219197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b0760 0x7f73fc0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 --2- 172.21.15.55:0/4114219197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc159560 0x7f73fc0aa530 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 --2- 172.21.15.55:0/4114219197 >> v2:172.21.15.142:3300/0 conn(0x7f73fc0b49a0 0x7f73fc0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 -- 172.21.15.55:0/4114219197 >> 172.21.15.55:0/4114219197 conn(0x7f73fc0997f0 msgr2=0x7f73fc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 -- 172.21.15.55:0/4114219197 shutdown_connections 2023-10-06T11:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.988+0000 7f7401988700 1 -- 172.21.15.55:0/4114219197 wait complete. 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.989+0000 7f7401988700 1 Processor -- start 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.989+0000 7f7401988700 1 -- start start 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f7401988700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 0x7f73fc156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f7401988700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b49a0 0x7f73fc1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f7401988700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc159560 0x7f73fc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f7401988700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc15b010 con 0x7f73fc0b0760 2023-10-06T11:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f7401988700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc156e40 con 0x7f73fc159560 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f7401988700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc15a400 con 0x7f73fc0b49a0 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 0x7f73fc156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 0x7f73fc156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35218/0 (socket says 172.21.15.55:35218) 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 -- 172.21.15.55:0/3572038227 learned_addr learned my addr 172.21.15.55:0/3572038227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc159560 0x7f73fc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b49a0 0x7f73fc1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 -- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b49a0 msgr2=0x7f73fc1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b49a0 0x7f73fc1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 -- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc159560 msgr2=0x7f73fc15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc159560 0x7f73fc15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.990+0000 7f73faffd700 1 -- 172.21.15.55:0/3572038227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec009ae0 con 0x7f73fc0b0760 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc159560 0x7f73fc15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b49a0 0x7f73fc1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f73faffd700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 0x7f73fc156900 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f73fc067c20 tx=0x7f73ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f73f2ffd700 1 -- 172.21.15.55:0/3572038227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec008be0 con 0x7f73fc0b0760 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f73f2ffd700 1 -- 172.21.15.55:0/3572038227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec008d60 con 0x7f73fc0b0760 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73fc15a6e0 con 0x7f73fc0b0760 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f73f2ffd700 1 -- 172.21.15.55:0/3572038227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec01c660 con 0x7f73fc0b0760 2023-10-06T11:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.991+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc15aca0 con 0x7f73fc0b0760 2023-10-06T11:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.992+0000 7f73f2ffd700 1 -- 172.21.15.55:0/3572038227 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73ec003040 con 0x7f73fc0b0760 2023-10-06T11:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.993+0000 7f73f2ffd700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73dc066f30 0x7f73dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.993+0000 7f73f2ffd700 1 -- 172.21.15.55:0/3572038227 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f73ec0860d0 con 0x7f73fc0b0760 2023-10-06T11:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.993+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73dc066f30 0x7f73dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.994+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73dc066f30 0x7f73dc0693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0cfe00 tx=0x7f73e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.995+0000 7f740ac80b80 1 Processor -- start 2023-10-06T11:15:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.995+0000 7f740ac80b80 1 -- start start 2023-10-06T11:15:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 0x55a32a5eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5aa9a0 0x55a32a5a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5a8bd0 0x55a32a5a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f740ac80b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a527c80 con 0x55a32a5eea90 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a4fea70 con 0x55a32a5aa9a0 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a32a4fc270 con 0x55a32a5a8bd0 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 0x55a32a5eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 0x55a32a5eee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35234/0 (socket says 172.21.15.55:35234) 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 -- 172.21.15.55:0/656037384 learned_addr learned my addr 172.21.15.55:0/656037384 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5aa9a0 0x55a32a5a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5a8bd0 0x55a32a5a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 -- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5a8bd0 msgr2=0x55a32a5a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5a8bd0 0x55a32a5a7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 -- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5aa9a0 msgr2=0x55a32a5a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5aa9a0 0x55a32a5a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 -- 172.21.15.55:0/656037384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a32a392270 con 0x55a32a5eea90 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73faffd700 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 0x55a32a5eee60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f73ec084360 tx=0x7f73ec084290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edffc8ad2fa44f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73dbfff700 1 -- 172.21.15.55:0/656037384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00e070 con 0x55a32a5eea90 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73dbfff700 1 -- 172.21.15.55:0/656037384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec056d40 con 0x55a32a5eea90 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.996+0000 7f73dbfff700 1 -- 172.21.15.55:0/656037384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec059f90 con 0x55a32a5eea90 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 -- 172.21.15.55:0/656037384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 msgr2=0x55a32a5eee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 0x55a32a5eee60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f73ec084360 tx=0x7f73ec084290 comp rx=0 tx=0).stop 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 -- 172.21.15.55:0/656037384 shutdown_connections 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5eea90 0x55a32a5eee60 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5a8bd0 0x55a32a5a7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 --2- 172.21.15.55:0/656037384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5aa9a0 0x55a32a5a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 -- 172.21.15.55:0/656037384 >> 172.21.15.55:0/656037384 conn(0x55a32a5a9070 msgr2=0x55a32a5a9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 -- 172.21.15.55:0/656037384 shutdown_connections 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.997+0000 7f740ac80b80 1 -- 172.21.15.55:0/656037384 wait complete. 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.998+0000 7f740ac80b80 1 -- start start 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.998+0000 7f740ac80b80 1 Processor -- start 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.998+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5a8bd0 0x55a32a5d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 0x55a32a5d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5eea90 0x55a32a5a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a4f8060 con 0x55a32a5aa9a0 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a4a3890 con 0x55a32a5a8bd0 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a32a4beea0 con 0x55a32a5eea90 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 10 client.0 _ll_register_callbacks cb 0x55a32a394f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:43.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 0x55a32a5d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 0x55a32a5d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35238/0 (socket says 172.21.15.55:35238) 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 -- 172.21.15.55:0/758606159 learned_addr learned my addr 172.21.15.55:0/758606159 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73faffd700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5a8bd0 0x55a32a5d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5eea90 0x55a32a5a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 -- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5eea90 msgr2=0x55a32a5a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5eea90 0x55a32a5a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 -- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5a8bd0 msgr2=0x55a32a5d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5a8bd0 0x55a32a5d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 -- 172.21.15.55:0/758606159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc15aca0 con 0x55a32a5aa9a0 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 0x55a32a5d2790 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f73e40127f0 tx=0x7f73e4016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332bdd7fbd073eca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73d97fa700 1 -- 172.21.15.55:0/758606159 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400b050 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73d97fa700 1 -- 172.21.15.55:0/758606159 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f73e401f630 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a32a59c690 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f73d97fa700 1 -- 172.21.15.55:0/758606159 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73e401fa00 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 10 client.6315 fetch_fsmap learned FSMap version 43 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:42.999+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55a32a334fe0 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f73d97fa700 1 -- 172.21.15.55:0/758606159 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a32a59c690 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f73d97fa700 1 -- 172.21.15.55:0/758606159 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f73e401fb60 con 0x55a32a5aa9a0 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f740ac80b80 10 client.6315 fetch_fsmap finished waiting for FSMap version 43 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f740ac80b80 10 client.6315 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f740ac80b80 20 client.6315 populate_metadata read hostname 'smithi055' 2023-10-06T11:15:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f740ac80b80 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5eb710 0x55a32a5ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f740ac80b80 4 client.6315 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 --> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a32a5795c0 con 0x55a32a5eb710 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f73faffd700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5eb710 0x55a32a5ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f73d97fa700 10 client.6315 ms_handle_connect on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.000+0000 7f73faffd700 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5eb710 0x55a32a5ebae0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f087f22f1845ca9 server_cookie=eb0e8aa8e32c5319 in_seq=0 out_seq=0 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f73d97fa700 1 -- 172.21.15.55:0/758606159 <== mds.0 v2:172.21.15.55:6833/1038778559 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a32a5795c0 con 0x55a32a5eb710 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f73d97fa700 10 client.6315 handle_command_reply: tid=0 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 client.6315 shutdown 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 msgr2=0x55a32a5d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 0x55a32a5d2790 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f73e40127f0 tx=0x7f73e4016040 comp rx=0 tx=0).stop 2023-10-06T11:15:43.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 shutdown_connections 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5eb710 0x55a32a5ebae0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5eea90 0x55a32a5a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5a8bd0 0x55a32a5d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 --2- 172.21.15.55:0/758606159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5aa9a0 0x55a32a5d2790 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f73d97fa700 0 client.6315 ms_handle_reset on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 >> 172.21.15.55:0/758606159 conn(0x55a32a5a9070 msgr2=0x55a32a5a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 shutdown_connections 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 1 -- 172.21.15.55:0/758606159 wait complete. 2023-10-06T11:15:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.001+0000 7f740ac80b80 20 client.6315 trim_cache size 0 max 16384 2023-10-06T11:15:43.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.018+0000 7f740ac80b80 1 Processor -- start 2023-10-06T11:15:43.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.018+0000 7f740ac80b80 1 -- start start 2023-10-06T11:15:43.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 0x55a32a5ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f740ac80b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a37ae30 con 0x55a32a5a8bd0 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a5a3570 con 0x55a32a5eea90 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a32a5eadb0 con 0x55a32a5aa9a0 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35246/0 (socket says 172.21.15.55:35246) 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 -- 172.21.15.55:0/3461436758 learned_addr learned my addr 172.21.15.55:0/3461436758 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 -- 172.21.15.55:0/3461436758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 msgr2=0x55a32a5ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 0x55a32a5ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 -- 172.21.15.55:0/3461436758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 msgr2=0x55a32a5cd250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5cd250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 -- 172.21.15.55:0/3461436758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a32a4c6780 con 0x55a32a5a8bd0 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73faffd700 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5ebb70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0843c0 tx=0x7f73ec014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2290f87e2d10f52d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73f0ff9700 1 -- 172.21.15.55:0/3461436758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec056b10 con 0x55a32a5a8bd0 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73f0ff9700 1 -- 172.21.15.55:0/3461436758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec05dce0 con 0x55a32a5a8bd0 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.019+0000 7f73f0ff9700 1 -- 172.21.15.55:0/3461436758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec059f90 con 0x55a32a5a8bd0 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 -- 172.21.15.55:0/3461436758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 msgr2=0x55a32a5ebb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5ebb70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0843c0 tx=0x7f73ec014040 comp rx=0 tx=0).stop 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 -- 172.21.15.55:0/3461436758 shutdown_connections 2023-10-06T11:15:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5ebb70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 --2- 172.21.15.55:0/3461436758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 0x55a32a5ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 -- 172.21.15.55:0/3461436758 >> 172.21.15.55:0/3461436758 conn(0x55a32a5a9070 msgr2=0x55a32a5a9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 -- 172.21.15.55:0/3461436758 shutdown_connections 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 -- 172.21.15.55:0/3461436758 wait complete. 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.020+0000 7f740ac80b80 1 -- start start 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 Processor -- start 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 0x55a32a64cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5a9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a653ff0 con 0x55a32a5a8bd0 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32a5cd790 con 0x55a32a5eea90 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a32a5d21d0 con 0x55a32a5aa9a0 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.021+0000 7f740ac80b80 10 client.0 _ll_register_callbacks cb 0x55a32a394f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35248/0 (socket says 172.21.15.55:35248) 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 -- 172.21.15.55:0/1178018028 learned_addr learned my addr 172.21.15.55:0/1178018028 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 -- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 msgr2=0x55a32a64cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 0x55a32a64cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 -- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 msgr2=0x55a32a5a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 -- 172.21.15.55:0/1178018028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a32a392270 con 0x55a32a5a8bd0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73fb7fe700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73faffd700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5cd250 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b770 tx=0x7f73ec06c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7369d97106df6c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73d97fa700 1 -- 172.21.15.55:0/1178018028 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec059f90 con 0x55a32a5a8bd0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73d97fa700 1 -- 172.21.15.55:0/1178018028 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f73ec01fe80 con 0x55a32a5a8bd0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73ec056d40 con 0x55a32a5a8bd0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73d97fa700 1 -- 172.21.15.55:0/1178018028 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73ec008ed0 con 0x55a32a5a8bd0 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 10 client.6321 fetch_fsmap learned FSMap version 43 2023-10-06T11:15:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55a32a4ad470 con 0x55a32a5a8bd0 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73d97fa700 1 -- 172.21.15.55:0/1178018028 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec056d40 con 0x55a32a5a8bd0 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f73d97fa700 1 -- 172.21.15.55:0/1178018028 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f73ec056230 con 0x55a32a5a8bd0 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 10 client.6321 fetch_fsmap finished waiting for FSMap version 43 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 10 client.6321 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 20 client.6321 populate_metadata read hostname 'smithi055' 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5fbf60 0x55a32a5fc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 4 client.6321 mds_command: new command op to 6165 tid=0[{"prefix": "status"}] 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.022+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 --> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a32a49ae00 con 0x55a32a5fbf60 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5fbf60 0x55a32a5fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f73fa7fc700 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5fbf60 0x55a32a5fc330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6e2c244e6f83fbb server_cookie=8da80225ebafc35 in_seq=0 out_seq=0 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f73d97fa700 10 client.6321 ms_handle_connect on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:43.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f73d97fa700 1 -- 172.21.15.55:0/1178018028 <== mds.0 v2:172.21.15.55:6833/1038778559 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a32a49ae00 con 0x55a32a5fbf60 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f73d97fa700 10 client.6321 handle_command_reply: tid=0 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 client.6321 shutdown 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 msgr2=0x55a32a5cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5cd250 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b770 tx=0x7f73ec06c070 comp rx=0 tx=0).stop 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 shutdown_connections 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a32a5fbf60 0x55a32a5fc330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a32a5a8bd0 0x55a32a5cd250 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f73d97fa700 0 client.6321 ms_handle_reset on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a32a5eea90 0x55a32a5a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 --2- 172.21.15.55:0/1178018028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a32a5aa9a0 0x55a32a64cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 >> 172.21.15.55:0/1178018028 conn(0x55a32a5a9070 msgr2=0x55a32a5d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 shutdown_connections 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.023+0000 7f740ac80b80 1 -- 172.21.15.55:0/1178018028 wait complete. 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f740ac80b80 20 client.6321 trim_cache size 0 max 16384 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6165, 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:15:43.034 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.913991438, 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 43, 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 79, 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 79, 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.017593848000001 2023-10-06T11:15:43.035 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73dc066f30 msgr2=0x7f73dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73dc066f30 0x7f73dc0693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0cfe00 tx=0x7f73e4008040 comp rx=0 tx=0).stop 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 msgr2=0x7f73fc156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 0x7f73fc156900 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f73fc067c20 tx=0x7f73ec018000 comp rx=0 tx=0).stop 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 shutdown_connections 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73dc066f30 0x7f73dc0693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73fc0b0760 0x7f73fc156900 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc159560 0x7f73fc15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 --2- 172.21.15.55:0/3572038227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0b49a0 0x7f73fc1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 >> 172.21.15.55:0/3572038227 conn(0x7f73fc0997f0 msgr2=0x7f73fc069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 shutdown_connections 2023-10-06T11:15:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.024+0000 7f7401988700 1 -- 172.21.15.55:0/3572038227 wait complete. 2023-10-06T11:15:43.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:15:43.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.155+0000 7f285bd35700 1 Processor -- start 2023-10-06T11:15:43.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.155+0000 7f285bd35700 1 -- start start 2023-10-06T11:15:43.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f285bd35700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28540b49a0 0x7f28540aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f285bd35700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540b0c60 con 0x7f28540b0760 2023-10-06T11:15:43.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f285bd35700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540b0f40 con 0x7f2854159560 2023-10-06T11:15:43.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f285bd35700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540b1220 con 0x7f28540b49a0 2023-10-06T11:15:43.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f28592d0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28540b49a0 0x7f28540aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f285a2d2700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28540b0760 0x7f28540b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58970/0 (socket says 172.21.15.55:58970) 2023-10-06T11:15:43.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f28592d0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28540b49a0 0x7f28540aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35256/0 (socket says 172.21.15.55:35256) 2023-10-06T11:15:43.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.156+0000 7f285a2d2700 1 -- 172.21.15.55:0/1743429945 learned_addr learned my addr 172.21.15.55:0/1743429945 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:43.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f28592d0700 1 -- 172.21.15.55:0/1743429945 >> v1:172.21.15.142:6789/0 conn(0x7f2854159560 legacy=0x7f28540aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f28592d0700 1 -- 172.21.15.55:0/1743429945 >> v1:172.21.15.55:6789/0 conn(0x7f28540b0760 legacy=0x7f28540b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f28592d0700 1 -- 172.21.15.55:0/1743429945 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540b1500 con 0x7f28540b49a0 2023-10-06T11:15:43.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f2858acf700 1 -- 172.21.15.55:0/1743429945 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117820771 0 0) 0x7f28540b0c60 con 0x7f28540b0760 2023-10-06T11:15:43.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f28592d0700 1 --2- 172.21.15.55:0/1743429945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b49a0 0x7f28540aac40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2848009910 tx=0x7f28480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6c6cf07317504c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f2858acf700 1 -- 172.21.15.55:0/1743429945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800b820 con 0x7f28540b49a0 2023-10-06T11:15:43.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f2858acf700 1 -- 172.21.15.55:0/1743429945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800b980 con 0x7f28540b49a0 2023-10-06T11:15:43.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f2858acf700 1 -- 172.21.15.55:0/1743429945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800bd20 con 0x7f28540b49a0 2023-10-06T11:15:43.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f285bd35700 1 -- 172.21.15.55:0/1743429945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b49a0 msgr2=0x7f28540aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f285bd35700 1 --2- 172.21.15.55:0/1743429945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b49a0 0x7f28540aac40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2848009910 tx=0x7f28480091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f285bd35700 1 -- 172.21.15.55:0/1743429945 shutdown_connections 2023-10-06T11:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f285bd35700 1 --2- 172.21.15.55:0/1743429945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b49a0 0x7f28540aac40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.157+0000 7f285bd35700 1 -- 172.21.15.55:0/1743429945 >> 172.21.15.55:0/1743429945 conn(0x7f28540997f0 msgr2=0x7f285406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.158+0000 7f285bd35700 1 -- 172.21.15.55:0/1743429945 shutdown_connections 2023-10-06T11:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.158+0000 7f285bd35700 1 -- 172.21.15.55:0/1743429945 wait complete. 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 Processor -- start 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 -- start start 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 0x7f28540aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28540b49a0 0x7f2854156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2854159560 0x7f28540abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540ab290 con 0x7f28540b0760 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540ab850 con 0x7f28540b49a0 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.159+0000 7f285bd35700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540aed90 con 0x7f2854159560 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 0x7f28540aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 0x7f28540aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35262/0 (socket says 172.21.15.55:35262) 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 -- 172.21.15.55:0/1763080683 learned_addr learned my addr 172.21.15.55:0/1763080683 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f28592d0700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28540b49a0 0x7f2854156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f285a2d2700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2854159560 0x7f28540abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 -- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2854159560 msgr2=0x7f28540abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2854159560 0x7f28540abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 -- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28540b49a0 msgr2=0x7f2854156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28540b49a0 0x7f2854156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 -- 172.21.15.55:0/1763080683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009420 con 0x7f28540b0760 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f28592d0700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28540b49a0 0x7f2854156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f285a2d2700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2854159560 0x7f28540abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:43.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2859ad1700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 0x7f28540aa740 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f284400cd30 tx=0x7f2844001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400ab70 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400acd0 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28540af070 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844012670 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.160+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28540aac80 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.162+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2854064a90 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.162+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2844012a60 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.162+0000 7f2851ffb700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2840066f30 0x7f28400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.162+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2844084f30 con 0x7f28540b0760 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.162+0000 7f28592d0700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2840066f30 0x7f28400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:43.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.163+0000 7f28592d0700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2840066f30 0x7f28400693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2848009910 tx=0x7f2848017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:43.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.166+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2844051f00 con 0x7f28540b0760 2023-10-06T11:15:43.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.405+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28540abb30 con 0x7f28540b0760 2023-10-06T11:15:43.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.406+0000 7f2851ffb700 1 -- 172.21.15.55:0/1763080683 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2844055520 con 0x7f28540b0760 2023-10-06T11:15:43.408 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2840066f30 msgr2=0x7f28400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2840066f30 0x7f28400693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2848009910 tx=0x7f2848017000 comp rx=0 tx=0).stop 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 msgr2=0x7f28540aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 0x7f28540aa740 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f284400cd30 tx=0x7f2844001b40 comp rx=0 tx=0).stop 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 shutdown_connections 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2840066f30 0x7f28400693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28540b0760 0x7f28540aa740 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2854159560 0x7f28540abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 --2- 172.21.15.55:0/1763080683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28540b49a0 0x7f2854156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 >> 172.21.15.55:0/1763080683 conn(0x7f28540997f0 msgr2=0x7f2854158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 shutdown_connections 2023-10-06T11:15:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:43.408+0000 7f285bd35700 1 -- 172.21.15.55:0/1763080683 wait complete. 2023-10-06T11:15:43.421 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:15:43.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:15:43.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:15:43.421 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:15:43.422 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:43.422 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:15:43.422 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:15:43.422 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:15:43.422 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:43.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.422 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:15:43.438 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:15:43.438 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:15:43.438 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:15:43.438 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.438 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42349sec preferred_lft 42349sec 2023-10-06T11:15:43.439 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:15:43.440 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:15:43.441 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:43.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.442 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:15:43.502 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:15:43.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.503 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:15:43.560 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:15:43.560 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:15:43.560 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:15:43.560 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:15:43.560 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:15:43.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.560 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:15:43.560 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:15:43.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:15:43.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:15:43.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:15:43.561 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:15:43.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.663 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:15:43.679 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:15:43.679 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:15:43.680 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:43.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:15:43.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:43.745 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:43.800 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:43.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:43.801 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:43.855 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:15:43.855 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:15:43.855 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:43.936 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:43.936 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:43.956 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:43.956 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:43.977 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:43.977 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:43.977 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:43.977 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:15:43.978 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:15:43.979 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:15:43.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:43.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:44.045 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:15:44.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.204+0000 7f42069b5700 1 Processor -- start 2023-10-06T11:15:44.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.204+0000 7f42069b5700 1 -- start start 2023-10-06T11:15:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.205+0000 7f42069b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4200159560 0x7f42000aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.205+0000 7f42069b5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000b0c60 con 0x7f42000b49a0 2023-10-06T11:15:44.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.205+0000 7f42069b5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000b0f40 con 0x7f42000b0760 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.205+0000 7f42069b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000b1220 con 0x7f4200159560 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.205+0000 7f41ff7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42000b49a0 0x7f42000aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58982/0 (socket says 172.21.15.55:58982) 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.205+0000 7f41ff7fe700 1 -- 172.21.15.55:0/2622772832 learned_addr learned my addr 172.21.15.55:0/2622772832 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41fffff700 1 --2- 172.21.15.55:0/2622772832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4200159560 0x7f42000aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624060795 0 0) 0x7f42000b0c60 con 0x7f42000b49a0 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ec003570 con 0x7f42000b49a0 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017351743 0 0) 0x7f42000b0f40 con 0x7f42000b0760 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42000b0c60 con 0x7f42000b0760 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188068269 0 0) 0x7f41ec003570 con 0x7f42000b49a0 2023-10-06T11:15:44.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41fffff700 1 -- 172.21.15.55:0/2622772832 >> v1:172.21.15.142:6789/0 conn(0x7f42000b0760 legacy=0x7f42000b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41fffff700 1 -- 172.21.15.55:0/2622772832 >> v1:172.21.15.55:6789/0 conn(0x7f42000b49a0 legacy=0x7f42000aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41fffff700 1 -- 172.21.15.55:0/2622772832 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000b1500 con 0x7f4200159560 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41fffff700 1 --2- 172.21.15.55:0/2622772832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4200159560 0x7f42000aa530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009900 tx=0x7f41e8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27c957d588639a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0001470 con 0x7f4200159560 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8011420 con 0x7f4200159560 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.206+0000 7f41feffd700 1 -- 172.21.15.55:0/2622772832 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80117c0 con 0x7f4200159560 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 -- 172.21.15.55:0/2622772832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4200159560 msgr2=0x7f42000aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 --2- 172.21.15.55:0/2622772832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4200159560 0x7f42000aa530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009900 tx=0x7f41e8009120 comp rx=0 tx=0).stop 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 -- 172.21.15.55:0/2622772832 shutdown_connections 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 --2- 172.21.15.55:0/2622772832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4200159560 0x7f42000aa530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 -- 172.21.15.55:0/2622772832 >> 172.21.15.55:0/2622772832 conn(0x7f42000997f0 msgr2=0x7f420006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 -- 172.21.15.55:0/2622772832 shutdown_connections 2023-10-06T11:15:44.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.207+0000 7f42069b5700 1 -- 172.21.15.55:0/2622772832 wait complete. 2023-10-06T11:15:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.208+0000 7f42069b5700 1 Processor -- start 2023-10-06T11:15:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.208+0000 7f42069b5700 1 -- start start 2023-10-06T11:15:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f42069b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000b0760 0x7f4200159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f42069b5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 0x7f420009d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f42069b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4200159560 0x7f4200158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f42069b5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000ae160 con 0x7f42000b49a0 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f42069b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000ad550 con 0x7f4200159560 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f42069b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000ad830 con 0x7f42000b0760 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 0x7f420009d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 0x7f420009d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35266/0 (socket says 172.21.15.55:35266) 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 -- 172.21.15.55:0/1027576304 learned_addr learned my addr 172.21.15.55:0/1027576304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41fffff700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000b0760 0x7f4200159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f4204f52700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4200159560 0x7f4200158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 -- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000b0760 msgr2=0x7f4200159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000b0760 0x7f4200159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 -- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4200159560 msgr2=0x7f4200158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4200159560 0x7f4200158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41ff7fe700 1 -- 172.21.15.55:0/1027576304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80093c0 con 0x7f42000b49a0 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f4204f52700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4200159560 0x7f4200158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.209+0000 7f41fffff700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000b0760 0x7f4200159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.210+0000 7f41ff7fe700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 0x7f420009d280 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f41f000c910 tx=0x7f41f00019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.210+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000ce50 con 0x7f42000b49a0 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.210+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0005b30 con 0x7f42000b49a0 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.210+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000adb10 con 0x7f42000b49a0 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.210+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00070f0 con 0x7f42000b49a0 2023-10-06T11:15:44.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.210+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4200159e70 con 0x7f42000b49a0 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.211+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4200064a90 con 0x7f42000b49a0 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.211+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41f00074e0 con 0x7f42000b49a0 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.212+0000 7f41f7fff700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f41e0066f30 0x7f41e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.212+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f41f0084550 con 0x7f42000b49a0 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.212+0000 7f41fffff700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f41e0066f30 0x7f41e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.212+0000 7f41fffff700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f41e0066f30 0x7f41e00693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009160 tx=0x7f41e8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.216+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41f00515a0 con 0x7f42000b49a0 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.457+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42000b17e0 con 0x7f42000b49a0 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.457+0000 7f41f7fff700 1 -- 172.21.15.55:0/1027576304 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f41f0054bc0 con 0x7f42000b49a0 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:15:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f41e0066f30 msgr2=0x7f41e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f41e0066f30 0x7f41e00693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009160 tx=0x7f41e8016000 comp rx=0 tx=0).stop 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 msgr2=0x7f420009d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 0x7f420009d280 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f41f000c910 tx=0x7f41f00019d0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 shutdown_connections 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f41e0066f30 0x7f41e00693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4200159560 0x7f4200158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42000b0760 0x7f4200159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 --2- 172.21.15.55:0/1027576304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42000b49a0 0x7f420009d280 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 >> 172.21.15.55:0/1027576304 conn(0x7f42000997f0 msgr2=0x7f42000683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 shutdown_connections 2023-10-06T11:15:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:44.459+0000 7f42069b5700 1 -- 172.21.15.55:0/1027576304 wait complete. 2023-10-06T11:15:44.473 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:15:44.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:15:44.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:15:44.473 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:15:44.474 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:44.474 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:15:44.474 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:15:44.474 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:15:44.474 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:15:44.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:44.474 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:15:44.493 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:15:44.493 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:15:44.493 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:15:44.493 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.493 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:15:44.493 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:15:44.494 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:15:44.495 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:15:44.496 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:15:44.497 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:44.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:44.497 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:15:44.563 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:15:44.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:44.565 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:15:44.626 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:15:44.626 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:15:44.626 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:15:44.626 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:15:44.626 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:15:44.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:44.627 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:15:44.627 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:15:44.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:15:44.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:15:44.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:15:44.628 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:15:44.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:44.735 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:15:44.751 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:15:44.751 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:15:44.751 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:15:44.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:44.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:15:44.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:44.816 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:44.872 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:15:44.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:44.872 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:44.927 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:15:44.927 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:15:44.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:45.008 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:45.008 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:45.026 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:45.027 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:45.027 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:45.027 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:45.027 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:45.028 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:45.028 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:45.028 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:45.049 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:15:45.049 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:15:45.049 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:15:45.049 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:15:45.050 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:15:45.051 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:15:45.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:45.052 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:45.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2023-10-06T11:15:45.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.243+0000 7fee9d368700 1 Processor -- start 2023-10-06T11:15:45.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.243+0000 7fee9d368700 1 -- start start 2023-10-06T11:15:45.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.243+0000 7fee9d368700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee980b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.243+0000 7fee9d368700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980c40e0 con 0x7fee98157820 2023-10-06T11:15:45.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.243+0000 7fee9d368700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980cf0a0 con 0x7fee980c97a0 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.243+0000 7fee9d368700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980c34d0 con 0x7fee98157450 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee967fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee98157820 0x7fee980c9090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34574/0 (socket says 172.21.15.55:34574) 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee967fc700 1 -- 172.21.15.55:0/2240982377 learned_addr learned my addr 172.21.15.55:0/2240982377 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711385228 0 0) 0x7fee980c40e0 con 0x7fee98157820 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee84003570 con 0x7fee98157820 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee96ffd700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee980b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071769993 0 0) 0x7fee84003570 con 0x7fee98157820 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 msgr2=0x7fee980b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee980b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 >> v1:172.21.15.142:6789/0 conn(0x7fee980c97a0 legacy=0x7fee980ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980c37b0 con 0x7fee98157820 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fee80001470 con 0x7fee98157820 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 >> v1:172.21.15.55:6789/0 conn(0x7fee98157820 legacy=0x7fee980c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee84003a90 0x7fee84003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee84004810 0x7fee84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee980c34d0 con 0x7fee84004810 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8400bb10 con 0x7fee84003a90 2023-10-06T11:15:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8400bcd0 con 0x7fee98157450 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee96ffd700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee84003a90 0x7fee84003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee967fc700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee84004810 0x7fee84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.244+0000 7fee977fe700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee96ffd700 1 -- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 msgr2=0x7fee840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee96ffd700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee96ffd700 1 -- 172.21.15.55:0/2240982377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee84004810 msgr2=0x7fee84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee96ffd700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee84004810 0x7fee84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee96ffd700 1 -- 172.21.15.55:0/2240982377 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84003570 con 0x7fee84003a90 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee977fe700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee98157450 0x7fee840051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee96ffd700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee84003a90 0x7fee84003e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee8800e2d0 tx=0x7fee8800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a52da4f61aa15b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800eb20 con 0x7fee84003a90 2023-10-06T11:15:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800f040 con 0x7fee84003a90 2023-10-06T11:15:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.245+0000 7fee95ffb700 1 -- 172.21.15.55:0/2240982377 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800eed0 con 0x7fee84003a90 2023-10-06T11:15:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee9d368700 1 -- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee84003a90 msgr2=0x7fee84003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee9d368700 1 --2- 172.21.15.55:0/2240982377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee84003a90 0x7fee84003e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee8800e2d0 tx=0x7fee8800b040 comp rx=0 tx=0).stop 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee977fe700 1 -- 172.21.15.55:0/2240982377 reap_dead start 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee9d368700 1 -- 172.21.15.55:0/2240982377 shutdown_connections 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee9d368700 1 -- 172.21.15.55:0/2240982377 >> 172.21.15.55:0/2240982377 conn(0x7fee98067d90 msgr2=0x7fee980ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee9d368700 1 -- 172.21.15.55:0/2240982377 shutdown_connections 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.246+0000 7fee9d368700 1 -- 172.21.15.55:0/2240982377 wait complete. 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.247+0000 7fee9d368700 1 Processor -- start 2023-10-06T11:15:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.247+0000 7fee9d368700 1 -- start start 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee84003a90 0x7fee9815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 0x7fee980c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee98152730 0x7fee980b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9815d7f0 con 0x7fee9815abc0 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9815dad0 con 0x7fee98152730 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9815ddb0 con 0x7fee84003a90 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 0x7fee980c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 0x7fee980c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49222/0 (socket says 172.21.15.55:49222) 2023-10-06T11:15:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 -- 172.21.15.55:0/760801161 learned_addr learned my addr 172.21.15.55:0/760801161 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee977fe700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee98152730 0x7fee980b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee96ffd700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee84003a90 0x7fee9815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 -- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee84003a90 msgr2=0x7fee9815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee84003a90 0x7fee9815cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 -- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee98152730 msgr2=0x7fee980b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee98152730 0x7fee980b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 -- 172.21.15.55:0/760801161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980c54a0 con 0x7fee9815abc0 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee96ffd700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee84003a90 0x7fee9815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee967fc700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 0x7fee980c5ca0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fee80007390 tx=0x7fee80001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000f9d0 con 0x7fee9815abc0 2023-10-06T11:15:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000fb50 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee980c5780 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee800133f0 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.248+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee980c61e0 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.249+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee980c59c0 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.250+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee800137a0 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.250+0000 7fee8effd700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fee78066f30 0x7fee780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.250+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fee80084b20 con 0x7fee9815abc0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.250+0000 7fee96ffd700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fee78066f30 0x7fee780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.251+0000 7fee96ffd700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fee78066f30 0x7fee780693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee880094a0 tx=0x7fee8801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.254+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee980c59c0 con 0x7fee9815abc0 2023-10-06T11:15:45.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.448+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) v1 -- 0x7fee980c59c0 con 0x7fee9815abc0 2023-10-06T11:15:45.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.453+0000 7fee8effd700 1 -- 172.21.15.55:0/760801161 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fee980c59c0 con 0x7fee9815abc0 2023-10-06T11:15:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fee78066f30 msgr2=0x7fee780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fee78066f30 0x7fee780693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee880094a0 tx=0x7fee8801a000 comp rx=0 tx=0).stop 2023-10-06T11:15:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 msgr2=0x7fee980c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 0x7fee980c5ca0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fee80007390 tx=0x7fee80001e70 comp rx=0 tx=0).stop 2023-10-06T11:15:45.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 shutdown_connections 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fee78066f30 0x7fee780693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee98152730 0x7fee980b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee84003a90 0x7fee9815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 --2- 172.21.15.55:0/760801161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee9815abc0 0x7fee980c5ca0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 >> 172.21.15.55:0/760801161 conn(0x7fee98067d90 msgr2=0x7fee9806c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 shutdown_connections 2023-10-06T11:15:45.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.455+0000 7fee9d368700 1 -- 172.21.15.55:0/760801161 wait complete. 2023-10-06T11:15:45.469 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:15:45.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:45.469 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:45.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:15:45.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:45.512 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:15:45.566 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:15:45.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:45.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:15:45.606 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:15:45.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:45.607 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:15:45.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.778+0000 7f8acbbab700 1 Processor -- start 2023-10-06T11:15:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.778+0000 7f8acbbab700 1 -- start start 2023-10-06T11:15:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.779+0000 7f8acbbab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 0x7f8ac40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.779+0000 7f8acbbab700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40cbfa0 con 0x7f8ac4159830 2023-10-06T11:15:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.779+0000 7f8acbbab700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40cb390 con 0x7f8ac40b29b0 2023-10-06T11:15:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.779+0000 7f8acbbab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40cb670 con 0x7f8ac40b25e0 2023-10-06T11:15:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.779+0000 7f8aca148700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8ac4159830 0x7f8ac40cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34586/0 (socket says 172.21.15.55:34586) 2023-10-06T11:15:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.779+0000 7f8aca148700 1 -- 172.21.15.55:0/506219270 learned_addr learned my addr 172.21.15.55:0/506219270 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac9947700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 0x7f8ac40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207094938 0 0) 0x7f8ac40cbfa0 con 0x7f8ac4159830 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac003570 con 0x7f8ac4159830 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907120819 0 0) 0x7f8ac40cb390 con 0x7f8ac40b29b0 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac40cbfa0 con 0x7f8ac40b29b0 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835289800 0 0) 0x7f8aac003570 con 0x7f8ac4159830 2023-10-06T11:15:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 msgr2=0x7f8ac40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 0x7f8ac40b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 >> v1:172.21.15.142:6789/0 conn(0x7f8ac40b29b0 legacy=0x7f8ac4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40cb950 con 0x7f8ac4159830 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f8ab4001470 con 0x7f8ac4159830 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 >> v1:172.21.15.55:6789/0 conn(0x7f8ac4159830 legacy=0x7f8ac40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 0x7f8aac003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aac0041d0 0x7f8aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40cb670 con 0x7f8aac004d50 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac00bbf0 con 0x7f8aac0041d0 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac00bdb0 con 0x7f8ac40b25e0 2023-10-06T11:15:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8aca148700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac9146700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aac0041d0 0x7f8aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.780+0000 7f8ac9947700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 0x7f8aac003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 -- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 msgr2=0x7f8aac003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac40b25e0 0x7f8aac003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 -- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aac0041d0 msgr2=0x7f8aac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aac0041d0 0x7f8aac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 -- 172.21.15.55:0/506219270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac003570 con 0x7f8aac004d50 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c210 tx=0x7f8ab4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fe0c13139e80c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400cc10 con 0x7f8aac004d50 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400cd70 con 0x7f8aac004d50 2023-10-06T11:15:45.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8ac8945700 1 -- 172.21.15.55:0/506219270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4005b70 con 0x7f8aac004d50 2023-10-06T11:15:45.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8acbbab700 1 -- 172.21.15.55:0/506219270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac004d50 msgr2=0x7f8aac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8acbbab700 1 --2- 172.21.15.55:0/506219270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c210 tx=0x7f8ab4001d40 comp rx=0 tx=0).stop 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8aca148700 1 -- 172.21.15.55:0/506219270 reap_dead start 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8acbbab700 1 -- 172.21.15.55:0/506219270 shutdown_connections 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8acbbab700 1 -- 172.21.15.55:0/506219270 >> 172.21.15.55:0/506219270 conn(0x7f8ac406ece0 msgr2=0x7f8ac406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8acbbab700 1 -- 172.21.15.55:0/506219270 shutdown_connections 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.781+0000 7f8acbbab700 1 -- 172.21.15.55:0/506219270 wait complete. 2023-10-06T11:15:45.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 Processor -- start 2023-10-06T11:15:45.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 -- start start 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac40c5580 0x7f8ac416e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 0x7f8ac416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac416a570 0x7f8ac415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac416dc80 con 0x7f8ac40c5950 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac416abd0 con 0x7f8ac40c5580 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8acbbab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac416aeb0 con 0x7f8ac416a570 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8ac9146700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 0x7f8ac416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8ac9146700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 0x7f8ac416a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49236/0 (socket says 172.21.15.55:49236) 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.783+0000 7f8ac9146700 1 -- 172.21.15.55:0/3933455405 learned_addr learned my addr 172.21.15.55:0/3933455405 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9947700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac40c5580 0x7f8ac416e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8aca148700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac416a570 0x7f8ac415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9146700 1 -- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac416a570 msgr2=0x7f8ac415b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9146700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac416a570 0x7f8ac415b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9146700 1 -- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac40c5580 msgr2=0x7f8ac416e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9146700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac40c5580 0x7f8ac416e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9146700 1 -- 172.21.15.55:0/3933455405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac416d630 con 0x7f8ac40c5950 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9947700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac40c5580 0x7f8ac416e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac9146700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 0x7f8ac416a030 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8002b80 tx=0x7f8ab8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800fa00 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800fb80 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac416d910 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8006820 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.784+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac415bde0 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.785+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac416a970 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.785+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ab8006bd0 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.786+0000 7f8ac1ffb700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.786+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8ab8084c90 con 0x7f8ac40c5950 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.786+0000 7f8ac9947700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.786+0000 7f8ac9947700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8ab0066f30 0x7f8ab00693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009fd0 tx=0x7f8abc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:45.790+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ab8051c60 con 0x7f8ac40c5950 2023-10-06T11:15:46.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.029+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ac416daa0 con 0x7f8ac40c5950 2023-10-06T11:15:46.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.029+0000 7f8ac1ffb700 1 -- 172.21.15.55:0/3933455405 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8ab8055280 con 0x7f8ac40c5950 2023-10-06T11:15:46.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:46.031 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8ab0066f30 msgr2=0x7f8ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8ab0066f30 0x7f8ab00693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009fd0 tx=0x7f8abc00b040 comp rx=0 tx=0).stop 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 msgr2=0x7f8ac416a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 0x7f8ac416a030 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8002b80 tx=0x7f8ab8007d30 comp rx=0 tx=0).stop 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 shutdown_connections 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ac416a570 0x7f8ac415b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac40c5580 0x7f8ac416e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 --2- 172.21.15.55:0/3933455405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac40c5950 0x7f8ac416a030 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 >> 172.21.15.55:0/3933455405 conn(0x7f8ac406ece0 msgr2=0x7f8ac4153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 shutdown_connections 2023-10-06T11:15:46.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.032+0000 7f8acbbab700 1 -- 172.21.15.55:0/3933455405 wait complete. 2023-10-06T11:15:46.035 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:46.045 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T11:15:46.183 INFO:teuthology.orchestra.run.smithi055.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":22,"msgr_send_messages":22,"msgr_recv_bytes":6257,"msgr_send_bytes":15760,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.004066001,"msgr_running_send_time":0.000355461,"msgr_running_recv_time":0.002104261,"msgr_running_fast_dispatch_time":0.000383494,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.014304240,"avgtime":0.000681154},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":20,"msgr_send_messages":24,"msgr_recv_bytes":4550,"msgr_send_bytes":107915,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.004181442,"msgr_running_send_time":0.000610943,"msgr_running_recv_time":0.003110466,"msgr_running_fast_dispatch_time":0.000310861,"msgr_send_messages_queue_lat":{"avgcount":22,"sum":0.012068668,"avgtime":0.000548575},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000003631,"avgtime":0.000000518}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":70,"msgr_send_messages":64,"msgr_recv_bytes":111383,"msgr_send_bytes":18803,"msgr_created_connections":5,"msgr_active_connections":3,"msgr_running_total_time":0.005390797,"msgr_running_send_time":0.001183603,"msgr_running_recv_time":0.005372916,"msgr_running_fast_dispatch_time":0.000378825,"msgr_send_messages_queue_lat":{"avgcount":64,"sum":0.015298352,"avgtime":0.000239036},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000001045,"avgtime":0.000000522}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":39,"sum":0.002061551,"avgtime":0.000052860}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012430,"avgtime":0.000006215}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000752935,"avgtime":0.000188233},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":233,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196957,"rdpos":0,"jlat":{"avgcount":5,"sum":0.010240651,"avgtime":0.002048130},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":34192,"heap":207104},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000493360,"avgtime":0.000164453},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000259575,"avgtime":0.000259575},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":1,"avg_session_uptime":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":205535,"buffer_anon_items":59,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50512,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13597,"op_resend":31,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":79,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":107,"get_sum":108716,"get_or_fail_fail":0,"get_or_fail_success":107,"take":0,"take_sum":0,"put":107,"put_sum":108716,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13597,"put":43,"put_sum":13597,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x5640d3655e00":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2653,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2653,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T11:15:46.185 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6257, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.000383494, "msgr_running_recv_time": 0.002104261, "msgr_running_send_time": 0.000355461, "msgr_running_total_time": 0.004066001, "msgr_send_bytes": 15760, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000681154, "sum": 0.01430424 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 5.18e-07, "sum": 3.631e-06 }, "msgr_recv_bytes": 4550, "msgr_recv_messages": 20, "msgr_running_fast_dispatch_time": 0.000310861, "msgr_running_recv_time": 0.003110466, "msgr_running_send_time": 0.000610943, "msgr_running_total_time": 0.004181442, "msgr_send_bytes": 107915, "msgr_send_messages": 24, "msgr_send_messages_queue_lat": { "avgcount": 22, "avgtime": 0.000548575, "sum": 0.012068668 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 5.22e-07, "sum": 1.045e-06 }, "msgr_recv_bytes": 111383, "msgr_recv_messages": 70, "msgr_running_fast_dispatch_time": 0.000378825, "msgr_running_recv_time": 0.005372916, "msgr_running_send_time": 0.001183603, "msgr_running_total_time": 0.005390797, "msgr_send_bytes": 18803, "msgr_send_messages": 64, "msgr_send_messages_queue_lat": { "avgcount": 64, "avgtime": 0.000239036, "sum": 0.015298352 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 39, "avgtime": 5.286e-05, "sum": 0.002061551 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.215e-06, "sum": 1.243e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 233, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000188233, "sum": 0.000752935 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.00204813, "sum": 0.010240651 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196957 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34192 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000164453, "sum": 0.00049336 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000259575, "sum": 0.000259575 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 205535, "buffer_anon_items": 59, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50512, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 79, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 31, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13597, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 107, "get_or_fail_fail": 0, "get_or_fail_success": 107, "get_started": 0, "get_sum": 108716, "max": 104857600, "put": 107, "put_sum": 108716, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13597, "take": 43, "take_sum": 13597, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x5640d3655e00": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2653, "max": 3758096384, "put": 5, "put_sum": 2653, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T11:15:46.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 session ls 2023-10-06T11:15:46.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.306+0000 7ff98a825700 1 Processor -- start 2023-10-06T11:15:46.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.306+0000 7ff98a825700 1 -- start start 2023-10-06T11:15:46.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff98a825700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff984150940 0x7ff984159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff98a825700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840cd4d0 0x7ff9840b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff98a825700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98415ac30 con 0x7ff98415a160 2023-10-06T11:15:46.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff98a825700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9840cb6a0 con 0x7ff984150940 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff98a825700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840cb090 con 0x7ff9840cd4d0 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff9837fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff98415a160 0x7ff9840ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34602/0 (socket says 172.21.15.55:34602) 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff9837fe700 1 -- 172.21.15.55:0/1140883916 learned_addr learned my addr 172.21.15.55:0/1140883916 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff983fff700 1 --2- 172.21.15.55:0/1140883916 >> v2:172.21.15.142:3300/0 conn(0x7ff984150940 0x7ff984159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff988dc2700 1 --2- 172.21.15.55:0/1140883916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840cd4d0 0x7ff9840b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff982ffd700 1 -- 172.21.15.55:0/1140883916 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760784226 0 0) 0x7ff978001110 con 0x7ff98415a160 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.307+0000 7ff982ffd700 1 -- 172.21.15.55:0/1140883916 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff96c003570 con 0x7ff98415a160 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff988dc2700 1 -- 172.21.15.55:0/1140883916 >> v2:172.21.15.142:3300/0 conn(0x7ff984150940 msgr2=0x7ff984159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff988dc2700 1 --2- 172.21.15.55:0/1140883916 >> v2:172.21.15.142:3300/0 conn(0x7ff984150940 0x7ff984159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff988dc2700 1 -- 172.21.15.55:0/1140883916 >> v1:172.21.15.55:6789/0 conn(0x7ff98415a160 legacy=0x7ff9840ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff988dc2700 1 -- 172.21.15.55:0/1140883916 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98415a670 con 0x7ff9840cd4d0 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff983fff700 1 --2- 172.21.15.55:0/1140883916 >> v2:172.21.15.142:3300/0 conn(0x7ff984150940 0x7ff984159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff988dc2700 1 --2- 172.21.15.55:0/1140883916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840cd4d0 0x7ff9840b2050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009e60 tx=0x7ff97c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712ab74e9227e484 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff982ffd700 1 -- 172.21.15.55:0/1140883916 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00e070 con 0x7ff9840cd4d0 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff982ffd700 1 -- 172.21.15.55:0/1140883916 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00bab0 con 0x7ff9840cd4d0 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff982ffd700 1 -- 172.21.15.55:0/1140883916 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00be70 con 0x7ff9840cd4d0 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff98a825700 1 -- 172.21.15.55:0/1140883916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840cd4d0 msgr2=0x7ff9840b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff98a825700 1 --2- 172.21.15.55:0/1140883916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840cd4d0 0x7ff9840b2050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009e60 tx=0x7ff97c009780 comp rx=0 tx=0).stop 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff98a825700 1 -- 172.21.15.55:0/1140883916 shutdown_connections 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.308+0000 7ff98a825700 1 --2- 172.21.15.55:0/1140883916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840cd4d0 0x7ff9840b2050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.309+0000 7ff98a825700 1 --2- 172.21.15.55:0/1140883916 >> v2:172.21.15.142:3300/0 conn(0x7ff984150940 0x7ff984159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.309+0000 7ff98a825700 1 -- 172.21.15.55:0/1140883916 >> 172.21.15.55:0/1140883916 conn(0x7ff984099700 msgr2=0x7ff98406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.309+0000 7ff98a825700 1 -- 172.21.15.55:0/1140883916 shutdown_connections 2023-10-06T11:15:46.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.309+0000 7ff98a825700 1 -- 172.21.15.55:0/1140883916 wait complete. 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.310+0000 7ff98a825700 1 Processor -- start 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.310+0000 7ff98a825700 1 -- start start 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.310+0000 7ff98a825700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 0x7ff98414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff98415a160 0x7ff984158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840b3c30 0x7ff98415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840b4d20 con 0x7ff9840cd4d0 2023-10-06T11:15:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98414e9d0 con 0x7ff98415a160 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840b4110 con 0x7ff9840b3c30 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 0x7ff98414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 0x7ff98414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49248/0 (socket says 172.21.15.55:49248) 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 -- 172.21.15.55:0/864747198 learned_addr learned my addr 172.21.15.55:0/864747198 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff9837fe700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff98415a160 0x7ff984158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff988dc2700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840b3c30 0x7ff98415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 -- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840b3c30 msgr2=0x7ff98415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840b3c30 0x7ff98415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 -- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff98415a160 msgr2=0x7ff984158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff98415a160 0x7ff984158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 -- 172.21.15.55:0/864747198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740093c0 con 0x7ff9840cd4d0 2023-10-06T11:15:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff983fff700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 0x7ff98414e490 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff97400ec80 tx=0x7ff974009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff96bfff700 1 -- 172.21.15.55:0/864747198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974005a00 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff96bfff700 1 -- 172.21.15.55:0/864747198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974005b60 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c009a20 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff96bfff700 1 -- 172.21.15.55:0/864747198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400c920 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.311+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9840b46d0 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.313+0000 7ff96bfff700 1 -- 172.21.15.55:0/864747198 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff97400cc90 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.313+0000 7ff96bfff700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff970066f30 0x7ff9700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.313+0000 7ff96bfff700 1 -- 172.21.15.55:0/864747198 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff974084d10 con 0x7ff9840cd4d0 2023-10-06T11:15:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.313+0000 7ff9837fe700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff970066f30 0x7ff9700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.314+0000 7ff9837fe700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff970066f30 0x7ff9700693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff978007fd0 tx=0x7ff978007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.315+0000 7ff993b1db80 1 Processor -- start 2023-10-06T11:15:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.315+0000 7ff993b1db80 1 -- start start 2023-10-06T11:15:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff993b1db80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a20292fcd0 con 0x55a2029b0c20 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a202906ac0 con 0x55a2029b29f0 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2029042c0 con 0x55a2029f6ae0 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff988dc2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff988dc2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49250/0 (socket says 172.21.15.55:49250) 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff988dc2700 1 -- 172.21.15.55:0/4067135001 learned_addr learned my addr 172.21.15.55:0/4067135001 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff983fff700 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.316+0000 7ff9837fe700 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff988dc2700 1 -- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 msgr2=0x55a2029f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff988dc2700 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff988dc2700 1 -- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 msgr2=0x55a2029af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff988dc2700 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff988dc2700 1 -- 172.21.15.55:0/4067135001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a20279a2c0 con 0x55a2029b0c20 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff988dc2700 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029afb10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff9840cb1d0 tx=0x7ff97c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2798cdb2a4a690 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff9697fa700 1 -- 172.21.15.55:0/4067135001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00bd20 con 0x55a2029b0c20 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff9697fa700 1 -- 172.21.15.55:0/4067135001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00be80 con 0x55a2029b0c20 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff9697fa700 1 -- 172.21.15.55:0/4067135001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c012890 con 0x55a2029b0c20 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff993b1db80 1 -- 172.21.15.55:0/4067135001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 msgr2=0x55a2029afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.317+0000 7ff993b1db80 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029afb10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff9840cb1d0 tx=0x7ff97c019000 comp rx=0 tx=0).stop 2023-10-06T11:15:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 -- 172.21.15.55:0/4067135001 shutdown_connections 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029afb10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 --2- 172.21.15.55:0/4067135001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 -- 172.21.15.55:0/4067135001 >> 172.21.15.55:0/4067135001 conn(0x55a2029b10c0 msgr2=0x55a2029b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 -- 172.21.15.55:0/4067135001 shutdown_connections 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 -- 172.21.15.55:0/4067135001 wait complete. 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 -- start start 2023-10-06T11:15:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.318+0000 7ff993b1db80 1 Processor -- start 2023-10-06T11:15:46.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b0c20 0x55a2029d6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2029000b0 con 0x55a2029f6ae0 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2028ab8e0 con 0x55a2029b29f0 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2028c6ef0 con 0x55a2029b0c20 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff993b1db80 10 client.0 _ll_register_callbacks cb 0x55a20279cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff988dc2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff988dc2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029d7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49252/0 (socket says 172.21.15.55:49252) 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff988dc2700 1 -- 172.21.15.55:0/1089250860 learned_addr learned my addr 172.21.15.55:0/1089250860 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff983fff700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b0c20 0x55a2029d6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff9837fe700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029dbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.319+0000 7ff988dc2700 1 -- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b0c20 msgr2=0x55a2029d6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff988dc2700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b0c20 0x55a2029d6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff988dc2700 1 -- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 msgr2=0x55a2029dbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff988dc2700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029dbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff988dc2700 1 -- 172.21.15.55:0/1089250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98415a670 con 0x55a2029f6ae0 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff983fff700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b0c20 0x55a2029d6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff988dc2700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029d7c80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff97c01f000 tx=0x7ff97c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909db4a9810b5561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff9627fc700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff9627fc700 1 -- 172.21.15.55:0/1089250860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c026640 con 0x55a2029f6ae0 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff9627fc700 1 -- 172.21.15.55:0/1089250860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff97c030070 con 0x55a2029f6ae0 2023-10-06T11:15:46.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2029a46e0 con 0x55a2029f6ae0 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff9627fc700 1 -- 172.21.15.55:0/1089250860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff97c0269b0 con 0x55a2029f6ae0 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 10 client.6363 fetch_fsmap learned FSMap version 43 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55a20273d030 con 0x55a2029f6ae0 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff9627fc700 1 -- 172.21.15.55:0/1089250860 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a2029a46e0 con 0x55a2029f6ae0 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff9627fc700 1 -- 172.21.15.55:0/1089250860 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff97c026b10 con 0x55a2029f6ae0 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 10 client.6363 fetch_fsmap finished waiting for FSMap version 43 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 10 client.6363 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 20 client.6363 populate_metadata read hostname 'smithi055' 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029dca90 0x55a2029f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 4 client.6363 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 --> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a202981610 con 0x55a2029dca90 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.320+0000 7ff983fff700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029dca90 0x55a2029f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff9627fc700 10 client.6363 ms_handle_connect on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff983fff700 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029dca90 0x55a2029f2a70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2908ac88cccc6658 server_cookie=8f03b618bd438ad2 in_seq=0 out_seq=0 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff9627fc700 1 -- 172.21.15.55:0/1089250860 <== mds.0 v2:172.21.15.55:6833/1038778559 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a202981610 con 0x55a2029dca90 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff9627fc700 10 client.6363 handle_command_reply: tid=0 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 client.6363 shutdown 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 msgr2=0x55a2029d7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029d7c80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff97c01f000 tx=0x7ff97c020040 comp rx=0 tx=0).stop 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 shutdown_connections 2023-10-06T11:15:46.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029dca90 0x55a2029f2a70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029d7c80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b0c20 0x55a2029d6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff9627fc700 0 client.6363 ms_handle_reset on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 --2- 172.21.15.55:0/1089250860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029dbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 >> 172.21.15.55:0/1089250860 conn(0x55a2029b10c0 msgr2=0x55a2029abac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 shutdown_connections 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.321+0000 7ff993b1db80 1 -- 172.21.15.55:0/1089250860 wait complete. 2023-10-06T11:15:46.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.322+0000 7ff993b1db80 20 client.6363 trim_cache size 0 max 16384 2023-10-06T11:15:46.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.339+0000 7ff993b1db80 1 Processor -- start 2023-10-06T11:15:46.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.339+0000 7ff993b1db80 1 -- start start 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff993b1db80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a202782e80 con 0x55a2029b0c20 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2029d5f40 con 0x55a2029b29f0 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a202a18670 con 0x55a2029f6ae0 2023-10-06T11:15:46.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029f33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49258/0 (socket says 172.21.15.55:49258) 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 -- 172.21.15.55:0/474742348 learned_addr learned my addr 172.21.15.55:0/474742348 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff9837fe700 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 -- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 msgr2=0x55a2029aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff988dc2700 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 -- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 msgr2=0x55a2029d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029d5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 -- 172.21.15.55:0/474742348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2029dc8d0 con 0x55a2029b0c20 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff988dc2700 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff983fff700 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029f33d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff974051ea0 tx=0x7ff974058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe8faae51a327b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff969ffb700 1 -- 172.21.15.55:0/474742348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740830a0 con 0x55a2029b0c20 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff969ffb700 1 -- 172.21.15.55:0/474742348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974053ae0 con 0x55a2029b0c20 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.340+0000 7ff969ffb700 1 -- 172.21.15.55:0/474742348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974055c00 con 0x55a2029b0c20 2023-10-06T11:15:46.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 -- 172.21.15.55:0/474742348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 msgr2=0x55a2029f33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029f33d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff974051ea0 tx=0x7ff974058040 comp rx=0 tx=0).stop 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 -- 172.21.15.55:0/474742348 shutdown_connections 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029b0c20 0x55a2029f33d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 --2- 172.21.15.55:0/474742348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b29f0 0x55a2029d5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 -- 172.21.15.55:0/474742348 >> 172.21.15.55:0/474742348 conn(0x55a2029b10c0 msgr2=0x55a2029df5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 -- 172.21.15.55:0/474742348 shutdown_connections 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 -- 172.21.15.55:0/474742348 wait complete. 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 -- start start 2023-10-06T11:15:46.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.341+0000 7ff993b1db80 1 Processor -- start 2023-10-06T11:15:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b0c20 0x55a202a0fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b29f0 0x55a202a5f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a202a60110 con 0x55a2029f6ae0 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2029ab610 con 0x55a2029b0c20 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a202a0f2c0 con 0x55a2029b29f0 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff993b1db80 10 client.0 _ll_register_callbacks cb 0x55a20279cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff988dc2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff988dc2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49268/0 (socket says 172.21.15.55:49268) 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff988dc2700 1 -- 172.21.15.55:0/2237978570 learned_addr learned my addr 172.21.15.55:0/2237978570 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff9837fe700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b29f0 0x55a202a5f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.342+0000 7ff983fff700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b0c20 0x55a202a0fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff988dc2700 1 -- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b29f0 msgr2=0x55a202a5f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff988dc2700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b29f0 0x55a202a5f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff988dc2700 1 -- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b0c20 msgr2=0x55a202a0fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff988dc2700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b0c20 0x55a202a0fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff988dc2700 1 -- 172.21.15.55:0/2237978570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9840b46d0 con 0x55a2029f6ae0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff988dc2700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029aca20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55a2029f3f20 tx=0x7ff97c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8b7407bcb4af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff9627fc700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff9627fc700 1 -- 172.21.15.55:0/2237978570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00bca0 con 0x55a2029f6ae0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff9627fc700 1 -- 172.21.15.55:0/2237978570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff97c030070 con 0x55a2029f6ae0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff97c00be80 con 0x55a2029f6ae0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff9627fc700 1 -- 172.21.15.55:0/2237978570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff97c009420 con 0x55a2029f6ae0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 10 client.6369 fetch_fsmap learned FSMap version 43 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55a2028ce7d0 con 0x55a2029f6ae0 2023-10-06T11:15:46.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff9627fc700 1 -- 172.21.15.55:0/2237978570 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00be80 con 0x55a2029f6ae0 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff9627fc700 1 -- 172.21.15.55:0/2237978570 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff97c048020 con 0x55a2029f6ae0 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 10 client.6369 fetch_fsmap finished waiting for FSMap version 43 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 10 client.6369 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 20 client.6369 populate_metadata read hostname 'smithi055' 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029f8ec0 0x55a2029acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 4 client.6369 mds_command: new command op to 6165 tid=0[{"prefix": "session ls"}] 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.343+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 --> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x55a2028a2e50 con 0x55a2029f8ec0 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff983fff700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029f8ec0 0x55a2029acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff9627fc700 10 client.6369 ms_handle_connect on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff983fff700 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029f8ec0 0x55a2029acf60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16af1d152a80c1a3 server_cookie=12942ebf32c194eb in_seq=0 out_seq=0 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff9627fc700 1 -- 172.21.15.55:0/2237978570 <== mds.0 v2:172.21.15.55:6833/1038778559 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a2028a2e50 con 0x55a2029f8ec0 2023-10-06T11:15:46.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff9627fc700 10 client.6369 handle_command_reply: tid=0 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 client.6369 shutdown 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 msgr2=0x55a2029aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029aca20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55a2029f3f20 tx=0x7ff97c02c070 comp rx=0 tx=0).stop 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 shutdown_connections 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:6833/1038778559,v1:172.21.15.55:6835/1038778559] conn(0x55a2029f8ec0 0x55a2029acf60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a2029f6ae0 0x55a2029aca20 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a2029b0c20 0x55a202a0fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff9627fc700 0 client.6369 ms_handle_reset on v2:172.21.15.55:6833/1038778559 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 --2- 172.21.15.55:0/2237978570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a2029b29f0 0x55a202a5f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 >> 172.21.15.55:0/2237978570 conn(0x55a2029b10c0 msgr2=0x55a2029df5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 shutdown_connections 2023-10-06T11:15:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 1 -- 172.21.15.55:0/2237978570 wait complete. 2023-10-06T11:15:46.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.344+0000 7ff993b1db80 20 client.6369 trim_cache size 0 max 16384 2023-10-06T11:15:46.355 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2023-10-06T11:15:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff970066f30 msgr2=0x7ff9700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff970066f30 0x7ff9700693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff978007fd0 tx=0x7ff978007bf0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 msgr2=0x7ff98414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 0x7ff98414e490 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff97400ec80 tx=0x7ff974009120 comp rx=0 tx=0).stop 2023-10-06T11:15:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 shutdown_connections 2023-10-06T11:15:46.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff970066f30 0x7ff9700693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9840cd4d0 0x7ff98414e490 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9840b3c30 0x7ff98415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 --2- 172.21.15.55:0/864747198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff98415a160 0x7ff984158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 >> 172.21.15.55:0/864747198 conn(0x7ff984099700 msgr2=0x7ff9840ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 shutdown_connections 2023-10-06T11:15:46.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.345+0000 7ff98a825700 1 -- 172.21.15.55:0/864747198 wait complete. 2023-10-06T11:15:46.359 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2023-10-06T11:15:46.495 INFO:teuthology.orchestra.run.smithi055.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":22,"msgr_send_messages":22,"msgr_recv_bytes":6257,"msgr_send_bytes":15760,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.004174687,"msgr_running_send_time":0.000355461,"msgr_running_recv_time":0.002104261,"msgr_running_fast_dispatch_time":0.000383494,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.014304240,"avgtime":0.000681154},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":22,"msgr_send_messages":27,"msgr_recv_bytes":4840,"msgr_send_bytes":128716,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.005009404,"msgr_running_send_time":0.000724900,"msgr_running_recv_time":0.003744409,"msgr_running_fast_dispatch_time":0.000310861,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.012116299,"avgtime":0.000484651},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000003766,"avgtime":0.000000418}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":70,"msgr_send_messages":64,"msgr_recv_bytes":111383,"msgr_send_bytes":18803,"msgr_created_connections":5,"msgr_active_connections":3,"msgr_running_total_time":0.005390797,"msgr_running_send_time":0.001183603,"msgr_running_recv_time":0.005372916,"msgr_running_fast_dispatch_time":0.000378825,"msgr_send_messages_queue_lat":{"avgcount":64,"sum":0.015298352,"avgtime":0.000239036},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000001045,"avgtime":0.000000522}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":39,"sum":0.002061551,"avgtime":0.000052860}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012430,"avgtime":0.000006215}},"mds":{"request":4,"reply":4,"reply_latency":{"avgcount":4,"sum":0.000752935,"avgtime":0.000188233},"slow_reply":0,"forward":0,"dir_fetch":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":0,"inodes_bottom":10,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":7,"traverse_hit":7,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":233,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":7,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":1,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196957,"rdpos":0,"jlat":{"avgcount":5,"sum":0.010240651,"avgtime":0.002048130},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":34192,"heap":207104},"mds_server":{"dispatch_client_request":4,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":3,"sum":0.000493360,"avgtime":0.000164453},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000259575,"avgtime":0.000259575},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":3,"average_load":1,"avg_session_uptime":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":205535,"buffer_anon_items":59,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6216,"osdmap_items":79,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50512,"mds_co_items":211,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13597,"op_resend":31,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":79,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":109,"get_sum":108826,"get_or_fail_fail":0,"get_or_fail_success":109,"take":0,"take_sum":0,"put":109,"put_sum":108826,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13597,"put":43,"put_sum":13597,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x5640d3655e00":{"val":0,"max":3758096384,"get_started":0,"get":7,"get_sum":2653,"get_or_fail_fail":0,"get_or_fail_success":7,"take":0,"take_sum":0,"put":5,"put_sum":2653,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T11:15:46.496 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6257, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.000383494, "msgr_running_recv_time": 0.002104261, "msgr_running_send_time": 0.000355461, "msgr_running_total_time": 0.004174687, "msgr_send_bytes": 15760, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000681154, "sum": 0.01430424 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 4.18e-07, "sum": 3.766e-06 }, "msgr_recv_bytes": 4840, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.000310861, "msgr_running_recv_time": 0.003744409, "msgr_running_send_time": 0.0007249, "msgr_running_total_time": 0.005009404, "msgr_send_bytes": 128716, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.000484651, "sum": 0.012116299 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 5.22e-07, "sum": 1.045e-06 }, "msgr_recv_bytes": 111383, "msgr_recv_messages": 70, "msgr_running_fast_dispatch_time": 0.000378825, "msgr_running_recv_time": 0.005372916, "msgr_running_send_time": 0.001183603, "msgr_running_total_time": 0.005390797, "msgr_send_bytes": 18803, "msgr_send_messages": 64, "msgr_send_messages_queue_lat": { "avgcount": 64, "avgtime": 0.000239036, "sum": 0.015298352 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 39, "avgtime": 5.286e-05, "sum": 0.002061551 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.215e-06, "sum": 1.243e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 10, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 233, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 4, "reply_latency": { "avgcount": 4, "avgtime": 0.000188233, "sum": 0.000752935 }, "request": 4, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 7, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 7, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 7, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.00204813, "sum": 0.010240651 }, "rdpos": 0, "replayed": 0, "seg": 1, "segadd": 1, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196957 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 207104, "ino": 13, "ino+": 13, "ino-": 0, "rss": 34192 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 3, "avgtime": 0.000164453, "sum": 0.00049336 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000259575, "sum": 0.000259575 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 3 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 205535, "buffer_anon_items": 59, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50512, "mds_co_items": 211, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6216, "osdmap_items": 79, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 79, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 31, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13597, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 109, "get_or_fail_fail": 0, "get_or_fail_success": 109, "get_started": 0, "get_sum": 108826, "max": 104857600, "put": 109, "put_sum": 108826, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13597, "take": 43, "take_sum": 13597, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x5640d3655e00": { "get": 7, "get_or_fail_fail": 0, "get_or_fail_success": 7, "get_started": 0, "get_sum": 2653, "max": 3758096384, "put": 5, "put_sum": 2653, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T11:15:46.497 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T11:15:46.498 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:15:46.498 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:46.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:46.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:15:46.573 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:46.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.692+0000 7fdb7a7bb700 1 Processor -- start 2023-10-06T11:15:46.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.692+0000 7fdb7a7bb700 1 -- start start 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.693+0000 7fdb7a7bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdb740b0760 0x7fdb740ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.693+0000 7fdb7a7bb700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b0c60 con 0x7fdb740b49a0 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.693+0000 7fdb7a7bb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b0f40 con 0x7fdb74159560 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.693+0000 7fdb7a7bb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb740ab350 con 0x7fdb740b0760 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.693+0000 7fdb737fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdb740b49a0 0x7fdb740aac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34618/0 (socket says 172.21.15.55:34618) 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.693+0000 7fdb737fe700 1 -- 172.21.15.55:0/1426917174 learned_addr learned my addr 172.21.15.55:0/1426917174 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140892196 0 0) 0x7fdb740b0c60 con 0x7fdb740b49a0 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1426917174 >> v2:172.21.15.142:3300/0 conn(0x7fdb740b0760 0x7fdb740ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5c003570 con 0x7fdb740b49a0 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469177806 0 0) 0x7fdb5c003570 con 0x7fdb740b49a0 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 >> v2:172.21.15.142:3300/0 conn(0x7fdb740b0760 msgr2=0x7fdb740ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 --2- 172.21.15.55:0/1426917174 >> v2:172.21.15.142:3300/0 conn(0x7fdb740b0760 0x7fdb740ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 >> v1:172.21.15.142:6789/0 conn(0x7fdb74159560 legacy=0x7fdb740aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740b1220 con 0x7fdb740b49a0 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fdb68001470 con 0x7fdb740b49a0 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 >> v1:172.21.15.55:6789/0 conn(0x7fdb740b49a0 legacy=0x7fdb740aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb5c003ab0 0x7fdb5c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb5c004810 0x7fdb5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740ab350 con 0x7fdb5c005210 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c00c130 con 0x7fdb5c004810 2023-10-06T11:15:46.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c00c2f0 con 0x7fdb5c003ab0 2023-10-06T11:15:46.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb737fe700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb5c004810 0x7fdb5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb73fff700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb5c003ab0 0x7fdb5c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 -- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb5c003ab0 msgr2=0x7fdb5c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb5c003ab0 0x7fdb5c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 -- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb5c004810 msgr2=0x7fdb5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb5c004810 0x7fdb5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb78d58700 1 -- 172.21.15.55:0/1426917174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c003570 con 0x7fdb5c005210 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.694+0000 7fdb73fff700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb5c003ab0 0x7fdb5c003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb78d58700 1 -- 172.21.15.55:0/1426917174 reap_dead start 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb5c00ba60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e210 tx=0x7fdb6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df71aa0dc0fdefe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00eac0 con 0x7fdb5c005210 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c00f040 con 0x7fdb5c005210 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb72ffd700 1 -- 172.21.15.55:0/1426917174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00ee70 con 0x7fdb5c005210 2023-10-06T11:15:46.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1426917174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 msgr2=0x7fdb5c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb5c00ba60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e210 tx=0x7fdb6c00b040 comp rx=0 tx=0).stop 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1426917174 shutdown_connections 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1426917174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb5c00ba60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1426917174 >> 172.21.15.55:0/1426917174 conn(0x7fdb740997f0 msgr2=0x7fdb7406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1426917174 shutdown_connections 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.695+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1426917174 wait complete. 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.696+0000 7fdb7a7bb700 1 Processor -- start 2023-10-06T11:15:46.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 -- start start 2023-10-06T11:15:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb740aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb74157dd0 0x7fdb7409c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb740ce500 0x7fdb740ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740aec20 con 0x7fdb5c005210 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740ceeb0 con 0x7fdb74157dd0 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb7a7bb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7409c6b0 con 0x7fdb740ce500 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb73fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb740aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb73fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb740aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49274/0 (socket says 172.21.15.55:49274) 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.697+0000 7fdb73fff700 1 -- 172.21.15.55:0/1539013570 learned_addr learned my addr 172.21.15.55:0/1539013570 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb737fe700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb74157dd0 0x7fdb7409c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb740ce500 0x7fdb740ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb73fff700 1 -- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb740ce500 msgr2=0x7fdb740ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb73fff700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb740ce500 0x7fdb740ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb73fff700 1 -- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb74157dd0 msgr2=0x7fdb7409c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb73fff700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb74157dd0 0x7fdb7409c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb73fff700 1 -- 172.21.15.55:0/1539013570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74158240 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb78d58700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb740ce500 0x7fdb740ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb73fff700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb740aeec0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400e580 tx=0x7fdb64009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64010490 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64010040 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7409c970 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64010840 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.698+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7409cf30 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.699+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb74064a90 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.699+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb64010bb0 con 0x7fdb5c005210 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.700+0000 7fdb5bfff700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdb60066f30 0x7fdb600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:46.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.700+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdb64083a50 con 0x7fdb5c005210 2023-10-06T11:15:46.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.700+0000 7fdb737fe700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdb60066f30 0x7fdb600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:46.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.700+0000 7fdb737fe700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdb60066f30 0x7fdb600693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdb7416ce40 tx=0x7fdb68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:46.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.704+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb6404d5a0 con 0x7fdb5c005210 2023-10-06T11:15:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.943+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb740b1500 con 0x7fdb5c005210 2023-10-06T11:15:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.944+0000 7fdb5bfff700 1 -- 172.21.15.55:0/1539013570 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fdb64019020 con 0x7fdb5c005210 2023-10-06T11:15:46.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:46.946 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdb60066f30 msgr2=0x7fdb600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdb60066f30 0x7fdb600693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdb7416ce40 tx=0x7fdb68009040 comp rx=0 tx=0).stop 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 msgr2=0x7fdb740aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb740aeec0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400e580 tx=0x7fdb64009040 comp rx=0 tx=0).stop 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 shutdown_connections 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdb60066f30 0x7fdb600693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb5c005210 0x7fdb740aeec0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb740ce500 0x7fdb740ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 --2- 172.21.15.55:0/1539013570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb74157dd0 0x7fdb7409c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 >> 172.21.15.55:0/1539013570 conn(0x7fdb740997f0 msgr2=0x7fdb740ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 shutdown_connections 2023-10-06T11:15:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:46.946+0000 7fdb7a7bb700 1 -- 172.21.15.55:0/1539013570 wait complete. 2023-10-06T11:15:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:46.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:47.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.078+0000 7fac5958c700 1 Processor -- start 2023-10-06T11:15:47.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.078+0000 7fac5958c700 1 -- start start 2023-10-06T11:15:47.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac5958c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac540b25e0 0x7fac540b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac5958c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540cbfa0 con 0x7fac540b29b0 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac5958c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540cb390 con 0x7fac54159830 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac5958c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac540cb670 con 0x7fac540b25e0 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac527fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac540b29b0 0x7fac54159120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34624/0 (socket says 172.21.15.55:34624) 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac527fc700 1 -- 172.21.15.55:0/1010710789 learned_addr learned my addr 172.21.15.55:0/1010710789 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac540b25e0 0x7fac540b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245677764 0 0) 0x7fac540cbfa0 con 0x7fac540b29b0 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3c003570 con 0x7fac540b29b0 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920736157 0 0) 0x7fac540cb390 con 0x7fac54159830 2023-10-06T11:15:47.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac540cbfa0 con 0x7fac54159830 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725553214 0 0) 0x7fac3c003570 con 0x7fac540b29b0 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac540b25e0 msgr2=0x7fac540b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac540b25e0 0x7fac540b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 >> v1:172.21.15.142:6789/0 conn(0x7fac54159830 legacy=0x7fac540cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540cb950 con 0x7fac540b29b0 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fac48001470 con 0x7fac540b29b0 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 >> v1:172.21.15.55:6789/0 conn(0x7fac540b29b0 legacy=0x7fac54159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac3c003c20 0x7fac3c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3c0051c0 0x7fac3c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac540cb670 con 0x7fac3c004810 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c00c020 con 0x7fac3c0051c0 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.079+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c00c1e0 con 0x7fac3c003c20 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac540b25e0 0x7fac540b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac537fe700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3c0051c0 0x7fac3c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac3c003c20 0x7fac3c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 -- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac3c003c20 msgr2=0x7fac3c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac3c003c20 0x7fac3c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 -- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3c0051c0 msgr2=0x7fac3c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3c0051c0 0x7fac3c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 -- 172.21.15.55:0/1010710789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c003570 con 0x7fac3c004810 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac3c003c20 0x7fac3c004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac537fe700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3c0051c0 0x7fac3c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac527fc700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac3c004c80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c2d0 tx=0x7fac48001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa24d9800a20291 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800cba0 con 0x7fac3c004810 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4800cd00 con 0x7fac3c004810 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.080+0000 7fac51ffb700 1 -- 172.21.15.55:0/1010710789 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48005b70 con 0x7fac3c004810 2023-10-06T11:15:47.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac5958c700 1 -- 172.21.15.55:0/1010710789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 msgr2=0x7fac3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac5958c700 1 --2- 172.21.15.55:0/1010710789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac3c004c80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c2d0 tx=0x7fac48001e10 comp rx=0 tx=0).stop 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac537fe700 1 -- 172.21.15.55:0/1010710789 reap_dead start 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac5958c700 1 -- 172.21.15.55:0/1010710789 shutdown_connections 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac5958c700 1 -- 172.21.15.55:0/1010710789 >> 172.21.15.55:0/1010710789 conn(0x7fac5406ece0 msgr2=0x7fac5406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac5958c700 1 -- 172.21.15.55:0/1010710789 shutdown_connections 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.081+0000 7fac5958c700 1 -- 172.21.15.55:0/1010710789 wait complete. 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.082+0000 7fac5958c700 1 Processor -- start 2023-10-06T11:15:47.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.082+0000 7fac5958c700 1 -- start start 2023-10-06T11:15:47.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac5958c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac5415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac5958c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415d7b0 0x7fac54145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac5958c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540c74d0 0x7fac540c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac5958c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415e910 con 0x7fac3c004810 2023-10-06T11:15:47.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac5958c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac540c7e40 con 0x7fac540c74d0 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac5958c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415dd00 con 0x7fac5415d7b0 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac5415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac5415eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49290/0 (socket says 172.21.15.55:49290) 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 -- 172.21.15.55:0/1840673950 learned_addr learned my addr 172.21.15.55:0/1840673950 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac527fc700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415d7b0 0x7fac54145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac537fe700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540c74d0 0x7fac540c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 -- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415d7b0 msgr2=0x7fac54145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415d7b0 0x7fac54145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 -- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540c74d0 msgr2=0x7fac540c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540c74d0 0x7fac540c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 -- 172.21.15.55:0/1840673950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5415dfe0 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac527fc700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415d7b0 0x7fac54145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac537fe700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540c74d0 0x7fac540c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac52ffd700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac5415eda0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fac44010c20 tx=0x7fac44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44005a00 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.083+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44005b60 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.084+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4400e9d0 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.084+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5415e2c0 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.084+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac540ca190 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.084+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5415ebf0 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.085+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac4400ed80 con 0x7fac3c004810 2023-10-06T11:15:47.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.085+0000 7fac3affd700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac40066f60 0x7fac40069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.085+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fac44084a90 con 0x7fac3c004810 2023-10-06T11:15:47.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.086+0000 7fac527fc700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac40066f60 0x7fac40069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.086+0000 7fac527fc700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac40066f60 0x7fac40069410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fac48007c90 tx=0x7fac48015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.090+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac440519c0 con 0x7fac3c004810 2023-10-06T11:15:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.287+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac54064a90 con 0x7fac3c004810 2023-10-06T11:15:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.288+0000 7fac3affd700 1 -- 172.21.15.55:0/1840673950 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fac44021090 con 0x7fac3c004810 2023-10-06T11:15:47.290 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:47.290 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:38.035759+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:34.232138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:35.489479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac40066f60 msgr2=0x7fac40069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac40066f60 0x7fac40069410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fac48007c90 tx=0x7fac48015000 comp rx=0 tx=0).stop 2023-10-06T11:15:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 msgr2=0x7fac5415eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac5415eda0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fac44010c20 tx=0x7fac44008040 comp rx=0 tx=0).stop 2023-10-06T11:15:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 shutdown_connections 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac40066f60 0x7fac40069410 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac3c004810 0x7fac5415eda0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac540c74d0 0x7fac540c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 --2- 172.21.15.55:0/1840673950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5415d7b0 0x7fac54145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 >> 172.21.15.55:0/1840673950 conn(0x7fac5406ece0 msgr2=0x7fac54153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 shutdown_connections 2023-10-06T11:15:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.290+0000 7fac5958c700 1 -- 172.21.15.55:0/1840673950 wait complete. 2023-10-06T11:15:47.304 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:15:34.232138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:15:35.489479+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:15:47.305 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:15:47.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.425+0000 7f6a4cc22700 1 Processor -- start 2023-10-06T11:15:47.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.425+0000 7f6a4cc22700 1 -- start start 2023-10-06T11:15:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a4cc22700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a480b2620 0x7f6a480cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a4cc22700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b29f0 0x7f6a480cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a4cc22700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a480ceaa0 0x7f6a480cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a4cc22700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480cc970 con 0x7f6a480b2620 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a4cc22700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480cf480 con 0x7f6a480ceaa0 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a4cc22700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480cbd60 con 0x7f6a480b29f0 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a480b2620 0x7f6a480cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a480b2620 0x7f6a480cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49298/0 (socket says 172.21.15.55:49298) 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 -- 172.21.15.55:0/3874973303 learned_addr learned my addr 172.21.15.55:0/3874973303 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a47fff700 1 --2- 172.21.15.55:0/3874973303 >> v2:172.21.15.142:3300/0 conn(0x7f6a480ceaa0 0x7f6a480cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a46ffd700 1 --2- 172.21.15.55:0/3874973303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b29f0 0x7f6a480cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 -- 172.21.15.55:0/3874973303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b29f0 msgr2=0x7f6a480cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 --2- 172.21.15.55:0/3874973303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b29f0 0x7f6a480cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 -- 172.21.15.55:0/3874973303 >> v2:172.21.15.142:3300/0 conn(0x7f6a480ceaa0 msgr2=0x7f6a480cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 --2- 172.21.15.55:0/3874973303 >> v2:172.21.15.142:3300/0 conn(0x7f6a480ceaa0 0x7f6a480cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a477fe700 1 -- 172.21.15.55:0/3874973303 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480cc040 con 0x7f6a480b2620 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.426+0000 7f6a47fff700 1 --2- 172.21.15.55:0/3874973303 >> v2:172.21.15.142:3300/0 conn(0x7f6a480ceaa0 0x7f6a480cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a477fe700 1 --2- 172.21.15.55:0/3874973303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b2620 0x7f6a480cccb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6a48089650 tx=0x7f6a38009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21512e3fac228254 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a467fc700 1 -- 172.21.15.55:0/3874973303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38005c10 con 0x7f6a480b2620 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a467fc700 1 -- 172.21.15.55:0/3874973303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38005d70 con 0x7f6a480b2620 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a467fc700 1 -- 172.21.15.55:0/3874973303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800b880 con 0x7f6a480b2620 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 -- 172.21.15.55:0/3874973303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b2620 msgr2=0x7f6a480cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/3874973303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b2620 0x7f6a480cccb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6a48089650 tx=0x7f6a38009220 comp rx=0 tx=0).stop 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 -- 172.21.15.55:0/3874973303 shutdown_connections 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/3874973303 >> v2:172.21.15.142:3300/0 conn(0x7f6a480ceaa0 0x7f6a480cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/3874973303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b2620 0x7f6a480cccb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/3874973303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b29f0 0x7f6a480cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 -- 172.21.15.55:0/3874973303 >> 172.21.15.55:0/3874973303 conn(0x7f6a48099520 msgr2=0x7f6a4806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 -- 172.21.15.55:0/3874973303 shutdown_connections 2023-10-06T11:15:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.427+0000 7f6a4cc22700 1 -- 172.21.15.55:0/3874973303 wait complete. 2023-10-06T11:15:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.428+0000 7f6a4cc22700 1 Processor -- start 2023-10-06T11:15:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 -- start start 2023-10-06T11:15:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b2620 0x7f6a480b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 0x7f6a480c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a480ceaa0 0x7f6a48158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480b51c0 con 0x7f6a480b29f0 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481544c0 con 0x7f6a480ceaa0 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a4cc22700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480b42d0 con 0x7f6a480b2620 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a46ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 0x7f6a480c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a46ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 0x7f6a480c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49310/0 (socket says 172.21.15.55:49310) 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.429+0000 7f6a46ffd700 1 -- 172.21.15.55:0/2774573986 learned_addr learned my addr 172.21.15.55:0/2774573986 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a477fe700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b2620 0x7f6a480b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a47fff700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a480ceaa0 0x7f6a48158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a46ffd700 1 -- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b2620 msgr2=0x7f6a480b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a46ffd700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b2620 0x7f6a480b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a46ffd700 1 -- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a480ceaa0 msgr2=0x7f6a48158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a46ffd700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a480ceaa0 0x7f6a48158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a46ffd700 1 -- 172.21.15.55:0/2774573986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38009480 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a46ffd700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 0x7f6a480c9e30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c7d0 tx=0x7f6a3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c011600 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c011760 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a480b45b0 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c011b20 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.430+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a480b4b70 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.431+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a480b5330 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.431+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3c0193f0 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.432+0000 7f6a2f7fe700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a34066f30 0x7f6a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.432+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a3c084cf0 con 0x7f6a480b29f0 2023-10-06T11:15:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.432+0000 7f6a477fe700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a34066f30 0x7f6a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.433+0000 7f6a477fe700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a34066f30 0x7f6a340693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009260 tx=0x7f6a38016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.436+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a3c089070 con 0x7f6a480b29f0 2023-10-06T11:15:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.629+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a4805f230 con 0x7f6a480b29f0 2023-10-06T11:15:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.629+0000 7f6a2f7fe700 1 -- 172.21.15.55:0/2774573986 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a3c051cc0 con 0x7f6a480b29f0 2023-10-06T11:15:47.631 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:15:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a34066f30 msgr2=0x7f6a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a34066f30 0x7f6a340693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009260 tx=0x7f6a38016000 comp rx=0 tx=0).stop 2023-10-06T11:15:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 msgr2=0x7f6a480c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 0x7f6a480c9e30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c7d0 tx=0x7f6a3c008040 comp rx=0 tx=0).stop 2023-10-06T11:15:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 shutdown_connections 2023-10-06T11:15:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a34066f30 0x7f6a340693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a480ceaa0 0x7f6a48158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a480b2620 0x7f6a480b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 --2- 172.21.15.55:0/2774573986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a480b29f0 0x7f6a480c9e30 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 >> 172.21.15.55:0/2774573986 conn(0x7f6a48099520 msgr2=0x7f6a480cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 shutdown_connections 2023-10-06T11:15:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.631+0000 7f6a4cc22700 1 -- 172.21.15.55:0/2774573986 wait complete. 2023-10-06T11:15:47.645 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:15:47.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.765+0000 7f8335c31700 1 Processor -- start 2023-10-06T11:15:47.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.765+0000 7f8335c31700 1 -- start start 2023-10-06T11:15:47.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f8335c31700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f83301594d0 0x7f83300cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f8335c31700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f83300cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f8335c31700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83300cf310 con 0x7f83300ce7e0 2023-10-06T11:15:47.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f8335c31700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83300cf5d0 con 0x7f83301594d0 2023-10-06T11:15:47.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f8335c31700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300cf8b0 con 0x7f83301598a0 2023-10-06T11:15:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f832f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f83301594d0 0x7f83300cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f832ffff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f83300ce7e0 0x7f83300cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:53994/0 (socket says 172.21.15.55:53994) 2023-10-06T11:15:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f832effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f83300cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.766+0000 7f832ffff700 1 -- 172.21.15.55:0/1136039025 learned_addr learned my addr 172.21.15.55:0/1136039025 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832e7fc700 1 -- 172.21.15.55:0/1136039025 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619586306 0 0) 0x7f83300cf310 con 0x7f83300ce7e0 2023-10-06T11:15:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832e7fc700 1 -- 172.21.15.55:0/1136039025 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8318003570 con 0x7f83300ce7e0 2023-10-06T11:15:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832effd700 1 -- 172.21.15.55:0/1136039025 >> v2:172.21.15.142:3300/0 conn(0x7f83301594d0 msgr2=0x7f83300cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832effd700 1 --2- 172.21.15.55:0/1136039025 >> v2:172.21.15.142:3300/0 conn(0x7f83301594d0 0x7f83300cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832effd700 1 -- 172.21.15.55:0/1136039025 >> v1:172.21.15.142:6789/0 conn(0x7f83300ce7e0 legacy=0x7f83300cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832effd700 1 -- 172.21.15.55:0/1136039025 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300cfb90 con 0x7f83301598a0 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832f7fe700 1 --2- 172.21.15.55:0/1136039025 >> v2:172.21.15.142:3300/0 conn(0x7f83301594d0 0x7f83300cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832effd700 1 --2- 172.21.15.55:0/1136039025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f83300cbaa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83200098e0 tx=0x7f83200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2040d12e7f6484 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832e7fc700 1 -- 172.21.15.55:0/1136039025 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011630 con 0x7f83301598a0 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832e7fc700 1 -- 172.21.15.55:0/1136039025 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320011790 con 0x7f83301598a0 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.767+0000 7f832e7fc700 1 -- 172.21.15.55:0/1136039025 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011b30 con 0x7f83301598a0 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 -- 172.21.15.55:0/1136039025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 msgr2=0x7f83300cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 --2- 172.21.15.55:0/1136039025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f83300cbaa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83200098e0 tx=0x7f83200091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 -- 172.21.15.55:0/1136039025 shutdown_connections 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 --2- 172.21.15.55:0/1136039025 >> v2:172.21.15.142:3300/0 conn(0x7f83301594d0 0x7f83300cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 --2- 172.21.15.55:0/1136039025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f83300cbaa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 -- 172.21.15.55:0/1136039025 >> 172.21.15.55:0/1136039025 conn(0x7f8330089e50 msgr2=0x7f8330099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:47.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 -- 172.21.15.55:0/1136039025 shutdown_connections 2023-10-06T11:15:47.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.768+0000 7f8335c31700 1 -- 172.21.15.55:0/1136039025 wait complete. 2023-10-06T11:15:47.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.769+0000 7f8335c31700 1 Processor -- start 2023-10-06T11:15:47.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.769+0000 7f8335c31700 1 -- start start 2023-10-06T11:15:47.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f8335c31700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83300ce7e0 0x7f833015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f8335c31700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 0x7f83300b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f8335c31700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f8330152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f8335c31700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833014cc50 con 0x7f83301594d0 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f8335c31700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8330169cf0 con 0x7f83300ce7e0 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f8335c31700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833015c320 con 0x7f83301598a0 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 0x7f83300b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 0x7f83300b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49322/0 (socket says 172.21.15.55:49322) 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 -- 172.21.15.55:0/2051283235 learned_addr learned my addr 172.21.15.55:0/2051283235 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832ffff700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f8330152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832f7fe700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83300ce7e0 0x7f833015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 -- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 msgr2=0x7f8330152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f8330152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 -- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83300ce7e0 msgr2=0x7f833015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83300ce7e0 0x7f833015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.770+0000 7f832effd700 1 -- 172.21.15.55:0/2051283235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324009420 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.771+0000 7f832effd700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 0x7f83300b4810 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8320013000 tx=0x7f8320017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.771+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320000d10 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.771+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320011b10 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.771+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320025660 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.771+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8320009420 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.771+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833015c8e0 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.772+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833014ca20 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.772+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8320025a50 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.773+0000 7f83177fe700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f831c066f30 0x7f831c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.773+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8320085ed0 con 0x7f83301594d0 2023-10-06T11:15:47.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.773+0000 7f832f7fe700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f831c066f30 0x7f831c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:47.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.773+0000 7f832f7fe700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f831c066f30 0x7f831c0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8324009f40 tx=0x7f83240091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:47.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.777+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f833014ca20 con 0x7f83301594d0 2023-10-06T11:15:47.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.968+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f833014ca20 con 0x7f83301594d0 2023-10-06T11:15:47.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.969+0000 7f83177fe700 1 -- 172.21.15.55:0/2051283235 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f833014ca20 con 0x7f83301594d0 2023-10-06T11:15:47.971 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f831c066f30 msgr2=0x7f831c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f831c066f30 0x7f831c0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8324009f40 tx=0x7f83240091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 msgr2=0x7f83300b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 0x7f83300b4810 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8320013000 tx=0x7f8320017000 comp rx=0 tx=0).stop 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 shutdown_connections 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f831c066f30 0x7f831c0693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83301598a0 0x7f8330152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83300ce7e0 0x7f833015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 --2- 172.21.15.55:0/2051283235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83301594d0 0x7f83300b4810 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 >> 172.21.15.55:0/2051283235 conn(0x7f8330089e50 msgr2=0x7f833014c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 shutdown_connections 2023-10-06T11:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:47.971+0000 7f8335c31700 1 -- 172.21.15.55:0/2051283235 wait complete. 2023-10-06T11:15:47.985 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:15:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.105+0000 7f714595b700 1 Processor -- start 2023-10-06T11:15:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.105+0000 7f714595b700 1 -- start start 2023-10-06T11:15:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f714595b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7140153d90 0x7f714015d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f714595b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7140069c60 con 0x7f71401539c0 2023-10-06T11:15:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f714595b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714015db90 con 0x7f714015d650 2023-10-06T11:15:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f714595b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714015ab70 con 0x7f7140153d90 2023-10-06T11:15:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713effd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f71401539c0 0x7f7140069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34630/0 (socket says 172.21.15.55:34630) 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713e7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7140153d90 0x7f714015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713effd700 1 -- 172.21.15.55:0/3614129420 learned_addr learned my addr 172.21.15.55:0/3614129420 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713e7fc700 1 -- 172.21.15.55:0/3614129420 >> v1:172.21.15.142:6789/0 conn(0x7f714015d650 legacy=0x7f71400cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713dffb700 1 -- 172.21.15.55:0/3614129420 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206824511 0 0) 0x7f7140069c60 con 0x7f71401539c0 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713e7fc700 1 -- 172.21.15.55:0/3614129420 >> v1:172.21.15.55:6789/0 conn(0x7f71401539c0 legacy=0x7f7140069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713e7fc700 1 -- 172.21.15.55:0/3614129420 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714015de70 con 0x7f7140153d90 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.106+0000 7f713e7fc700 1 --2- 172.21.15.55:0/3614129420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7140153d90 0x7f714015d110 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71280098e0 tx=0x7f71280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad2fbf9f7ef8a7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f713dffb700 1 -- 172.21.15.55:0/3614129420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128009e80 con 0x7f7140153d90 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f713dffb700 1 -- 172.21.15.55:0/3614129420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800b820 con 0x7f7140153d90 2023-10-06T11:15:48.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f713dffb700 1 -- 172.21.15.55:0/3614129420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800bba0 con 0x7f7140153d90 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 -- 172.21.15.55:0/3614129420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7140153d90 msgr2=0x7f714015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 --2- 172.21.15.55:0/3614129420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7140153d90 0x7f714015d110 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71280098e0 tx=0x7f71280091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 -- 172.21.15.55:0/3614129420 shutdown_connections 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 --2- 172.21.15.55:0/3614129420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7140153d90 0x7f714015d110 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 -- 172.21.15.55:0/3614129420 >> 172.21.15.55:0/3614129420 conn(0x7f714006b610 msgr2=0x7f714006ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 -- 172.21.15.55:0/3614129420 shutdown_connections 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.107+0000 7f714595b700 1 -- 172.21.15.55:0/3614129420 wait complete. 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.108+0000 7f714595b700 1 Processor -- start 2023-10-06T11:15:48.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.108+0000 7f714595b700 1 -- start start 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f714595b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 0x7f7140141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f714595b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7140153d90 0x7f7140154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f714595b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714015d650 0x7f7140155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f714595b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7140156480 con 0x7f71401539c0 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f714595b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7140158060 con 0x7f7140153d90 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f714595b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71401557b0 con 0x7f714015d650 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 0x7f7140141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 0x7f7140141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49338/0 (socket says 172.21.15.55:49338) 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 -- 172.21.15.55:0/4286146637 learned_addr learned my addr 172.21.15.55:0/4286146637 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713e7fc700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7140153d90 0x7f7140154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 -- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714015d650 msgr2=0x7f7140155110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714015d650 0x7f7140155110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 -- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7140153d90 msgr2=0x7f7140154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7140153d90 0x7f7140154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.109+0000 7f713effd700 1 -- 172.21.15.55:0/4286146637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009420 con 0x7f71401539c0 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.110+0000 7f713effd700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 0x7f7140141c70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f713000c5b0 tx=0x7f7130001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.110+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130005b30 con 0x7f71401539c0 2023-10-06T11:15:48.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.110+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130005c90 con 0x7f71401539c0 2023-10-06T11:15:48.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.110+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7140155e30 con 0x7f71401539c0 2023-10-06T11:15:48.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.110+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130007300 con 0x7f71401539c0 2023-10-06T11:15:48.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.110+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71401421b0 con 0x7f71401539c0 2023-10-06T11:15:48.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.111+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71401562d0 con 0x7f71401539c0 2023-10-06T11:15:48.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.111+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f713001b3b0 con 0x7f71401539c0 2023-10-06T11:15:48.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.112+0000 7f7136ffd700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.112+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7130083e50 con 0x7f71401539c0 2023-10-06T11:15:48.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.112+0000 7f713e7fc700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.112+0000 7f713e7fc700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7120066f30 0x7f71200693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7140154190 tx=0x7f7128016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.116+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7130050d80 con 0x7f71401539c0 2023-10-06T11:15:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.309+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7140064a90 con 0x7f71401539c0 2023-10-06T11:15:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.309+0000 7f7136ffd700 1 -- 172.21.15.55:0/4286146637 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71300170a0 con 0x7f71401539c0 2023-10-06T11:15:48.311 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7120066f30 msgr2=0x7f71200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7120066f30 0x7f71200693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7140154190 tx=0x7f7128016000 comp rx=0 tx=0).stop 2023-10-06T11:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 msgr2=0x7f7140141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 0x7f7140141c70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f713000c5b0 tx=0x7f7130001070 comp rx=0 tx=0).stop 2023-10-06T11:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 shutdown_connections 2023-10-06T11:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71401539c0 0x7f7140141c70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714015d650 0x7f7140155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 --2- 172.21.15.55:0/4286146637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7140153d90 0x7f7140154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 >> 172.21.15.55:0/4286146637 conn(0x7f714006b610 msgr2=0x7f7140152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 shutdown_connections 2023-10-06T11:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.311+0000 7f714595b700 1 -- 172.21.15.55:0/4286146637 wait complete. 2023-10-06T11:15:48.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:15:48.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.445+0000 7fd139ef5700 1 Processor -- start 2023-10-06T11:15:48.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.445+0000 7fd139ef5700 1 -- start start 2023-10-06T11:15:48.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd139ef5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1340b2620 0x7fd1340cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd139ef5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd1340cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd139ef5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340cc970 con 0x7fd1340b29f0 2023-10-06T11:15:48.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd139ef5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1340cbd60 con 0x7fd1340b2620 2023-10-06T11:15:48.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd139ef5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340cc040 con 0x7fd1340cf1b0 2023-10-06T11:15:48.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd133fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1340b29f0 0x7fd1340ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34646/0 (socket says 172.21.15.55:34646) 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd133fff700 1 -- 172.21.15.55:0/4049801114 learned_addr learned my addr 172.21.15.55:0/4049801114 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd1396f4700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd1340cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd138ef3700 1 --2- 172.21.15.55:0/4049801114 >> v2:172.21.15.142:3300/0 conn(0x7fd1340b2620 0x7fd1340cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.446+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213707297 0 0) 0x7fd1340cc970 con 0x7fd1340b29f0 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd120003570 con 0x7fd1340b29f0 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786265919 0 0) 0x7fd120003570 con 0x7fd1340b29f0 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 msgr2=0x7fd1340cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd1340cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 >> v2:172.21.15.142:3300/0 conn(0x7fd1340b2620 msgr2=0x7fd1340cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 --2- 172.21.15.55:0/4049801114 >> v2:172.21.15.142:3300/0 conn(0x7fd1340b2620 0x7fd1340cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340cc320 con 0x7fd1340b29f0 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fd124001470 con 0x7fd1340b29f0 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 >> v1:172.21.15.55:6789/0 conn(0x7fd1340b29f0 legacy=0x7fd1340ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd120003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd120004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd120004d50 0x7fd1200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340cbd60 con 0x7fd120003a60 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340cc040 con 0x7fd120004d50 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12000bb10 con 0x7fd1340cf1b0 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd120003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd133fff700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd120004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1396f4700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd120004d50 0x7fd1200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 -- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 msgr2=0x7fd120004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd120004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 -- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd120004d50 msgr2=0x7fd1200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd120004d50 0x7fd1200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 -- 172.21.15.55:0/4049801114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120003570 con 0x7fd120003a60 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd1396f4700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd120004d50 0x7fd1200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd133fff700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1340cf1b0 0x7fd120004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.447+0000 7fd138ef3700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd120003e70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007490 tx=0x7fd12c009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583e3abeda0e1953 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c009a90 con 0x7fd120003a60 2023-10-06T11:15:48.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c007d40 con 0x7fd120003a60 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd1337fe700 1 -- 172.21.15.55:0/4049801114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c014630 con 0x7fd120003a60 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd139ef5700 1 -- 172.21.15.55:0/4049801114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 msgr2=0x7fd120003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd139ef5700 1 --2- 172.21.15.55:0/4049801114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd120003e70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007490 tx=0x7fd12c009760 comp rx=0 tx=0).stop 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd1396f4700 1 -- 172.21.15.55:0/4049801114 reap_dead start 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd139ef5700 1 -- 172.21.15.55:0/4049801114 shutdown_connections 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd139ef5700 1 -- 172.21.15.55:0/4049801114 >> 172.21.15.55:0/4049801114 conn(0x7fd134099520 msgr2=0x7fd13406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd139ef5700 1 -- 172.21.15.55:0/4049801114 shutdown_connections 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.448+0000 7fd139ef5700 1 -- 172.21.15.55:0/4049801114 wait complete. 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.449+0000 7fd139ef5700 1 Processor -- start 2023-10-06T11:15:48.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.449+0000 7fd139ef5700 1 -- start start 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd139ef5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd13413f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd139ef5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd13413f740 0x7fd13413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd139ef5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1340c8bd0 0x7fd1340c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd139ef5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13413f5d0 con 0x7fd120003a60 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd139ef5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13414e4c0 con 0x7fd1340c8bd0 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd139ef5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13414e7a0 con 0x7fd13413f740 2023-10-06T11:15:48.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd138ef3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd13413f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd138ef3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd13413f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49350/0 (socket says 172.21.15.55:49350) 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd138ef3700 1 -- 172.21.15.55:0/2701783428 learned_addr learned my addr 172.21.15.55:0/2701783428 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd1396f4700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1340c8bd0 0x7fd1340c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd133fff700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd13413f740 0x7fd13413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd138ef3700 1 -- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd13413f740 msgr2=0x7fd13413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd138ef3700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd13413f740 0x7fd13413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.450+0000 7fd138ef3700 1 -- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1340c8bd0 msgr2=0x7fd1340c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd138ef3700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1340c8bd0 0x7fd1340c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd138ef3700 1 -- 172.21.15.55:0/2701783428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340c98b0 con 0x7fd120003a60 2023-10-06T11:15:48.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd1396f4700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1340c8bd0 0x7fd1340c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd133fff700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd13413f740 0x7fd13413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd138ef3700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd13413f090 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007a80 tx=0x7fd12c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c028430 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c023070 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1340c9b90 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c028800 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.451+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1340c9580 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.452+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13405f230 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.452+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd12c025030 con 0x7fd120003a60 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.453+0000 7fd130ff9700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd114066f30 0x7fd1140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.453+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd12c086870 con 0x7fd120003a60 2023-10-06T11:15:48.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.453+0000 7fd133fff700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd114066f30 0x7fd1140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.454+0000 7fd133fff700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd114066f30 0x7fd1140693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd124001d20 tx=0x7fd124001e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.457+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd12c053840 con 0x7fd120003a60 2023-10-06T11:15:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.650+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1340cc600 con 0x7fd120003a60 2023-10-06T11:15:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.650+0000 7fd130ff9700 1 -- 172.21.15.55:0/2701783428 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd12c056e60 con 0x7fd120003a60 2023-10-06T11:15:48.652 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:15:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd114066f30 msgr2=0x7fd1140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd114066f30 0x7fd1140693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd124001d20 tx=0x7fd124001e60 comp rx=0 tx=0).stop 2023-10-06T11:15:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 msgr2=0x7fd13413f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd13413f090 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007a80 tx=0x7fd12c018000 comp rx=0 tx=0).stop 2023-10-06T11:15:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 shutdown_connections 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd114066f30 0x7fd1140693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd120003a60 0x7fd13413f090 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1340c8bd0 0x7fd1340c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 --2- 172.21.15.55:0/2701783428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd13413f740 0x7fd13413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 >> 172.21.15.55:0/2701783428 conn(0x7fd134099520 msgr2=0x7fd134069380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 shutdown_connections 2023-10-06T11:15:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.652+0000 7fd139ef5700 1 -- 172.21.15.55:0/2701783428 wait complete. 2023-10-06T11:15:48.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.783+0000 7f99cb40d700 1 Processor -- start 2023-10-06T11:15:48.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.784+0000 7f99cb40d700 1 -- start start 2023-10-06T11:15:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.784+0000 7f99cb40d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c4159560 0x7f99c40aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.784+0000 7f99cb40d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99c40b49a0 0x7f99c40aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99cb40d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40b0c60 con 0x7f99c40b0760 2023-10-06T11:15:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99cb40d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40b0f40 con 0x7f99c40b49a0 2023-10-06T11:15:48.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99cb40d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40b1220 con 0x7f99c4159560 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c89a8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99c40b49a0 0x7f99c40aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c91a9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c4159560 0x7f99c40aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c99aa700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f99c40b0760 0x7f99c40b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:54018/0 (socket says 172.21.15.55:54018) 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c99aa700 1 -- 172.21.15.55:0/4138719697 learned_addr learned my addr 172.21.15.55:0/4138719697 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c91a9700 1 -- 172.21.15.55:0/4138719697 >> v2:172.21.15.142:3300/0 conn(0x7f99c40b49a0 msgr2=0x7f99c40aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c91a9700 1 --2- 172.21.15.55:0/4138719697 >> v2:172.21.15.142:3300/0 conn(0x7f99c40b49a0 0x7f99c40aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c91a9700 1 -- 172.21.15.55:0/4138719697 >> v1:172.21.15.142:6789/0 conn(0x7f99c40b0760 legacy=0x7f99c40b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c91a9700 1 -- 172.21.15.55:0/4138719697 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40b1500 con 0x7f99c4159560 2023-10-06T11:15:48.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c89a8700 1 --2- 172.21.15.55:0/4138719697 >> v2:172.21.15.142:3300/0 conn(0x7f99c40b49a0 0x7f99c40aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.785+0000 7f99c91a9700 1 --2- 172.21.15.55:0/4138719697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c4159560 0x7f99c40aa530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0098d0 tx=0x7f99bc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ef6a5438a168f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99c3fff700 1 -- 172.21.15.55:0/4138719697 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc005c10 con 0x7f99c4159560 2023-10-06T11:15:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99c3fff700 1 -- 172.21.15.55:0/4138719697 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc005d70 con 0x7f99c4159560 2023-10-06T11:15:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99c3fff700 1 -- 172.21.15.55:0/4138719697 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc006280 con 0x7f99c4159560 2023-10-06T11:15:48.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 -- 172.21.15.55:0/4138719697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c4159560 msgr2=0x7f99c40aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 --2- 172.21.15.55:0/4138719697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c4159560 0x7f99c40aa530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0098d0 tx=0x7f99bc009120 comp rx=0 tx=0).stop 2023-10-06T11:15:48.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 -- 172.21.15.55:0/4138719697 shutdown_connections 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 --2- 172.21.15.55:0/4138719697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c4159560 0x7f99c40aa530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 --2- 172.21.15.55:0/4138719697 >> v2:172.21.15.142:3300/0 conn(0x7f99c40b49a0 0x7f99c40aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 -- 172.21.15.55:0/4138719697 >> 172.21.15.55:0/4138719697 conn(0x7f99c40997f0 msgr2=0x7f99c406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 -- 172.21.15.55:0/4138719697 shutdown_connections 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.786+0000 7f99cb40d700 1 -- 172.21.15.55:0/4138719697 wait complete. 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.787+0000 7f99cb40d700 1 Processor -- start 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.787+0000 7f99cb40d700 1 -- start start 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99cb40d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c40b0760 0x7f99c40c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99cb40d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c40b49a0 0x7f99c4157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99cb40d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 0x7f99c4169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99cb40d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4157fe0 con 0x7f99c4159560 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99cb40d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c416d280 con 0x7f99c40b0760 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99cb40d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c416cf30 con 0x7f99c40b49a0 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99c99aa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 0x7f99c4169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99c99aa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 0x7f99c4169930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49352/0 (socket says 172.21.15.55:49352) 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.788+0000 7f99c99aa700 1 -- 172.21.15.55:0/1846404995 learned_addr learned my addr 172.21.15.55:0/1846404995 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c91a9700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c40b0760 0x7f99c40c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c89a8700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c40b49a0 0x7f99c4157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c99aa700 1 -- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c40b49a0 msgr2=0x7f99c4157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c99aa700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c40b49a0 0x7f99c4157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c99aa700 1 -- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c40b0760 msgr2=0x7f99c40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c99aa700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c40b0760 0x7f99c40c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c99aa700 1 -- 172.21.15.55:0/1846404995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009420 con 0x7f99c4159560 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c89a8700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c40b49a0 0x7f99c4157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c99aa700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 0x7f99c4169930 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f99b400cc40 tx=0x7f99b4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400a910 con 0x7f99c4159560 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400aa70 con 0x7f99c4159560 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0093c0 con 0x7f99c4159560 2023-10-06T11:15:48.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400ae30 con 0x7f99c4159560 2023-10-06T11:15:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.789+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c416a460 con 0x7f99c4159560 2023-10-06T11:15:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.790+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c4064a90 con 0x7f99c4159560 2023-10-06T11:15:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.791+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99b4007300 con 0x7f99c4159560 2023-10-06T11:15:48.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.791+0000 7f99c17fa700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99b0066f30 0x7f99b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:48.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.791+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f99b4084b70 con 0x7f99c4159560 2023-10-06T11:15:48.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.791+0000 7f99c91a9700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99b0066f30 0x7f99b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:48.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.792+0000 7f99c91a9700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99b0066f30 0x7f99b00693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f99c40d1110 tx=0x7f99bc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:48.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:48.795+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99b4051b40 con 0x7f99c4159560 2023-10-06T11:15:49.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.033+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99c416d3f0 con 0x7f99c4159560 2023-10-06T11:15:49.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.034+0000 7f99c17fa700 1 -- 172.21.15.55:0/1846404995 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f99b4055160 con 0x7f99c4159560 2023-10-06T11:15:49.035 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:49.035 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:49.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.035+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99b0066f30 msgr2=0x7f99b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.035+0000 7f99cb40d700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99b0066f30 0x7f99b00693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f99c40d1110 tx=0x7f99bc016000 comp rx=0 tx=0).stop 2023-10-06T11:15:49.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 msgr2=0x7f99c4169930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 0x7f99c4169930 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f99b400cc40 tx=0x7f99b4001a50 comp rx=0 tx=0).stop 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 shutdown_connections 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f99b0066f30 0x7f99b00693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99c4159560 0x7f99c4169930 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99c40b0760 0x7f99c40c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 --2- 172.21.15.55:0/1846404995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99c40b49a0 0x7f99c4157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 >> 172.21.15.55:0/1846404995 conn(0x7f99c40997f0 msgr2=0x7f99c40cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 shutdown_connections 2023-10-06T11:15:49.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.036+0000 7f99cb40d700 1 -- 172.21.15.55:0/1846404995 wait complete. 2023-10-06T11:15:49.039 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:49.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.166+0000 7f71a151b700 1 Processor -- start 2023-10-06T11:15:49.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.167+0000 7f71a151b700 1 -- start start 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.167+0000 7f71a151b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b49a0 0x7f719c0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.167+0000 7f71a151b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f719c0b0760 0x7f719c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.167+0000 7f71a151b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0b0c60 con 0x7f719c159560 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.167+0000 7f71a151b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0b0f40 con 0x7f719c0b0760 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.167+0000 7f71a151b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0b1220 con 0x7f719c0b49a0 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f719c0b0760 0x7f719c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719affd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f719c159560 0x7f719c0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34660/0 (socket says 172.21.15.55:34660) 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719affd700 1 -- 172.21.15.55:0/2618686416 learned_addr learned my addr 172.21.15.55:0/2618686416 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719a7fc700 1 --2- 172.21.15.55:0/2618686416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b49a0 0x7f719c0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719b7fe700 1 -- 172.21.15.55:0/2618686416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b49a0 msgr2=0x7f719c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719b7fe700 1 --2- 172.21.15.55:0/2618686416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b49a0 0x7f719c0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f7199ffb700 1 -- 172.21.15.55:0/2618686416 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072079673 0 0) 0x7f719c0b0c60 con 0x7f719c159560 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719b7fe700 1 -- 172.21.15.55:0/2618686416 >> v1:172.21.15.55:6789/0 conn(0x7f719c159560 legacy=0x7f719c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719b7fe700 1 -- 172.21.15.55:0/2618686416 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0b1500 con 0x7f719c0b0760 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f719b7fe700 1 --2- 172.21.15.55:0/2618686416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b0760 0x7f719c0b1bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7194009e60 tx=0x7f7194009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88319940bfc6b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f7199ffb700 1 -- 172.21.15.55:0/2618686416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400e070 con 0x7f719c0b0760 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.168+0000 7f7199ffb700 1 -- 172.21.15.55:0/2618686416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400bb60 con 0x7f719c0b0760 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f7199ffb700 1 -- 172.21.15.55:0/2618686416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194012430 con 0x7f719c0b0760 2023-10-06T11:15:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 -- 172.21.15.55:0/2618686416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b0760 msgr2=0x7f719c0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 --2- 172.21.15.55:0/2618686416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b0760 0x7f719c0b1bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7194009e60 tx=0x7f7194009780 comp rx=0 tx=0).stop 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 -- 172.21.15.55:0/2618686416 shutdown_connections 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 --2- 172.21.15.55:0/2618686416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b0760 0x7f719c0b1bc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 --2- 172.21.15.55:0/2618686416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b49a0 0x7f719c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 -- 172.21.15.55:0/2618686416 >> 172.21.15.55:0/2618686416 conn(0x7f719c0997f0 msgr2=0x7f719c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 -- 172.21.15.55:0/2618686416 shutdown_connections 2023-10-06T11:15:49.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.169+0000 7f71a151b700 1 -- 172.21.15.55:0/2618686416 wait complete. 2023-10-06T11:15:49.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.170+0000 7f71a151b700 1 Processor -- start 2023-10-06T11:15:49.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 -- start start 2023-10-06T11:15:49.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b0760 0x7f719c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 0x7f719c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c159560 0x7f719c09bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c09ccf0 con 0x7f719c0b49a0 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c169a50 con 0x7f719c159560 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f71a151b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c15ab10 con 0x7f719c0b0760 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f719a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 0x7f719c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f719a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 0x7f719c1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49378/0 (socket says 172.21.15.55:49378) 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f719a7fc700 1 -- 172.21.15.55:0/2457881944 learned_addr learned my addr 172.21.15.55:0/2457881944 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:49.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.171+0000 7f719b7fe700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c159560 0x7f719c09bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719affd700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b0760 0x7f719c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719a7fc700 1 -- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b0760 msgr2=0x7f719c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719a7fc700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b0760 0x7f719c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719a7fc700 1 -- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c159560 msgr2=0x7f719c09bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719a7fc700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c159560 0x7f719c09bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719a7fc700 1 -- 172.21.15.55:0/2457881944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194009a20 con 0x7f719c0b49a0 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.172+0000 7f719a7fc700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 0x7f719c1588b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f718400ec80 tx=0x7f71840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.173+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400c7f0 con 0x7f719c0b49a0 2023-10-06T11:15:49.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.174+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400c970 con 0x7f719c0b49a0 2023-10-06T11:15:49.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.174+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c15adf0 con 0x7f719c0b49a0 2023-10-06T11:15:49.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.174+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400cd30 con 0x7f719c0b49a0 2023-10-06T11:15:49.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.174+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c15b3b0 con 0x7f719c0b49a0 2023-10-06T11:15:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.175+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c169bf0 con 0x7f719c0b49a0 2023-10-06T11:15:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.175+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7184013680 con 0x7f719c0b49a0 2023-10-06T11:15:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.175+0000 7f7192ffd700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f717c066f60 0x7f717c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.175+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f71840849e0 con 0x7f719c0b49a0 2023-10-06T11:15:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.175+0000 7f719affd700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f717c066f60 0x7f717c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.176+0000 7f719affd700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f717c066f60 0x7f717c069410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f718c0029c0 tx=0x7f718c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.179+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f719c169bf0 con 0x7f719c0b49a0 2023-10-06T11:15:49.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.379+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719c169b90 con 0x7f719c0b49a0 2023-10-06T11:15:49.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.380+0000 7f7192ffd700 1 -- 172.21.15.55:0/2457881944 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f71840519b0 con 0x7f719c0b49a0 2023-10-06T11:15:49.382 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:49.382 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:38.035759+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:34.232138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:35.489479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f717c066f60 msgr2=0x7f717c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f717c066f60 0x7f717c069410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f718c0029c0 tx=0x7f718c009040 comp rx=0 tx=0).stop 2023-10-06T11:15:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 msgr2=0x7f719c1588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 0x7f719c1588b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f718400ec80 tx=0x7f71840091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 shutdown_connections 2023-10-06T11:15:49.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f717c066f60 0x7f717c069410 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f719c159560 0x7f719c09bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f719c0b0760 0x7f719c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 --2- 172.21.15.55:0/2457881944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0b49a0 0x7f719c1588b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 >> 172.21.15.55:0/2457881944 conn(0x7f719c0997f0 msgr2=0x7f719c0b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:49.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 shutdown_connections 2023-10-06T11:15:49.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.382+0000 7f71a151b700 1 -- 172.21.15.55:0/2457881944 wait complete. 2023-10-06T11:15:49.397 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:15:49.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:49.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.514+0000 7fdfba416700 1 Processor -- start 2023-10-06T11:15:49.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.514+0000 7fdfba416700 1 -- start start 2023-10-06T11:15:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfba416700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb4159560 0x7fdfb40aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfba416700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40b0c60 con 0x7fdfb40b49a0 2023-10-06T11:15:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfba416700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40b0f40 con 0x7fdfb40b0760 2023-10-06T11:15:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfba416700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40b1220 con 0x7fdfb4159560 2023-10-06T11:15:49.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfb37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdfb40b49a0 0x7fdfb40aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34670/0 (socket says 172.21.15.55:34670) 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfb37fe700 1 -- 172.21.15.55:0/2721588204 learned_addr learned my addr 172.21.15.55:0/2721588204 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.515+0000 7fdfb3fff700 1 --2- 172.21.15.55:0/2721588204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb4159560 0x7fdfb40aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491199826 0 0) 0x7fdfb40b0c60 con 0x7fdfb40b49a0 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf9c003570 con 0x7fdfb40b49a0 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321769342 0 0) 0x7fdfb40b0f40 con 0x7fdfb40b0760 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb40b0c60 con 0x7fdfb40b0760 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb3fff700 1 -- 172.21.15.55:0/2721588204 >> v1:172.21.15.142:6789/0 conn(0x7fdfb40b0760 legacy=0x7fdfb40b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4146022877 0 0) 0x7fdf9c003570 con 0x7fdfb40b49a0 2023-10-06T11:15:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb3fff700 1 -- 172.21.15.55:0/2721588204 >> v1:172.21.15.55:6789/0 conn(0x7fdfb40b49a0 legacy=0x7fdfb40aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb3fff700 1 -- 172.21.15.55:0/2721588204 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40b1500 con 0x7fdfb4159560 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb3fff700 1 --2- 172.21.15.55:0/2721588204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb4159560 0x7fdfb40aa530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009900 tx=0x7fdfa4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb68d0c74f264430 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8001470 con 0x7fdfb4159560 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4011420 con 0x7fdfb4159560 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.516+0000 7fdfb2ffd700 1 -- 172.21.15.55:0/2721588204 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40117a0 con 0x7fdfb4159560 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 -- 172.21.15.55:0/2721588204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb4159560 msgr2=0x7fdfb40aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 --2- 172.21.15.55:0/2721588204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb4159560 0x7fdfb40aa530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009900 tx=0x7fdfa4009120 comp rx=0 tx=0).stop 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 -- 172.21.15.55:0/2721588204 shutdown_connections 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 --2- 172.21.15.55:0/2721588204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb4159560 0x7fdfb40aa530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 -- 172.21.15.55:0/2721588204 >> 172.21.15.55:0/2721588204 conn(0x7fdfb40997f0 msgr2=0x7fdfb406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:49.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 -- 172.21.15.55:0/2721588204 shutdown_connections 2023-10-06T11:15:49.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.517+0000 7fdfba416700 1 -- 172.21.15.55:0/2721588204 wait complete. 2023-10-06T11:15:49.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.518+0000 7fdfba416700 1 Processor -- start 2023-10-06T11:15:49.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.518+0000 7fdfba416700 1 -- start start 2023-10-06T11:15:49.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfba416700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb40b0760 0x7fdfb415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfba416700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 0x7fdfb41580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfba416700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfb4159560 0x7fdfb40ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfba416700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4158a80 con 0x7fdfb40b49a0 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfba416700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40ae6d0 con 0x7fdfb4159560 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfba416700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40aeb60 con 0x7fdfb40b0760 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 0x7fdfb41580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 0x7fdfb41580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49382/0 (socket says 172.21.15.55:49382) 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 -- 172.21.15.55:0/974878710 learned_addr learned my addr 172.21.15.55:0/974878710 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb3fff700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb40b0760 0x7fdfb415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb89b3700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfb4159560 0x7fdfb40ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 -- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb40b0760 msgr2=0x7fdfb415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb40b0760 0x7fdfb415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 -- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfb4159560 msgr2=0x7fdfb40ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfb4159560 0x7fdfb40ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 -- 172.21.15.55:0/974878710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40093c0 con 0x7fdfb40b49a0 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.519+0000 7fdfb37fe700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 0x7fdfb41580a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8001ed0 tx=0x7fdfa8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.520+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800ce20 con 0x7fdfb40b49a0 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.520+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8005b30 con 0x7fdfb40b49a0 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.520+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40adac0 con 0x7fdfb40b49a0 2023-10-06T11:15:49.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.520+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80070f0 con 0x7fdfb40b49a0 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.520+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb40ae080 con 0x7fdfb40b49a0 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.521+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb40ae840 con 0x7fdfb40b49a0 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.521+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfa8007460 con 0x7fdfb40b49a0 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.521+0000 7fdf9bfff700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.522+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdfa8083e80 con 0x7fdfb40b49a0 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.522+0000 7fdfb3fff700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.522+0000 7fdfb3fff700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009160 tx=0x7fdfa4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.526+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfa804b5a0 con 0x7fdfb40b49a0 2023-10-06T11:15:49.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.760+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb4064a90 con 0x7fdfb40b49a0 2023-10-06T11:15:49.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.761+0000 7fdf9bfff700 1 -- 172.21.15.55:0/974878710 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fdfa8017070 con 0x7fdfb40b49a0 2023-10-06T11:15:49.763 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:49.763 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:49.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa0066f30 msgr2=0x7fdfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009160 tx=0x7fdfa4016000 comp rx=0 tx=0).stop 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 msgr2=0x7fdfb41580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 0x7fdfb41580a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8001ed0 tx=0x7fdfa8001a20 comp rx=0 tx=0).stop 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 shutdown_connections 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfb4159560 0x7fdfb40ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdfb40b0760 0x7fdfb415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 --2- 172.21.15.55:0/974878710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb40b49a0 0x7fdfb41580a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 >> 172.21.15.55:0/974878710 conn(0x7fdfb40997f0 msgr2=0x7fdfb40cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 shutdown_connections 2023-10-06T11:15:49.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.763+0000 7fdfba416700 1 -- 172.21.15.55:0/974878710 wait complete. 2023-10-06T11:15:49.766 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:49.777 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.894+0000 7f792f720700 1 Processor -- start 2023-10-06T11:15:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.895+0000 7f792f720700 1 -- start start 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.895+0000 7f792f720700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79280adb60 0x7f79280ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.895+0000 7f792f720700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7928157de0 con 0x7f79280ca370 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.895+0000 7f792f720700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79280ceb10 con 0x7f79280ce6d0 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.895+0000 7f792f720700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280cbb90 con 0x7f79280adb60 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792ccbb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79280adb60 0x7f79280ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792d4bc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79280ca370 0x7f7928158270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34678/0 (socket says 172.21.15.55:34678) 2023-10-06T11:15:49.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792d4bc700 1 -- 172.21.15.55:0/858028831 learned_addr learned my addr 172.21.15.55:0/858028831 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792ccbb700 1 -- 172.21.15.55:0/858028831 >> v1:172.21.15.142:6789/0 conn(0x7f79280ce6d0 legacy=0x7f792815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792ccbb700 1 -- 172.21.15.55:0/858028831 >> v1:172.21.15.55:6789/0 conn(0x7f79280ca370 legacy=0x7f7928158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f7927fff700 1 -- 172.21.15.55:0/858028831 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312430837 0 0) 0x7f7928157de0 con 0x7f79280ca370 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792ccbb700 1 -- 172.21.15.55:0/858028831 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280cb5d0 con 0x7f79280adb60 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f792ccbb700 1 --2- 172.21.15.55:0/858028831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f79280ce190 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f791c0098e0 tx=0x7f791c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897b00beaef20b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f7927fff700 1 -- 172.21.15.55:0/858028831 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c009e80 con 0x7f79280adb60 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f7927fff700 1 -- 172.21.15.55:0/858028831 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00b860 con 0x7f79280adb60 2023-10-06T11:15:49.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.896+0000 7f7927fff700 1 -- 172.21.15.55:0/858028831 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00bbe0 con 0x7f79280adb60 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 -- 172.21.15.55:0/858028831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 msgr2=0x7f79280ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 --2- 172.21.15.55:0/858028831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f79280ce190 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f791c0098e0 tx=0x7f791c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 -- 172.21.15.55:0/858028831 shutdown_connections 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 --2- 172.21.15.55:0/858028831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f79280ce190 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 -- 172.21.15.55:0/858028831 >> 172.21.15.55:0/858028831 conn(0x7f79280707d0 msgr2=0x7f7928070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 -- 172.21.15.55:0/858028831 shutdown_connections 2023-10-06T11:15:49.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.897+0000 7f792f720700 1 -- 172.21.15.55:0/858028831 wait complete. 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.898+0000 7f792f720700 1 Processor -- start 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.898+0000 7f792f720700 1 -- start start 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792f720700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f7928168540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792f720700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79280ca370 0x7f79280c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792f720700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79280ce6d0 0x7f79280c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792f720700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c3ef0 con 0x7f79280adb60 2023-10-06T11:15:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792f720700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c35c0 con 0x7f79280ca370 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792f720700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c38a0 con 0x7f79280ce6d0 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f7928168540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f7928168540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49398/0 (socket says 172.21.15.55:49398) 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 -- 172.21.15.55:0/3221085491 learned_addr learned my addr 172.21.15.55:0/3221085491 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792ccbb700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79280ca370 0x7f79280c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792dcbd700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79280ce6d0 0x7f79280c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 -- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79280ce6d0 msgr2=0x7f79280c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79280ce6d0 0x7f79280c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 -- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79280ca370 msgr2=0x7f79280c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79280ca370 0x7f79280c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 -- 172.21.15.55:0/3221085491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009420 con 0x7f79280adb60 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792dcbd700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79280ce6d0 0x7f79280c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.899+0000 7f792d4bc700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f7928168540 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f792000c810 tx=0x7f7920007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.900+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920005c00 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.900+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920005d60 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.900+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79280c3b80 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.900+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920007320 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.900+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79280c4380 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.901+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7928064a90 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.901+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f792001b3b0 con 0x7f79280adb60 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.901+0000 7f79257fa700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7914066f30 0x7f79140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.901+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7920083d00 con 0x7f79280adb60 2023-10-06T11:15:49.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.902+0000 7f792ccbb700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7914066f30 0x7f79140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:49.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.902+0000 7f792ccbb700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7914066f30 0x7f79140693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f79280adfa0 tx=0x7f791c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:49.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:49.906+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7920050cd0 con 0x7f79280adb60 2023-10-06T11:15:50.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.142+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79280cb8b0 con 0x7f79280adb60 2023-10-06T11:15:50.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.142+0000 7f79257fa700 1 -- 172.21.15.55:0/3221085491 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f7920017020 con 0x7f79280adb60 2023-10-06T11:15:50.144 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:50.144 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:36.517477+0000","modified":"2023-10-06T11:15:40.121525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1038778559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1038778559},{"type":"v1","addr":"172.21.15.55:6835","nonce":1038778559}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:15:50.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7914066f30 msgr2=0x7f79140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7914066f30 0x7f79140693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f79280adfa0 tx=0x7f791c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 msgr2=0x7f7928168540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f7928168540 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f792000c810 tx=0x7f7920007d90 comp rx=0 tx=0).stop 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 shutdown_connections 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7914066f30 0x7f79140693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79280adb60 0x7f7928168540 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79280ce6d0 0x7f79280c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 --2- 172.21.15.55:0/3221085491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79280ca370 0x7f79280c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 >> 172.21.15.55:0/3221085491 conn(0x7f79280707d0 msgr2=0x7f79280ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 shutdown_connections 2023-10-06T11:15:50.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.145+0000 7f792f720700 1 -- 172.21.15.55:0/3221085491 wait complete. 2023-10-06T11:15:50.148 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 43 2023-10-06T11:15:50.158 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:50.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.276+0000 7f4272a9d700 1 Processor -- start 2023-10-06T11:15:50.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.276+0000 7f4272a9d700 1 -- start start 2023-10-06T11:15:50.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f4272a9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f426c0c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f4272a9d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0c7330 con 0x7f426c0ac000 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f4272a9d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0c6720 con 0x7f426c0adf20 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f4272a9d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c156110 con 0x7f426c069c30 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f426c0ac000 0x7f426c069520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34682/0 (socket says 172.21.15.55:34682) 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426bfff700 1 -- 172.21.15.55:0/2416746398 learned_addr learned my addr 172.21.15.55:0/2416746398 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f427103a700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f426c0c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096825898 0 0) 0x7f426c0c7330 con 0x7f426c0ac000 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4254003570 con 0x7f426c0ac000 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413487433 0 0) 0x7f426c0c6720 con 0x7f426c0adf20 2023-10-06T11:15:50.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426c0c7330 con 0x7f426c0adf20 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274831984 0 0) 0x7f4254003570 con 0x7f426c0ac000 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 msgr2=0x7f426c0c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f426c0c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 >> v1:172.21.15.142:6789/0 conn(0x7f426c0adf20 legacy=0x7f426c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0c6a00 con 0x7f426c0ac000 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f4260001470 con 0x7f426c0ac000 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 >> v1:172.21.15.55:6789/0 conn(0x7f426c0ac000 legacy=0x7f426c069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4254003c20 0x7f4254004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f4254004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254004d50 0x7f42540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c156110 con 0x7f4254003c20 2023-10-06T11:15:50.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425400bb40 con 0x7f4254004d50 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.277+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425400bd00 con 0x7f426c069c30 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4254003c20 0x7f4254004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f426bfff700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f4254004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f427103a700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254004d50 0x7f42540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 -- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 msgr2=0x7f4254004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f4254004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 -- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254004d50 msgr2=0x7f42540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254004d50 0x7f42540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 -- 172.21.15.55:0/2416746398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254003570 con 0x7f4254003c20 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f426bfff700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c069c30 0x7f4254004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f427103a700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254004d50 0x7f42540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:50.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f4270839700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4254003c20 0x7f4254004010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f425c001500 tx=0x7f425c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8a962660e67f20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00c5d0 con 0x7f4254003c20 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00c730 con 0x7f4254003c20 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.278+0000 7f426b7fe700 1 -- 172.21.15.55:0/2416746398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00cad0 con 0x7f4254003c20 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f4272a9d700 1 -- 172.21.15.55:0/2416746398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4254003c20 msgr2=0x7f4254004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f4272a9d700 1 --2- 172.21.15.55:0/2416746398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4254003c20 0x7f4254004010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f425c001500 tx=0x7f425c007d30 comp rx=0 tx=0).stop 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f427103a700 1 -- 172.21.15.55:0/2416746398 reap_dead start 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f4272a9d700 1 -- 172.21.15.55:0/2416746398 shutdown_connections 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f4272a9d700 1 -- 172.21.15.55:0/2416746398 >> 172.21.15.55:0/2416746398 conn(0x7f426c068080 msgr2=0x7f426c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f4272a9d700 1 -- 172.21.15.55:0/2416746398 shutdown_connections 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.279+0000 7f4272a9d700 1 -- 172.21.15.55:0/2416746398 wait complete. 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.280+0000 7f4272a9d700 1 Processor -- start 2023-10-06T11:15:50.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.280+0000 7f4272a9d700 1 -- start start 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254003c20 0x7f426c149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c1541d0 0x7f426c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 0x7f426c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0cb780 con 0x7f426c0cada0 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0bfdc0 con 0x7f4254003c20 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0c49c0 con 0x7f426c1541d0 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 0x7f426c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 0x7f426c0cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49414/0 (socket says 172.21.15.55:49414) 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 -- 172.21.15.55:0/457983882 learned_addr learned my addr 172.21.15.55:0/457983882 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:50.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4270839700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254003c20 0x7f426c149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f426bfff700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c1541d0 0x7f426c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 -- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c1541d0 msgr2=0x7f426c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c1541d0 0x7f426c0c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 -- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254003c20 msgr2=0x7f426c149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254003c20 0x7f426c149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 -- 172.21.15.55:0/457983882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0c4ca0 con 0x7f426c0cada0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f426bfff700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c1541d0 0x7f426c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f427103a700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 0x7f426c0cb240 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f426c06a030 tx=0x7f426400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400e030 con 0x7f426c0cada0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264011c30 con 0x7f426c0cada0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.281+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c0c4f80 con 0x7f426c0cada0 2023-10-06T11:15:50.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.282+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264009b70 con 0x7f426c0cada0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.282+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c149970 con 0x7f426c0cada0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.283+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c064a90 con 0x7f426c0cada0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.283+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4264016680 con 0x7f426c0cada0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.283+0000 7f4268ff9700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4258066f30 0x7f42580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.283+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f426400f070 con 0x7f426c0cada0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.284+0000 7f4270839700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4258066f30 0x7f42580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.284+0000 7f4270839700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4258066f30 0x7f42580693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f425c008fd0 tx=0x7f425c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.288+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4264055eb0 con 0x7f426c0cada0 2023-10-06T11:15:50.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.480+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f426c0c6ce0 con 0x7f426c0cada0 2023-10-06T11:15:50.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.481+0000 7f4268ff9700 1 -- 172.21.15.55:0/457983882 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f4264055a40 con 0x7f426c0cada0 2023-10-06T11:15:50.483 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:50.483 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:38.035759+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:34.232138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:35.489479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:50.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4258066f30 msgr2=0x7f42580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4258066f30 0x7f42580693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f425c008fd0 tx=0x7f425c016000 comp rx=0 tx=0).stop 2023-10-06T11:15:50.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 msgr2=0x7f426c0cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 0x7f426c0cb240 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f426c06a030 tx=0x7f426400b040 comp rx=0 tx=0).stop 2023-10-06T11:15:50.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 shutdown_connections 2023-10-06T11:15:50.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4258066f30 0x7f42580693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426c0cada0 0x7f426c0cb240 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254003c20 0x7f426c149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 --2- 172.21.15.55:0/457983882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f426c1541d0 0x7f426c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 >> 172.21.15.55:0/457983882 conn(0x7f426c068080 msgr2=0x7f426c0c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 shutdown_connections 2023-10-06T11:15:50.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.483+0000 7f4272a9d700 1 -- 172.21.15.55:0/457983882 wait complete. 2023-10-06T11:15:50.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:15:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.615+0000 7f0ceb2ba700 1 Processor -- start 2023-10-06T11:15:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.615+0000 7f0ceb2ba700 1 -- start start 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ceb2ba700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce4069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ceb2ba700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ce4069a60 0x7f0ce40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ceb2ba700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce40c7330 con 0x7f0ce40adf20 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ceb2ba700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce4156110 con 0x7f0ce4069a60 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ceb2ba700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4069ee0 con 0x7f0ce40ac000 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ce9056700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0ce40adf20 0x7f0ce406e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34688/0 (socket says 172.21.15.55:34688) 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ce9056700 1 -- 172.21.15.55:0/3714941016 learned_addr learned my addr 172.21.15.55:0/3714941016 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ce9857700 1 --2- 172.21.15.55:0/3714941016 >> v2:172.21.15.142:3300/0 conn(0x7f0ce4069a60 0x7f0ce40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.616+0000 7f0ce8855700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce3fff700 1 -- 172.21.15.55:0/3714941016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549975941 0 0) 0x7f0ce40c7330 con 0x7f0ce40adf20 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce3fff700 1 -- 172.21.15.55:0/3714941016 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc003570 con 0x7f0ce40adf20 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce9857700 1 -- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 msgr2=0x7f0ce4069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce9857700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce4069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce3fff700 1 -- 172.21.15.55:0/3714941016 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488477655 0 0) 0x7f0ccc003570 con 0x7f0ce40adf20 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce9857700 1 -- 172.21.15.55:0/3714941016 >> v1:172.21.15.55:6789/0 conn(0x7f0ce40adf20 legacy=0x7f0ce406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce9857700 1 -- 172.21.15.55:0/3714941016 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40c6720 con 0x7f0ce4069a60 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce8855700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce4069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce9857700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c77c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009e90 tx=0x7f0cd4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe9fbbd0d74c14bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce3fff700 1 -- 172.21.15.55:0/3714941016 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400e070 con 0x7f0ce4069a60 2023-10-06T11:15:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce3fff700 1 -- 172.21.15.55:0/3714941016 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd400b870 con 0x7f0ce4069a60 2023-10-06T11:15:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.617+0000 7f0ce3fff700 1 -- 172.21.15.55:0/3714941016 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc001470 con 0x7f0ce4069a60 2023-10-06T11:15:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce4069a60 msgr2=0x7f0ce40c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c77c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009e90 tx=0x7f0cd4009780 comp rx=0 tx=0).stop 2023-10-06T11:15:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/3714941016 shutdown_connections 2023-10-06T11:15:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c77c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/3714941016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce4069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/3714941016 >> 172.21.15.55:0/3714941016 conn(0x7f0ce4068080 msgr2=0x7f0ce40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/3714941016 shutdown_connections 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.618+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/3714941016 wait complete. 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.619+0000 7f0ceb2ba700 1 Processor -- start 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.619+0000 7f0ceb2ba700 1 -- start start 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ceb2ba700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ceb2ba700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce414d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ceb2ba700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce40adf20 0x7f0ce414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ceb2ba700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40c45b0 con 0x7f0ce4069a60 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ceb2ba700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce414c900 con 0x7f0ce40adf20 2023-10-06T11:15:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ceb2ba700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce414cba0 con 0x7f0ce40ac000 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49428/0 (socket says 172.21.15.55:49428) 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 -- 172.21.15.55:0/4286687146 learned_addr learned my addr 172.21.15.55:0/4286687146 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce8855700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce414d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9857700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce40adf20 0x7f0ce414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 -- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 msgr2=0x7f0ce414d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce414d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 -- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce40adf20 msgr2=0x7f0ce414dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce40adf20 0x7f0ce414dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.620+0000 7f0ce9056700 1 -- 172.21.15.55:0/4286687146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8009420 con 0x7f0ce4069a60 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.621+0000 7f0ce9056700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c3fd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00cb90 tx=0x7f0cdc001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.621+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc007e90 con 0x7f0ce4069a60 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.621+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc007360 con 0x7f0ce4069a60 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.621+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd4009a20 con 0x7f0ce4069a60 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.621+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004830 con 0x7f0ce4069a60 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.621+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce414d160 con 0x7f0ce4069a60 2023-10-06T11:15:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.622+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce414a900 con 0x7f0ce4069a60 2023-10-06T11:15:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.622+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cdc004ba0 con 0x7f0ce4069a60 2023-10-06T11:15:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.623+0000 7f0ce17fa700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.623+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0cdc083f30 con 0x7f0ce4069a60 2023-10-06T11:15:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.623+0000 7f0ce8855700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.623+0000 7f0ce8855700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0cd0066f30 0x7f0cd00693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40b1ca0 tx=0x7f0cd80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.627+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cdc050f80 con 0x7f0ce4069a60 2023-10-06T11:15:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.870+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0ce4064a90 con 0x7f0ce4069a60 2023-10-06T11:15:50.872 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:15:50.870+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:15:50.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.875+0000 7f0ce17fa700 1 -- 172.21.15.55:0/4286687146 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cdc018020 con 0x7f0ce4069a60 2023-10-06T11:15:50.878 INFO:tasks.ceph.mds.a.smithi055.stderr: -637> 2023-10-06T11:15:41.405+0000 7f2c33217700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0cd0066f30 msgr2=0x7f0cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0cd0066f30 0x7f0cd00693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40b1ca0 tx=0x7f0cd80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 msgr2=0x7f0ce40c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c3fd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00cb90 tx=0x7f0cdc001b30 comp rx=0 tx=0).stop 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 shutdown_connections 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0cd0066f30 0x7f0cd00693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ce4069a60 0x7f0ce40c3fd0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce40adf20 0x7f0ce414dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 --2- 172.21.15.55:0/4286687146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce40ac000 0x7f0ce414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 >> 172.21.15.55:0/4286687146 conn(0x7f0ce4068080 msgr2=0x7f0ce40c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 shutdown_connections 2023-10-06T11:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:50.878+0000 7f0ceb2ba700 1 -- 172.21.15.55:0/4286687146 wait complete. 2023-10-06T11:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:15:50.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:15:50.899 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:15:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.012+0000 7f3decffb700 1 Processor -- start 2023-10-06T11:15:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.012+0000 7f3decffb700 1 -- start start 2023-10-06T11:15:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3decffb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3de80b2620 0x7f3de80cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3decffb700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80cc970 con 0x7f3de80cf1b0 2023-10-06T11:15:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3decffb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80cbd60 con 0x7f3de80b29f0 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3decffb700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80cc040 con 0x7f3de80b2620 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3de77fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3de80b2620 0x7f3de80cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3de7fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3de80cf1b0 0x7f3de80c5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34696/0 (socket says 172.21.15.55:34696) 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.013+0000 7f3de7fff700 1 -- 172.21.15.55:0/4095845463 learned_addr learned my addr 172.21.15.55:0/4095845463 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de77fe700 1 -- 172.21.15.55:0/4095845463 >> v1:172.21.15.142:6789/0 conn(0x7f3de80b29f0 legacy=0x7f3de80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de77fe700 1 -- 172.21.15.55:0/4095845463 >> v1:172.21.15.55:6789/0 conn(0x7f3de80cf1b0 legacy=0x7f3de80c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de77fe700 1 -- 172.21.15.55:0/4095845463 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80cc320 con 0x7f3de80b2620 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de67fc700 1 -- 172.21.15.55:0/4095845463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455456593 0 0) 0x7f3de80cc970 con 0x7f3de80cf1b0 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de77fe700 1 --2- 172.21.15.55:0/4095845463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b2620 0x7f3de80cccb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80098d0 tx=0x7f3dd8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb32b53f8fa4a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de67fc700 1 -- 172.21.15.55:0/4095845463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8009e70 con 0x7f3de80b2620 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de67fc700 1 -- 172.21.15.55:0/4095845463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd8005c10 con 0x7f3de80b2620 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.014+0000 7f3de67fc700 1 -- 172.21.15.55:0/4095845463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800b650 con 0x7f3de80b2620 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 -- 172.21.15.55:0/4095845463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b2620 msgr2=0x7f3de80cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 --2- 172.21.15.55:0/4095845463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b2620 0x7f3de80cccb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80098d0 tx=0x7f3dd8009120 comp rx=0 tx=0).stop 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 -- 172.21.15.55:0/4095845463 shutdown_connections 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 --2- 172.21.15.55:0/4095845463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b2620 0x7f3de80cccb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 -- 172.21.15.55:0/4095845463 >> 172.21.15.55:0/4095845463 conn(0x7f3de8099520 msgr2=0x7f3de806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 -- 172.21.15.55:0/4095845463 shutdown_connections 2023-10-06T11:15:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.015+0000 7f3decffb700 1 -- 172.21.15.55:0/4095845463 wait complete. 2023-10-06T11:15:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.016+0000 7f3decffb700 1 Processor -- start 2023-10-06T11:15:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.016+0000 7f3decffb700 1 -- start start 2023-10-06T11:15:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80b2620 0x7f3de80b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 0x7f3de80c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf1b0 0x7f3de80c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80ca690 con 0x7f3de80b29f0 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80b3de0 con 0x7f3de80b2620 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de80c9df0 con 0x7f3de80cf1b0 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 0x7f3de80c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 0x7f3de80c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49458/0 (socket says 172.21.15.55:49458) 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 -- 172.21.15.55:0/1425749142 learned_addr learned my addr 172.21.15.55:0/1425749142 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de77fe700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80b2620 0x7f3de80b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de7fff700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf1b0 0x7f3de80c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 -- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf1b0 msgr2=0x7f3de80c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf1b0 0x7f3de80c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 -- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80b2620 msgr2=0x7f3de80b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80b2620 0x7f3de80b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 -- 172.21.15.55:0/1425749142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80093c0 con 0x7f3de80b29f0 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3de6ffd700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 0x7f3de80c7380 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c7c0 tx=0x7f3ddc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011590 con 0x7f3de80b29f0 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0116f0 con 0x7f3de80b29f0 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de80ca0d0 con 0x7f3de80b29f0 2023-10-06T11:15:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.017+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011ab0 con 0x7f3de80b29f0 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.018+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de8153160 con 0x7f3de80b29f0 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.018+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de80b3bb0 con 0x7f3de80b29f0 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.019+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ddc01b3b0 con 0x7f3de80b29f0 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.019+0000 7f3dcf7fe700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3dd4066f30 0x7f3dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.019+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3ddc083e10 con 0x7f3de80b29f0 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.020+0000 7f3de77fe700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3dd4066f30 0x7f3dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.020+0000 7f3de77fe700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3dd4066f30 0x7f3dd40693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009160 tx=0x7f3dd8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:51.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.024+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de80b3bb0 con 0x7f3de80b29f0 2023-10-06T11:15:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.263+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3de80b3bb0 con 0x7f3de80b29f0 2023-10-06T11:15:51.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.880+0000 7f3dcf7fe700 1 -- 172.21.15.55:0/1425749142 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3de80b3bb0 con 0x7f3de80b29f0 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3dd4066f30 msgr2=0x7f3dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3dd4066f30 0x7f3dd40693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009160 tx=0x7f3dd8016000 comp rx=0 tx=0).stop 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 msgr2=0x7f3de80c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 0x7f3de80c7380 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c7c0 tx=0x7f3ddc007f50 comp rx=0 tx=0).stop 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 shutdown_connections 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3dd4066f30 0x7f3dd40693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3de80cf1b0 0x7f3de80c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3de80b2620 0x7f3de80b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 --2- 172.21.15.55:0/1425749142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3de80b29f0 0x7f3de80c7380 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:51.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 >> 172.21.15.55:0/1425749142 conn(0x7f3de8099520 msgr2=0x7f3de80ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:51.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 shutdown_connections 2023-10-06T11:15:51.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:51.883+0000 7f3decffb700 1 -- 172.21.15.55:0/1425749142 wait complete. 2023-10-06T11:15:51.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:15:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.069+0000 7fd5a0271700 1 Processor -- start 2023-10-06T11:15:52.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.069+0000 7fd5a0271700 1 -- start start 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd5a0271700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd59806ece0 0x7fd5980b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd5a0271700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5980aede0 0x7fd5980af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd5a0271700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980b2ce0 con 0x7fd59806f0b0 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd5a0271700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59806fb40 con 0x7fd59806ece0 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd5a0271700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980b0410 con 0x7fd5980aede0 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd59806ece0 0x7fd5980b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd59806ece0 0x7fd5980b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49466/0 (socket says 172.21.15.55:49466) 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 -- 172.21.15.55:0/3031400103 learned_addr learned my addr 172.21.15.55:0/3031400103 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e80e700 1 --2- 172.21.15.55:0/3031400103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5980aede0 0x7fd5980af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 -- 172.21.15.55:0/3031400103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5980aede0 msgr2=0x7fd5980af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 --2- 172.21.15.55:0/3031400103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5980aede0 0x7fd5980af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 -- 172.21.15.55:0/3031400103 >> v1:172.21.15.142:6789/0 conn(0x7fd59806f0b0 legacy=0x7fd5980b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 -- 172.21.15.55:0/3031400103 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980af780 con 0x7fd59806ece0 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.070+0000 7fd59e00d700 1 --2- 172.21.15.55:0/3031400103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806ece0 0x7fd5980b2360 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd588009f20 tx=0x7fd588009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fe2ae8ad701516 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd59d00b700 1 -- 172.21.15.55:0/3031400103 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800e070 con 0x7fd59806ece0 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd59d00b700 1 -- 172.21.15.55:0/3031400103 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800ba80 con 0x7fd59806ece0 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd59d00b700 1 -- 172.21.15.55:0/3031400103 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5880092e0 con 0x7fd59806ece0 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 -- 172.21.15.55:0/3031400103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806ece0 msgr2=0x7fd5980b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 --2- 172.21.15.55:0/3031400103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806ece0 0x7fd5980b2360 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd588009f20 tx=0x7fd588009840 comp rx=0 tx=0).stop 2023-10-06T11:15:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 -- 172.21.15.55:0/3031400103 shutdown_connections 2023-10-06T11:15:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 --2- 172.21.15.55:0/3031400103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5980aede0 0x7fd5980af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 --2- 172.21.15.55:0/3031400103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806ece0 0x7fd5980b2360 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 -- 172.21.15.55:0/3031400103 >> 172.21.15.55:0/3031400103 conn(0x7fd5980682f0 msgr2=0x7fd5980686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 -- 172.21.15.55:0/3031400103 shutdown_connections 2023-10-06T11:15:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.071+0000 7fd5a0271700 1 -- 172.21.15.55:0/3031400103 wait complete. 2023-10-06T11:15:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.072+0000 7fd5a0271700 1 Processor -- start 2023-10-06T11:15:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.072+0000 7fd5a0271700 1 -- start start 2023-10-06T11:15:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd5a0271700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd59806ece0 0x7fd59816e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd5a0271700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 0x7fd598156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd5a0271700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5980aede0 0x7fd59806e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd5a0271700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59806eae0 con 0x7fd59806f0b0 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd5a0271700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59806c540 con 0x7fd5980aede0 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd5a0271700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59816ec90 con 0x7fd59806ece0 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59d80c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 0x7fd598156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59d80c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 0x7fd598156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49476/0 (socket says 172.21.15.55:49476) 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59d80c700 1 -- 172.21.15.55:0/419386546 learned_addr learned my addr 172.21.15.55:0/419386546 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59e00d700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd59806ece0 0x7fd59816e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59e80e700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5980aede0 0x7fd59806e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59d80c700 1 -- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd59806ece0 msgr2=0x7fd59816e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.073+0000 7fd59d80c700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd59806ece0 0x7fd59816e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd59d80c700 1 -- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5980aede0 msgr2=0x7fd59806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd59d80c700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5980aede0 0x7fd59806e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd59d80c700 1 -- 172.21.15.55:0/419386546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009ae0 con 0x7fd59806f0b0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd59e00d700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd59806ece0 0x7fd59816e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd59d80c700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 0x7fd598156990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c590 tx=0x7fd58c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c011590 con 0x7fd59806f0b0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c0116f0 con 0x7fd59806f0b0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59806bc10 con 0x7fd59806f0b0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c011ab0 con 0x7fd59806f0b0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.074+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59806c1d0 con 0x7fd59806f0b0 2023-10-06T11:15:52.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.075+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59806c360 con 0x7fd59806f0b0 2023-10-06T11:15:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.075+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd58c01b3b0 con 0x7fd59806f0b0 2023-10-06T11:15:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.076+0000 7fd5967fc700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd584066f30 0x7fd5840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.076+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd58c083dd0 con 0x7fd59806f0b0 2023-10-06T11:15:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.076+0000 7fd59e00d700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd584066f30 0x7fd5840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.076+0000 7fd59e00d700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd584066f30 0x7fd5840693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd588009880 tx=0x7fd588018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.080+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd58c050d50 con 0x7fd59806f0b0 2023-10-06T11:15:52.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:52.278+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd598064a90 con 0x7fd59806f0b0 2023-10-06T11:15:53.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.196+0000 7fd5967fc700 1 -- 172.21.15.55:0/419386546 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd58c017070 con 0x7fd59806f0b0 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd584066f30 msgr2=0x7fd5840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd584066f30 0x7fd5840693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd588009880 tx=0x7fd588018000 comp rx=0 tx=0).stop 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 msgr2=0x7fd598156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 0x7fd598156990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c590 tx=0x7fd58c00c950 comp rx=0 tx=0).stop 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 shutdown_connections 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd584066f30 0x7fd5840693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5980aede0 0x7fd59806e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd59806ece0 0x7fd59816e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 --2- 172.21.15.55:0/419386546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd59806f0b0 0x7fd598156990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 >> 172.21.15.55:0/419386546 conn(0x7fd5980682f0 msgr2=0x7fd5980ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 shutdown_connections 2023-10-06T11:15:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.200+0000 7fd5a0271700 1 -- 172.21.15.55:0/419386546 wait complete. 2023-10-06T11:15:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:15:53.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:15:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.346+0000 7febbc935700 1 Processor -- start 2023-10-06T11:15:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.346+0000 7febbc935700 1 -- start start 2023-10-06T11:15:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.347+0000 7febbc935700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb8153950 0x7febb815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.347+0000 7febbc935700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febb815ad30 0x7febb815b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.347+0000 7febbc935700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb815c400 con 0x7febb8153d20 2023-10-06T11:15:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.347+0000 7febbc935700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb8158200 con 0x7febb815ad30 2023-10-06T11:15:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.347+0000 7febbc935700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb815b7f0 con 0x7febb8153950 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb659c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb8153950 0x7febb815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febb815ad30 0x7febb815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb5d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7febb8153d20 0x7febb81577a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:54084/0 (socket says 172.21.15.55:54084) 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb5d9b700 1 -- 172.21.15.55:0/4216032944 learned_addr learned my addr 172.21.15.55:0/4216032944 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb659c700 1 -- 172.21.15.55:0/4216032944 >> v2:172.21.15.142:3300/0 conn(0x7febb815ad30 msgr2=0x7febb815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb659c700 1 --2- 172.21.15.55:0/4216032944 >> v2:172.21.15.142:3300/0 conn(0x7febb815ad30 0x7febb815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb659c700 1 -- 172.21.15.55:0/4216032944 >> v1:172.21.15.142:6789/0 conn(0x7febb8153d20 legacy=0x7febb81577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb559a700 1 -- 172.21.15.55:0/4216032944 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064064969 0 0) 0x7febb815c400 con 0x7febb8153d20 2023-10-06T11:15:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb659c700 1 -- 172.21.15.55:0/4216032944 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb815bad0 con 0x7febb8153950 2023-10-06T11:15:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb6d9d700 1 --2- 172.21.15.55:0/4216032944 >> v2:172.21.15.142:3300/0 conn(0x7febb815ad30 0x7febb815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.348+0000 7febb659c700 1 --2- 172.21.15.55:0/4216032944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb8153950 0x7febb815c890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7febb00098d0 tx=0x7febb0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1938ee416c9615e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febb559a700 1 -- 172.21.15.55:0/4216032944 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0005c10 con 0x7febb8153950 2023-10-06T11:15:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febb559a700 1 -- 172.21.15.55:0/4216032944 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0005d70 con 0x7febb8153950 2023-10-06T11:15:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febb559a700 1 -- 172.21.15.55:0/4216032944 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0006280 con 0x7febb8153950 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 -- 172.21.15.55:0/4216032944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb8153950 msgr2=0x7febb815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 --2- 172.21.15.55:0/4216032944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb8153950 0x7febb815c890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7febb00098d0 tx=0x7febb0009120 comp rx=0 tx=0).stop 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 -- 172.21.15.55:0/4216032944 shutdown_connections 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 --2- 172.21.15.55:0/4216032944 >> v2:172.21.15.142:3300/0 conn(0x7febb815ad30 0x7febb815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 --2- 172.21.15.55:0/4216032944 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb8153950 0x7febb815c890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 -- 172.21.15.55:0/4216032944 >> 172.21.15.55:0/4216032944 conn(0x7febb806ece0 msgr2=0x7febb806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 -- 172.21.15.55:0/4216032944 shutdown_connections 2023-10-06T11:15:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.349+0000 7febbc935700 1 -- 172.21.15.55:0/4216032944 wait complete. 2023-10-06T11:15:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.350+0000 7febbc935700 1 Processor -- start 2023-10-06T11:15:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.350+0000 7febbc935700 1 -- start start 2023-10-06T11:15:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febbc935700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febb8153950 0x7febb8146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febbc935700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 0x7febb80cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febbc935700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb815ad30 0x7febb80cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febbc935700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb8156d10 con 0x7febb8153d20 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febbc935700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb81571a0 con 0x7febb8153950 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febbc935700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb8156100 con 0x7febb815ad30 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febb5d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 0x7febb80cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febb5d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 0x7febb80cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49490/0 (socket says 172.21.15.55:49490) 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febb5d9b700 1 -- 172.21.15.55:0/2080333163 learned_addr learned my addr 172.21.15.55:0/2080333163 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febb659c700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febb8153950 0x7febb8146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.351+0000 7febb6d9d700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb815ad30 0x7febb80cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb5d9b700 1 -- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb815ad30 msgr2=0x7febb80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb5d9b700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb815ad30 0x7febb80cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb5d9b700 1 -- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febb8153950 msgr2=0x7febb8146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb5d9b700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febb8153950 0x7febb8146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb5d9b700 1 -- 172.21.15.55:0/2080333163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8009a20 con 0x7febb8153d20 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb6d9d700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb815ad30 0x7febb80cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febb5d9b700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 0x7febb80cf930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7feba000c7e0 tx=0x7feba0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0005b30 con 0x7febb8153d20 2023-10-06T11:15:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0005c90 con 0x7febb8153d20 2023-10-06T11:15:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb00093c0 con 0x7febb8153d20 2023-10-06T11:15:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0007300 con 0x7febb8153d20 2023-10-06T11:15:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.352+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb81566c0 con 0x7febb8153d20 2023-10-06T11:15:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.353+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb8156ec0 con 0x7febb8153d20 2023-10-06T11:15:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.353+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feba00076b0 con 0x7febb8153d20 2023-10-06T11:15:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.354+0000 7febae7fc700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.354+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6026+0+0 (secure 0 0 0) 0x7feba0083bd0 con 0x7febb8153d20 2023-10-06T11:15:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.354+0000 7febb659c700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.355+0000 7febb659c700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb98066f30 0x7feb980693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7febb0009160 tx=0x7febb0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:53.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.358+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb8156ec0 con 0x7febb8153d20 2023-10-06T11:15:53.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:53.551+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7febb8064a90 con 0x7febb8153d20 2023-10-06T11:15:54.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.194+0000 7febae7fc700 1 -- 172.21.15.55:0/2080333163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7feba00170d0 con 0x7febb8153d20 2023-10-06T11:15:54.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb98066f30 msgr2=0x7feb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb98066f30 0x7feb980693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7febb0009160 tx=0x7febb0016000 comp rx=0 tx=0).stop 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 msgr2=0x7febb80cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 0x7febb80cf930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7feba000c7e0 tx=0x7feba0007df0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 shutdown_connections 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febb815ad30 0x7febb80cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febb8153950 0x7febb8146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 --2- 172.21.15.55:0/2080333163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febb8153d20 0x7febb80cf930 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 >> 172.21.15.55:0/2080333163 conn(0x7febb806ece0 msgr2=0x7febb80b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:54.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 shutdown_connections 2023-10-06T11:15:54.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.198+0000 7febbc935700 1 -- 172.21.15.55:0/2080333163 wait complete. 2023-10-06T11:15:54.202 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:15:54.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:15:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.337+0000 7f15fe4f9700 1 Processor -- start 2023-10-06T11:15:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15fe4f9700 1 -- start start 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15fe4f9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15f81597f0 0x7f15f80682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15fe4f9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15f8068820 0x7f15f80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15fe4f9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80cdc60 con 0x7f15f8159420 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15fe4f9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f8068c20 con 0x7f15f81597f0 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15fe4f9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80cd050 con 0x7f15f8068820 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.338+0000 7f15f77fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15f81597f0 0x7f15f80682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15f81597f0 0x7f15f80682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60214/0 (socket says 172.21.15.55:60214) 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 -- 172.21.15.55:0/4203104185 learned_addr learned my addr 172.21.15.55:0/4203104185 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15fca96700 1 --2- 172.21.15.55:0/4203104185 >> v2:172.21.15.142:3300/0 conn(0x7f15f8068820 0x7f15f80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 -- 172.21.15.55:0/4203104185 >> v2:172.21.15.142:3300/0 conn(0x7f15f8068820 msgr2=0x7f15f80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 --2- 172.21.15.55:0/4203104185 >> v2:172.21.15.142:3300/0 conn(0x7f15f8068820 0x7f15f80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 -- 172.21.15.55:0/4203104185 >> v1:172.21.15.142:6789/0 conn(0x7f15f8159420 legacy=0x7f15f80cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 -- 172.21.15.55:0/4203104185 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80cd330 con 0x7f15f81597f0 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f77fe700 1 --2- 172.21.15.55:0/4203104185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80682e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f15f80afd20 tx=0x7f15e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b40e2c574cdf161 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f6ffd700 1 -- 172.21.15.55:0/4203104185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000b860 con 0x7f15f81597f0 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f6ffd700 1 -- 172.21.15.55:0/4203104185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000b9c0 con 0x7f15f81597f0 2023-10-06T11:15:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.339+0000 7f15f6ffd700 1 -- 172.21.15.55:0/4203104185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000bd60 con 0x7f15f81597f0 2023-10-06T11:15:54.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 -- 172.21.15.55:0/4203104185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 msgr2=0x7f15f80682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/4203104185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80682e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f15f80afd20 tx=0x7f15e0009250 comp rx=0 tx=0).stop 2023-10-06T11:15:54.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 -- 172.21.15.55:0/4203104185 shutdown_connections 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/4203104185 >> v2:172.21.15.142:3300/0 conn(0x7f15f8068820 0x7f15f80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/4203104185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80682e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 -- 172.21.15.55:0/4203104185 >> 172.21.15.55:0/4203104185 conn(0x7f15f806ece0 msgr2=0x7f15f806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 -- 172.21.15.55:0/4203104185 shutdown_connections 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.340+0000 7f15fe4f9700 1 -- 172.21.15.55:0/4203104185 wait complete. 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.341+0000 7f15fe4f9700 1 Processor -- start 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.341+0000 7f15fe4f9700 1 -- start start 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fe4f9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f8068820 0x7f15f8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fe4f9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f8159420 0x7f15f8145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fe4f9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fe4f9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8158960 con 0x7f15f81597f0 2023-10-06T11:15:54.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fe4f9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80c8930 con 0x7f15f8068820 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fe4f9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80c7d20 con 0x7f15f8159420 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60230/0 (socket says 172.21.15.55:60230) 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 -- 172.21.15.55:0/1940887679 learned_addr learned my addr 172.21.15.55:0/1940887679 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15f77fe700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f8159420 0x7f15f8145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15f7fff700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f8068820 0x7f15f8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 -- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f8159420 msgr2=0x7f15f8145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f8159420 0x7f15f8145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 -- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f8068820 msgr2=0x7f15f8158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f8068820 0x7f15f8158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 -- 172.21.15.55:0/1940887679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00094f0 con 0x7f15f81597f0 2023-10-06T11:15:54.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15f7fff700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f8068820 0x7f15f8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.342+0000 7f15fca96700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80c8dc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f15f0007f20 tx=0x7f15f0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.343+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000ebf0 con 0x7f15f81597f0 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.343+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f000ed70 con 0x7f15f81597f0 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.343+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f80c8000 con 0x7f15f81597f0 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.343+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0014670 con 0x7f15f81597f0 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.343+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f81535e0 con 0x7f15f81597f0 2023-10-06T11:15:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.343+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f80c8ac0 con 0x7f15f81597f0 2023-10-06T11:15:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.344+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15f00149e0 con 0x7f15f81597f0 2023-10-06T11:15:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.344+0000 7f15effff700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f15d8066f30 0x7f15d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.344+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f15f0084b10 con 0x7f15f81597f0 2023-10-06T11:15:54.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.345+0000 7f15f7fff700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f15d8066f30 0x7f15d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.345+0000 7f15f7fff700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f15d8066f30 0x7f15d80693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007fd0 tx=0x7f15e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:54.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.348+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15f0051de0 con 0x7f15f81597f0 2023-10-06T11:15:54.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.547+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f15f8064a90 con 0x7f15f81597f0 2023-10-06T11:15:54.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.551+0000 7f15effff700 1 -- 172.21.15.55:0/1940887679 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f15f0055400 con 0x7f15f81597f0 2023-10-06T11:15:54.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f15d8066f30 msgr2=0x7f15d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f15d8066f30 0x7f15d80693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007fd0 tx=0x7f15e8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:54.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 msgr2=0x7f15f80c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80c8dc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f15f0007f20 tx=0x7f15f0009860 comp rx=0 tx=0).stop 2023-10-06T11:15:54.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 shutdown_connections 2023-10-06T11:15:54.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f15d8066f30 0x7f15d80693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15f81597f0 0x7f15f80c8dc0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f8068820 0x7f15f8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 --2- 172.21.15.55:0/1940887679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f8159420 0x7f15f8145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 >> 172.21.15.55:0/1940887679 conn(0x7f15f806ece0 msgr2=0x7f15f8153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 shutdown_connections 2023-10-06T11:15:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.553+0000 7f15fe4f9700 1 -- 172.21.15.55:0/1940887679 wait complete. 2023-10-06T11:15:54.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds ms_async_reap_threshold 2023-10-06T11:15:54.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.686+0000 7f5a48132700 1 Processor -- start 2023-10-06T11:15:54.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.686+0000 7f5a48132700 1 -- start start 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a48132700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a40150940 0x7f5a40159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a48132700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a4015a160 0x7f5a400ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a48132700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4015ac30 con 0x7f5a400c5250 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a48132700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cb6a0 con 0x7f5a4015a160 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a48132700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cb090 con 0x7f5a40150940 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a456cd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a4015a160 0x7f5a400ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a466cf700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5a400c5250 0x7f5a400b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37604/0 (socket says 172.21.15.55:37604) 2023-10-06T11:15:54.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a466cf700 1 -- 172.21.15.55:0/3784368540 learned_addr learned my addr 172.21.15.55:0/3784368540 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a45ece700 1 --2- 172.21.15.55:0/3784368540 >> v2:172.21.15.142:3300/0 conn(0x7f5a40150940 0x7f5a40159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a456cd700 1 -- 172.21.15.55:0/3784368540 >> v2:172.21.15.142:3300/0 conn(0x7f5a40150940 msgr2=0x7f5a40159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a456cd700 1 --2- 172.21.15.55:0/3784368540 >> v2:172.21.15.142:3300/0 conn(0x7f5a40150940 0x7f5a40159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a456cd700 1 -- 172.21.15.55:0/3784368540 >> v1:172.21.15.55:6789/0 conn(0x7f5a400c5250 legacy=0x7f5a400b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a456cd700 1 -- 172.21.15.55:0/3784368540 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4015a670 con 0x7f5a4015a160 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a44ecc700 1 -- 172.21.15.55:0/3784368540 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632909113 0 0) 0x7f5a38001490 con 0x7f5a400c5250 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a45ece700 1 --2- 172.21.15.55:0/3784368540 >> v2:172.21.15.142:3300/0 conn(0x7f5a40150940 0x7f5a40159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a456cd700 1 --2- 172.21.15.55:0/3784368540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a400ccdc0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5a4008ab60 tx=0x7f5a340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a25e143716c8fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a44ecc700 1 -- 172.21.15.55:0/3784368540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400b6b0 con 0x7f5a4015a160 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a44ecc700 1 -- 172.21.15.55:0/3784368540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400b810 con 0x7f5a4015a160 2023-10-06T11:15:54.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.687+0000 7f5a44ecc700 1 -- 172.21.15.55:0/3784368540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400bbb0 con 0x7f5a4015a160 2023-10-06T11:15:54.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 -- 172.21.15.55:0/3784368540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 msgr2=0x7f5a400ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 --2- 172.21.15.55:0/3784368540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a400ccdc0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5a4008ab60 tx=0x7f5a340091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 -- 172.21.15.55:0/3784368540 shutdown_connections 2023-10-06T11:15:54.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 --2- 172.21.15.55:0/3784368540 >> v2:172.21.15.142:3300/0 conn(0x7f5a40150940 0x7f5a40159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 --2- 172.21.15.55:0/3784368540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a400ccdc0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 -- 172.21.15.55:0/3784368540 >> 172.21.15.55:0/3784368540 conn(0x7f5a40099700 msgr2=0x7f5a4006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 -- 172.21.15.55:0/3784368540 shutdown_connections 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.688+0000 7f5a48132700 1 -- 172.21.15.55:0/3784368540 wait complete. 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.689+0000 7f5a48132700 1 Processor -- start 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.689+0000 7f5a48132700 1 -- start start 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a48132700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a400c5250 0x7f5a400c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a48132700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a4016cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a48132700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a401537f0 0x7f5a4016d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a48132700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c84a0 con 0x7f5a4015a160 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a48132700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c7890 con 0x7f5a400c5250 2023-10-06T11:15:54.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a48132700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c7b70 con 0x7f5a401537f0 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a4016cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a4016cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60244/0 (socket says 172.21.15.55:60244) 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 -- 172.21.15.55:0/3612518974 learned_addr learned my addr 172.21.15.55:0/3612518974 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a45ece700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a400c5250 0x7f5a400c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 -- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a401537f0 msgr2=0x7f5a4016d4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a401537f0 0x7f5a4016d4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 -- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a400c5250 msgr2=0x7f5a400c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a400c5250 0x7f5a400c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 -- 172.21.15.55:0/3612518974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34009420 con 0x7f5a4015a160 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.690+0000 7f5a456cd700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a4016cf60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5a34013000 tx=0x7f5a34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.691+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34011420 con 0x7f5a4015a160 2023-10-06T11:15:54.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.691+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34011580 con 0x7f5a4015a160 2023-10-06T11:15:54.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.691+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400c7e50 con 0x7f5a4015a160 2023-10-06T11:15:54.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.691+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34011920 con 0x7f5a4015a160 2023-10-06T11:15:54.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.691+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400c7560 con 0x7f5a4015a160 2023-10-06T11:15:54.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.692+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400c8610 con 0x7f5a4015a160 2023-10-06T11:15:54.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.692+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a34011d10 con 0x7f5a4015a160 2023-10-06T11:15:54.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.692+0000 7f5a3dffb700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:54.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.693+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5a34085eb0 con 0x7f5a4015a160 2023-10-06T11:15:54.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.693+0000 7f5a45ece700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:54.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.693+0000 7f5a45ece700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000ab80 tx=0x7f5a30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:54.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.697+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a34053200 con 0x7f5a4015a160 2023-10-06T11:15:54.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.894+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"} v 0) v1 -- 0x7f5a40064a90 con 0x7f5a4015a160 2023-10-06T11:15:54.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.898+0000 7f5a3dffb700 1 -- 172.21.15.55:0/3612518974 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "ms_async_reap_threshold"}]=0 v21) v1 ==== 106+0+0 (secure 0 0 0) 0x7f5a34056820 con 0x7f5a4015a160 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5a2c066f30 msgr2=0x7f5a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000ab80 tx=0x7f5a30008040 comp rx=0 tx=0).stop 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 msgr2=0x7f5a4016cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a4016cf60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5a34013000 tx=0x7f5a34017000 comp rx=0 tx=0).stop 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 shutdown_connections 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a401537f0 0x7f5a4016d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a400c5250 0x7f5a400c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 --2- 172.21.15.55:0/3612518974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4015a160 0x7f5a4016cf60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 >> 172.21.15.55:0/3612518974 conn(0x7f5a40099700 msgr2=0x7f5a40069270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 shutdown_connections 2023-10-06T11:15:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:54.900+0000 7f5a48132700 1 -- 172.21.15.55:0/3612518974 wait complete. 2023-10-06T11:15:54.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2023-10-06T11:15:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.034+0000 7f212eb50700 1 Processor -- start 2023-10-06T11:15:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.034+0000 7f212eb50700 1 -- start start 2023-10-06T11:15:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212eb50700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2128159470 0x7f21280ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212eb50700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280cd5d0 con 0x7f21280c6220 2023-10-06T11:15:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212eb50700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280cc800 con 0x7f21280cd160 2023-10-06T11:15:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212eb50700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280cbc30 con 0x7f2128159470 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212db4e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2128159470 0x7f21280ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212e34f700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f21280c6220 0x7f2128163030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37610/0 (socket says 172.21.15.55:37610) 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212e34f700 1 -- 172.21.15.55:0/2978559727 learned_addr learned my addr 172.21.15.55:0/2978559727 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.035+0000 7f212db4e700 1 --2- 172.21.15.55:0/2978559727 >> v2:172.21.15.55:3300/0 conn(0x7f2128159470 0x7f21280ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60252/0 (socket says 172.21.15.55:60252) 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212db4e700 1 -- 172.21.15.55:0/2978559727 >> v1:172.21.15.142:6789/0 conn(0x7f21280cd160 legacy=0x7f21280ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212db4e700 1 -- 172.21.15.55:0/2978559727 >> v1:172.21.15.55:6789/0 conn(0x7f21280c6220 legacy=0x7f2128163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212db4e700 1 -- 172.21.15.55:0/2978559727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280cbed0 con 0x7f2128159470 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212db4e700 1 --2- 172.21.15.55:0/2978559727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2128159470 0x7f21280ccc20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2118009eb0 tx=0x7f2118009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6936732347ea31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212cb4c700 1 -- 172.21.15.55:0/2978559727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800e070 con 0x7f2128159470 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212cb4c700 1 -- 172.21.15.55:0/2978559727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800bc30 con 0x7f2128159470 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212cb4c700 1 -- 172.21.15.55:0/2978559727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118012430 con 0x7f2128159470 2023-10-06T11:15:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212eb50700 1 -- 172.21.15.55:0/2978559727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2128159470 msgr2=0x7f21280ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.036+0000 7f212eb50700 1 --2- 172.21.15.55:0/2978559727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2128159470 0x7f21280ccc20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2118009eb0 tx=0x7f2118009780 comp rx=0 tx=0).stop 2023-10-06T11:15:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.037+0000 7f212eb50700 1 -- 172.21.15.55:0/2978559727 shutdown_connections 2023-10-06T11:15:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.037+0000 7f212eb50700 1 --2- 172.21.15.55:0/2978559727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2128159470 0x7f21280ccc20 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.037+0000 7f212eb50700 1 -- 172.21.15.55:0/2978559727 >> 172.21.15.55:0/2978559727 conn(0x7f21280995c0 msgr2=0x7f212806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.037+0000 7f212eb50700 1 -- 172.21.15.55:0/2978559727 shutdown_connections 2023-10-06T11:15:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.037+0000 7f212eb50700 1 -- 172.21.15.55:0/2978559727 wait complete. 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 Processor -- start 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 -- start start 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21280c6220 0x7f212815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 0x7f2128143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2128159470 0x7f2128159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212815ae10 con 0x7f21280cd160 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212815b7e0 con 0x7f21280c6220 2023-10-06T11:15:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.038+0000 7f212eb50700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212815a200 con 0x7f2128159470 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 0x7f2128143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 0x7f2128143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60266/0 (socket says 172.21.15.55:60266) 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 -- 172.21.15.55:0/3620173319 learned_addr learned my addr 172.21.15.55:0/3620173319 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212db4e700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21280c6220 0x7f212815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 -- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2128159470 msgr2=0x7f2128159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212e34f700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2128159470 0x7f2128159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2128159470 0x7f2128159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 -- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21280c6220 msgr2=0x7f212815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21280c6220 0x7f212815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 -- 172.21.15.55:0/3620173319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009a20 con 0x7f21280cd160 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212db4e700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21280c6220 0x7f212815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212d34d700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 0x7f2128143c60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c540 tx=0x7f211c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c011590 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0116f0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212815a4e0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c011ab0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.039+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212815aaa0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.040+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212815afc0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.041+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f211c01b3b0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.041+0000 7f2125ffb700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2114066f30 0x7f21140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.041+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f211c0838e0 con 0x7f21280cd160 2023-10-06T11:15:55.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.041+0000 7f212db4e700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2114066f30 0x7f21140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.042+0000 7f212db4e700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2114066f30 0x7f21140693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2118009eb0 tx=0x7f2118017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:55.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.045+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f212815afc0 con 0x7f21280cd160 2023-10-06T11:15:55.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:55.320+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) v1 -- 0x7f212805f230 con 0x7f21280cd160 2023-10-06T11:15:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.208+0000 7f2125ffb700 1 -- 172.21.15.55:0/3620173319 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v181) v1 ==== 143+0+0 (secure 0 0 0) 0x7f211c017070 con 0x7f21280cd160 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2114066f30 msgr2=0x7f21140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2114066f30 0x7f21140693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2118009eb0 tx=0x7f2118017000 comp rx=0 tx=0).stop 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 msgr2=0x7f2128143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 0x7f2128143c60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c540 tx=0x7f211c001070 comp rx=0 tx=0).stop 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 shutdown_connections 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2114066f30 0x7f21140693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2128159470 0x7f2128159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21280c6220 0x7f212815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 --2- 172.21.15.55:0/3620173319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21280cd160 0x7f2128143c60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 >> 172.21.15.55:0/3620173319 conn(0x7f21280995c0 msgr2=0x7f2128158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 shutdown_connections 2023-10-06T11:15:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.211+0000 7f212eb50700 1 -- 172.21.15.55:0/3620173319 wait complete. 2023-10-06T11:15:56.229 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2023-10-06T11:15:56.229 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2023-10-06T11:15:56.229 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T11:15:56.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2023-10-06T11:15:56.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.353+0000 7f293821d700 1 Processor -- start 2023-10-06T11:15:56.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.353+0000 7f293821d700 1 -- start start 2023-10-06T11:15:56.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.353+0000 7f293821d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b25e0 0x7f29300b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:56.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f293821d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29300b29b0 0x7f2930159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:56.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f293821d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29300cbfa0 con 0x7f2930159660 2023-10-06T11:15:56.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f293821d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29300cb390 con 0x7f29300b29b0 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f293821d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29300cb670 con 0x7f29300b25e0 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29367ba700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2930159660 0x7f2930068540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37612/0 (socket says 172.21.15.55:37612) 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29367ba700 1 -- 172.21.15.55:0/3789550970 learned_addr learned my addr 172.21.15.55:0/3789550970 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f2935fb9700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b25e0 0x7f29300b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29357b8700 1 --2- 172.21.15.55:0/3789550970 >> v2:172.21.15.142:3300/0 conn(0x7f29300b29b0 0x7f2930159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f2934fb7700 1 -- 172.21.15.55:0/3789550970 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177467269 0 0) 0x7f29300cbfa0 con 0x7f2930159660 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f2934fb7700 1 -- 172.21.15.55:0/3789550970 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2918003570 con 0x7f2930159660 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29357b8700 1 -- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b25e0 msgr2=0x7f29300b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29357b8700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b25e0 0x7f29300b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f2934fb7700 1 -- 172.21.15.55:0/3789550970 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87340547 0 0) 0x7f2918003570 con 0x7f2930159660 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29357b8700 1 -- 172.21.15.55:0/3789550970 >> v1:172.21.15.55:6789/0 conn(0x7f2930159660 legacy=0x7f2930068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f29357b8700 1 -- 172.21.15.55:0/3789550970 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29300cb950 con 0x7f29300b29b0 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.354+0000 7f2935fb9700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b25e0 0x7f29300b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f29357b8700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29300b29b0 0x7f2930159120 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f29240098e0 tx=0x7f29240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3484217ecb5664f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f2934fb7700 1 -- 172.21.15.55:0/3789550970 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928001470 con 0x7f29300b29b0 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f2934fb7700 1 -- 172.21.15.55:0/3789550970 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924011420 con 0x7f29300b29b0 2023-10-06T11:15:56.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f2934fb7700 1 -- 172.21.15.55:0/3789550970 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240117a0 con 0x7f29300b29b0 2023-10-06T11:15:56.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 -- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29300b29b0 msgr2=0x7f2930159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29300b29b0 0x7f2930159120 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f29240098e0 tx=0x7f29240091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 -- 172.21.15.55:0/3789550970 shutdown_connections 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b25e0 0x7f29300b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 --2- 172.21.15.55:0/3789550970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29300b29b0 0x7f2930159120 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 -- 172.21.15.55:0/3789550970 >> 172.21.15.55:0/3789550970 conn(0x7f293006ece0 msgr2=0x7f293006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 -- 172.21.15.55:0/3789550970 shutdown_connections 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.355+0000 7f293821d700 1 -- 172.21.15.55:0/3789550970 wait complete. 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.356+0000 7f293821d700 1 Processor -- start 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.356+0000 7f293821d700 1 -- start start 2023-10-06T11:15:56.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f293821d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 0x7f29300c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f293821d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b29b0 0x7f29300c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f293821d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930159660 0x7f2930167470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f293821d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300c7a10 con 0x7f29300b25e0 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f293821d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300ca040 con 0x7f2930159660 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f293821d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29300ca320 con 0x7f29300b29b0 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f2935fb9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 0x7f29300c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f2935fb9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 0x7f29300c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60272/0 (socket says 172.21.15.55:60272) 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f2935fb9700 1 -- 172.21.15.55:0/2850292484 learned_addr learned my addr 172.21.15.55:0/2850292484 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.357+0000 7f29357b8700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b29b0 0x7f29300c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f29367ba700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930159660 0x7f2930167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f2935fb9700 1 -- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b29b0 msgr2=0x7f29300c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f2935fb9700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b29b0 0x7f29300c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f2935fb9700 1 -- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930159660 msgr2=0x7f2930167470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f2935fb9700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930159660 0x7f2930167470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f2935fb9700 1 -- 172.21.15.55:0/2850292484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920009a20 con 0x7f29300b25e0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f2935fb9700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 0x7f29300c99d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f292000c1f0 tx=0x7f292000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000ce30 con 0x7f29300b25e0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292000f040 con 0x7f29300b25e0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2924009420 con 0x7f29300b25e0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29200146b0 con 0x7f29300b25e0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.358+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2930150860 con 0x7f29300b25e0 2023-10-06T11:15:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.359+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2930150eb0 con 0x7f29300b25e0 2023-10-06T11:15:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.359+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2920014a20 con 0x7f29300b25e0 2023-10-06T11:15:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.360+0000 7f292dffb700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f291c066f30 0x7f291c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.360+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2920085400 con 0x7f29300b25e0 2023-10-06T11:15:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.360+0000 7f29357b8700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f291c066f30 0x7f291c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.361+0000 7f29357b8700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f291c066f30 0x7f291c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f293015cf90 tx=0x7f2924016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.364+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29200526d0 con 0x7f29300b25e0 2023-10-06T11:15:56.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:56.639+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7f2930064a90 con 0x7f29300b25e0 2023-10-06T11:15:57.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.213+0000 7f292dffb700 1 -- 172.21.15.55:0/2850292484 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v182) v1 ==== 148+0+0 (secure 0 0 0) 0x7f2920055cf0 con 0x7f29300b25e0 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f291c066f30 msgr2=0x7f291c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f291c066f30 0x7f291c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f293015cf90 tx=0x7f2924016000 comp rx=0 tx=0).stop 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 msgr2=0x7f29300c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 0x7f29300c99d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f292000c1f0 tx=0x7f292000b040 comp rx=0 tx=0).stop 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 shutdown_connections 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f291c066f30 0x7f291c0693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29300b25e0 0x7f29300c99d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2930159660 0x7f2930167470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 --2- 172.21.15.55:0/2850292484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29300b29b0 0x7f29300c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 >> 172.21.15.55:0/2850292484 conn(0x7f293006ece0 msgr2=0x7f293015c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 shutdown_connections 2023-10-06T11:15:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.215+0000 7f293821d700 1 -- 172.21.15.55:0/2850292484 wait complete. 2023-10-06T11:15:57.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:15:57.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.355+0000 7ff737473700 1 Processor -- start 2023-10-06T11:15:57.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.356+0000 7ff737473700 1 -- start start 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.356+0000 7ff737473700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff7300cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.356+0000 7ff737473700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7301598a0 0x7ff7300cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.356+0000 7ff737473700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7300cf310 con 0x7ff7300ce7e0 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.356+0000 7ff737473700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7300cf5d0 con 0x7ff7301598a0 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.356+0000 7ff737473700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300cf8b0 con 0x7ff7301594d0 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7301598a0 0x7ff7300cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7301598a0 0x7ff7300cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60274/0 (socket says 172.21.15.55:60274) 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 -- 172.21.15.55:0/3351232727 learned_addr learned my addr 172.21.15.55:0/3351232727 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff73520f700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff7300cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 -- 172.21.15.55:0/3351232727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 msgr2=0x7ff7300cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff7300cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 -- 172.21.15.55:0/3351232727 >> v1:172.21.15.142:6789/0 conn(0x7ff7300ce7e0 legacy=0x7ff7300cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 -- 172.21.15.55:0/3351232727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300cfb90 con 0x7ff7301598a0 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff73520f700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff7300cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff734a0e700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7301598a0 0x7ff7300cbaa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff7240099b0 tx=0x7ff724009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5208ddcac010586d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff72ffff700 1 -- 172.21.15.55:0/3351232727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400b820 con 0x7ff7301598a0 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff72ffff700 1 -- 172.21.15.55:0/3351232727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72400b980 con 0x7ff7301598a0 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.357+0000 7ff72ffff700 1 -- 172.21.15.55:0/3351232727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400bd20 con 0x7ff7301598a0 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 -- 172.21.15.55:0/3351232727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7301598a0 msgr2=0x7ff7300cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7301598a0 0x7ff7300cbaa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff7240099b0 tx=0x7ff724009250 comp rx=0 tx=0).stop 2023-10-06T11:15:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 -- 172.21.15.55:0/3351232727 shutdown_connections 2023-10-06T11:15:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff7300cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 --2- 172.21.15.55:0/3351232727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7301598a0 0x7ff7300cbaa0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 -- 172.21.15.55:0/3351232727 >> 172.21.15.55:0/3351232727 conn(0x7ff730089e50 msgr2=0x7ff730099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 -- 172.21.15.55:0/3351232727 shutdown_connections 2023-10-06T11:15:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.358+0000 7ff737473700 1 -- 172.21.15.55:0/3351232727 wait complete. 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.359+0000 7ff737473700 1 Processor -- start 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.359+0000 7ff737473700 1 -- start start 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff737473700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 0x7ff730151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff737473700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff73014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff737473700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7301598a0 0x7ff730152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff737473700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73015a580 con 0x7ff7300ce7e0 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff737473700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730159c90 con 0x7ff7301598a0 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff737473700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73014f730 con 0x7ff7301594d0 2023-10-06T11:15:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 0x7ff730151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 0x7ff730151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60284/0 (socket says 172.21.15.55:60284) 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 -- 172.21.15.55:0/2937995919 learned_addr learned my addr 172.21.15.55:0/2937995919 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff734a0e700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff73014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff735a10700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7301598a0 0x7ff730152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 -- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 msgr2=0x7ff73014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff73014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 -- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7301598a0 msgr2=0x7ff730152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.360+0000 7ff73520f700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7301598a0 0x7ff730152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff73520f700 1 -- 172.21.15.55:0/2937995919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240094f0 con 0x7ff7300ce7e0 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff73520f700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 0x7ff730151cd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff72000a400 tx=0x7ff720007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000d650 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72000d7b0 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff730159f30 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000db50 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.361+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff730152970 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.362+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730064a90 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.362+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff720015440 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.363+0000 7ff72d7fa700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.363+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff720084e40 con 0x7ff7300ce7e0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.363+0000 7ff734a0e700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.363+0000 7ff734a0e700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff71c066f30 0x7ff71c0693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff7240099b0 tx=0x7ff724016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.367+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7200521c0 con 0x7ff7300ce7e0 2023-10-06T11:15:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.559+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff730152210 con 0x7ff7300ce7e0 2023-10-06T11:15:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.563+0000 7ff72d7fa700 1 -- 172.21.15.55:0/2937995919 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff72001a0c0 con 0x7ff7300ce7e0 2023-10-06T11:15:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.565+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff71c066f30 msgr2=0x7ff71c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff71c066f30 0x7ff71c0693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff7240099b0 tx=0x7ff724016000 comp rx=0 tx=0).stop 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 msgr2=0x7ff730151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 0x7ff730151cd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff72000a400 tx=0x7ff720007910 comp rx=0 tx=0).stop 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 shutdown_connections 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7300ce7e0 0x7ff730151cd0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7301598a0 0x7ff730152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 --2- 172.21.15.55:0/2937995919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7301594d0 0x7ff73014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 >> 172.21.15.55:0/2937995919 conn(0x7ff730089e50 msgr2=0x7ff73015d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 shutdown_connections 2023-10-06T11:15:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.566+0000 7ff737473700 1 -- 172.21.15.55:0/2937995919 wait complete. 2023-10-06T11:15:57.580 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:15:57.581 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:57.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:57.662 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:15:57.662 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:15:57.663 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:57.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.779+0000 7f2d5599d700 1 Processor -- start 2023-10-06T11:15:57.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.779+0000 7f2d5599d700 1 -- start start 2023-10-06T11:15:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5599d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2d50159440 0x7f2d500b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5599d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d500b35d0 0x7f2d500cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5599d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500cb7a0 con 0x7f2d500cc170 2023-10-06T11:15:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5599d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500b0860 con 0x7f2d500b35d0 2023-10-06T11:15:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5599d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500cb150 con 0x7f2d50159440 2023-10-06T11:15:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d4ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d500b35d0 0x7f2d500cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5519c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2d500cc170 0x7f2d500b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37620/0 (socket says 172.21.15.55:37620) 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5519c700 1 -- 172.21.15.55:0/3048927627 learned_addr learned my addr 172.21.15.55:0/3048927627 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5499b700 1 --2- 172.21.15.55:0/3048927627 >> v2:172.21.15.142:3300/0 conn(0x7f2d50159440 0x7f2d500b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3048927627 >> v2:172.21.15.142:3300/0 conn(0x7f2d50159440 msgr2=0x7f2d500b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d4ffff700 1 --2- 172.21.15.55:0/3048927627 >> v2:172.21.15.142:3300/0 conn(0x7f2d50159440 0x7f2d500b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3048927627 >> v1:172.21.15.55:6789/0 conn(0x7f2d500cc170 legacy=0x7f2d500b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d4f7fe700 1 -- 172.21.15.55:0/3048927627 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786082292 0 0) 0x7f2d500cb7a0 con 0x7f2d500cc170 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3048927627 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500cb430 con 0x7f2d500b35d0 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.780+0000 7f2d5499b700 1 --2- 172.21.15.55:0/3048927627 >> v2:172.21.15.142:3300/0 conn(0x7f2d50159440 0x7f2d500b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d4ffff700 1 --2- 172.21.15.55:0/3048927627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500b35d0 0x7f2d500cbc30 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2d5006f9f0 tx=0x7f2d40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175f8eada7a2a1ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d4f7fe700 1 -- 172.21.15.55:0/3048927627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000e070 con 0x7f2d500b35d0 2023-10-06T11:15:57.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d4f7fe700 1 -- 172.21.15.55:0/3048927627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4000bc30 con 0x7f2d500b35d0 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d4f7fe700 1 -- 172.21.15.55:0/3048927627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40012430 con 0x7f2d500b35d0 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 -- 172.21.15.55:0/3048927627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500b35d0 msgr2=0x7f2d500cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3048927627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500b35d0 0x7f2d500cbc30 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2d5006f9f0 tx=0x7f2d40009780 comp rx=0 tx=0).stop 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 -- 172.21.15.55:0/3048927627 shutdown_connections 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3048927627 >> v2:172.21.15.142:3300/0 conn(0x7f2d50159440 0x7f2d500b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3048927627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500b35d0 0x7f2d500cbc30 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 -- 172.21.15.55:0/3048927627 >> 172.21.15.55:0/3048927627 conn(0x7f2d5006ece0 msgr2=0x7f2d5006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 -- 172.21.15.55:0/3048927627 shutdown_connections 2023-10-06T11:15:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.781+0000 7f2d5599d700 1 -- 172.21.15.55:0/3048927627 wait complete. 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.782+0000 7f2d5599d700 1 Processor -- start 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 -- start start 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500b35d0 0x7f2d500ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 0x7f2d5015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d50159440 0x7f2d5015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500ceb50 con 0x7f2d500cc170 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500cee30 con 0x7f2d500b35d0 2023-10-06T11:15:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d5599d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500cf110 con 0x7f2d50159440 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d4ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 0x7f2d5015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d4ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 0x7f2d5015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60312/0 (socket says 172.21.15.55:60312) 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.783+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3249623537 learned_addr learned my addr 172.21.15.55:0/3249623537 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d5499b700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500b35d0 0x7f2d500ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d5519c700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d50159440 0x7f2d5015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d50159440 msgr2=0x7f2d5015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4ffff700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d50159440 0x7f2d5015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500b35d0 msgr2=0x7f2d500ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4ffff700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500b35d0 0x7f2d500ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4ffff700 1 -- 172.21.15.55:0/3249623537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009a20 con 0x7f2d500cc170 2023-10-06T11:15:57.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d5499b700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500b35d0 0x7f2d500ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4ffff700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 0x7f2d5015b240 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2d400099f0 tx=0x7f2d40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40001090 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4001d630 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4001d9f0 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d500cf3f0 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.784+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d50154b50 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.785+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d500cf910 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.786+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d40024070 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.786+0000 7f2d4cff9700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2d30066f30 0x7f2d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.786+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2d40086c20 con 0x7f2d500cc170 2023-10-06T11:15:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.786+0000 7f2d5499b700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2d30066f30 0x7f2d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:57.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.787+0000 7f2d5499b700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2d30066f30 0x7f2d300693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006fd0 tx=0x7f2d38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:57.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:57.791+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d500cf910 con 0x7f2d500cc170 2023-10-06T11:15:58.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.028+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d500cf910 con 0x7f2d500cc170 2023-10-06T11:15:58.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.029+0000 7f2d4cff9700 1 -- 172.21.15.55:0/3249623537 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f2d4002cde0 con 0x7f2d500cc170 2023-10-06T11:15:58.032 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:58.032 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/320070138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":320070138},{"type":"v1","addr":"172.21.15.142:6836","nonce":320070138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1431204526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1431204526},{"type":"v1","addr":"172.21.15.142:6837","nonce":1431204526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/4247212901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4247212901},{"type":"v1","addr":"172.21.15.55:6834","nonce":4247212901}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":6450,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/31399577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":31399577},{"type":"v1","addr":"172.21.15.55:6835","nonce":31399577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[]} 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2d30066f30 msgr2=0x7f2d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2d30066f30 0x7f2d300693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006fd0 tx=0x7f2d38008040 comp rx=0 tx=0).stop 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 msgr2=0x7f2d5015b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 0x7f2d5015b240 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2d400099f0 tx=0x7f2d40019000 comp rx=0 tx=0).stop 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 shutdown_connections 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2d30066f30 0x7f2d300693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d50159440 0x7f2d5015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500b35d0 0x7f2d500ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 --2- 172.21.15.55:0/3249623537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d500cc170 0x7f2d5015b240 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 >> 172.21.15.55:0/3249623537 conn(0x7f2d5006ece0 msgr2=0x7f2d50157980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:58.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 shutdown_connections 2023-10-06T11:15:58.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.031+0000 7f2d5599d700 1 -- 172.21.15.55:0/3249623537 wait complete. 2023-10-06T11:15:58.035 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 45 2023-10-06T11:15:58.046 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:15:58.046 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:15:58.046 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:15:58.046 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:58.046 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:15:58.046 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:15:58.047 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:15:58.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:58.047 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:15:58.047 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:15:58.047 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:15:58.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:58.047 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:15:58.047 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:15:58.048 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:15:58.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:58.055 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:15:58.056 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:15:58.056 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:15:58.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:15:58.058 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:15:58.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:15:58.059 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:15:58.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:15:58.098 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:15:58.098 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:58.099 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:15:58.099 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:58.102 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:15:58.102 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:58.103 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:15:58.103 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:58.103 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:15:58.174 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:15:58.174 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:15:58.180 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:15:58.180 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:15:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.228+0000 7f53e715c700 1 Processor -- start 2023-10-06T11:15:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.229+0000 7f53e715c700 1 -- start start 2023-10-06T11:15:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.229+0000 7f53e715c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 0x7f53e00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.229+0000 7f53e715c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 0x7f53e0159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.229+0000 7f53e715c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e0068d10 con 0x7f53e015a010 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.229+0000 7f53e715c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e0154020 con 0x7f53e00696e0 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.229+0000 7f53e715c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e015a450 con 0x7f53e00cb5f0 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53dffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 0x7f53e0159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 0x7f53e00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e56f9700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f53e015a010 0x7f53e00ca670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:51494/0 (socket says 172.21.15.55:51494) 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53dffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 0x7f53e0159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.55:35098/0 (socket says 172.21.15.55:35098) 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 0x7f53e00691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:45582/0 (socket says 172.21.15.55:45582) 2023-10-06T11:15:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e56f9700 1 -- 172.21.15.55:0/739010612 learned_addr learned my addr 172.21.15.55:0/739010612 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 -- 172.21.15.55:0/739010612 >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 msgr2=0x7f53e0159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 --2- 172.21.15.55:0/739010612 >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 0x7f53e0159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 -- 172.21.15.55:0/739010612 >> v1:172.21.15.142:6789/0 conn(0x7f53e015a010 legacy=0x7f53e00ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 -- 172.21.15.55:0/739010612 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e015a670 con 0x7f53e00cb5f0 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53dffff700 1 --2- 172.21.15.55:0/739010612 >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 0x7f53e0159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53e4ef8700 1 --2- 172.21.15.55:0/739010612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 0x7f53e00691a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53d00098e0 tx=0x7f53d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e24e803599e094 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53df7fe700 1 -- 172.21.15.55:0/739010612 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000b640 con 0x7f53e00cb5f0 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53df7fe700 1 -- 172.21.15.55:0/739010612 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d000b7a0 con 0x7f53e00cb5f0 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.230+0000 7f53df7fe700 1 -- 172.21.15.55:0/739010612 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000bb40 con 0x7f53e00cb5f0 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 -- 172.21.15.55:0/739010612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 msgr2=0x7f53e00691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/739010612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 0x7f53e00691a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53d00098e0 tx=0x7f53d00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 -- 172.21.15.55:0/739010612 shutdown_connections 2023-10-06T11:15:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/739010612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00cb5f0 0x7f53e00691a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/739010612 >> v2:172.21.15.142:3300/0 conn(0x7f53e00696e0 0x7f53e0159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 -- 172.21.15.55:0/739010612 >> 172.21.15.55:0/739010612 conn(0x7f53e00707d0 msgr2=0x7f53e0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 -- 172.21.15.55:0/739010612 shutdown_connections 2023-10-06T11:15:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.231+0000 7f53e715c700 1 -- 172.21.15.55:0/739010612 wait complete. 2023-10-06T11:15:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.232+0000 7f53e715c700 1 Processor -- start 2023-10-06T11:15:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.232+0000 7f53e715c700 1 -- start start 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e715c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00696e0 0x7f53e00c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e715c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 0x7f53e00b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e715c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e015a010 0x7f53e00c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e715c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00c2a70 con 0x7f53e00cb5f0 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e715c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00c1e60 con 0x7f53e015a010 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e715c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00c2140 con 0x7f53e00696e0 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 0x7f53e00b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 0x7f53e00b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60368/0 (socket says 172.21.15.55:60368) 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 -- 172.21.15.55:0/1686549461 learned_addr learned my addr 172.21.15.55:0/1686549461 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e4ef8700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00696e0 0x7f53e00c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e56f9700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e015a010 0x7f53e00c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 -- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00696e0 msgr2=0x7f53e00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00696e0 0x7f53e00c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 -- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e015a010 msgr2=0x7f53e00c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e015a010 0x7f53e00c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53dffff700 1 -- 172.21.15.55:0/1686549461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009420 con 0x7f53e00cb5f0 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e4ef8700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00696e0 0x7f53e00c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.233+0000 7f53e56f9700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e015a010 0x7f53e00c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.234+0000 7f53dffff700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 0x7f53e00b1080 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ec80 tx=0x7f53d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.234+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400c850 con 0x7f53e00cb5f0 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.234+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400c9b0 con 0x7f53e00cb5f0 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.234+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0009420 con 0x7f53e00cb5f0 2023-10-06T11:15:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.234+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400cd30 con 0x7f53e00cb5f0 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.234+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00c2700 con 0x7f53e00cb5f0 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.235+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e00c2c20 con 0x7f53e00cb5f0 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.235+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53d4013680 con 0x7f53e00cb5f0 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.235+0000 7f53dcff9700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f53cc066f30 0x7f53cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.236+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f53d4084790 con 0x7f53e00cb5f0 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.236+0000 7f53e4ef8700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f53cc066f30 0x7f53cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:58.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.236+0000 7f53e4ef8700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f53cc066f30 0x7f53cc0693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53d00093f0 tx=0x7f53d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.240+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53e00c2c20 con 0x7f53e00cb5f0 2023-10-06T11:15:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:58.449+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f53e0064a90 con 0x7f53e00cb5f0 2023-10-06T11:15:59.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.228+0000 7f53dcff9700 1 -- 172.21.15.55:0/1686549461 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53d40554f0 con 0x7f53e00cb5f0 2023-10-06T11:15:59.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f53cc066f30 msgr2=0x7f53cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f53cc066f30 0x7f53cc0693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53d00093f0 tx=0x7f53d0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:59.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 msgr2=0x7f53e00b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 0x7f53e00b1080 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ec80 tx=0x7f53d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 shutdown_connections 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f53cc066f30 0x7f53cc0693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e015a010 0x7f53e00c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e00696e0 0x7f53e00c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 --2- 172.21.15.55:0/1686549461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53e00cb5f0 0x7f53e00b1080 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.231+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 >> 172.21.15.55:0/1686549461 conn(0x7f53e00707d0 msgr2=0x7f53e00ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.232+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 shutdown_connections 2023-10-06T11:15:59.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.232+0000 7f53e715c700 1 -- 172.21.15.55:0/1686549461 wait complete. 2023-10-06T11:15:59.237 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-10-06T11:15:59.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:15:59.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.372+0000 7f08658df700 1 Processor -- start 2023-10-06T11:15:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.372+0000 7f08658df700 1 -- start start 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f08658df700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0860159560 0x7f08600aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f08658df700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b0760 0x7f08600b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f08658df700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08600b0c60 con 0x7f08600b49a0 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f08658df700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600b0f40 con 0x7f0860159560 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f08658df700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08600b1220 con 0x7f08600b0760 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0860159560 0x7f08600aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0860159560 0x7f08600aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60382/0 (socket says 172.21.15.55:60382) 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 -- 172.21.15.55:0/1913969703 learned_addr learned my addr 172.21.15.55:0/1913969703 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085f7fe700 1 --2- 172.21.15.55:0/1913969703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b0760 0x7f08600b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 -- 172.21.15.55:0/1913969703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b0760 msgr2=0x7f08600b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 --2- 172.21.15.55:0/1913969703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b0760 0x7f08600b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 -- 172.21.15.55:0/1913969703 >> v1:172.21.15.142:6789/0 conn(0x7f08600b49a0 legacy=0x7f08600aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 -- 172.21.15.55:0/1913969703 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600b1500 con 0x7f0860159560 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085effd700 1 --2- 172.21.15.55:0/1913969703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f08600aa530 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f08500099c0 tx=0x7f0850009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c1dfb46984b2bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085dffb700 1 -- 172.21.15.55:0/1913969703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850005c10 con 0x7f0860159560 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085dffb700 1 -- 172.21.15.55:0/1913969703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850005d70 con 0x7f0860159560 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.373+0000 7f085dffb700 1 -- 172.21.15.55:0/1913969703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000b800 con 0x7f0860159560 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 -- 172.21.15.55:0/1913969703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 msgr2=0x7f08600aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 --2- 172.21.15.55:0/1913969703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f08600aa530 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f08500099c0 tx=0x7f0850009220 comp rx=0 tx=0).stop 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 -- 172.21.15.55:0/1913969703 shutdown_connections 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 --2- 172.21.15.55:0/1913969703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b0760 0x7f08600b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 --2- 172.21.15.55:0/1913969703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f08600aa530 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 -- 172.21.15.55:0/1913969703 >> 172.21.15.55:0/1913969703 conn(0x7f08600997f0 msgr2=0x7f086006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 -- 172.21.15.55:0/1913969703 shutdown_connections 2023-10-06T11:15:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.374+0000 7f08658df700 1 -- 172.21.15.55:0/1913969703 wait complete. 2023-10-06T11:15:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.375+0000 7f08658df700 1 Processor -- start 2023-10-06T11:15:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.375+0000 7f08658df700 1 -- start start 2023-10-06T11:15:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f08658df700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08600b0760 0x7f086009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f08658df700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b49a0 0x7f08600af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f08658df700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f0860157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f08658df700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600ad810 con 0x7f0860159560 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f08658df700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600af900 con 0x7f08600b0760 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f08658df700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08600abb30 con 0x7f08600b49a0 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f0860157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f0860157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60388/0 (socket says 172.21.15.55:60388) 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 -- 172.21.15.55:0/3282155054 learned_addr learned my addr 172.21.15.55:0/3282155054 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08600b0760 0x7f086009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085e7fc700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b49a0 0x7f08600af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 -- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b49a0 msgr2=0x7f08600af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b49a0 0x7f08600af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 -- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08600b0760 msgr2=0x7f086009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08600b0760 0x7f086009aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.376+0000 7f085f7fe700 1 -- 172.21.15.55:0/3282155054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850009480 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.377+0000 7f085f7fe700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f0860157b40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0858007f30 tx=0x7f08580098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.377+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800eb90 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.377+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800ecf0 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.377+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858014670 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.377+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08600ac3d0 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.377+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08600abd80 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.378+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086008aa90 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.378+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0858014a20 con 0x7f0860159560 2023-10-06T11:15:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.378+0000 7f0846ffd700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f084c066f30 0x7f084c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.379+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0858084b90 con 0x7f0860159560 2023-10-06T11:15:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.379+0000 7f085effd700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f084c066f30 0x7f084c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.379+0000 7f085effd700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f084c066f30 0x7f084c0693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0850007fd0 tx=0x7f0850015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.383+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0858051eb0 con 0x7f0860159560 2023-10-06T11:15:59.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.654+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f08600b17e0 con 0x7f0860159560 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.654+0000 7f0846ffd700 1 -- 172.21.15.55:0/3282155054 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f085800ee60 con 0x7f0860159560 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-10-06T11:15:59.657 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ==", 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg==", 2023-10-06T11:15:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q==", 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag==", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw==", 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw==", 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.662 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA==", 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.663 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA==", 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-10-06T11:15:59.664 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ==", 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug==", 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw==", 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.666 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg==", 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:59.667 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w==", 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.668 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg==", 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.669 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ==", 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:59.670 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA==", 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.671 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9loAeQDxAAHRWvLBSoBR/HeRdtrvbGCw==", 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.672 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA==", 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:15:59.673 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g==", 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:15:59.674 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:15:59.675 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:15:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f084c066f30 msgr2=0x7f084c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f084c066f30 0x7f084c0693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0850007fd0 tx=0x7f0850015000 comp rx=0 tx=0).stop 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 msgr2=0x7f0860157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f0860157b40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0858007f30 tx=0x7f08580098e0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 shutdown_connections 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f084c066f30 0x7f084c0693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0860159560 0x7f0860157b40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08600b0760 0x7f086009aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 --2- 172.21.15.55:0/3282155054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08600b49a0 0x7f08600af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 >> 172.21.15.55:0/3282155054 conn(0x7f08600997f0 msgr2=0x7f0860069970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 shutdown_connections 2023-10-06T11:15:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.656+0000 7f08658df700 1 -- 172.21.15.55:0/3282155054 wait complete. 2023-10-06T11:15:59.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.795+0000 7f0144d56700 1 Processor -- start 2023-10-06T11:15:59.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.795+0000 7f0144d56700 1 -- start start 2023-10-06T11:15:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f0144d56700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 0x7f01400cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f0144d56700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f014015db10 0x7f01400ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f0144d56700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400ca600 con 0x7f01400ad5e0 2023-10-06T11:15:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f0144d56700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400cecf0 con 0x7f014015db10 2023-10-06T11:15:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f0144d56700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400cefd0 con 0x7f01400ad210 2023-10-06T11:15:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 0x7f01400cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013ed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f014015db10 0x7f01400ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 0x7f01400cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:45626/0 (socket says 172.21.15.55:45626) 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 -- 172.21.15.55:0/4049285167 learned_addr learned my addr 172.21.15.55:0/4049285167 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013d59a700 1 -- 172.21.15.55:0/4049285167 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312631871 0 0) 0x7f01400ca600 con 0x7f01400ad5e0 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013d59a700 1 -- 172.21.15.55:0/4049285167 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f012c003570 con 0x7f01400ad5e0 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 -- 172.21.15.55:0/4049285167 >> v2:172.21.15.142:3300/0 conn(0x7f014015db10 msgr2=0x7f01400ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 --2- 172.21.15.55:0/4049285167 >> v2:172.21.15.142:3300/0 conn(0x7f014015db10 0x7f01400ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 -- 172.21.15.55:0/4049285167 >> v1:172.21.15.142:6789/0 conn(0x7f01400ad5e0 legacy=0x7f014015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.796+0000 7f013e59c700 1 -- 172.21.15.55:0/4049285167 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400cca90 con 0x7f01400ad210 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f013e59c700 1 --2- 172.21.15.55:0/4049285167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 0x7f01400cd290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0130009990 tx=0x7f0130009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1429a5252624f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f013d59a700 1 -- 172.21.15.55:0/4049285167 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130005c10 con 0x7f01400ad210 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f013d59a700 1 -- 172.21.15.55:0/4049285167 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130005d70 con 0x7f01400ad210 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f013d59a700 1 -- 172.21.15.55:0/4049285167 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130006260 con 0x7f01400ad210 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 -- 172.21.15.55:0/4049285167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 msgr2=0x7f01400cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 --2- 172.21.15.55:0/4049285167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 0x7f01400cd290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0130009990 tx=0x7f0130009220 comp rx=0 tx=0).stop 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 -- 172.21.15.55:0/4049285167 shutdown_connections 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 --2- 172.21.15.55:0/4049285167 >> v2:172.21.15.142:3300/0 conn(0x7f014015db10 0x7f01400ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 --2- 172.21.15.55:0/4049285167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400ad210 0x7f01400cd290 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 -- 172.21.15.55:0/4049285167 >> 172.21.15.55:0/4049285167 conn(0x7f0140067d90 msgr2=0x7f01400ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 -- 172.21.15.55:0/4049285167 shutdown_connections 2023-10-06T11:15:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.797+0000 7f0144d56700 1 -- 172.21.15.55:0/4049285167 wait complete. 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.798+0000 7f0144d56700 1 Processor -- start 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.798+0000 7f0144d56700 1 -- start start 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f0144d56700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 0x7f01400b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f0144d56700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01400ad5e0 0x7f0140169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f0144d56700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014015db10 0x7f014006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f0144d56700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014016ac70 con 0x7f01400ad210 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f0144d56700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014016b230 con 0x7f01400ad5e0 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f0144d56700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014016a5d0 con 0x7f014015db10 2023-10-06T11:15:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f013e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 0x7f01400b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f013e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 0x7f01400b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60400/0 (socket says 172.21.15.55:60400) 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f013e59c700 1 -- 172.21.15.55:0/2011170194 learned_addr learned my addr 172.21.15.55:0/2011170194 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.799+0000 7f013dd9b700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01400ad5e0 0x7f0140169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013ed9d700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014015db10 0x7f014006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013e59c700 1 -- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014015db10 msgr2=0x7f014006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013e59c700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014015db10 0x7f014006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013e59c700 1 -- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01400ad5e0 msgr2=0x7f0140169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013e59c700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01400ad5e0 0x7f0140169af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013e59c700 1 -- 172.21.15.55:0/2011170194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009480 con 0x7f01400ad210 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013dd9b700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01400ad5e0 0x7f0140169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013ed9d700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014015db10 0x7f014006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f013e59c700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 0x7f01400b1740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f01400cf110 tx=0x7f0130016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130011950 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130011ab0 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014016a8b0 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130011e70 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.800+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014016af70 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.801+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140064a90 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.801+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f013001b640 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.802+0000 7f01367fc700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0120066f30 0x7f01200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.802+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0130085a40 con 0x7f01400ad210 2023-10-06T11:15:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.802+0000 7f013dd9b700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0120066f30 0x7f01200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:59.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.802+0000 7f013dd9b700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0120066f30 0x7f01200693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:59.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.806+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0130087e60 con 0x7f01400ad210 2023-10-06T11:16:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:15:59.999+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01400ccd70 con 0x7f01400ad210 2023-10-06T11:16:00.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.000+0000 7f01367fc700 1 -- 172.21.15.55:0/2011170194 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f0130052d60 con 0x7f01400ad210 2023-10-06T11:16:00.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:00.003 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:15:59.227057+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0120066f30 msgr2=0x7f01200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0120066f30 0x7f01200693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128009040 comp rx=0 tx=0).stop 2023-10-06T11:16:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 msgr2=0x7f01400b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 0x7f01400b1740 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f01400cf110 tx=0x7f0130016000 comp rx=0 tx=0).stop 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 shutdown_connections 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0120066f30 0x7f01200693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400ad210 0x7f01400b1740 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014015db10 0x7f014006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 --2- 172.21.15.55:0/2011170194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01400ad5e0 0x7f0140169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 >> 172.21.15.55:0/2011170194 conn(0x7f0140067d90 msgr2=0x7f014015bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 shutdown_connections 2023-10-06T11:16:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.002+0000 7f0144d56700 1 -- 172.21.15.55:0/2011170194 wait complete. 2023-10-06T11:16:00.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:16:00.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:16:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.138+0000 7f6a34a94700 1 Processor -- start 2023-10-06T11:16:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.138+0000 7f6a34a94700 1 -- start start 2023-10-06T11:16:00.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a34a94700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a300cc820 0x7f6a300ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a34a94700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a300675b0 0x7f6a300679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a34a94700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a30067f30 con 0x7f6a3006efb0 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a34a94700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a30159bc0 con 0x7f6a300675b0 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a34a94700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3006f420 con 0x7f6a300cc820 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a2ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a300675b0 0x7f6a300679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a2dd9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6a3006efb0 0x7f6a300c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37642/0 (socket says 172.21.15.55:37642) 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.139+0000 7f6a2dd9b700 1 -- 172.21.15.55:0/3478140094 learned_addr learned my addr 172.21.15.55:0/3478140094 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:00.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2e59c700 1 --2- 172.21.15.55:0/3478140094 >> v2:172.21.15.142:3300/0 conn(0x7f6a300cc820 0x7f6a300ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2ed9d700 1 -- 172.21.15.55:0/3478140094 >> v2:172.21.15.142:3300/0 conn(0x7f6a300cc820 msgr2=0x7f6a300ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2ed9d700 1 --2- 172.21.15.55:0/3478140094 >> v2:172.21.15.142:3300/0 conn(0x7f6a300cc820 0x7f6a300ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2ed9d700 1 -- 172.21.15.55:0/3478140094 >> v1:172.21.15.55:6789/0 conn(0x7f6a3006efb0 legacy=0x7f6a300c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2ed9d700 1 -- 172.21.15.55:0/3478140094 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300cbf70 con 0x7f6a300675b0 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2ed9d700 1 --2- 172.21.15.55:0/3478140094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a300675b0 0x7f6a300679f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6a300cc160 tx=0x7f6a200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb573e156c0053c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2d59a700 1 -- 172.21.15.55:0/3478140094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000b680 con 0x7f6a300675b0 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2d59a700 1 -- 172.21.15.55:0/3478140094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000b7e0 con 0x7f6a300675b0 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.140+0000 7f6a2d59a700 1 -- 172.21.15.55:0/3478140094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000bba0 con 0x7f6a300675b0 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 -- 172.21.15.55:0/3478140094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a300675b0 msgr2=0x7f6a300679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 --2- 172.21.15.55:0/3478140094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a300675b0 0x7f6a300679f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6a300cc160 tx=0x7f6a200091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 -- 172.21.15.55:0/3478140094 shutdown_connections 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 --2- 172.21.15.55:0/3478140094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a300675b0 0x7f6a300679f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 --2- 172.21.15.55:0/3478140094 >> v2:172.21.15.142:3300/0 conn(0x7f6a300cc820 0x7f6a300ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 -- 172.21.15.55:0/3478140094 >> 172.21.15.55:0/3478140094 conn(0x7f6a30069190 msgr2=0x7f6a300cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 -- 172.21.15.55:0/3478140094 shutdown_connections 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.141+0000 7f6a34a94700 1 -- 172.21.15.55:0/3478140094 wait complete. 2023-10-06T11:16:00.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.142+0000 7f6a34a94700 1 Processor -- start 2023-10-06T11:16:00.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.142+0000 7f6a34a94700 1 -- start start 2023-10-06T11:16:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a300675b0 0x7f6a300b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 0x7f6a30158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a300cc820 0x7f6a30158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300c4f70 con 0x7f6a3006efb0 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300c4360 con 0x7f6a300675b0 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300c4640 con 0x7f6a300cc820 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 0x7f6a30158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 0x7f6a30158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60420/0 (socket says 172.21.15.55:60420) 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 -- 172.21.15.55:0/756865502 learned_addr learned my addr 172.21.15.55:0/756865502 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2e59c700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a300675b0 0x7f6a300b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2ed9d700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a300cc820 0x7f6a30158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 -- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a300cc820 msgr2=0x7f6a30158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a300cc820 0x7f6a30158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 -- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a300675b0 msgr2=0x7f6a300b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a300675b0 0x7f6a300b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 -- 172.21.15.55:0/756865502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20009420 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2e59c700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a300675b0 0x7f6a300b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a2dd9b700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 0x7f6a30158790 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c7c0 tx=0x7f6a18007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18005b30 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18005cb0 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a300c4920 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18004a80 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.143+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a300b23d0 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.144+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300cdc40 con 0x7f6a3006efb0 2023-10-06T11:16:00.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.145+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a180070f0 con 0x7f6a3006efb0 2023-10-06T11:16:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.145+0000 7f6a267fc700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a10066f30 0x7f6a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.145+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6a18083900 con 0x7f6a3006efb0 2023-10-06T11:16:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.146+0000 7f6a2e59c700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a10066f30 0x7f6a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.146+0000 7f6a2e59c700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a10066f30 0x7f6a100693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009fd0 tx=0x7f6a28009740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.151+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a18050ca0 con 0x7f6a3006efb0 2023-10-06T11:16:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.347+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a30064a90 con 0x7f6a3006efb0 2023-10-06T11:16:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.348+0000 7f6a267fc700 1 -- 172.21.15.55:0/756865502 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a18018070 con 0x7f6a3006efb0 2023-10-06T11:16:00.350 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:16:00.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a10066f30 msgr2=0x7f6a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a10066f30 0x7f6a100693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009fd0 tx=0x7f6a28009740 comp rx=0 tx=0).stop 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 msgr2=0x7f6a30158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 0x7f6a30158790 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c7c0 tx=0x7f6a18007f70 comp rx=0 tx=0).stop 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 shutdown_connections 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a10066f30 0x7f6a100693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a300cc820 0x7f6a30158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a300675b0 0x7f6a300b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 --2- 172.21.15.55:0/756865502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a3006efb0 0x7f6a30158790 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 >> 172.21.15.55:0/756865502 conn(0x7f6a30069190 msgr2=0x7f6a30063410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 shutdown_connections 2023-10-06T11:16:00.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.350+0000 7f6a34a94700 1 -- 172.21.15.55:0/756865502 wait complete. 2023-10-06T11:16:00.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:16:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.484+0000 7f2a5788d700 1 Processor -- start 2023-10-06T11:16:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.484+0000 7f2a5788d700 1 -- start start 2023-10-06T11:16:00.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a5788d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500b0640 0x7f2a500cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a5788d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500cca90 con 0x7f2a500cc5f0 2023-10-06T11:16:00.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a5788d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500c53c0 con 0x7f2a500b0a10 2023-10-06T11:16:00.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a5788d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500ca790 con 0x7f2a500b0640 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a55e2a700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2a500cc5f0 0x7f2a500c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37658/0 (socket says 172.21.15.55:37658) 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a55e2a700 1 -- 172.21.15.55:0/3520713475 learned_addr learned my addr 172.21.15.55:0/3520713475 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a55629700 1 --2- 172.21.15.55:0/3520713475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500b0640 0x7f2a500cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015277568 0 0) 0x7f2a500cca90 con 0x7f2a500cc5f0 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a38003570 con 0x7f2a500cc5f0 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307524968 0 0) 0x7f2a500c53c0 con 0x7f2a500b0a10 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a500cca90 con 0x7f2a500b0a10 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a55629700 1 -- 172.21.15.55:0/3520713475 >> v1:172.21.15.142:6789/0 conn(0x7f2a500b0a10 legacy=0x7f2a500cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a55629700 1 -- 172.21.15.55:0/3520713475 >> v1:172.21.15.55:6789/0 conn(0x7f2a500cc5f0 legacy=0x7f2a500c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.485+0000 7f2a55629700 1 -- 172.21.15.55:0/3520713475 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500ccd00 con 0x7f2a500b0640 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a55629700 1 --2- 172.21.15.55:0/3520713475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500b0640 0x7f2a500cecd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009900 tx=0x7f2a40009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12531f5a5512b41c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40005c10 con 0x7f2a500b0640 2023-10-06T11:16:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40005d70 con 0x7f2a500b0640 2023-10-06T11:16:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a4ffff700 1 -- 172.21.15.55:0/3520713475 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40006260 con 0x7f2a500b0640 2023-10-06T11:16:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 -- 172.21.15.55:0/3520713475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500b0640 msgr2=0x7f2a500cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3520713475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500b0640 0x7f2a500cecd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009900 tx=0x7f2a40009120 comp rx=0 tx=0).stop 2023-10-06T11:16:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 -- 172.21.15.55:0/3520713475 shutdown_connections 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3520713475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500b0640 0x7f2a500cecd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 -- 172.21.15.55:0/3520713475 >> 172.21.15.55:0/3520713475 conn(0x7f2a50087fc0 msgr2=0x7f2a500ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 -- 172.21.15.55:0/3520713475 shutdown_connections 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.486+0000 7f2a5788d700 1 -- 172.21.15.55:0/3520713475 wait complete. 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 Processor -- start 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 -- start start 2023-10-06T11:16:00.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 0x7f2a5014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b0a10 0x7f2a501694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500cc5f0 0x7f2a501682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5015b730 con 0x7f2a500b0640 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50168e20 con 0x7f2a500b0a10 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.488+0000 7f2a5788d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50169100 con 0x7f2a500cc5f0 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 0x7f2a5014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 0x7f2a5014fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60434/0 (socket says 172.21.15.55:60434) 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 -- 172.21.15.55:0/3364046440 learned_addr learned my addr 172.21.15.55:0/3364046440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55e2a700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500cc5f0 0x7f2a501682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a54e28700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b0a10 0x7f2a501694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 -- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500cc5f0 msgr2=0x7f2a501682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500cc5f0 0x7f2a501682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 -- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b0a10 msgr2=0x7f2a501694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b0a10 0x7f2a501694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 -- 172.21.15.55:0/3364046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400093c0 con 0x7f2a500b0640 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a55629700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 0x7f2a5014fdd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009390 tx=0x7f2a40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4001d8f0 con 0x7f2a500b0640 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4001da70 con 0x7f2a500b0640 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5015b980 con 0x7f2a500b0640 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4001de30 con 0x7f2a500b0640 2023-10-06T11:16:00.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.489+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50150310 con 0x7f2a500b0640 2023-10-06T11:16:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.490+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a501692c0 con 0x7f2a500b0640 2023-10-06T11:16:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.491+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a4001b690 con 0x7f2a500b0640 2023-10-06T11:16:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.491+0000 7f2a4d7fa700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2a3c066f30 0x7f2a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.491+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2a40086550 con 0x7f2a500b0640 2023-10-06T11:16:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.491+0000 7f2a54e28700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2a3c066f30 0x7f2a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.493+0000 7f2a54e28700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2a3c066f30 0x7f2a3c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2a500b3580 tx=0x7f2a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.496+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a40053870 con 0x7f2a500b0640 2023-10-06T11:16:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.686+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a5015bea0 con 0x7f2a500b0640 2023-10-06T11:16:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.687+0000 7f2a4d7fa700 1 -- 172.21.15.55:0/3364046440 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a5015bea0 con 0x7f2a500b0640 2023-10-06T11:16:00.690 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2a3c066f30 msgr2=0x7f2a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2a3c066f30 0x7f2a3c0693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2a500b3580 tx=0x7f2a44009040 comp rx=0 tx=0).stop 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 msgr2=0x7f2a5014fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 0x7f2a5014fdd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009390 tx=0x7f2a40016000 comp rx=0 tx=0).stop 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 shutdown_connections 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2a3c066f30 0x7f2a3c0693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a500b0640 0x7f2a5014fdd0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a500cc5f0 0x7f2a501682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 --2- 172.21.15.55:0/3364046440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a500b0a10 0x7f2a501694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 >> 172.21.15.55:0/3364046440 conn(0x7f2a50087fc0 msgr2=0x7f2a5006c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:00.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 shutdown_connections 2023-10-06T11:16:00.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.689+0000 7f2a5788d700 1 -- 172.21.15.55:0/3364046440 wait complete. 2023-10-06T11:16:00.704 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:16:00.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.821+0000 7fce6db66700 1 Processor -- start 2023-10-06T11:16:00.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.821+0000 7fce6db66700 1 -- start start 2023-10-06T11:16:00.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce6db66700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fce6815db10 0x7fce680cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce6db66700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce680ad5e0 0x7fce680ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce6db66700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce680ca600 con 0x7fce680ad210 2023-10-06T11:16:00.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce6db66700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce680cecf0 con 0x7fce680ad5e0 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce6db66700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce680cefd0 con 0x7fce6815db10 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce67fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce680ad5e0 0x7fce680ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce677fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce680ad210 0x7fce6815d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37662/0 (socket says 172.21.15.55:37662) 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce677fe700 1 -- 172.21.15.55:0/612658799 learned_addr learned my addr 172.21.15.55:0/612658799 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce66ffd700 1 --2- 172.21.15.55:0/612658799 >> v2:172.21.15.142:3300/0 conn(0x7fce6815db10 0x7fce680cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce67fff700 1 -- 172.21.15.55:0/612658799 >> v2:172.21.15.142:3300/0 conn(0x7fce6815db10 msgr2=0x7fce680cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce67fff700 1 --2- 172.21.15.55:0/612658799 >> v2:172.21.15.142:3300/0 conn(0x7fce6815db10 0x7fce680cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce67fff700 1 -- 172.21.15.55:0/612658799 >> v1:172.21.15.55:6789/0 conn(0x7fce680ad210 legacy=0x7fce6815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce67fff700 1 -- 172.21.15.55:0/612658799 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680cca90 con 0x7fce680ad5e0 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.822+0000 7fce667fc700 1 -- 172.21.15.55:0/612658799 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070213774 0 0) 0x7fce680ca600 con 0x7fce680ad210 2023-10-06T11:16:00.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce67fff700 1 --2- 172.21.15.55:0/612658799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce680ad5e0 0x7fce680ca0c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce6806ed40 tx=0x7fce60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3438bbaf20718673 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce667fc700 1 -- 172.21.15.55:0/612658799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000e070 con 0x7fce680ad5e0 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce667fc700 1 -- 172.21.15.55:0/612658799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000bc30 con 0x7fce680ad5e0 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce667fc700 1 -- 172.21.15.55:0/612658799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60012430 con 0x7fce680ad5e0 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 -- 172.21.15.55:0/612658799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce680ad5e0 msgr2=0x7fce680ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 --2- 172.21.15.55:0/612658799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce680ad5e0 0x7fce680ca0c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fce6806ed40 tx=0x7fce60009780 comp rx=0 tx=0).stop 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 -- 172.21.15.55:0/612658799 shutdown_connections 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 --2- 172.21.15.55:0/612658799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce680ad5e0 0x7fce680ca0c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 --2- 172.21.15.55:0/612658799 >> v2:172.21.15.142:3300/0 conn(0x7fce6815db10 0x7fce680cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 -- 172.21.15.55:0/612658799 >> 172.21.15.55:0/612658799 conn(0x7fce68067d90 msgr2=0x7fce680ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 -- 172.21.15.55:0/612658799 shutdown_connections 2023-10-06T11:16:00.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.823+0000 7fce6db66700 1 -- 172.21.15.55:0/612658799 wait complete. 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 Processor -- start 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 -- start start 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce680ad210 0x7fce681507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce680ad5e0 0x7fce680b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 0x7fce680b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce68150d00 con 0x7fce6815db10 2023-10-06T11:16:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce680c3350 con 0x7fce680ad5e0 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce6db66700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce680c7fa0 con 0x7fce680ad210 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce67fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 0x7fce680b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce67fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 0x7fce680b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60446/0 (socket says 172.21.15.55:60446) 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.825+0000 7fce67fff700 1 -- 172.21.15.55:0/193524366 learned_addr learned my addr 172.21.15.55:0/193524366 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce677fe700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce680ad210 0x7fce681507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce66ffd700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce680ad5e0 0x7fce680b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce67fff700 1 -- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce680ad210 msgr2=0x7fce681507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce67fff700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce680ad210 0x7fce681507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce67fff700 1 -- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce680ad5e0 msgr2=0x7fce680b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce67fff700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce680ad5e0 0x7fce680b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce67fff700 1 -- 172.21.15.55:0/193524366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60009a20 con 0x7fce6815db10 2023-10-06T11:16:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce66ffd700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce680ad5e0 0x7fce680b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce677fe700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce680ad210 0x7fce681507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce67fff700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 0x7fce680b18a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce68070480 tx=0x7fce60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60012ea0 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6001d630 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce680c7700 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6001d9f0 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.826+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce680c7cc0 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.827+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce680c34c0 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.828+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce60024070 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.828+0000 7fce4f7fe700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce54066f30 0x7fce540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.828+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fce60086d10 con 0x7fce6815db10 2023-10-06T11:16:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.828+0000 7fce677fe700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce54066f30 0x7fce540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.829+0000 7fce677fe700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce54066f30 0x7fce540693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce580018b0 tx=0x7fce58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:00.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:00.833+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce680c34c0 con 0x7fce6815db10 2023-10-06T11:16:01.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.030+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fce680c34c0 con 0x7fce6815db10 2023-10-06T11:16:01.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.031+0000 7fce4f7fe700 1 -- 172.21.15.55:0/193524366 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+126 (secure 0 0 0) 0x7fce680c34c0 con 0x7fce6815db10 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:01.033 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:16:01.034 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:16:01.034 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:16:01.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce54066f30 msgr2=0x7fce540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce54066f30 0x7fce540693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fce580018b0 tx=0x7fce58009040 comp rx=0 tx=0).stop 2023-10-06T11:16:01.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 msgr2=0x7fce680b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 0x7fce680b18a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fce68070480 tx=0x7fce60019000 comp rx=0 tx=0).stop 2023-10-06T11:16:01.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 shutdown_connections 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fce54066f30 0x7fce540693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6815db10 0x7fce680b18a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce680ad210 0x7fce681507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 --2- 172.21.15.55:0/193524366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce680ad5e0 0x7fce680b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 >> 172.21.15.55:0/193524366 conn(0x7fce68067d90 msgr2=0x7fce6815c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 shutdown_connections 2023-10-06T11:16:01.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.033+0000 7fce6db66700 1 -- 172.21.15.55:0/193524366 wait complete. 2023-10-06T11:16:01.046 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:16:01.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:16:01.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.167+0000 7ff5f94c1700 1 Processor -- start 2023-10-06T11:16:01.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.167+0000 7ff5f94c1700 1 -- start start 2023-10-06T11:16:01.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f94c1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5f40b0df0 0x7ff5f4163f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f94c1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f40af710 con 0x7ff5f4157120 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f94c1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f40aeb00 con 0x7ff5f415d6f0 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f94c1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f40aede0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f37fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5f40b0df0 0x7ff5f4163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f2ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5f4157120 0x7ff5f415cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37674/0 (socket says 172.21.15.55:37674) 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f37fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5f40b0df0 0x7ff5f4163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60460/0 (socket says 172.21.15.55:60460) 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.168+0000 7ff5f2ffd700 1 -- 172.21.15.55:0/4075337319 learned_addr learned my addr 172.21.15.55:0/4075337319 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f37fe700 1 -- 172.21.15.55:0/4075337319 >> v1:172.21.15.142:6789/0 conn(0x7ff5f415d6f0 legacy=0x7ff5f40ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f37fe700 1 -- 172.21.15.55:0/4075337319 >> v1:172.21.15.55:6789/0 conn(0x7ff5f4157120 legacy=0x7ff5f415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f1ffb700 1 -- 172.21.15.55:0/4075337319 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40768973 0 0) 0x7ff5f40af710 con 0x7ff5f4157120 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f37fe700 1 -- 172.21.15.55:0/4075337319 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40af0c0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f37fe700 1 --2- 172.21.15.55:0/4075337319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4163f10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009e60 tx=0x7ff5e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40797aeecd32b71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f1ffb700 1 -- 172.21.15.55:0/4075337319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400e070 con 0x7ff5f40b0df0 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f1ffb700 1 -- 172.21.15.55:0/4075337319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e400bbf0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f1ffb700 1 -- 172.21.15.55:0/4075337319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4012430 con 0x7ff5f40b0df0 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4075337319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 msgr2=0x7ff5f4163f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4075337319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4163f10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009e60 tx=0x7ff5e4009780 comp rx=0 tx=0).stop 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4075337319 shutdown_connections 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4075337319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4163f10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4075337319 >> 172.21.15.55:0/4075337319 conn(0x7ff5f406f4c0 msgr2=0x7ff5f40d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4075337319 shutdown_connections 2023-10-06T11:16:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.169+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4075337319 wait complete. 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 Processor -- start 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 -- start start 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f4157120 0x7ff5f4157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f415d6f0 0x7ff5f40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f4143280 con 0x7ff5f40b0df0 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40b3530 con 0x7ff5f4157120 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f94c1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40b3810 con 0x7ff5f415d6f0 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.171+0000 7ff5f2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60462/0 (socket says 172.21.15.55:60462) 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 -- 172.21.15.55:0/4196218750 learned_addr learned my addr 172.21.15.55:0/4196218750 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f27fc700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f4157120 0x7ff5f4157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f37fe700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f415d6f0 0x7ff5f40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 -- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f415d6f0 msgr2=0x7ff5f40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f415d6f0 0x7ff5f40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 -- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f4157120 msgr2=0x7ff5f4157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f4157120 0x7ff5f4157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 -- 172.21.15.55:0/4196218750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4009a20 con 0x7ff5f40b0df0 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f27fc700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f4157120 0x7ff5f4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f37fe700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f415d6f0 0x7ff5f40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f2ffd700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4142d40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c5b0 tx=0x7ff5ec001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec005b30 con 0x7ff5f40b0df0 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec005c90 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f40b3af0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec007300 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.172+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f4157b40 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.173+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f405f230 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.174+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5ec01b3b0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.174+0000 7ff5eaffd700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff5d4066f30 0x7ff5d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.174+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff5ec0839c0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.175+0000 7ff5f27fc700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff5d4066f30 0x7ff5d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.175+0000 7ff5f27fc700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff5d4066f30 0x7ff5d40693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007fd0 tx=0x7ff5dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.179+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5ec050ce0 con 0x7ff5f40b0df0 2023-10-06T11:16:01.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:01.372+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff5f40b3f90 con 0x7ff5f40b0df0 2023-10-06T11:16:02.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.244+0000 7ff5eaffd700 1 -- 172.21.15.55:0/4196218750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v88) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff5ec0170b0 con 0x7ff5f40b0df0 2023-10-06T11:16:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.248+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff5d4066f30 msgr2=0x7ff5d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.248+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff5d4066f30 0x7ff5d40693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007fd0 tx=0x7ff5dc009040 comp rx=0 tx=0).stop 2023-10-06T11:16:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.248+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 msgr2=0x7ff5f4142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.248+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4142d40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c5b0 tx=0x7ff5ec001070 comp rx=0 tx=0).stop 2023-10-06T11:16:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.249+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 shutdown_connections 2023-10-06T11:16:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.249+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff5d4066f30 0x7ff5d40693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.249+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5f40b0df0 0x7ff5f4142d40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.249+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f415d6f0 0x7ff5f40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.249+0000 7ff5f94c1700 1 --2- 172.21.15.55:0/4196218750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f4157120 0x7ff5f4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.249+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 >> 172.21.15.55:0/4196218750 conn(0x7ff5f406f4c0 msgr2=0x7ff5f415cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:02.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.250+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 shutdown_connections 2023-10-06T11:16:02.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.250+0000 7ff5f94c1700 1 -- 172.21.15.55:0/4196218750 wait complete. 2023-10-06T11:16:02.255 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:16:02.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:16:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.400+0000 7f75dcc1e700 1 Processor -- start 2023-10-06T11:16:02.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.400+0000 7f75dcc1e700 1 -- start start 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75dcc1e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75d81539c0 0x7f75d8069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75dcc1e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d8069a90 0x7f75d815d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75dcc1e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f75d8153d90 0x7f75d80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75dcc1e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d815ab70 con 0x7f75d81539c0 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75dcc1e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d815db90 con 0x7f75d8153d90 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75dcc1e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d815de70 con 0x7f75d8069a90 2023-10-06T11:16:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75d81539c0 0x7f75d8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75d81539c0 0x7f75d8069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60472/0 (socket says 172.21.15.55:60472) 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 -- 172.21.15.55:0/659761358 learned_addr learned my addr 172.21.15.55:0/659761358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d5d9b700 1 --2- 172.21.15.55:0/659761358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d8069a90 0x7f75d815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d6d9d700 1 --2- 172.21.15.55:0/659761358 >> v2:172.21.15.142:3300/0 conn(0x7f75d8153d90 0x7f75d80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 -- 172.21.15.55:0/659761358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d8069a90 msgr2=0x7f75d815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 --2- 172.21.15.55:0/659761358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d8069a90 0x7f75d815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 -- 172.21.15.55:0/659761358 >> v2:172.21.15.142:3300/0 conn(0x7f75d8153d90 msgr2=0x7f75d80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 --2- 172.21.15.55:0/659761358 >> v2:172.21.15.142:3300/0 conn(0x7f75d8153d90 0x7f75d80cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 -- 172.21.15.55:0/659761358 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8068d50 con 0x7f75d81539c0 2023-10-06T11:16:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d659c700 1 --2- 172.21.15.55:0/659761358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d81539c0 0x7f75d8069550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f75d806c880 tx=0x7f75c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee4f06d7537e645 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d559a700 1 -- 172.21.15.55:0/659761358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800b860 con 0x7f75d81539c0 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.401+0000 7f75d559a700 1 -- 172.21.15.55:0/659761358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800b9c0 con 0x7f75d81539c0 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75d559a700 1 -- 172.21.15.55:0/659761358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800bd60 con 0x7f75d81539c0 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 -- 172.21.15.55:0/659761358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d81539c0 msgr2=0x7f75d8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/659761358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d81539c0 0x7f75d8069550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f75d806c880 tx=0x7f75c8009250 comp rx=0 tx=0).stop 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 -- 172.21.15.55:0/659761358 shutdown_connections 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/659761358 >> v2:172.21.15.142:3300/0 conn(0x7f75d8153d90 0x7f75d80cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/659761358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d81539c0 0x7f75d8069550 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/659761358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d8069a90 0x7f75d815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 -- 172.21.15.55:0/659761358 >> 172.21.15.55:0/659761358 conn(0x7f75d806b610 msgr2=0x7f75d806ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:02.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 -- 172.21.15.55:0/659761358 shutdown_connections 2023-10-06T11:16:02.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.402+0000 7f75dcc1e700 1 -- 172.21.15.55:0/659761358 wait complete. 2023-10-06T11:16:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.403+0000 7f75dcc1e700 1 Processor -- start 2023-10-06T11:16:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.403+0000 7f75dcc1e700 1 -- start start 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75dcc1e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 0x7f75d813e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75dcc1e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d81539c0 0x7f75d815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75dcc1e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d8153d90 0x7f75d80c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75dcc1e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8155fa0 con 0x7f75d8069a90 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75dcc1e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8155390 con 0x7f75d8153d90 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75dcc1e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8155670 con 0x7f75d81539c0 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 0x7f75d813e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 0x7f75d813e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60478/0 (socket says 172.21.15.55:60478) 2023-10-06T11:16:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 -- 172.21.15.55:0/2087809418 learned_addr learned my addr 172.21.15.55:0/2087809418 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d6d9d700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d8153d90 0x7f75d80c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d5d9b700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d81539c0 0x7f75d815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 -- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d81539c0 msgr2=0x7f75d815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d81539c0 0x7f75d815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 -- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d8153d90 msgr2=0x7f75d80c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d8153d90 0x7f75d80c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.404+0000 7f75d659c700 1 -- 172.21.15.55:0/2087809418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80094f0 con 0x7f75d8069a90 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.405+0000 7f75d659c700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 0x7f75d813e870 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f75d806ed40 tx=0x7f75c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.405+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8011dc0 con 0x7f75d8069a90 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.405+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8024440 con 0x7f75d8069a90 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.405+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8155950 con 0x7f75d8069a90 2023-10-06T11:16:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.405+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8024800 con 0x7f75d8069a90 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.405+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8154fb0 con 0x7f75d8069a90 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.406+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d8064a90 con 0x7f75d8069a90 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.406+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75c801a420 con 0x7f75d8069a90 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.406+0000 7f75c67fc700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f75b8066f30 0x7f75b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.407+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f75c80864a0 con 0x7f75d8069a90 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.407+0000 7f75d5d9b700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f75b8066f30 0x7f75b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.407+0000 7f75d5d9b700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f75b8066f30 0x7f75b80693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75d80cb850 tx=0x7f75cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.411+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75c8053650 con 0x7f75d8069a90 2023-10-06T11:16:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:02.605+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f75d815aef0 con 0x7f75d8069a90 2023-10-06T11:16:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.251+0000 7f75c67fc700 1 -- 172.21.15.55:0/2087809418 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v89) v1 ==== 170+0+0 (secure 0 0 0) 0x7f75c8056c70 con 0x7f75d8069a90 2023-10-06T11:16:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.259+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f75b8066f30 msgr2=0x7f75b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.259+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f75b8066f30 0x7f75b80693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75d80cb850 tx=0x7f75cc008040 comp rx=0 tx=0).stop 2023-10-06T11:16:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.259+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 msgr2=0x7f75d813e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.259+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 0x7f75d813e870 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f75d806ed40 tx=0x7f75c8017000 comp rx=0 tx=0).stop 2023-10-06T11:16:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.260+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 shutdown_connections 2023-10-06T11:16:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.260+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f75b8066f30 0x7f75b80693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.260+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d8069a90 0x7f75d813e870 secure :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f75d806ed40 tx=0x7f75c8017000 comp rx=0 tx=0).stop 2023-10-06T11:16:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.260+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75d8153d90 0x7f75d80c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.260+0000 7f75dcc1e700 1 --2- 172.21.15.55:0/2087809418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75d81539c0 0x7f75d815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.260+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 >> 172.21.15.55:0/2087809418 conn(0x7f75d806b610 msgr2=0x7f75d8150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.262+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 shutdown_connections 2023-10-06T11:16:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.262+0000 7f75dcc1e700 1 -- 172.21.15.55:0/2087809418 wait complete. 2023-10-06T11:16:03.275 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:16:03.287 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:16:03.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 Processor -- start 2023-10-06T11:16:03.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 -- start start 2023-10-06T11:16:03.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa374159470 0x7fa3740ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:03.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa374159840 0x7fa3740ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:03.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740cbb80 con 0x7fa3740c6170 2023-10-06T11:16:03.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740c6d00 con 0x7fa374159840 2023-10-06T11:16:03.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.412+0000 7fa37a916700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740c6f00 con 0x7fa374159470 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa373fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa374159470 0x7fa3740ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa3737fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa374159840 0x7fa3740ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa378eb3700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa3740c6170 0x7fa3740c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:51522/0 (socket says 172.21.15.55:51522) 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa378eb3700 1 -- 172.21.15.55:0/838739518 learned_addr learned my addr 172.21.15.55:0/838739518 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa372ffd700 1 -- 172.21.15.55:0/838739518 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592607605 0 0) 0x7fa3740cbb80 con 0x7fa3740c6170 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa372ffd700 1 -- 172.21.15.55:0/838739518 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c003570 con 0x7fa3740c6170 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa373fff700 1 -- 172.21.15.55:0/838739518 >> v2:172.21.15.142:3300/0 conn(0x7fa374159840 msgr2=0x7fa3740ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa373fff700 1 --2- 172.21.15.55:0/838739518 >> v2:172.21.15.142:3300/0 conn(0x7fa374159840 0x7fa3740ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa373fff700 1 -- 172.21.15.55:0/838739518 >> v1:172.21.15.142:6789/0 conn(0x7fa3740c6170 legacy=0x7fa3740c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa373fff700 1 -- 172.21.15.55:0/838739518 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740cb530 con 0x7fa374159470 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa3737fe700 1 --2- 172.21.15.55:0/838739518 >> v2:172.21.15.142:3300/0 conn(0x7fa374159840 0x7fa3740ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:03.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.413+0000 7fa373fff700 1 --2- 172.21.15.55:0/838739518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa374159470 0x7fa3740ce980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3640098d0 tx=0x7fa364009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6df1dc468cd089 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa372ffd700 1 -- 172.21.15.55:0/838739518 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364005c10 con 0x7fa374159470 2023-10-06T11:16:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa372ffd700 1 -- 172.21.15.55:0/838739518 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364005d70 con 0x7fa374159470 2023-10-06T11:16:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa372ffd700 1 -- 172.21.15.55:0/838739518 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364006240 con 0x7fa374159470 2023-10-06T11:16:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 -- 172.21.15.55:0/838739518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa374159470 msgr2=0x7fa3740ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 --2- 172.21.15.55:0/838739518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa374159470 0x7fa3740ce980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa3640098d0 tx=0x7fa364009120 comp rx=0 tx=0).stop 2023-10-06T11:16:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 -- 172.21.15.55:0/838739518 shutdown_connections 2023-10-06T11:16:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 --2- 172.21.15.55:0/838739518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa374159470 0x7fa3740ce980 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 --2- 172.21.15.55:0/838739518 >> v2:172.21.15.142:3300/0 conn(0x7fa374159840 0x7fa3740ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 -- 172.21.15.55:0/838739518 >> 172.21.15.55:0/838739518 conn(0x7fa3740996e0 msgr2=0x7fa37406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 -- 172.21.15.55:0/838739518 shutdown_connections 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.414+0000 7fa37a916700 1 -- 172.21.15.55:0/838739518 wait complete. 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.415+0000 7fa37a916700 1 Processor -- start 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.415+0000 7fa37a916700 1 -- start start 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa37a916700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3740c6170 0x7fa37413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa37a916700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 0x7fa374159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa37a916700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa374159840 0x7fa37415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa37a916700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415d0f0 con 0x7fa374159470 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa37a916700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415d6b0 con 0x7fa374159840 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa37a916700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415c9f0 con 0x7fa3740c6170 2023-10-06T11:16:03.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa3737fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 0x7fa374159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa3737fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 0x7fa374159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60486/0 (socket says 172.21.15.55:60486) 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa3737fe700 1 -- 172.21.15.55:0/434790152 learned_addr learned my addr 172.21.15.55:0/434790152 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa373fff700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3740c6170 0x7fa37413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.416+0000 7fa378eb3700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa374159840 0x7fa37415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa3737fe700 1 -- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3740c6170 msgr2=0x7fa37413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa3737fe700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3740c6170 0x7fa37413ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa3737fe700 1 -- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa374159840 msgr2=0x7fa37415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa3737fe700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa374159840 0x7fa37415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa3737fe700 1 -- 172.21.15.55:0/434790152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368009420 con 0x7fa374159470 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa3737fe700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 0x7fa374159c10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa36800ec80 tx=0x7fa3680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800c850 con 0x7fa374159470 2023-10-06T11:16:03.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3640093c0 con 0x7fa374159470 2023-10-06T11:16:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36800c9b0 con 0x7fa374159470 2023-10-06T11:16:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800cd30 con 0x7fa374159470 2023-10-06T11:16:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.417+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37415d340 con 0x7fa374159470 2023-10-06T11:16:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.418+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37415d820 con 0x7fa374159470 2023-10-06T11:16:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.418+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa368013680 con 0x7fa374159470 2023-10-06T11:16:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.419+0000 7fa35bfff700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa360066f30 0x7fa3600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.419+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fa3680849f0 con 0x7fa374159470 2023-10-06T11:16:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.419+0000 7fa373fff700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa360066f30 0x7fa3600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.420+0000 7fa373fff700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa360066f30 0x7fa3600693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa364009160 tx=0x7fa364016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.423+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3680554b0 con 0x7fa374159470 2023-10-06T11:16:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:03.660+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa374064a90 con 0x7fa374159470 2023-10-06T11:16:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.252+0000 7fa35bfff700 1 -- 172.21.15.55:0/434790152 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa3680170c0 con 0x7fa374159470 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa360066f30 msgr2=0x7fa3600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa360066f30 0x7fa3600693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa364009160 tx=0x7fa364016000 comp rx=0 tx=0).stop 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 msgr2=0x7fa374159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 0x7fa374159c10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa36800ec80 tx=0x7fa3680091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 shutdown_connections 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa360066f30 0x7fa3600693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa374159840 0x7fa37415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3740c6170 0x7fa37413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 --2- 172.21.15.55:0/434790152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa374159470 0x7fa374159c10 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.255+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 >> 172.21.15.55:0/434790152 conn(0x7fa3740996e0 msgr2=0x7fa3740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.256+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 shutdown_connections 2023-10-06T11:16:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.256+0000 7fa37a916700 1 -- 172.21.15.55:0/434790152 wait complete. 2023-10-06T11:16:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 14 and data pool 15 2023-10-06T11:16:04.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:04.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.411+0000 7f7be147d700 1 Processor -- start 2023-10-06T11:16:04.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.411+0000 7f7be147d700 1 -- start start 2023-10-06T11:16:04.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7be147d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 0x7f7bdc161f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7be147d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0cad20 con 0x7f7bdc1570f0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7be147d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0cc4f0 con 0x7f7bdc06e8b0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7be147d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc06a560 con 0x7f7bdc068cd0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7bdaffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7bdc1570f0 0x7f7bdc069ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49340/0 (socket says 172.21.15.55:49340) 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7bdaffd700 1 -- 172.21.15.55:0/3752478273 learned_addr learned my addr 172.21.15.55:0/3752478273 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7bdb7fe700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 0x7f7bdc161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471837118 0 0) 0x7f7bdc0cad20 con 0x7f7bdc1570f0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.412+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc8003570 con 0x7f7bdc1570f0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4131999126 0 0) 0x7f7bc8003570 con 0x7f7bdc1570f0 2023-10-06T11:16:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 msgr2=0x7f7bdc161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 0x7f7bdc161f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 >> v1:172.21.15.142:6789/0 conn(0x7f7bdc06e8b0 legacy=0x7f7bdc0685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc06a840 con 0x7f7bdc1570f0 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f7bd4001470 con 0x7f7bdc1570f0 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 >> v1:172.21.15.55:6789/0 conn(0x7f7bdc1570f0 legacy=0x7f7bdc069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 0x7f7bc8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc8004d50 0x7f7bc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc06a560 con 0x7f7bc8004010 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc800bc70 con 0x7f7bc8004d50 2023-10-06T11:16:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc800be30 con 0x7f7bdc068cd0 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bdb7fe700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc8004d50 0x7f7bc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bdaffd700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 0x7f7bc8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 -- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 msgr2=0x7f7bc8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc068cd0 0x7f7bc8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 -- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc8004d50 msgr2=0x7f7bc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc8004d50 0x7f7bc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 -- 172.21.15.55:0/3752478273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8003570 con 0x7f7bc8004010 2023-10-06T11:16:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.413+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bc8004810 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4001880 tx=0x7f7bc4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c450c788157a2fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4012420 con 0x7f7bc8004010 2023-10-06T11:16:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4012580 con 0x7f7bc8004010 2023-10-06T11:16:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7bd9ffb700 1 -- 172.21.15.55:0/3752478273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4012920 con 0x7f7bc8004010 2023-10-06T11:16:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7be147d700 1 -- 172.21.15.55:0/3752478273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 msgr2=0x7f7bc8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7be147d700 1 --2- 172.21.15.55:0/3752478273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bc8004810 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4001880 tx=0x7f7bc4007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7bdb7fe700 1 -- 172.21.15.55:0/3752478273 reap_dead start 2023-10-06T11:16:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7be147d700 1 -- 172.21.15.55:0/3752478273 shutdown_connections 2023-10-06T11:16:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7be147d700 1 -- 172.21.15.55:0/3752478273 >> 172.21.15.55:0/3752478273 conn(0x7f7bdc0c9c10 msgr2=0x7f7bdc06dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7be147d700 1 -- 172.21.15.55:0/3752478273 shutdown_connections 2023-10-06T11:16:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.414+0000 7f7be147d700 1 -- 172.21.15.55:0/3752478273 wait complete. 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.415+0000 7f7be147d700 1 Processor -- start 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.415+0000 7f7be147d700 1 -- start start 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7be147d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bdc0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7be147d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bdc0b1df0 0x7f7bdc152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7be147d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc1403a0 0x7f7bdc153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7be147d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc140830 con 0x7f7bc8004010 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7be147d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc140b10 con 0x7f7bdc0b1df0 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7be147d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc140df0 con 0x7f7bdc1403a0 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7bdaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bdc0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7bdaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bdc0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60514/0 (socket says 172.21.15.55:60514) 2023-10-06T11:16:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7bdaffd700 1 -- 172.21.15.55:0/4222800939 learned_addr learned my addr 172.21.15.55:0/4222800939 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7bdb7fe700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc1403a0 0x7f7bdc153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.416+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bdc0b1df0 0x7f7bdc152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bdaffd700 1 -- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc1403a0 msgr2=0x7f7bdc153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bdaffd700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc1403a0 0x7f7bdc153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bdaffd700 1 -- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bdc0b1df0 msgr2=0x7f7bdc152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bdaffd700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bdc0b1df0 0x7f7bdc152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bdaffd700 1 -- 172.21.15.55:0/4222800939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc1410d0 con 0x7f7bc8004010 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bdaffd700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bdc0b18b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4007310 tx=0x7f7bd4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4018030 con 0x7f7bc8004010 2023-10-06T11:16:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4007780 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400fb00 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc1413b0 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.417+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc1538c0 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.418+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc05f230 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.418+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bd401b070 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.419+0000 7f7bd2ffd700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7bbc066f30 0x7f7bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.419+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7bd4019070 con 0x7f7bc8004010 2023-10-06T11:16:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.419+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7bbc066f30 0x7f7bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.420+0000 7f7bda7fc700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7bbc066f30 0x7f7bbc0693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4008fd0 tx=0x7f7bc4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.423+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bd4051640 con 0x7f7bc8004010 2023-10-06T11:16:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.619+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bdc0cafc0 con 0x7f7bc8004010 2023-10-06T11:16:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.619+0000 7f7bd2ffd700 1 -- 172.21.15.55:0/4222800939 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f7bd4054c60 con 0x7f7bc8004010 2023-10-06T11:16:04.621 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:04.621 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:03.661610+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:01.403615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:02.635607+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:04.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.621+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7bbc066f30 msgr2=0x7f7bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.621+0000 7f7be147d700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7bbc066f30 0x7f7bbc0693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4008fd0 tx=0x7f7bc4015000 comp rx=0 tx=0).stop 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.621+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 msgr2=0x7f7bdc0b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.621+0000 7f7be147d700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bdc0b18b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4007310 tx=0x7f7bd4001e50 comp rx=0 tx=0).stop 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 shutdown_connections 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7bbc066f30 0x7f7bbc0693e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bc8004010 0x7f7bdc0b18b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bdc1403a0 0x7f7bdc153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 --2- 172.21.15.55:0/4222800939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bdc0b1df0 0x7f7bdc152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 >> 172.21.15.55:0/4222800939 conn(0x7f7bdc0c9c10 msgr2=0x7f7bdc0aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 shutdown_connections 2023-10-06T11:16:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.622+0000 7f7be147d700 1 -- 172.21.15.55:0/4222800939 wait complete. 2023-10-06T11:16:04.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:04.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.753+0000 7f267deed700 1 Processor -- start 2023-10-06T11:16:04.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.753+0000 7f267deed700 1 -- start start 2023-10-06T11:16:04.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267deed700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2678159440 0x7f26780b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267deed700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26780cb7a0 con 0x7f26780b2100 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267deed700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26780b0860 con 0x7f26780b35d0 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267deed700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780cb150 con 0x7f2678159440 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267d6ec700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26780b2100 0x7f26780b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49350/0 (socket says 172.21.15.55:49350) 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267d6ec700 1 -- 172.21.15.55:0/397059677 learned_addr learned my addr 172.21.15.55:0/397059677 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322136359 0 0) 0x7f26780cb7a0 con 0x7f26780b2100 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2664003570 con 0x7f26780b2100 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.754+0000 7f267ceeb700 1 --2- 172.21.15.55:0/397059677 >> v2:172.21.15.142:3300/0 conn(0x7f2678159440 0x7f26780b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 388672286 0 0) 0x7f2664003570 con 0x7f26780b2100 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 >> v2:172.21.15.142:3300/0 conn(0x7f2678159440 msgr2=0x7f26780b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:04.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 --2- 172.21.15.55:0/397059677 >> v2:172.21.15.142:3300/0 conn(0x7f2678159440 0x7f26780b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 >> v1:172.21.15.142:6789/0 conn(0x7f26780b35d0 legacy=0x7f26780cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26780cb430 con 0x7f26780b2100 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f2660001470 con 0x7f26780b2100 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 >> v1:172.21.15.55:6789/0 conn(0x7f26780b2100 legacy=0x7f26780b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2664003a60 0x7f2664003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2664004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26640051c0 0x7f266400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780cb150 con 0x7f2664004810 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266400c0e0 con 0x7f2664003a60 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266400c2a0 con 0x7f26640051c0 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2664004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f267ceeb700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2664003a60 0x7f2664003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f267d6ec700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26640051c0 0x7f266400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 -- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26640051c0 msgr2=0x7f266400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26640051c0 0x7f266400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 -- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2664003a60 msgr2=0x7f2664003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2664003a60 0x7f2664003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 -- 172.21.15.55:0/397059677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664003570 con 0x7f2664004810 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f267d6ec700 1 -- 172.21.15.55:0/397059677 reap_dead start 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f2677fff700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2664004c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2668001960 tx=0x7f2668007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fa17088816bb73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800c5d0 con 0x7f2664004810 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266800c730 con 0x7f2664004810 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.755+0000 7f26777fe700 1 -- 172.21.15.55:0/397059677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800cad0 con 0x7f2664004810 2023-10-06T11:16:04.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 -- 172.21.15.55:0/397059677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 msgr2=0x7f2664004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2664004c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2668001960 tx=0x7f2668007d10 comp rx=0 tx=0).stop 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 -- 172.21.15.55:0/397059677 shutdown_connections 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 --2- 172.21.15.55:0/397059677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2664004c80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 -- 172.21.15.55:0/397059677 >> 172.21.15.55:0/397059677 conn(0x7f267806ece0 msgr2=0x7f267806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 -- 172.21.15.55:0/397059677 shutdown_connections 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.756+0000 7f267deed700 1 -- 172.21.15.55:0/397059677 wait complete. 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.757+0000 7f267deed700 1 Processor -- start 2023-10-06T11:16:04.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.757+0000 7f267deed700 1 -- start start 2023-10-06T11:16:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267deed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2678159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267deed700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267815a410 0x7f2678169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267deed700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2678169760 0x7f2678169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267deed700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26781560d0 con 0x7f2664004810 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267deed700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267816a120 con 0x7f267815a410 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267deed700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267815b530 con 0x7f2678169760 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2678159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2678159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60530/0 (socket says 172.21.15.55:60530) 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 -- 172.21.15.55:0/1318957835 learned_addr learned my addr 172.21.15.55:0/1318957835 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267d6ec700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2678169760 0x7f2678169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f2677fff700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267815a410 0x7f2678169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 -- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2678169760 msgr2=0x7f2678169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2678169760 0x7f2678169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 -- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267815a410 msgr2=0x7f2678169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267815a410 0x7f2678169220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f267ceeb700 1 -- 172.21.15.55:0/1318957835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267815b9c0 con 0x7f2664004810 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.758+0000 7f2677fff700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267815a410 0x7f2678169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.759+0000 7f267ceeb700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2678159ed0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2670009e50 tx=0x7f267000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.759+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000e040 con 0x7f2664004810 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.759+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000f040 con 0x7f2664004810 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.759+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267815a920 con 0x7f2664004810 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.759+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000fe50 con 0x7f2664004810 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.759+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267815aee0 con 0x7f2664004810 2023-10-06T11:16:04.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.760+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267805f230 con 0x7f2664004810 2023-10-06T11:16:04.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.760+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2670015640 con 0x7f2664004810 2023-10-06T11:16:04.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.761+0000 7f2674ff9700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2658066f30 0x7f26580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:04.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.761+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2670085460 con 0x7f2664004810 2023-10-06T11:16:04.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.761+0000 7f2677fff700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2658066f30 0x7f26580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:04.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.761+0000 7f2677fff700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2658066f30 0x7f26580693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26780b34e0 tx=0x7f2668015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:04.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.765+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2670055ec0 con 0x7f2664004810 2023-10-06T11:16:04.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.960+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2678159810 con 0x7f2664004810 2023-10-06T11:16:04.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.961+0000 7f2674ff9700 1 -- 172.21.15.55:0/1318957835 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f2670055a50 con 0x7f2664004810 2023-10-06T11:16:04.963 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:04.963 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:03.661610+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:01.403615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:02.635607+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:04.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2658066f30 msgr2=0x7f26580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2658066f30 0x7f26580693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26780b34e0 tx=0x7f2668015000 comp rx=0 tx=0).stop 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 msgr2=0x7f2678159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2678159ed0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2670009e50 tx=0x7f267000b040 comp rx=0 tx=0).stop 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 shutdown_connections 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2658066f30 0x7f26580693e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664004810 0x7f2678159ed0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2678169760 0x7f2678169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 --2- 172.21.15.55:0/1318957835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f267815a410 0x7f2678169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 >> 172.21.15.55:0/1318957835 conn(0x7f267806ece0 msgr2=0x7f26780b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 shutdown_connections 2023-10-06T11:16:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:04.963+0000 7f267deed700 1 -- 172.21.15.55:0/1318957835 wait complete. 2023-10-06T11:16:04.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:16:05.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.098+0000 7fc591611700 1 Processor -- start 2023-10-06T11:16:05.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.098+0000 7fc591611700 1 -- start start 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc591611700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc58c0b29f0 0x7fc58c164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc591611700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0cc970 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc591611700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0cbd60 con 0x7fc58c0b2620 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc591611700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0cc040 con 0x7fc58c0b29f0 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc590e10700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc58c0b29f0 0x7fc58c164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc58b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc58c0cd3c0 0x7fc58c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49358/0 (socket says 172.21.15.55:49358) 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc590e10700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc58c0b29f0 0x7fc58c164320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60532/0 (socket says 172.21.15.55:60532) 2023-10-06T11:16:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc58b7fe700 1 -- 172.21.15.55:0/2395796672 learned_addr learned my addr 172.21.15.55:0/2395796672 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc590e10700 1 -- 172.21.15.55:0/2395796672 >> v1:172.21.15.142:6789/0 conn(0x7fc58c0b2620 legacy=0x7fc58c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc590e10700 1 -- 172.21.15.55:0/2395796672 >> v1:172.21.15.55:6789/0 conn(0x7fc58c0cd3c0 legacy=0x7fc58c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc590e10700 1 -- 172.21.15.55:0/2395796672 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0cc320 con 0x7fc58c0b29f0 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc590e10700 1 --2- 172.21.15.55:0/2395796672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0b29f0 0x7fc58c164320 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc584009e60 tx=0x7fc584009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c3032f6d029b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc58affd700 1 -- 172.21.15.55:0/2395796672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400e070 con 0x7fc58c0b29f0 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc58affd700 1 -- 172.21.15.55:0/2395796672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400bbf0 con 0x7fc58c0b29f0 2023-10-06T11:16:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.099+0000 7fc58affd700 1 -- 172.21.15.55:0/2395796672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584012430 con 0x7fc58c0b29f0 2023-10-06T11:16:05.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 -- 172.21.15.55:0/2395796672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0b29f0 msgr2=0x7fc58c164320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:05.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 --2- 172.21.15.55:0/2395796672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0b29f0 0x7fc58c164320 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc584009e60 tx=0x7fc584009780 comp rx=0 tx=0).stop 2023-10-06T11:16:05.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 -- 172.21.15.55:0/2395796672 shutdown_connections 2023-10-06T11:16:05.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 --2- 172.21.15.55:0/2395796672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0b29f0 0x7fc58c164320 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 -- 172.21.15.55:0/2395796672 >> 172.21.15.55:0/2395796672 conn(0x7fc58c099520 msgr2=0x7fc58c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 -- 172.21.15.55:0/2395796672 shutdown_connections 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.100+0000 7fc591611700 1 -- 172.21.15.55:0/2395796672 wait complete. 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.101+0000 7fc591611700 1 Processor -- start 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.101+0000 7fc591611700 1 -- start start 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc591611700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc591611700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc58c0b29f0 0x7fc58c16e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc591611700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 0x7fc58c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc591611700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0b4b00 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc591611700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0b5680 con 0x7fc58c0b2620 2023-10-06T11:16:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc591611700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0b4300 con 0x7fc58c0b29f0 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 0x7fc58c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 0x7fc58c0b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60548/0 (socket says 172.21.15.55:60548) 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 -- 172.21.15.55:0/462795111 learned_addr learned my addr 172.21.15.55:0/462795111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc58bfff700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc58b7fe700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc58c0b29f0 0x7fc58c16e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 -- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc58c0b29f0 msgr2=0x7fc58c16e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc58c0b29f0 0x7fc58c16e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 -- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc58c0b2620 msgr2=0x7fc58c0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc590e10700 1 -- 172.21.15.55:0/462795111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584009a20 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc58bfff700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.102+0000 7fc58b7fe700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc58c0b29f0 0x7fc58c16e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.103+0000 7fc590e10700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 0x7fc58c0b3dc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc58c06fcc0 tx=0x7fc584018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.103+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58401e640 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.103+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58401e7a0 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.103+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0b4d50 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.103+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58401eb60 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.103+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0b5310 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.104+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c05f230 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.104+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc584024070 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.105+0000 7fc573fff700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc578066f30 0x7fc5780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.105+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc584087370 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.105+0000 7fc58bfff700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc578066f30 0x7fc5780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.105+0000 7fc58bfff700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc578066f30 0x7fc5780693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0099f0 tx=0x7fc57c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:05.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.109+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5840542a0 con 0x7fc58c0cd3c0 2023-10-06T11:16:05.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:05.347+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc58c0b57c0 con 0x7fc58c0cd3c0 2023-10-06T11:16:06.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.289+0000 7fc573fff700 1 -- 172.21.15.55:0/462795111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc5840578c0 con 0x7fc58c0cd3c0 2023-10-06T11:16:06.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.291+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc578066f30 msgr2=0x7fc5780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.291+0000 7fc591611700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc578066f30 0x7fc5780693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0099f0 tx=0x7fc57c008040 comp rx=0 tx=0).stop 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.291+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 msgr2=0x7fc58c0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.291+0000 7fc591611700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 0x7fc58c0b3dc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc58c06fcc0 tx=0x7fc584018000 comp rx=0 tx=0).stop 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 shutdown_connections 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc578066f30 0x7fc5780693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc58c0cd3c0 0x7fc58c0b3dc0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc58c0b2620 0x7fc58c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 --2- 172.21.15.55:0/462795111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc58c0b29f0 0x7fc58c16e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 >> 172.21.15.55:0/462795111 conn(0x7fc58c099520 msgr2=0x7fc58c154330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 shutdown_connections 2023-10-06T11:16:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.292+0000 7fc591611700 1 -- 172.21.15.55:0/462795111 wait complete. 2023-10-06T11:16:06.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:16:06.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.435+0000 7f3591933700 1 Processor -- start 2023-10-06T11:16:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.435+0000 7f3591933700 1 -- start start 2023-10-06T11:16:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f3591933700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0b0820 0x7f358c0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f3591933700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f358c0c4450 0x7f358c0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f3591933700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f358c0cc740 0x7f358c0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f3591933700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c0c9670 con 0x7f358c0cc740 2023-10-06T11:16:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f3591933700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c159c00 con 0x7f358c0c4450 2023-10-06T11:16:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f3591933700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0c8a60 con 0x7f358c0b0820 2023-10-06T11:16:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f358b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f358c0cc740 0x7f358c0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f358b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f358c0cc740 0x7f358c0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60564/0 (socket says 172.21.15.55:60564) 2023-10-06T11:16:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.436+0000 7f358b7fe700 1 -- 172.21.15.55:0/2945249190 learned_addr learned my addr 172.21.15.55:0/2945249190 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358affd700 1 --2- 172.21.15.55:0/2945249190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0b0820 0x7f358c0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358a7fc700 1 --2- 172.21.15.55:0/2945249190 >> v2:172.21.15.142:3300/0 conn(0x7f358c0c4450 0x7f358c0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358b7fe700 1 -- 172.21.15.55:0/2945249190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0b0820 msgr2=0x7f358c0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358b7fe700 1 --2- 172.21.15.55:0/2945249190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0b0820 0x7f358c0686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358b7fe700 1 -- 172.21.15.55:0/2945249190 >> v2:172.21.15.142:3300/0 conn(0x7f358c0c4450 msgr2=0x7f358c0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358b7fe700 1 --2- 172.21.15.55:0/2945249190 >> v2:172.21.15.142:3300/0 conn(0x7f358c0c4450 0x7f358c0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358b7fe700 1 -- 172.21.15.55:0/2945249190 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0c8d40 con 0x7f358c0cc740 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f358b7fe700 1 --2- 172.21.15.55:0/2945249190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0cc740 0x7f358c0ccba0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f358c06f330 tx=0x7f357c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967970082370e034 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f3589ffb700 1 -- 172.21.15.55:0/2945249190 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00b860 con 0x7f358c0cc740 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f3589ffb700 1 -- 172.21.15.55:0/2945249190 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c00b9c0 con 0x7f358c0cc740 2023-10-06T11:16:06.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f3589ffb700 1 -- 172.21.15.55:0/2945249190 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00bd60 con 0x7f358c0cc740 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f3591933700 1 -- 172.21.15.55:0/2945249190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0cc740 msgr2=0x7f358c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.437+0000 7f3591933700 1 --2- 172.21.15.55:0/2945249190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0cc740 0x7f358c0ccba0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f358c06f330 tx=0x7f357c009250 comp rx=0 tx=0).stop 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 -- 172.21.15.55:0/2945249190 shutdown_connections 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 --2- 172.21.15.55:0/2945249190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0cc740 0x7f358c0ccba0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 --2- 172.21.15.55:0/2945249190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0b0820 0x7f358c0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 --2- 172.21.15.55:0/2945249190 >> v2:172.21.15.142:3300/0 conn(0x7f358c0c4450 0x7f358c0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 -- 172.21.15.55:0/2945249190 >> 172.21.15.55:0/2945249190 conn(0x7f358c087fc0 msgr2=0x7f358c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 -- 172.21.15.55:0/2945249190 shutdown_connections 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.438+0000 7f3591933700 1 -- 172.21.15.55:0/2945249190 wait complete. 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.439+0000 7f3591933700 1 Processor -- start 2023-10-06T11:16:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.439+0000 7f3591933700 1 -- start start 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 0x7f358c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0c4450 0x7f358c0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f358c0cc740 0x7f358c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1523b0 con 0x7f358c0b0820 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0c7610 con 0x7f358c0cc740 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0c78f0 con 0x7f358c0c4450 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 0x7f358c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 0x7f358c151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60566/0 (socket says 172.21.15.55:60566) 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 -- 172.21.15.55:0/4054008182 learned_addr learned my addr 172.21.15.55:0/4054008182 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 -- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0c4450 msgr2=0x7f358c0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0c4450 0x7f358c0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 -- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f358c0cc740 msgr2=0x7f358c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f358c0cc740 0x7f358c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 -- 172.21.15.55:0/4054008182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0094f0 con 0x7f358c0b0820 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f358affd700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 0x7f358c151e70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f358400e0e0 tx=0x7f35840098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400ed80 con 0x7f358c0b0820 2023-10-06T11:16:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584014420 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c0c7bd0 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840147e0 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.440+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c0c71e0 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.442+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c0c8220 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.442+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3584014b50 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.442+0000 7f3582ffd700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f356c066f30 0x7f356c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.442+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3584084fd0 con 0x7f358c0b0820 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.443+0000 7f358a7fc700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f356c066f30 0x7f356c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.444+0000 7f358a7fc700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f356c066f30 0x7f356c0693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3574009a40 tx=0x7f3574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.447+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3584051fa0 con 0x7f358c0b0820 2023-10-06T11:16:06.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:06.684+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f358c0c73d0 con 0x7f358c0b0820 2023-10-06T11:16:07.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.297+0000 7f3582ffd700 1 -- 172.21.15.55:0/4054008182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f358c0c73d0 con 0x7f358c0b0820 2023-10-06T11:16:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f356c066f30 msgr2=0x7f356c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f356c066f30 0x7f356c0693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3574009a40 tx=0x7f3574008040 comp rx=0 tx=0).stop 2023-10-06T11:16:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 msgr2=0x7f358c151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 0x7f358c151e70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f358400e0e0 tx=0x7f35840098d0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 shutdown_connections 2023-10-06T11:16:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f356c066f30 0x7f356c0693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c0b0820 0x7f358c151e70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f358c0cc740 0x7f358c0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 --2- 172.21.15.55:0/4054008182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f358c0c4450 0x7f358c0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 >> 172.21.15.55:0/4054008182 conn(0x7f358c087fc0 msgr2=0x7f358c0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 shutdown_connections 2023-10-06T11:16:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.299+0000 7f3591933700 1 -- 172.21.15.55:0/4054008182 wait complete. 2023-10-06T11:16:07.314 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:07.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.433+0000 7f62f1279700 1 Processor -- start 2023-10-06T11:16:07.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.433+0000 7f62f1279700 1 -- start start 2023-10-06T11:16:07.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62f1279700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec159560 0x7f62ec0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62f1279700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f62ec0b49a0 0x7f62ec0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62f1279700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62ec0b0760 0x7f62ec0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62f1279700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec0b0c60 con 0x7f62ec0b0760 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62f1279700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec0b0f40 con 0x7f62ec0b49a0 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62f1279700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b1220 con 0x7f62ec159560 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62eb7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62ec0b0760 0x7f62ec0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62eb7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62ec0b0760 0x7f62ec0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60572/0 (socket says 172.21.15.55:60572) 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.434+0000 7f62eb7fe700 1 -- 172.21.15.55:0/588038071 learned_addr learned my addr 172.21.15.55:0/588038071 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62ea7fc700 1 --2- 172.21.15.55:0/588038071 >> v2:172.21.15.142:3300/0 conn(0x7f62ec0b49a0 0x7f62ec0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eaffd700 1 --2- 172.21.15.55:0/588038071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec159560 0x7f62ec0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eb7fe700 1 -- 172.21.15.55:0/588038071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec159560 msgr2=0x7f62ec0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:07.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eb7fe700 1 --2- 172.21.15.55:0/588038071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec159560 0x7f62ec0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eb7fe700 1 -- 172.21.15.55:0/588038071 >> v2:172.21.15.142:3300/0 conn(0x7f62ec0b49a0 msgr2=0x7f62ec0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eb7fe700 1 --2- 172.21.15.55:0/588038071 >> v2:172.21.15.142:3300/0 conn(0x7f62ec0b49a0 0x7f62ec0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eb7fe700 1 -- 172.21.15.55:0/588038071 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0b1500 con 0x7f62ec0b0760 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62eb7fe700 1 --2- 172.21.15.55:0/588038071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec0b3890 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f62ec089020 tx=0x7f62dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59d916180f4a859 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62e9ffb700 1 -- 172.21.15.55:0/588038071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00e070 con 0x7f62ec0b0760 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62e9ffb700 1 -- 172.21.15.55:0/588038071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc00ba50 con 0x7f62ec0b0760 2023-10-06T11:16:07.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.435+0000 7f62e9ffb700 1 -- 172.21.15.55:0/588038071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0092e0 con 0x7f62ec0b0760 2023-10-06T11:16:07.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 -- 172.21.15.55:0/588038071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 msgr2=0x7f62ec0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 --2- 172.21.15.55:0/588038071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec0b3890 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f62ec089020 tx=0x7f62dc009840 comp rx=0 tx=0).stop 2023-10-06T11:16:07.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 -- 172.21.15.55:0/588038071 shutdown_connections 2023-10-06T11:16:07.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 --2- 172.21.15.55:0/588038071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec0b3890 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 --2- 172.21.15.55:0/588038071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec159560 0x7f62ec0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 --2- 172.21.15.55:0/588038071 >> v2:172.21.15.142:3300/0 conn(0x7f62ec0b49a0 0x7f62ec0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 -- 172.21.15.55:0/588038071 >> 172.21.15.55:0/588038071 conn(0x7f62ec0997f0 msgr2=0x7f62ec06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 -- 172.21.15.55:0/588038071 shutdown_connections 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.436+0000 7f62f1279700 1 -- 172.21.15.55:0/588038071 wait complete. 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.437+0000 7f62f1279700 1 Processor -- start 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.437+0000 7f62f1279700 1 -- start start 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec0b49a0 0x7f62ec0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62ec159560 0x7f62ec0c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0cc1f0 con 0x7f62ec0b0760 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec09c470 con 0x7f62ec159560 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0cb950 con 0x7f62ec0b49a0 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec14d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60588/0 (socket says 172.21.15.55:60588) 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 -- 172.21.15.55:0/3365684321 learned_addr learned my addr 172.21.15.55:0/3365684321 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62ea7fc700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec0b49a0 0x7f62ec0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eb7fe700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62ec159560 0x7f62ec0c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 -- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec0b49a0 msgr2=0x7f62ec0c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec0b49a0 0x7f62ec0c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 -- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62ec159560 msgr2=0x7f62ec0c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62ec159560 0x7f62ec0c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 -- 172.21.15.55:0/3365684321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009ae0 con 0x7f62ec0b0760 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62ea7fc700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec0b49a0 0x7f62ec0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62eaffd700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec14d870 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f62e400d8c0 tx=0x7f62e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4005a00 con 0x7f62ec0b0760 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e4005ba0 con 0x7f62ec0b0760 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec0cbc30 con 0x7f62ec0b0760 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4006030 con 0x7f62ec0b0760 2023-10-06T11:16:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.438+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec14ddb0 con 0x7f62ec0b0760 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.439+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec064a90 con 0x7f62ec0b0760 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.440+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62e40063a0 con 0x7f62ec0b0760 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.440+0000 7f62e2ffd700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f62cc066f60 0x7f62cc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.440+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f62e4084aa0 con 0x7f62ec0b0760 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.441+0000 7f62ea7fc700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f62cc066f60 0x7f62cc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.441+0000 7f62ea7fc700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f62cc066f60 0x7f62cc069410 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0c8930 tx=0x7f62d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.445+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62e4051a70 con 0x7f62ec0b0760 2023-10-06T11:16:07.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.680+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62ec0b17e0 con 0x7f62ec0b0760 2023-10-06T11:16:07.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.680+0000 7f62e2ffd700 1 -- 172.21.15.55:0/3365684321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f62e4055090 con 0x7f62ec0b0760 2023-10-06T11:16:07.682 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:07.682 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f62cc066f60 msgr2=0x7f62cc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f62cc066f60 0x7f62cc069410 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0c8930 tx=0x7f62d4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 msgr2=0x7f62ec14d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec14d870 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f62e400d8c0 tx=0x7f62e4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 shutdown_connections 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f62cc066f60 0x7f62cc069410 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ec0b0760 0x7f62ec14d870 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62ec159560 0x7f62ec0c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 --2- 172.21.15.55:0/3365684321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62ec0b49a0 0x7f62ec0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 >> 172.21.15.55:0/3365684321 conn(0x7f62ec0997f0 msgr2=0x7f62ec069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 shutdown_connections 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.682+0000 7f62f1279700 1 -- 172.21.15.55:0/3365684321 wait complete. 2023-10-06T11:16:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:07.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.813+0000 7f28e9b0f700 1 Processor -- start 2023-10-06T11:16:07.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.814+0000 7f28e9b0f700 1 -- start start 2023-10-06T11:16:07.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.814+0000 7f28e9b0f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28e4159470 0x7f28e40ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.814+0000 7f28e9b0f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40cd5d0 con 0x7f28e40c6220 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.814+0000 7f28e9b0f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40cc800 con 0x7f28e40cd160 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.814+0000 7f28e9b0f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e40cbc30 con 0x7f28e4159470 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e930e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28e40c6220 0x7f28e4163030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49360/0 (socket says 172.21.15.55:49360) 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e930e700 1 -- 172.21.15.55:0/1192716067 learned_addr learned my addr 172.21.15.55:0/1192716067 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e8b0d700 1 --2- 172.21.15.55:0/1192716067 >> v2:172.21.15.142:3300/0 conn(0x7f28e4159470 0x7f28e40ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248536588 0 0) 0x7f28e40cd5d0 con 0x7f28e40c6220 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0003570 con 0x7f28e40c6220 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 267703537 0 0) 0x7f28d0003570 con 0x7f28e40c6220 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 >> v2:172.21.15.142:3300/0 conn(0x7f28e4159470 msgr2=0x7f28e40ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 --2- 172.21.15.55:0/1192716067 >> v2:172.21.15.142:3300/0 conn(0x7f28e4159470 0x7f28e40ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 >> v1:172.21.15.142:6789/0 conn(0x7f28e40cd160 legacy=0x7f28e40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40cbed0 con 0x7f28e40c6220 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f28cc001470 con 0x7f28e40c6220 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 >> v1:172.21.15.55:6789/0 conn(0x7f28e40c6220 legacy=0x7f28e4163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28d0003a60 0x7f28d0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28d0004810 0x7f28d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40cbc30 con 0x7f28d0005230 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000c200 con 0x7f28d0004810 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000c3c0 con 0x7f28d0003a60 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e930e700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.815+0000 7f28e8b0d700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28d0003a60 0x7f28d0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 -- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28d0003a60 msgr2=0x7f28d0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28d0003a60 0x7f28d0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 -- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28d0004810 msgr2=0x7f28d0004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28d0004810 0x7f28d0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 -- 172.21.15.55:0/1192716067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0003570 con 0x7f28d0005230 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 -- 172.21.15.55:0/1192716067 reap_dead start 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e930e700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28d000ba60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c3c0 tx=0x7f28cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a0aea339d3f3da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00cc90 con 0x7f28d0005230 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00ce30 con 0x7f28d0005230 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e37fe700 1 -- 172.21.15.55:0/1192716067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc005b70 con 0x7f28d0005230 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e9b0f700 1 -- 172.21.15.55:0/1192716067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 msgr2=0x7f28d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28d000ba60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c3c0 tx=0x7f28cc001e70 comp rx=0 tx=0).stop 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e9b0f700 1 -- 172.21.15.55:0/1192716067 shutdown_connections 2023-10-06T11:16:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/1192716067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28d000ba60 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.816+0000 7f28e9b0f700 1 -- 172.21.15.55:0/1192716067 >> 172.21.15.55:0/1192716067 conn(0x7f28e40995c0 msgr2=0x7f28e406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.817+0000 7f28e9b0f700 1 -- 172.21.15.55:0/1192716067 shutdown_connections 2023-10-06T11:16:07.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.817+0000 7f28e9b0f700 1 -- 172.21.15.55:0/1192716067 wait complete. 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.818+0000 7f28e9b0f700 1 Processor -- start 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.818+0000 7f28e9b0f700 1 -- start start 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.818+0000 7f28e9b0f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28e4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.818+0000 7f28e9b0f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28e4158730 0x7f28e40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e9b0f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e41576b0 0x7f28e40b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e9b0f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4157220 con 0x7f28d0005230 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e9b0f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4156610 con 0x7f28e41576b0 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e9b0f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e41568f0 con 0x7f28e4158730 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28e4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28e4155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60608/0 (socket says 172.21.15.55:60608) 2023-10-06T11:16:07.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 -- 172.21.15.55:0/579517039 learned_addr learned my addr 172.21.15.55:0/579517039 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e930e700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e41576b0 0x7f28e40b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e3fff700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28e4158730 0x7f28e40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 -- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28e4158730 msgr2=0x7f28e40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28e4158730 0x7f28e40b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 -- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e41576b0 msgr2=0x7f28e40b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e41576b0 0x7f28e40b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 -- 172.21.15.55:0/579517039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4156bd0 con 0x7f28d0005230 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e8b0d700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28e4155d10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f28dc011f00 tx=0x7f28dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00e040 con 0x7f28d0005230 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc00f040 con 0x7f28d0005230 2023-10-06T11:16:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e4156eb0 con 0x7f28d0005230 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc015430 con 0x7f28d0005230 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.819+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e4156250 con 0x7f28d0005230 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.820+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e4157500 con 0x7f28d0005230 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.821+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28dc015860 con 0x7f28d0005230 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.821+0000 7f28e0ff9700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28c4066f30 0x7f28c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.821+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f28dc085520 con 0x7f28d0005230 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.821+0000 7f28e3fff700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28c4066f30 0x7f28c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.822+0000 7f28e3fff700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28c4066f30 0x7f28c40693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f28e409b490 tx=0x7f28d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:07.825+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28dc0524f0 con 0x7f28d0005230 2023-10-06T11:16:08.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.020+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e405f230 con 0x7f28d0005230 2023-10-06T11:16:08.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.021+0000 7f28e0ff9700 1 -- 172.21.15.55:0/579517039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f28dc055b10 con 0x7f28d0005230 2023-10-06T11:16:08.023 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:08.023 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:05.249987+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:01.403615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:02.635607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28c4066f30 msgr2=0x7f28c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28c4066f30 0x7f28c40693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f28e409b490 tx=0x7f28d4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 msgr2=0x7f28e4155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28e4155d10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f28dc011f00 tx=0x7f28dc00b040 comp rx=0 tx=0).stop 2023-10-06T11:16:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 shutdown_connections 2023-10-06T11:16:08.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f28c4066f30 0x7f28c40693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d0005230 0x7f28e4155d10 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28e41576b0 0x7f28e40b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 --2- 172.21.15.55:0/579517039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28e4158730 0x7f28e40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 >> 172.21.15.55:0/579517039 conn(0x7f28e40995c0 msgr2=0x7f28e4154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 shutdown_connections 2023-10-06T11:16:08.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.023+0000 7f28e9b0f700 1 -- 172.21.15.55:0/579517039 wait complete. 2023-10-06T11:16:08.037 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:16:08.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:08.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.155+0000 7f22f0b89700 1 Processor -- start 2023-10-06T11:16:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.155+0000 7f22f0b89700 1 -- start start 2023-10-06T11:16:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22f0b89700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f22ec159560 0x7f22ec0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22f0b89700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b49a0 0x7f22ec0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22f0b89700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22ec0b0760 0x7f22ec0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22f0b89700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0c60 con 0x7f22ec0b0760 2023-10-06T11:16:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22f0b89700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0f40 con 0x7f22ec159560 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22f0b89700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0b1220 con 0x7f22ec0b49a0 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22ec0b0760 0x7f22ec0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22ec0b0760 0x7f22ec0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60620/0 (socket says 172.21.15.55:60620) 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 -- 172.21.15.55:0/3778243191 learned_addr learned my addr 172.21.15.55:0/3778243191 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22e9d9b700 1 --2- 172.21.15.55:0/3778243191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b49a0 0x7f22ec0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ea59c700 1 --2- 172.21.15.55:0/3778243191 >> v2:172.21.15.142:3300/0 conn(0x7f22ec159560 0x7f22ec0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 -- 172.21.15.55:0/3778243191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b49a0 msgr2=0x7f22ec0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 --2- 172.21.15.55:0/3778243191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b49a0 0x7f22ec0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 -- 172.21.15.55:0/3778243191 >> v2:172.21.15.142:3300/0 conn(0x7f22ec159560 msgr2=0x7f22ec0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 --2- 172.21.15.55:0/3778243191 >> v2:172.21.15.142:3300/0 conn(0x7f22ec159560 0x7f22ec0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 -- 172.21.15.55:0/3778243191 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0b1500 con 0x7f22ec0b0760 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.156+0000 7f22ead9d700 1 --2- 172.21.15.55:0/3778243191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b0760 0x7f22ec0b3890 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f22ec088c80 tx=0x7f22dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c720bc12cfb73197 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22e959a700 1 -- 172.21.15.55:0/3778243191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00e070 con 0x7f22ec0b0760 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22e959a700 1 -- 172.21.15.55:0/3778243191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00b970 con 0x7f22ec0b0760 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22e959a700 1 -- 172.21.15.55:0/3778243191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0092e0 con 0x7f22ec0b0760 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 -- 172.21.15.55:0/3778243191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b0760 msgr2=0x7f22ec0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 --2- 172.21.15.55:0/3778243191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b0760 0x7f22ec0b3890 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f22ec088c80 tx=0x7f22dc009840 comp rx=0 tx=0).stop 2023-10-06T11:16:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 -- 172.21.15.55:0/3778243191 shutdown_connections 2023-10-06T11:16:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 --2- 172.21.15.55:0/3778243191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b0760 0x7f22ec0b3890 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 --2- 172.21.15.55:0/3778243191 >> v2:172.21.15.142:3300/0 conn(0x7f22ec159560 0x7f22ec0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 --2- 172.21.15.55:0/3778243191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b49a0 0x7f22ec0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 -- 172.21.15.55:0/3778243191 >> 172.21.15.55:0/3778243191 conn(0x7f22ec0997f0 msgr2=0x7f22ec06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 -- 172.21.15.55:0/3778243191 shutdown_connections 2023-10-06T11:16:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.157+0000 7f22f0b89700 1 -- 172.21.15.55:0/3778243191 wait complete. 2023-10-06T11:16:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.158+0000 7f22f0b89700 1 Processor -- start 2023-10-06T11:16:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.158+0000 7f22f0b89700 1 -- start start 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22f0b89700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b0760 0x7f22ec156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22f0b89700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 0x7f22ec09d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22f0b89700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec159560 0x7f22ec1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22f0b89700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec16d9b0 con 0x7f22ec0b49a0 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22f0b89700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec09a550 con 0x7f22ec159560 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22f0b89700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec09a830 con 0x7f22ec0b0760 2023-10-06T11:16:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22e9d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 0x7f22ec09d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22e9d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 0x7f22ec09d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60636/0 (socket says 172.21.15.55:60636) 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22e9d9b700 1 -- 172.21.15.55:0/858842063 learned_addr learned my addr 172.21.15.55:0/858842063 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22ea59c700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b0760 0x7f22ec156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.159+0000 7f22ead9d700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec159560 0x7f22ec1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e9d9b700 1 -- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b0760 msgr2=0x7f22ec156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e9d9b700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b0760 0x7f22ec156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e9d9b700 1 -- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec159560 msgr2=0x7f22ec1579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e9d9b700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec159560 0x7f22ec1579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e9d9b700 1 -- 172.21.15.55:0/858842063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc009ae0 con 0x7f22ec0b49a0 2023-10-06T11:16:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22ea59c700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b0760 0x7f22ec156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22ead9d700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec159560 0x7f22ec1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e9d9b700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 0x7f22ec09d8f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f22d400ec80 tx=0x7f22d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400c9d0 con 0x7f22ec0b49a0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400cb50 con 0x7f22ec0b49a0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec09ab10 con 0x7f22ec0b49a0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4013470 con 0x7f22ec0b49a0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.160+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec09b0d0 con 0x7f22ec0b49a0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.161+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec15bb10 con 0x7f22ec0b49a0 2023-10-06T11:16:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.161+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22d4013860 con 0x7f22ec0b49a0 2023-10-06T11:16:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.162+0000 7f22e27fc700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.162+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f22d4084ba0 con 0x7f22ec0b49a0 2023-10-06T11:16:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.162+0000 7f22ea59c700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.163+0000 7f22ea59c700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f22cc066f30 0x7f22cc0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009cd0 tx=0x7f22e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.166+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22ec15bb10 con 0x7f22ec0b49a0 2023-10-06T11:16:08.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.358+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22ec15bb10 con 0x7f22cc066f30 2023-10-06T11:16:08.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.368+0000 7f22e27fc700 1 -- 172.21.15.55:0/858842063 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308454 (secure 0 0 0) 0x7f22ec15bb10 con 0x7f22cc066f30 2023-10-06T11:16:08.373 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:08.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f22cc066f30 msgr2=0x7f22cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f22cc066f30 0x7f22cc0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009cd0 tx=0x7f22e4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 msgr2=0x7f22ec09d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 0x7f22ec09d8f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f22d400ec80 tx=0x7f22d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 shutdown_connections 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f22cc066f30 0x7f22cc0693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec159560 0x7f22ec1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec0b0760 0x7f22ec156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 --2- 172.21.15.55:0/858842063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22ec0b49a0 0x7f22ec09d8f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 >> 172.21.15.55:0/858842063 conn(0x7f22ec0997f0 msgr2=0x7f22ec0afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 shutdown_connections 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.371+0000 7f22f0b89700 1 -- 172.21.15.55:0/858842063 wait complete. 2023-10-06T11:16:08.377 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:08.385 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-10-06T11:16:06.881778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388040,"kb_used_data":9736,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586680,"statfs":{"total":773094113280,"available":770648760320,"internally_reserved":0,"allocated":9969664,"data_stored":5293824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.637051"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259329+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:54.124898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255809+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:07.558350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:06.571060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255705+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257788+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259929+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260316+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256161+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:45.238766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255529+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258540+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259642+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257049+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256845+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264443+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:54.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258112+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259580+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255539+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256100+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:36.415872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256146+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258985+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:55.934205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255195+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:34.579388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254942+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:39.095991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259077+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260861+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255178+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:43.932698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261171+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261858+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254547+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:54.043722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264892+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:03.086947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257643+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258667+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:43.497915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262747+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.618237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265967+0000","last_change":"2023-10-06T11:16:03.265967+0000","last_active":"2023-10-06T11:16:03.265967+0000","last_peered":"2023-10-06T11:16:03.265967+0000","last_clean":"2023-10-06T11:16:03.265967+0000","last_became_active":"2023-10-06T11:16:03.265053+0000","last_became_peered":"2023-10-06T11:16:03.265053+0000","last_unstale":"2023-10-06T11:16:03.265967+0000","last_undegraded":"2023-10-06T11:16:03.265967+0000","last_fullsized":"2023-10-06T11:16:03.265967+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256884+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271147+0000","last_change":"2023-10-06T11:16:03.271147+0000","last_active":"2023-10-06T11:16:03.271147+0000","last_peered":"2023-10-06T11:16:03.271147+0000","last_clean":"2023-10-06T11:16:03.271147+0000","last_became_active":"2023-10-06T11:16:03.270881+0000","last_became_peered":"2023-10-06T11:16:03.270881+0000","last_unstale":"2023-10-06T11:16:03.271147+0000","last_undegraded":"2023-10-06T11:16:03.271147+0000","last_fullsized":"2023-10-06T11:16:03.271147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262608+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:10.645661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264964+0000","last_change":"2023-10-06T11:16:03.264964+0000","last_active":"2023-10-06T11:16:03.264964+0000","last_peered":"2023-10-06T11:16:03.264964+0000","last_clean":"2023-10-06T11:16:03.264964+0000","last_became_active":"2023-10-06T11:16:03.264681+0000","last_became_peered":"2023-10-06T11:16:03.264681+0000","last_unstale":"2023-10-06T11:16:03.264964+0000","last_undegraded":"2023-10-06T11:16:03.264964+0000","last_fullsized":"2023-10-06T11:16:03.264964+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254346+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:05.498350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265607+0000","last_change":"2023-10-06T11:16:03.265607+0000","last_active":"2023-10-06T11:16:03.265607+0000","last_peered":"2023-10-06T11:16:03.265607+0000","last_clean":"2023-10-06T11:16:03.265607+0000","last_became_active":"2023-10-06T11:16:03.265304+0000","last_became_peered":"2023-10-06T11:16:03.265304+0000","last_unstale":"2023-10-06T11:16:03.265607+0000","last_undegraded":"2023-10-06T11:16:03.265607+0000","last_fullsized":"2023-10-06T11:16:03.265607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:10.608527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253382+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:34.606442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271423+0000","last_change":"2023-10-06T11:16:03.271423+0000","last_active":"2023-10-06T11:16:03.271423+0000","last_peered":"2023-10-06T11:16:03.271423+0000","last_clean":"2023-10-06T11:16:03.271423+0000","last_became_active":"2023-10-06T11:16:03.271147+0000","last_became_peered":"2023-10-06T11:16:03.271147+0000","last_unstale":"2023-10-06T11:16:03.271423+0000","last_undegraded":"2023-10-06T11:16:03.271423+0000","last_fullsized":"2023-10-06T11:16:03.271423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:26.800474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259056+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273222+0000","last_change":"2023-10-06T11:16:03.273222+0000","last_active":"2023-10-06T11:16:03.273222+0000","last_peered":"2023-10-06T11:16:03.273222+0000","last_clean":"2023-10-06T11:16:03.273222+0000","last_became_active":"2023-10-06T11:16:03.272855+0000","last_became_peered":"2023-10-06T11:16:03.272855+0000","last_unstale":"2023-10-06T11:16:03.273222+0000","last_undegraded":"2023-10-06T11:16:03.273222+0000","last_fullsized":"2023-10-06T11:16:03.273222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:10.786531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254825+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271806+0000","last_change":"2023-10-06T11:16:03.271806+0000","last_active":"2023-10-06T11:16:03.271806+0000","last_peered":"2023-10-06T11:16:03.271806+0000","last_clean":"2023-10-06T11:16:03.271806+0000","last_became_active":"2023-10-06T11:16:03.271561+0000","last_became_peered":"2023-10-06T11:16:03.271561+0000","last_unstale":"2023-10-06T11:16:03.271806+0000","last_undegraded":"2023-10-06T11:16:03.271806+0000","last_fullsized":"2023-10-06T11:16:03.271806+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254129+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:11.614960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269573+0000","last_change":"2023-10-06T11:16:03.269573+0000","last_active":"2023-10-06T11:16:03.269573+0000","last_peered":"2023-10-06T11:16:03.269573+0000","last_clean":"2023-10-06T11:16:03.269573+0000","last_became_active":"2023-10-06T11:16:03.269062+0000","last_became_peered":"2023-10-06T11:16:03.269062+0000","last_unstale":"2023-10-06T11:16:03.269573+0000","last_undegraded":"2023-10-06T11:16:03.269573+0000","last_fullsized":"2023-10-06T11:16:03.269573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:01.433177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254020+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266206+0000","last_change":"2023-10-06T11:16:03.266206+0000","last_active":"2023-10-06T11:16:03.266206+0000","last_peered":"2023-10-06T11:16:03.266206+0000","last_clean":"2023-10-06T11:16:03.266206+0000","last_became_active":"2023-10-06T11:16:03.265914+0000","last_became_peered":"2023-10-06T11:16:03.265914+0000","last_unstale":"2023-10-06T11:16:03.266206+0000","last_undegraded":"2023-10-06T11:16:03.266206+0000","last_fullsized":"2023-10-06T11:16:03.266206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:48.121863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:22.679612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266356+0000","last_change":"2023-10-06T11:16:03.266356+0000","last_active":"2023-10-06T11:16:03.266356+0000","last_peered":"2023-10-06T11:16:03.266356+0000","last_clean":"2023-10-06T11:16:03.266356+0000","last_became_active":"2023-10-06T11:16:03.265589+0000","last_became_peered":"2023-10-06T11:16:03.265589+0000","last_unstale":"2023-10-06T11:16:03.266356+0000","last_undegraded":"2023-10-06T11:16:03.266356+0000","last_fullsized":"2023-10-06T11:16:03.266356+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.931454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259480+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266459+0000","last_change":"2023-10-06T11:16:03.266459+0000","last_active":"2023-10-06T11:16:03.266459+0000","last_peered":"2023-10-06T11:16:03.266459+0000","last_clean":"2023-10-06T11:16:03.266459+0000","last_became_active":"2023-10-06T11:16:03.266184+0000","last_became_peered":"2023-10-06T11:16:03.266184+0000","last_unstale":"2023-10-06T11:16:03.266459+0000","last_undegraded":"2023-10-06T11:16:03.266459+0000","last_fullsized":"2023-10-06T11:16:03.266459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260649+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269548+0000","last_change":"2023-10-06T11:16:03.269548+0000","last_active":"2023-10-06T11:16:03.269548+0000","last_peered":"2023-10-06T11:16:03.269548+0000","last_clean":"2023-10-06T11:16:03.269548+0000","last_became_active":"2023-10-06T11:16:03.269297+0000","last_became_peered":"2023-10-06T11:16:03.269297+0000","last_unstale":"2023-10-06T11:16:03.269548+0000","last_undegraded":"2023-10-06T11:16:03.269548+0000","last_fullsized":"2023-10-06T11:16:03.269548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.267342+0000","last_change":"2023-10-06T11:16:03.267342+0000","last_active":"2023-10-06T11:16:03.267342+0000","last_peered":"2023-10-06T11:16:03.267342+0000","last_clean":"2023-10-06T11:16:03.267342+0000","last_became_active":"2023-10-06T11:16:03.266327+0000","last_became_peered":"2023-10-06T11:16:03.266327+0000","last_unstale":"2023-10-06T11:16:03.267342+0000","last_undegraded":"2023-10-06T11:16:03.267342+0000","last_fullsized":"2023-10-06T11:16:03.267342+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:23.538191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261470+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:39.333083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.275983+0000","last_change":"2023-10-06T11:16:03.275983+0000","last_active":"2023-10-06T11:16:03.275983+0000","last_peered":"2023-10-06T11:16:03.275983+0000","last_clean":"2023-10-06T11:16:03.275983+0000","last_became_active":"2023-10-06T11:16:03.275473+0000","last_became_peered":"2023-10-06T11:16:03.275473+0000","last_unstale":"2023-10-06T11:16:03.275983+0000","last_undegraded":"2023-10-06T11:16:03.275983+0000","last_fullsized":"2023-10-06T11:16:03.275983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:41.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:03.103375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264078+0000","last_change":"2023-10-06T11:16:03.264078+0000","last_active":"2023-10-06T11:16:03.264078+0000","last_peered":"2023-10-06T11:16:03.264078+0000","last_clean":"2023-10-06T11:16:03.264078+0000","last_became_active":"2023-10-06T11:16:03.263683+0000","last_became_peered":"2023-10-06T11:16:03.263683+0000","last_unstale":"2023-10-06T11:16:03.264078+0000","last_undegraded":"2023-10-06T11:16:03.264078+0000","last_fullsized":"2023-10-06T11:16:03.264078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262776+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:33.366065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271127+0000","last_change":"2023-10-06T11:16:03.271127+0000","last_active":"2023-10-06T11:16:03.271127+0000","last_peered":"2023-10-06T11:16:03.271127+0000","last_clean":"2023-10-06T11:16:03.271127+0000","last_became_active":"2023-10-06T11:16:03.270133+0000","last_became_peered":"2023-10-06T11:16:03.270133+0000","last_unstale":"2023-10-06T11:16:03.271127+0000","last_undegraded":"2023-10-06T11:16:03.271127+0000","last_fullsized":"2023-10-06T11:16:03.271127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:50.310646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253489+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265577+0000","last_change":"2023-10-06T11:16:03.265577+0000","last_active":"2023-10-06T11:16:03.265577+0000","last_peered":"2023-10-06T11:16:03.265577+0000","last_clean":"2023-10-06T11:16:03.265577+0000","last_became_active":"2023-10-06T11:16:03.265337+0000","last_became_peered":"2023-10-06T11:16:03.265337+0000","last_unstale":"2023-10-06T11:16:03.265577+0000","last_undegraded":"2023-10-06T11:16:03.265577+0000","last_fullsized":"2023-10-06T11:16:03.265577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:29.052675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258850+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:08.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271695+0000","last_change":"2023-10-06T11:16:03.271695+0000","last_active":"2023-10-06T11:16:03.271695+0000","last_peered":"2023-10-06T11:16:03.271695+0000","last_clean":"2023-10-06T11:16:03.271695+0000","last_became_active":"2023-10-06T11:16:03.271426+0000","last_became_peered":"2023-10-06T11:16:03.271426+0000","last_unstale":"2023-10-06T11:16:03.271695+0000","last_undegraded":"2023-10-06T11:16:03.271695+0000","last_fullsized":"2023-10-06T11:16:03.271695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:58.625857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262201+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:56.438390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.259310+0000","last_change":"2023-10-06T11:16:03.259310+0000","last_active":"2023-10-06T11:16:03.259310+0000","last_peered":"2023-10-06T11:16:03.259310+0000","last_clean":"2023-10-06T11:16:03.259310+0000","last_became_active":"2023-10-06T11:16:03.259025+0000","last_became_peered":"2023-10-06T11:16:03.259025+0000","last_unstale":"2023-10-06T11:16:03.259310+0000","last_undegraded":"2023-10-06T11:16:03.259310+0000","last_fullsized":"2023-10-06T11:16:03.259310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:02.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258209+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265765+0000","last_change":"2023-10-06T11:16:03.265765+0000","last_active":"2023-10-06T11:16:03.265765+0000","last_peered":"2023-10-06T11:16:03.265765+0000","last_clean":"2023-10-06T11:16:03.265765+0000","last_became_active":"2023-10-06T11:16:03.265563+0000","last_became_peered":"2023-10-06T11:16:03.265563+0000","last_unstale":"2023-10-06T11:16:03.265765+0000","last_undegraded":"2023-10-06T11:16:03.265765+0000","last_fullsized":"2023-10-06T11:16:03.265765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:17.485665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.263556+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:02.439611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265381+0000","last_change":"2023-10-06T11:16:03.265381+0000","last_active":"2023-10-06T11:16:03.265381+0000","last_peered":"2023-10-06T11:16:03.265381+0000","last_clean":"2023-10-06T11:16:03.265381+0000","last_became_active":"2023-10-06T11:16:03.264912+0000","last_became_peered":"2023-10-06T11:16:03.264912+0000","last_unstale":"2023-10-06T11:16:03.265381+0000","last_undegraded":"2023-10-06T11:16:03.265381+0000","last_fullsized":"2023-10-06T11:16:03.265381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:43.791751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254074+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:44.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273426+0000","last_change":"2023-10-06T11:16:03.273426+0000","last_active":"2023-10-06T11:16:03.273426+0000","last_peered":"2023-10-06T11:16:03.273426+0000","last_clean":"2023-10-06T11:16:03.273426+0000","last_became_active":"2023-10-06T11:16:03.273151+0000","last_became_peered":"2023-10-06T11:16:03.273151+0000","last_unstale":"2023-10-06T11:16:03.273426+0000","last_undegraded":"2023-10-06T11:16:03.273426+0000","last_fullsized":"2023-10-06T11:16:03.273426+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258548+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:24.031979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.270536+0000","last_change":"2023-10-06T11:16:03.270536+0000","last_active":"2023-10-06T11:16:03.270536+0000","last_peered":"2023-10-06T11:16:03.270536+0000","last_clean":"2023-10-06T11:16:03.270536+0000","last_became_active":"2023-10-06T11:16:03.270254+0000","last_became_peered":"2023-10-06T11:16:03.270254+0000","last_unstale":"2023-10-06T11:16:03.270536+0000","last_undegraded":"2023-10-06T11:16:03.270536+0000","last_fullsized":"2023-10-06T11:16:03.270536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:12.895297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257433+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271934+0000","last_change":"2023-10-06T11:16:03.271934+0000","last_active":"2023-10-06T11:16:03.271934+0000","last_peered":"2023-10-06T11:16:03.271934+0000","last_clean":"2023-10-06T11:16:03.271934+0000","last_became_active":"2023-10-06T11:16:03.271636+0000","last_became_peered":"2023-10-06T11:16:03.271636+0000","last_unstale":"2023-10-06T11:16:03.271934+0000","last_undegraded":"2023-10-06T11:16:03.271934+0000","last_fullsized":"2023-10-06T11:16:03.271934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:50.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269336+0000","last_change":"2023-10-06T11:16:03.269336+0000","last_active":"2023-10-06T11:16:03.269336+0000","last_peered":"2023-10-06T11:16:03.269336+0000","last_clean":"2023-10-06T11:16:03.269336+0000","last_became_active":"2023-10-06T11:16:03.269072+0000","last_became_peered":"2023-10-06T11:16:03.269072+0000","last_unstale":"2023-10-06T11:16:03.269336+0000","last_undegraded":"2023-10-06T11:16:03.269336+0000","last_fullsized":"2023-10-06T11:16:03.269336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.151151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250171+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:02.250171+0000","last_peered":"2023-10-06T11:16:02.250171+0000","last_clean":"2023-10-06T11:16:02.250171+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:02.250171+0000","last_undegraded":"2023-10-06T11:16:02.250171+0000","last_fullsized":"2023-10-06T11:16:02.250171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259252+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.272428+0000","last_change":"2023-10-06T11:16:03.272428+0000","last_active":"2023-10-06T11:16:03.272428+0000","last_peered":"2023-10-06T11:16:03.272428+0000","last_clean":"2023-10-06T11:16:03.272428+0000","last_became_active":"2023-10-06T11:16:03.272148+0000","last_became_peered":"2023-10-06T11:16:03.272148+0000","last_unstale":"2023-10-06T11:16:03.272428+0000","last_undegraded":"2023-10-06T11:16:03.272428+0000","last_fullsized":"2023-10-06T11:16:03.272428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247882+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:02.247882+0000","last_peered":"2023-10-06T11:16:02.247882+0000","last_clean":"2023-10-06T11:16:02.247882+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:02.247882+0000","last_undegraded":"2023-10-06T11:16:02.247882+0000","last_fullsized":"2023-10-06T11:16:02.247882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253854+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:03.569628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266437+0000","last_change":"2023-10-06T11:16:03.266437+0000","last_active":"2023-10-06T11:16:03.266437+0000","last_peered":"2023-10-06T11:16:03.266437+0000","last_clean":"2023-10-06T11:16:03.266437+0000","last_became_active":"2023-10-06T11:16:03.266161+0000","last_became_peered":"2023-10-06T11:16:03.266161+0000","last_unstale":"2023-10-06T11:16:03.266437+0000","last_undegraded":"2023-10-06T11:16:03.266437+0000","last_fullsized":"2023-10-06T11:16:03.266437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.245711+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:02.245711+0000","last_peered":"2023-10-06T11:16:02.245711+0000","last_clean":"2023-10-06T11:16:02.245711+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:02.245711+0000","last_undegraded":"2023-10-06T11:16:02.245711+0000","last_fullsized":"2023-10-06T11:16:02.245711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:22.046036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271072+0000","last_change":"2023-10-06T11:16:03.271072+0000","last_active":"2023-10-06T11:16:03.271072+0000","last_peered":"2023-10-06T11:16:03.271072+0000","last_clean":"2023-10-06T11:16:03.271072+0000","last_became_active":"2023-10-06T11:16:03.270859+0000","last_became_peered":"2023-10-06T11:16:03.270859+0000","last_unstale":"2023-10-06T11:16:03.271072+0000","last_undegraded":"2023-10-06T11:16:03.271072+0000","last_fullsized":"2023-10-06T11:16:03.271072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247883+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:02.247883+0000","last_peered":"2023-10-06T11:16:02.247883+0000","last_clean":"2023-10-06T11:16:02.247883+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:02.247883+0000","last_undegraded":"2023-10-06T11:16:02.247883+0000","last_fullsized":"2023-10-06T11:16:02.247883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260159+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266154+0000","last_change":"2023-10-06T11:16:03.266154+0000","last_active":"2023-10-06T11:16:03.266154+0000","last_peered":"2023-10-06T11:16:03.266154+0000","last_clean":"2023-10-06T11:16:03.266154+0000","last_became_active":"2023-10-06T11:16:03.265870+0000","last_became_peered":"2023-10-06T11:16:03.265870+0000","last_unstale":"2023-10-06T11:16:03.266154+0000","last_undegraded":"2023-10-06T11:16:03.266154+0000","last_fullsized":"2023-10-06T11:16:03.266154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:43.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251429+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:02.251429+0000","last_peered":"2023-10-06T11:16:02.251429+0000","last_clean":"2023-10-06T11:16:02.251429+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:02.251429+0000","last_undegraded":"2023-10-06T11:16:02.251429+0000","last_fullsized":"2023-10-06T11:16:02.251429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258004+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.579290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265091+0000","last_change":"2023-10-06T11:16:03.265091+0000","last_active":"2023-10-06T11:16:03.265091+0000","last_peered":"2023-10-06T11:16:03.265091+0000","last_clean":"2023-10-06T11:16:03.265091+0000","last_became_active":"2023-10-06T11:16:03.264806+0000","last_became_peered":"2023-10-06T11:16:03.264806+0000","last_unstale":"2023-10-06T11:16:03.265091+0000","last_undegraded":"2023-10-06T11:16:03.265091+0000","last_fullsized":"2023-10-06T11:16:03.265091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:40.908155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260202+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:55.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273491+0000","last_change":"2023-10-06T11:16:03.273491+0000","last_active":"2023-10-06T11:16:03.273491+0000","last_peered":"2023-10-06T11:16:03.273491+0000","last_clean":"2023-10-06T11:16:03.273491+0000","last_became_active":"2023-10-06T11:16:03.273217+0000","last_became_peered":"2023-10-06T11:16:03.273217+0000","last_unstale":"2023-10-06T11:16:03.273491+0000","last_undegraded":"2023-10-06T11:16:03.273491+0000","last_fullsized":"2023-10-06T11:16:03.273491+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:04.630874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250469+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:02.250469+0000","last_peered":"2023-10-06T11:16:02.250469+0000","last_clean":"2023-10-06T11:16:02.250469+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:02.250469+0000","last_undegraded":"2023-10-06T11:16:02.250469+0000","last_fullsized":"2023-10-06T11:16:02.250469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:51.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.268311+0000","last_change":"2023-10-06T11:16:03.268311+0000","last_active":"2023-10-06T11:16:03.268311+0000","last_peered":"2023-10-06T11:16:03.268311+0000","last_clean":"2023-10-06T11:16:03.268311+0000","last_became_active":"2023-10-06T11:16:03.266368+0000","last_became_peered":"2023-10-06T11:16:03.266368+0000","last_unstale":"2023-10-06T11:16:03.268311+0000","last_undegraded":"2023-10-06T11:16:03.268311+0000","last_fullsized":"2023-10-06T11:16:03.268311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.252377+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:02.252377+0000","last_peered":"2023-10-06T11:16:02.252377+0000","last_clean":"2023-10-06T11:16:02.252377+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:02.252377+0000","last_undegraded":"2023-10-06T11:16:02.252377+0000","last_fullsized":"2023-10-06T11:16:02.252377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.378}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.26200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":0.496}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.434},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.315},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27900000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.629}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:08.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:08.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.543+0000 7f3331730700 1 Processor -- start 2023-10-06T11:16:08.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.543+0000 7f3331730700 1 -- start start 2023-10-06T11:16:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f3331730700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f332c159440 0x7f332c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f3331730700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 0x7f332c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f3331730700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0cb7a0 con 0x7f332c0cc170 2023-10-06T11:16:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f3331730700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0b0860 con 0x7f332c159440 2023-10-06T11:16:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f3331730700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0cb150 con 0x7f332c0b35d0 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f332b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 0x7f332c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f332b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 0x7f332c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:49706/0 (socket says 172.21.15.55:49706) 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f332bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f332c159440 0x7f332c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.544+0000 7f332b7fe700 1 -- 172.21.15.55:0/4168579617 learned_addr learned my addr 172.21.15.55:0/4168579617 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332affd700 1 -- 172.21.15.55:0/4168579617 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573382375 0 0) 0x7f332c0cb7a0 con 0x7f332c0cc170 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332affd700 1 -- 172.21.15.55:0/4168579617 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3318003570 con 0x7f332c0cc170 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332bfff700 1 -- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 msgr2=0x7f332c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332bfff700 1 --2- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 0x7f332c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332bfff700 1 -- 172.21.15.55:0/4168579617 >> v1:172.21.15.142:6789/0 conn(0x7f332c0cc170 legacy=0x7f332c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332bfff700 1 -- 172.21.15.55:0/4168579617 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0cb430 con 0x7f332c159440 2023-10-06T11:16:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332b7fe700 1 --2- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 0x7f332c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332bfff700 1 --2- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b3090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f331c0098e0 tx=0x7f331c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46dd31a0ac56c92e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332affd700 1 -- 172.21.15.55:0/4168579617 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c011630 con 0x7f332c159440 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332affd700 1 -- 172.21.15.55:0/4168579617 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c011790 con 0x7f332c159440 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.545+0000 7f332affd700 1 -- 172.21.15.55:0/4168579617 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c011b30 con 0x7f332c159440 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 -- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 msgr2=0x7f332c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 --2- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b3090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f331c0098e0 tx=0x7f331c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 -- 172.21.15.55:0/4168579617 shutdown_connections 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 --2- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b3090 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 --2- 172.21.15.55:0/4168579617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0b35d0 0x7f332c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 -- 172.21.15.55:0/4168579617 >> 172.21.15.55:0/4168579617 conn(0x7f332c06ece0 msgr2=0x7f332c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 -- 172.21.15.55:0/4168579617 shutdown_connections 2023-10-06T11:16:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.546+0000 7f3331730700 1 -- 172.21.15.55:0/4168579617 wait complete. 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.547+0000 7f3331730700 1 Processor -- start 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.547+0000 7f3331730700 1 -- start start 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3331730700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 0x7f332c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3331730700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0cc170 0x7f332c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3331730700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3331730700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0cf740 con 0x7f332c0b35d0 2023-10-06T11:16:08.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3331730700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0ce330 con 0x7f332c159440 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3331730700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0ce590 con 0x7f332c0cc170 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 0x7f332c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 0x7f332c0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60640/0 (socket says 172.21.15.55:60640) 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 -- 172.21.15.55:0/2764401300 learned_addr learned my addr 172.21.15.55:0/2764401300 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332b7fe700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0cc170 0x7f332c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3330f2f700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 -- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0cc170 msgr2=0x7f332c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0cc170 0x7f332c0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 -- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 msgr2=0x7f332c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 -- 172.21.15.55:0/2764401300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140094f0 con 0x7f332c0b35d0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3330f2f700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f332bfff700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 0x7f332c0cddf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f332c069150 tx=0x7f331c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.548+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c011b10 con 0x7f332c0b35d0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.549+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c000cc0 con 0x7f332c0b35d0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.549+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c009420 con 0x7f332c0b35d0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.549+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c023600 con 0x7f332c0b35d0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.549+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c0ceb50 con 0x7f332c0b35d0 2023-10-06T11:16:08.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.549+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c05f230 con 0x7f332c0b35d0 2023-10-06T11:16:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.550+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f331c02c3b0 con 0x7f332c0b35d0 2023-10-06T11:16:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.550+0000 7f3323fff700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f330c066f60 0x7f330c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.551+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f331c085b30 con 0x7f332c0b35d0 2023-10-06T11:16:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.551+0000 7f332b7fe700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f330c066f60 0x7f330c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.551+0000 7f332b7fe700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f330c066f60 0x7f330c069410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f332c0c7280 tx=0x7f3314009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.555+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f331c052b80 con 0x7f332c0b35d0 2023-10-06T11:16:08.571 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-10-06T11:16:08.569+0000 7f9fbde4a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.744+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f332c159810 con 0x7f330c066f60 2023-10-06T11:16:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.753+0000 7f3323fff700 1 -- 172.21.15.55:0/2764401300 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308454 (secure 0 0 0) 0x7f332c159810 con 0x7f330c066f60 2023-10-06T11:16:08.758 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f330c066f60 msgr2=0x7f330c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f330c066f60 0x7f330c069410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f332c0c7280 tx=0x7f3314009250 comp rx=0 tx=0).stop 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 msgr2=0x7f332c0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 0x7f332c0cddf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f332c069150 tx=0x7f331c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 shutdown_connections 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f330c066f60 0x7f330c069410 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c0b35d0 0x7f332c0cddf0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f332c159440 0x7f332c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 --2- 172.21.15.55:0/2764401300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f332c0cc170 0x7f332c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 >> 172.21.15.55:0/2764401300 conn(0x7f332c06ece0 msgr2=0x7f332c156590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 shutdown_connections 2023-10-06T11:16:08.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.756+0000 7f3331730700 1 -- 172.21.15.55:0/2764401300 wait complete. 2023-10-06T11:16:08.761 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:08.770 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-10-06T11:16:06.881778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388040,"kb_used_data":9736,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586680,"statfs":{"total":773094113280,"available":770648760320,"internally_reserved":0,"allocated":9969664,"data_stored":5293824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.637051"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259329+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:54.124898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255809+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:07.558350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:06.571060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255705+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257788+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259929+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260316+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256161+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:45.238766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255529+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258540+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259642+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257049+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256845+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264443+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:54.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258112+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259580+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255539+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256100+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:36.415872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256146+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258985+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:55.934205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255195+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:34.579388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254942+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:39.095991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259077+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260861+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255178+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:43.932698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261171+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261858+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254547+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:54.043722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264892+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:03.086947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257643+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258667+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:43.497915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262747+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.618237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265967+0000","last_change":"2023-10-06T11:16:03.265967+0000","last_active":"2023-10-06T11:16:03.265967+0000","last_peered":"2023-10-06T11:16:03.265967+0000","last_clean":"2023-10-06T11:16:03.265967+0000","last_became_active":"2023-10-06T11:16:03.265053+0000","last_became_peered":"2023-10-06T11:16:03.265053+0000","last_unstale":"2023-10-06T11:16:03.265967+0000","last_undegraded":"2023-10-06T11:16:03.265967+0000","last_fullsized":"2023-10-06T11:16:03.265967+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256884+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271147+0000","last_change":"2023-10-06T11:16:03.271147+0000","last_active":"2023-10-06T11:16:03.271147+0000","last_peered":"2023-10-06T11:16:03.271147+0000","last_clean":"2023-10-06T11:16:03.271147+0000","last_became_active":"2023-10-06T11:16:03.270881+0000","last_became_peered":"2023-10-06T11:16:03.270881+0000","last_unstale":"2023-10-06T11:16:03.271147+0000","last_undegraded":"2023-10-06T11:16:03.271147+0000","last_fullsized":"2023-10-06T11:16:03.271147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262608+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:10.645661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264964+0000","last_change":"2023-10-06T11:16:03.264964+0000","last_active":"2023-10-06T11:16:03.264964+0000","last_peered":"2023-10-06T11:16:03.264964+0000","last_clean":"2023-10-06T11:16:03.264964+0000","last_became_active":"2023-10-06T11:16:03.264681+0000","last_became_peered":"2023-10-06T11:16:03.264681+0000","last_unstale":"2023-10-06T11:16:03.264964+0000","last_undegraded":"2023-10-06T11:16:03.264964+0000","last_fullsized":"2023-10-06T11:16:03.264964+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254346+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:05.498350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265607+0000","last_change":"2023-10-06T11:16:03.265607+0000","last_active":"2023-10-06T11:16:03.265607+0000","last_peered":"2023-10-06T11:16:03.265607+0000","last_clean":"2023-10-06T11:16:03.265607+0000","last_became_active":"2023-10-06T11:16:03.265304+0000","last_became_peered":"2023-10-06T11:16:03.265304+0000","last_unstale":"2023-10-06T11:16:03.265607+0000","last_undegraded":"2023-10-06T11:16:03.265607+0000","last_fullsized":"2023-10-06T11:16:03.265607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:10.608527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253382+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:34.606442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271423+0000","last_change":"2023-10-06T11:16:03.271423+0000","last_active":"2023-10-06T11:16:03.271423+0000","last_peered":"2023-10-06T11:16:03.271423+0000","last_clean":"2023-10-06T11:16:03.271423+0000","last_became_active":"2023-10-06T11:16:03.271147+0000","last_became_peered":"2023-10-06T11:16:03.271147+0000","last_unstale":"2023-10-06T11:16:03.271423+0000","last_undegraded":"2023-10-06T11:16:03.271423+0000","last_fullsized":"2023-10-06T11:16:03.271423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:26.800474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259056+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273222+0000","last_change":"2023-10-06T11:16:03.273222+0000","last_active":"2023-10-06T11:16:03.273222+0000","last_peered":"2023-10-06T11:16:03.273222+0000","last_clean":"2023-10-06T11:16:03.273222+0000","last_became_active":"2023-10-06T11:16:03.272855+0000","last_became_peered":"2023-10-06T11:16:03.272855+0000","last_unstale":"2023-10-06T11:16:03.273222+0000","last_undegraded":"2023-10-06T11:16:03.273222+0000","last_fullsized":"2023-10-06T11:16:03.273222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:10.786531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254825+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271806+0000","last_change":"2023-10-06T11:16:03.271806+0000","last_active":"2023-10-06T11:16:03.271806+0000","last_peered":"2023-10-06T11:16:03.271806+0000","last_clean":"2023-10-06T11:16:03.271806+0000","last_became_active":"2023-10-06T11:16:03.271561+0000","last_became_peered":"2023-10-06T11:16:03.271561+0000","last_unstale":"2023-10-06T11:16:03.271806+0000","last_undegraded":"2023-10-06T11:16:03.271806+0000","last_fullsized":"2023-10-06T11:16:03.271806+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254129+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:11.614960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269573+0000","last_change":"2023-10-06T11:16:03.269573+0000","last_active":"2023-10-06T11:16:03.269573+0000","last_peered":"2023-10-06T11:16:03.269573+0000","last_clean":"2023-10-06T11:16:03.269573+0000","last_became_active":"2023-10-06T11:16:03.269062+0000","last_became_peered":"2023-10-06T11:16:03.269062+0000","last_unstale":"2023-10-06T11:16:03.269573+0000","last_undegraded":"2023-10-06T11:16:03.269573+0000","last_fullsized":"2023-10-06T11:16:03.269573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:01.433177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254020+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266206+0000","last_change":"2023-10-06T11:16:03.266206+0000","last_active":"2023-10-06T11:16:03.266206+0000","last_peered":"2023-10-06T11:16:03.266206+0000","last_clean":"2023-10-06T11:16:03.266206+0000","last_became_active":"2023-10-06T11:16:03.265914+0000","last_became_peered":"2023-10-06T11:16:03.265914+0000","last_unstale":"2023-10-06T11:16:03.266206+0000","last_undegraded":"2023-10-06T11:16:03.266206+0000","last_fullsized":"2023-10-06T11:16:03.266206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:48.121863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:22.679612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266356+0000","last_change":"2023-10-06T11:16:03.266356+0000","last_active":"2023-10-06T11:16:03.266356+0000","last_peered":"2023-10-06T11:16:03.266356+0000","last_clean":"2023-10-06T11:16:03.266356+0000","last_became_active":"2023-10-06T11:16:03.265589+0000","last_became_peered":"2023-10-06T11:16:03.265589+0000","last_unstale":"2023-10-06T11:16:03.266356+0000","last_undegraded":"2023-10-06T11:16:03.266356+0000","last_fullsized":"2023-10-06T11:16:03.266356+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.931454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259480+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266459+0000","last_change":"2023-10-06T11:16:03.266459+0000","last_active":"2023-10-06T11:16:03.266459+0000","last_peered":"2023-10-06T11:16:03.266459+0000","last_clean":"2023-10-06T11:16:03.266459+0000","last_became_active":"2023-10-06T11:16:03.266184+0000","last_became_peered":"2023-10-06T11:16:03.266184+0000","last_unstale":"2023-10-06T11:16:03.266459+0000","last_undegraded":"2023-10-06T11:16:03.266459+0000","last_fullsized":"2023-10-06T11:16:03.266459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260649+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269548+0000","last_change":"2023-10-06T11:16:03.269548+0000","last_active":"2023-10-06T11:16:03.269548+0000","last_peered":"2023-10-06T11:16:03.269548+0000","last_clean":"2023-10-06T11:16:03.269548+0000","last_became_active":"2023-10-06T11:16:03.269297+0000","last_became_peered":"2023-10-06T11:16:03.269297+0000","last_unstale":"2023-10-06T11:16:03.269548+0000","last_undegraded":"2023-10-06T11:16:03.269548+0000","last_fullsized":"2023-10-06T11:16:03.269548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.267342+0000","last_change":"2023-10-06T11:16:03.267342+0000","last_active":"2023-10-06T11:16:03.267342+0000","last_peered":"2023-10-06T11:16:03.267342+0000","last_clean":"2023-10-06T11:16:03.267342+0000","last_became_active":"2023-10-06T11:16:03.266327+0000","last_became_peered":"2023-10-06T11:16:03.266327+0000","last_unstale":"2023-10-06T11:16:03.267342+0000","last_undegraded":"2023-10-06T11:16:03.267342+0000","last_fullsized":"2023-10-06T11:16:03.267342+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:23.538191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261470+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:39.333083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.275983+0000","last_change":"2023-10-06T11:16:03.275983+0000","last_active":"2023-10-06T11:16:03.275983+0000","last_peered":"2023-10-06T11:16:03.275983+0000","last_clean":"2023-10-06T11:16:03.275983+0000","last_became_active":"2023-10-06T11:16:03.275473+0000","last_became_peered":"2023-10-06T11:16:03.275473+0000","last_unstale":"2023-10-06T11:16:03.275983+0000","last_undegraded":"2023-10-06T11:16:03.275983+0000","last_fullsized":"2023-10-06T11:16:03.275983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:41.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:03.103375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264078+0000","last_change":"2023-10-06T11:16:03.264078+0000","last_active":"2023-10-06T11:16:03.264078+0000","last_peered":"2023-10-06T11:16:03.264078+0000","last_clean":"2023-10-06T11:16:03.264078+0000","last_became_active":"2023-10-06T11:16:03.263683+0000","last_became_peered":"2023-10-06T11:16:03.263683+0000","last_unstale":"2023-10-06T11:16:03.264078+0000","last_undegraded":"2023-10-06T11:16:03.264078+0000","last_fullsized":"2023-10-06T11:16:03.264078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262776+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:33.366065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271127+0000","last_change":"2023-10-06T11:16:03.271127+0000","last_active":"2023-10-06T11:16:03.271127+0000","last_peered":"2023-10-06T11:16:03.271127+0000","last_clean":"2023-10-06T11:16:03.271127+0000","last_became_active":"2023-10-06T11:16:03.270133+0000","last_became_peered":"2023-10-06T11:16:03.270133+0000","last_unstale":"2023-10-06T11:16:03.271127+0000","last_undegraded":"2023-10-06T11:16:03.271127+0000","last_fullsized":"2023-10-06T11:16:03.271127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:50.310646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253489+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265577+0000","last_change":"2023-10-06T11:16:03.265577+0000","last_active":"2023-10-06T11:16:03.265577+0000","last_peered":"2023-10-06T11:16:03.265577+0000","last_clean":"2023-10-06T11:16:03.265577+0000","last_became_active":"2023-10-06T11:16:03.265337+0000","last_became_peered":"2023-10-06T11:16:03.265337+0000","last_unstale":"2023-10-06T11:16:03.265577+0000","last_undegraded":"2023-10-06T11:16:03.265577+0000","last_fullsized":"2023-10-06T11:16:03.265577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:29.052675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258850+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:08.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271695+0000","last_change":"2023-10-06T11:16:03.271695+0000","last_active":"2023-10-06T11:16:03.271695+0000","last_peered":"2023-10-06T11:16:03.271695+0000","last_clean":"2023-10-06T11:16:03.271695+0000","last_became_active":"2023-10-06T11:16:03.271426+0000","last_became_peered":"2023-10-06T11:16:03.271426+0000","last_unstale":"2023-10-06T11:16:03.271695+0000","last_undegraded":"2023-10-06T11:16:03.271695+0000","last_fullsized":"2023-10-06T11:16:03.271695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:58.625857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262201+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:56.438390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.259310+0000","last_change":"2023-10-06T11:16:03.259310+0000","last_active":"2023-10-06T11:16:03.259310+0000","last_peered":"2023-10-06T11:16:03.259310+0000","last_clean":"2023-10-06T11:16:03.259310+0000","last_became_active":"2023-10-06T11:16:03.259025+0000","last_became_peered":"2023-10-06T11:16:03.259025+0000","last_unstale":"2023-10-06T11:16:03.259310+0000","last_undegraded":"2023-10-06T11:16:03.259310+0000","last_fullsized":"2023-10-06T11:16:03.259310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:02.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258209+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265765+0000","last_change":"2023-10-06T11:16:03.265765+0000","last_active":"2023-10-06T11:16:03.265765+0000","last_peered":"2023-10-06T11:16:03.265765+0000","last_clean":"2023-10-06T11:16:03.265765+0000","last_became_active":"2023-10-06T11:16:03.265563+0000","last_became_peered":"2023-10-06T11:16:03.265563+0000","last_unstale":"2023-10-06T11:16:03.265765+0000","last_undegraded":"2023-10-06T11:16:03.265765+0000","last_fullsized":"2023-10-06T11:16:03.265765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:17.485665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.263556+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:02.439611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265381+0000","last_change":"2023-10-06T11:16:03.265381+0000","last_active":"2023-10-06T11:16:03.265381+0000","last_peered":"2023-10-06T11:16:03.265381+0000","last_clean":"2023-10-06T11:16:03.265381+0000","last_became_active":"2023-10-06T11:16:03.264912+0000","last_became_peered":"2023-10-06T11:16:03.264912+0000","last_unstale":"2023-10-06T11:16:03.265381+0000","last_undegraded":"2023-10-06T11:16:03.265381+0000","last_fullsized":"2023-10-06T11:16:03.265381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:43.791751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254074+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:44.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273426+0000","last_change":"2023-10-06T11:16:03.273426+0000","last_active":"2023-10-06T11:16:03.273426+0000","last_peered":"2023-10-06T11:16:03.273426+0000","last_clean":"2023-10-06T11:16:03.273426+0000","last_became_active":"2023-10-06T11:16:03.273151+0000","last_became_peered":"2023-10-06T11:16:03.273151+0000","last_unstale":"2023-10-06T11:16:03.273426+0000","last_undegraded":"2023-10-06T11:16:03.273426+0000","last_fullsized":"2023-10-06T11:16:03.273426+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258548+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:24.031979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.270536+0000","last_change":"2023-10-06T11:16:03.270536+0000","last_active":"2023-10-06T11:16:03.270536+0000","last_peered":"2023-10-06T11:16:03.270536+0000","last_clean":"2023-10-06T11:16:03.270536+0000","last_became_active":"2023-10-06T11:16:03.270254+0000","last_became_peered":"2023-10-06T11:16:03.270254+0000","last_unstale":"2023-10-06T11:16:03.270536+0000","last_undegraded":"2023-10-06T11:16:03.270536+0000","last_fullsized":"2023-10-06T11:16:03.270536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:12.895297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257433+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271934+0000","last_change":"2023-10-06T11:16:03.271934+0000","last_active":"2023-10-06T11:16:03.271934+0000","last_peered":"2023-10-06T11:16:03.271934+0000","last_clean":"2023-10-06T11:16:03.271934+0000","last_became_active":"2023-10-06T11:16:03.271636+0000","last_became_peered":"2023-10-06T11:16:03.271636+0000","last_unstale":"2023-10-06T11:16:03.271934+0000","last_undegraded":"2023-10-06T11:16:03.271934+0000","last_fullsized":"2023-10-06T11:16:03.271934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:50.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269336+0000","last_change":"2023-10-06T11:16:03.269336+0000","last_active":"2023-10-06T11:16:03.269336+0000","last_peered":"2023-10-06T11:16:03.269336+0000","last_clean":"2023-10-06T11:16:03.269336+0000","last_became_active":"2023-10-06T11:16:03.269072+0000","last_became_peered":"2023-10-06T11:16:03.269072+0000","last_unstale":"2023-10-06T11:16:03.269336+0000","last_undegraded":"2023-10-06T11:16:03.269336+0000","last_fullsized":"2023-10-06T11:16:03.269336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.151151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250171+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:02.250171+0000","last_peered":"2023-10-06T11:16:02.250171+0000","last_clean":"2023-10-06T11:16:02.250171+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:02.250171+0000","last_undegraded":"2023-10-06T11:16:02.250171+0000","last_fullsized":"2023-10-06T11:16:02.250171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259252+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.272428+0000","last_change":"2023-10-06T11:16:03.272428+0000","last_active":"2023-10-06T11:16:03.272428+0000","last_peered":"2023-10-06T11:16:03.272428+0000","last_clean":"2023-10-06T11:16:03.272428+0000","last_became_active":"2023-10-06T11:16:03.272148+0000","last_became_peered":"2023-10-06T11:16:03.272148+0000","last_unstale":"2023-10-06T11:16:03.272428+0000","last_undegraded":"2023-10-06T11:16:03.272428+0000","last_fullsized":"2023-10-06T11:16:03.272428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247882+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:02.247882+0000","last_peered":"2023-10-06T11:16:02.247882+0000","last_clean":"2023-10-06T11:16:02.247882+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:02.247882+0000","last_undegraded":"2023-10-06T11:16:02.247882+0000","last_fullsized":"2023-10-06T11:16:02.247882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253854+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:03.569628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266437+0000","last_change":"2023-10-06T11:16:03.266437+0000","last_active":"2023-10-06T11:16:03.266437+0000","last_peered":"2023-10-06T11:16:03.266437+0000","last_clean":"2023-10-06T11:16:03.266437+0000","last_became_active":"2023-10-06T11:16:03.266161+0000","last_became_peered":"2023-10-06T11:16:03.266161+0000","last_unstale":"2023-10-06T11:16:03.266437+0000","last_undegraded":"2023-10-06T11:16:03.266437+0000","last_fullsized":"2023-10-06T11:16:03.266437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.245711+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:02.245711+0000","last_peered":"2023-10-06T11:16:02.245711+0000","last_clean":"2023-10-06T11:16:02.245711+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:02.245711+0000","last_undegraded":"2023-10-06T11:16:02.245711+0000","last_fullsized":"2023-10-06T11:16:02.245711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:22.046036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271072+0000","last_change":"2023-10-06T11:16:03.271072+0000","last_active":"2023-10-06T11:16:03.271072+0000","last_peered":"2023-10-06T11:16:03.271072+0000","last_clean":"2023-10-06T11:16:03.271072+0000","last_became_active":"2023-10-06T11:16:03.270859+0000","last_became_peered":"2023-10-06T11:16:03.270859+0000","last_unstale":"2023-10-06T11:16:03.271072+0000","last_undegraded":"2023-10-06T11:16:03.271072+0000","last_fullsized":"2023-10-06T11:16:03.271072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247883+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:02.247883+0000","last_peered":"2023-10-06T11:16:02.247883+0000","last_clean":"2023-10-06T11:16:02.247883+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:02.247883+0000","last_undegraded":"2023-10-06T11:16:02.247883+0000","last_fullsized":"2023-10-06T11:16:02.247883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260159+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266154+0000","last_change":"2023-10-06T11:16:03.266154+0000","last_active":"2023-10-06T11:16:03.266154+0000","last_peered":"2023-10-06T11:16:03.266154+0000","last_clean":"2023-10-06T11:16:03.266154+0000","last_became_active":"2023-10-06T11:16:03.265870+0000","last_became_peered":"2023-10-06T11:16:03.265870+0000","last_unstale":"2023-10-06T11:16:03.266154+0000","last_undegraded":"2023-10-06T11:16:03.266154+0000","last_fullsized":"2023-10-06T11:16:03.266154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:43.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251429+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:02.251429+0000","last_peered":"2023-10-06T11:16:02.251429+0000","last_clean":"2023-10-06T11:16:02.251429+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:02.251429+0000","last_undegraded":"2023-10-06T11:16:02.251429+0000","last_fullsized":"2023-10-06T11:16:02.251429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258004+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.579290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265091+0000","last_change":"2023-10-06T11:16:03.265091+0000","last_active":"2023-10-06T11:16:03.265091+0000","last_peered":"2023-10-06T11:16:03.265091+0000","last_clean":"2023-10-06T11:16:03.265091+0000","last_became_active":"2023-10-06T11:16:03.264806+0000","last_became_peered":"2023-10-06T11:16:03.264806+0000","last_unstale":"2023-10-06T11:16:03.265091+0000","last_undegraded":"2023-10-06T11:16:03.265091+0000","last_fullsized":"2023-10-06T11:16:03.265091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:40.908155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260202+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:55.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273491+0000","last_change":"2023-10-06T11:16:03.273491+0000","last_active":"2023-10-06T11:16:03.273491+0000","last_peered":"2023-10-06T11:16:03.273491+0000","last_clean":"2023-10-06T11:16:03.273491+0000","last_became_active":"2023-10-06T11:16:03.273217+0000","last_became_peered":"2023-10-06T11:16:03.273217+0000","last_unstale":"2023-10-06T11:16:03.273491+0000","last_undegraded":"2023-10-06T11:16:03.273491+0000","last_fullsized":"2023-10-06T11:16:03.273491+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:04.630874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250469+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:02.250469+0000","last_peered":"2023-10-06T11:16:02.250469+0000","last_clean":"2023-10-06T11:16:02.250469+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:02.250469+0000","last_undegraded":"2023-10-06T11:16:02.250469+0000","last_fullsized":"2023-10-06T11:16:02.250469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:51.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.268311+0000","last_change":"2023-10-06T11:16:03.268311+0000","last_active":"2023-10-06T11:16:03.268311+0000","last_peered":"2023-10-06T11:16:03.268311+0000","last_clean":"2023-10-06T11:16:03.268311+0000","last_became_active":"2023-10-06T11:16:03.266368+0000","last_became_peered":"2023-10-06T11:16:03.266368+0000","last_unstale":"2023-10-06T11:16:03.268311+0000","last_undegraded":"2023-10-06T11:16:03.268311+0000","last_fullsized":"2023-10-06T11:16:03.268311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.252377+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:02.252377+0000","last_peered":"2023-10-06T11:16:02.252377+0000","last_clean":"2023-10-06T11:16:02.252377+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:02.252377+0000","last_undegraded":"2023-10-06T11:16:02.252377+0000","last_fullsized":"2023-10-06T11:16:02.252377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.378}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.26200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":0.496}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.434},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.315},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27900000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.629}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:08.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:08.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:08.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.940+0000 7fc952580700 1 Processor -- start 2023-10-06T11:16:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.940+0000 7fc952580700 1 -- start start 2023-10-06T11:16:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc952580700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc952580700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc94c0b49a0 0x7fc94c0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc952580700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc94c0b0760 0x7fc94c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc952580700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0b0c60 con 0x7fc94c0b0760 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc952580700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0b0f40 con 0x7fc94c0b49a0 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc952580700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0b1220 con 0x7fc94c159560 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc94c0b0760 0x7fc94c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc94c0b0760 0x7fc94c0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60646/0 (socket says 172.21.15.55:60646) 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 -- 172.21.15.55:0/1063687854 learned_addr learned my addr 172.21.15.55:0/1063687854 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc94bfff700 1 --2- 172.21.15.55:0/1063687854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc94b7fe700 1 --2- 172.21.15.55:0/1063687854 >> v2:172.21.15.142:3300/0 conn(0x7fc94c0b49a0 0x7fc94c0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 -- 172.21.15.55:0/1063687854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 msgr2=0x7fc94c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 --2- 172.21.15.55:0/1063687854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 -- 172.21.15.55:0/1063687854 >> v2:172.21.15.142:3300/0 conn(0x7fc94c0b49a0 msgr2=0x7fc94c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 --2- 172.21.15.55:0/1063687854 >> v2:172.21.15.142:3300/0 conn(0x7fc94c0b49a0 0x7fc94c0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 -- 172.21.15.55:0/1063687854 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0b1500 con 0x7fc94c0b0760 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc950b1d700 1 --2- 172.21.15.55:0/1063687854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c0b3890 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc94c089020 tx=0x7fc944009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f33fec3e06d5fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc94affd700 1 -- 172.21.15.55:0/1063687854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400e070 con 0x7fc94c0b0760 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc94affd700 1 -- 172.21.15.55:0/1063687854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400ba50 con 0x7fc94c0b0760 2023-10-06T11:16:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.941+0000 7fc94affd700 1 -- 172.21.15.55:0/1063687854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440092e0 con 0x7fc94c0b0760 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 -- 172.21.15.55:0/1063687854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 msgr2=0x7fc94c0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 --2- 172.21.15.55:0/1063687854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c0b3890 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc94c089020 tx=0x7fc944009840 comp rx=0 tx=0).stop 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 -- 172.21.15.55:0/1063687854 shutdown_connections 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 --2- 172.21.15.55:0/1063687854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c0b3890 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 --2- 172.21.15.55:0/1063687854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 --2- 172.21.15.55:0/1063687854 >> v2:172.21.15.142:3300/0 conn(0x7fc94c0b49a0 0x7fc94c0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 -- 172.21.15.55:0/1063687854 >> 172.21.15.55:0/1063687854 conn(0x7fc94c0997f0 msgr2=0x7fc94c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 -- 172.21.15.55:0/1063687854 shutdown_connections 2023-10-06T11:16:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.942+0000 7fc952580700 1 -- 172.21.15.55:0/1063687854 wait complete. 2023-10-06T11:16:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.943+0000 7fc952580700 1 Processor -- start 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.943+0000 7fc952580700 1 -- start start 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc952580700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c16a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc952580700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc94c0b49a0 0x7fc94c16aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc952580700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c16c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc952580700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cc240 con 0x7fc94c0b0760 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc952580700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c53d0 con 0x7fc94c0b49a0 2023-10-06T11:16:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc952580700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cb9a0 con 0x7fc94c159560 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c16a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c16a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60650/0 (socket says 172.21.15.55:60650) 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 -- 172.21.15.55:0/3542389503 learned_addr learned my addr 172.21.15.55:0/3542389503 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94b7fe700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc94c0b49a0 0x7fc94c16aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc950b1d700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c16c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 -- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 msgr2=0x7fc94c16c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c16c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 -- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc94c0b49a0 msgr2=0x7fc94c16aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc94c0b49a0 0x7fc94c16aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.944+0000 7fc94bfff700 1 -- 172.21.15.55:0/3542389503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009ae0 con 0x7fc94c0b0760 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.945+0000 7fc94bfff700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c16a3f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d840 tx=0x7fc93c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.945+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c014620 con 0x7fc94c0b0760 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.945+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c014780 con 0x7fc94c0b0760 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.945+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c0cbc80 con 0x7fc94c0b0760 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.945+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c014b40 con 0x7fc94c0b0760 2023-10-06T11:16:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.945+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c16af80 con 0x7fc94c0b0760 2023-10-06T11:16:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.946+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c0c5230 con 0x7fc94c0b0760 2023-10-06T11:16:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.946+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc93c01d400 con 0x7fc94c0b0760 2023-10-06T11:16:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.947+0000 7fc943fff700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.947+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc93c084ce0 con 0x7fc94c0b0760 2023-10-06T11:16:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.947+0000 7fc94b7fe700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.947+0000 7fc94b7fe700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc92c066f30 0x7fc92c0693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc94c157f10 tx=0x7fc934008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:08.951+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc94c0c5230 con 0x7fc94c0b0760 2023-10-06T11:16:09.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.140+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc94c0c5230 con 0x7fc92c066f30 2023-10-06T11:16:09.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.150+0000 7fc943fff700 1 -- 172.21.15.55:0/3542389503 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308454 (secure 0 0 0) 0x7fc94c0c5230 con 0x7fc92c066f30 2023-10-06T11:16:09.156 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc92c066f30 msgr2=0x7fc92c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc92c066f30 0x7fc92c0693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc94c157f10 tx=0x7fc934008040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 msgr2=0x7fc94c16a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c16a3f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d840 tx=0x7fc93c008040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 shutdown_connections 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94c0b0760 0x7fc94c16a3f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc94c159560 0x7fc94c16c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 --2- 172.21.15.55:0/3542389503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc94c0b49a0 0x7fc94c16aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 >> 172.21.15.55:0/3542389503 conn(0x7fc94c0997f0 msgr2=0x7fc94c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 shutdown_connections 2023-10-06T11:16:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.153+0000 7fc952580700 1 -- 172.21.15.55:0/3542389503 wait complete. 2023-10-06T11:16:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:09.167 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-10-06T11:16:08.882308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388040,"kb_used_data":9736,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586680,"statfs":{"total":773094113280,"available":770648760320,"internally_reserved":0,"allocated":9969664,"data_stored":5293824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001408"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259329+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:54.124898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255809+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:07.558350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:06.571060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255705+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257788+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259929+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260316+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256161+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:45.238766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255529+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258540+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259642+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257049+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256845+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264443+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:54.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258112+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259580+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255539+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256100+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:36.415872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256146+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258985+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:55.934205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255195+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:34.579388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254942+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:39.095991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259077+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260861+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255178+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:43.932698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261171+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261858+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254547+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:54.043722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264892+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:03.086947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257643+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258667+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:43.497915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262747+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.618237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265967+0000","last_change":"2023-10-06T11:16:03.265967+0000","last_active":"2023-10-06T11:16:03.265967+0000","last_peered":"2023-10-06T11:16:03.265967+0000","last_clean":"2023-10-06T11:16:03.265967+0000","last_became_active":"2023-10-06T11:16:03.265053+0000","last_became_peered":"2023-10-06T11:16:03.265053+0000","last_unstale":"2023-10-06T11:16:03.265967+0000","last_undegraded":"2023-10-06T11:16:03.265967+0000","last_fullsized":"2023-10-06T11:16:03.265967+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256884+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271147+0000","last_change":"2023-10-06T11:16:03.271147+0000","last_active":"2023-10-06T11:16:03.271147+0000","last_peered":"2023-10-06T11:16:03.271147+0000","last_clean":"2023-10-06T11:16:03.271147+0000","last_became_active":"2023-10-06T11:16:03.270881+0000","last_became_peered":"2023-10-06T11:16:03.270881+0000","last_unstale":"2023-10-06T11:16:03.271147+0000","last_undegraded":"2023-10-06T11:16:03.271147+0000","last_fullsized":"2023-10-06T11:16:03.271147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262608+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:10.645661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264964+0000","last_change":"2023-10-06T11:16:03.264964+0000","last_active":"2023-10-06T11:16:03.264964+0000","last_peered":"2023-10-06T11:16:03.264964+0000","last_clean":"2023-10-06T11:16:03.264964+0000","last_became_active":"2023-10-06T11:16:03.264681+0000","last_became_peered":"2023-10-06T11:16:03.264681+0000","last_unstale":"2023-10-06T11:16:03.264964+0000","last_undegraded":"2023-10-06T11:16:03.264964+0000","last_fullsized":"2023-10-06T11:16:03.264964+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254346+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:05.498350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265607+0000","last_change":"2023-10-06T11:16:03.265607+0000","last_active":"2023-10-06T11:16:03.265607+0000","last_peered":"2023-10-06T11:16:03.265607+0000","last_clean":"2023-10-06T11:16:03.265607+0000","last_became_active":"2023-10-06T11:16:03.265304+0000","last_became_peered":"2023-10-06T11:16:03.265304+0000","last_unstale":"2023-10-06T11:16:03.265607+0000","last_undegraded":"2023-10-06T11:16:03.265607+0000","last_fullsized":"2023-10-06T11:16:03.265607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:10.608527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253382+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:34.606442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271423+0000","last_change":"2023-10-06T11:16:03.271423+0000","last_active":"2023-10-06T11:16:03.271423+0000","last_peered":"2023-10-06T11:16:03.271423+0000","last_clean":"2023-10-06T11:16:03.271423+0000","last_became_active":"2023-10-06T11:16:03.271147+0000","last_became_peered":"2023-10-06T11:16:03.271147+0000","last_unstale":"2023-10-06T11:16:03.271423+0000","last_undegraded":"2023-10-06T11:16:03.271423+0000","last_fullsized":"2023-10-06T11:16:03.271423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:26.800474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259056+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273222+0000","last_change":"2023-10-06T11:16:03.273222+0000","last_active":"2023-10-06T11:16:03.273222+0000","last_peered":"2023-10-06T11:16:03.273222+0000","last_clean":"2023-10-06T11:16:03.273222+0000","last_became_active":"2023-10-06T11:16:03.272855+0000","last_became_peered":"2023-10-06T11:16:03.272855+0000","last_unstale":"2023-10-06T11:16:03.273222+0000","last_undegraded":"2023-10-06T11:16:03.273222+0000","last_fullsized":"2023-10-06T11:16:03.273222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:10.786531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254825+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271806+0000","last_change":"2023-10-06T11:16:03.271806+0000","last_active":"2023-10-06T11:16:03.271806+0000","last_peered":"2023-10-06T11:16:03.271806+0000","last_clean":"2023-10-06T11:16:03.271806+0000","last_became_active":"2023-10-06T11:16:03.271561+0000","last_became_peered":"2023-10-06T11:16:03.271561+0000","last_unstale":"2023-10-06T11:16:03.271806+0000","last_undegraded":"2023-10-06T11:16:03.271806+0000","last_fullsized":"2023-10-06T11:16:03.271806+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254129+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:11.614960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269573+0000","last_change":"2023-10-06T11:16:03.269573+0000","last_active":"2023-10-06T11:16:03.269573+0000","last_peered":"2023-10-06T11:16:03.269573+0000","last_clean":"2023-10-06T11:16:03.269573+0000","last_became_active":"2023-10-06T11:16:03.269062+0000","last_became_peered":"2023-10-06T11:16:03.269062+0000","last_unstale":"2023-10-06T11:16:03.269573+0000","last_undegraded":"2023-10-06T11:16:03.269573+0000","last_fullsized":"2023-10-06T11:16:03.269573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:01.433177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254020+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266206+0000","last_change":"2023-10-06T11:16:03.266206+0000","last_active":"2023-10-06T11:16:03.266206+0000","last_peered":"2023-10-06T11:16:03.266206+0000","last_clean":"2023-10-06T11:16:03.266206+0000","last_became_active":"2023-10-06T11:16:03.265914+0000","last_became_peered":"2023-10-06T11:16:03.265914+0000","last_unstale":"2023-10-06T11:16:03.266206+0000","last_undegraded":"2023-10-06T11:16:03.266206+0000","last_fullsized":"2023-10-06T11:16:03.266206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:48.121863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:22.679612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266356+0000","last_change":"2023-10-06T11:16:03.266356+0000","last_active":"2023-10-06T11:16:03.266356+0000","last_peered":"2023-10-06T11:16:03.266356+0000","last_clean":"2023-10-06T11:16:03.266356+0000","last_became_active":"2023-10-06T11:16:03.265589+0000","last_became_peered":"2023-10-06T11:16:03.265589+0000","last_unstale":"2023-10-06T11:16:03.266356+0000","last_undegraded":"2023-10-06T11:16:03.266356+0000","last_fullsized":"2023-10-06T11:16:03.266356+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.931454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259480+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266459+0000","last_change":"2023-10-06T11:16:03.266459+0000","last_active":"2023-10-06T11:16:03.266459+0000","last_peered":"2023-10-06T11:16:03.266459+0000","last_clean":"2023-10-06T11:16:03.266459+0000","last_became_active":"2023-10-06T11:16:03.266184+0000","last_became_peered":"2023-10-06T11:16:03.266184+0000","last_unstale":"2023-10-06T11:16:03.266459+0000","last_undegraded":"2023-10-06T11:16:03.266459+0000","last_fullsized":"2023-10-06T11:16:03.266459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260649+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269548+0000","last_change":"2023-10-06T11:16:03.269548+0000","last_active":"2023-10-06T11:16:03.269548+0000","last_peered":"2023-10-06T11:16:03.269548+0000","last_clean":"2023-10-06T11:16:03.269548+0000","last_became_active":"2023-10-06T11:16:03.269297+0000","last_became_peered":"2023-10-06T11:16:03.269297+0000","last_unstale":"2023-10-06T11:16:03.269548+0000","last_undegraded":"2023-10-06T11:16:03.269548+0000","last_fullsized":"2023-10-06T11:16:03.269548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.267342+0000","last_change":"2023-10-06T11:16:03.267342+0000","last_active":"2023-10-06T11:16:03.267342+0000","last_peered":"2023-10-06T11:16:03.267342+0000","last_clean":"2023-10-06T11:16:03.267342+0000","last_became_active":"2023-10-06T11:16:03.266327+0000","last_became_peered":"2023-10-06T11:16:03.266327+0000","last_unstale":"2023-10-06T11:16:03.267342+0000","last_undegraded":"2023-10-06T11:16:03.267342+0000","last_fullsized":"2023-10-06T11:16:03.267342+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:23.538191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261470+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:39.333083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.275983+0000","last_change":"2023-10-06T11:16:03.275983+0000","last_active":"2023-10-06T11:16:03.275983+0000","last_peered":"2023-10-06T11:16:03.275983+0000","last_clean":"2023-10-06T11:16:03.275983+0000","last_became_active":"2023-10-06T11:16:03.275473+0000","last_became_peered":"2023-10-06T11:16:03.275473+0000","last_unstale":"2023-10-06T11:16:03.275983+0000","last_undegraded":"2023-10-06T11:16:03.275983+0000","last_fullsized":"2023-10-06T11:16:03.275983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:41.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:03.103375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264078+0000","last_change":"2023-10-06T11:16:03.264078+0000","last_active":"2023-10-06T11:16:03.264078+0000","last_peered":"2023-10-06T11:16:03.264078+0000","last_clean":"2023-10-06T11:16:03.264078+0000","last_became_active":"2023-10-06T11:16:03.263683+0000","last_became_peered":"2023-10-06T11:16:03.263683+0000","last_unstale":"2023-10-06T11:16:03.264078+0000","last_undegraded":"2023-10-06T11:16:03.264078+0000","last_fullsized":"2023-10-06T11:16:03.264078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262776+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:33.366065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271127+0000","last_change":"2023-10-06T11:16:03.271127+0000","last_active":"2023-10-06T11:16:03.271127+0000","last_peered":"2023-10-06T11:16:03.271127+0000","last_clean":"2023-10-06T11:16:03.271127+0000","last_became_active":"2023-10-06T11:16:03.270133+0000","last_became_peered":"2023-10-06T11:16:03.270133+0000","last_unstale":"2023-10-06T11:16:03.271127+0000","last_undegraded":"2023-10-06T11:16:03.271127+0000","last_fullsized":"2023-10-06T11:16:03.271127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:50.310646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253489+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265577+0000","last_change":"2023-10-06T11:16:03.265577+0000","last_active":"2023-10-06T11:16:03.265577+0000","last_peered":"2023-10-06T11:16:03.265577+0000","last_clean":"2023-10-06T11:16:03.265577+0000","last_became_active":"2023-10-06T11:16:03.265337+0000","last_became_peered":"2023-10-06T11:16:03.265337+0000","last_unstale":"2023-10-06T11:16:03.265577+0000","last_undegraded":"2023-10-06T11:16:03.265577+0000","last_fullsized":"2023-10-06T11:16:03.265577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:29.052675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258850+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:08.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271695+0000","last_change":"2023-10-06T11:16:03.271695+0000","last_active":"2023-10-06T11:16:03.271695+0000","last_peered":"2023-10-06T11:16:03.271695+0000","last_clean":"2023-10-06T11:16:03.271695+0000","last_became_active":"2023-10-06T11:16:03.271426+0000","last_became_peered":"2023-10-06T11:16:03.271426+0000","last_unstale":"2023-10-06T11:16:03.271695+0000","last_undegraded":"2023-10-06T11:16:03.271695+0000","last_fullsized":"2023-10-06T11:16:03.271695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:58.625857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262201+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:56.438390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.259310+0000","last_change":"2023-10-06T11:16:03.259310+0000","last_active":"2023-10-06T11:16:03.259310+0000","last_peered":"2023-10-06T11:16:03.259310+0000","last_clean":"2023-10-06T11:16:03.259310+0000","last_became_active":"2023-10-06T11:16:03.259025+0000","last_became_peered":"2023-10-06T11:16:03.259025+0000","last_unstale":"2023-10-06T11:16:03.259310+0000","last_undegraded":"2023-10-06T11:16:03.259310+0000","last_fullsized":"2023-10-06T11:16:03.259310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:02.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258209+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265765+0000","last_change":"2023-10-06T11:16:03.265765+0000","last_active":"2023-10-06T11:16:03.265765+0000","last_peered":"2023-10-06T11:16:03.265765+0000","last_clean":"2023-10-06T11:16:03.265765+0000","last_became_active":"2023-10-06T11:16:03.265563+0000","last_became_peered":"2023-10-06T11:16:03.265563+0000","last_unstale":"2023-10-06T11:16:03.265765+0000","last_undegraded":"2023-10-06T11:16:03.265765+0000","last_fullsized":"2023-10-06T11:16:03.265765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:17.485665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.263556+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:02.439611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265381+0000","last_change":"2023-10-06T11:16:03.265381+0000","last_active":"2023-10-06T11:16:03.265381+0000","last_peered":"2023-10-06T11:16:03.265381+0000","last_clean":"2023-10-06T11:16:03.265381+0000","last_became_active":"2023-10-06T11:16:03.264912+0000","last_became_peered":"2023-10-06T11:16:03.264912+0000","last_unstale":"2023-10-06T11:16:03.265381+0000","last_undegraded":"2023-10-06T11:16:03.265381+0000","last_fullsized":"2023-10-06T11:16:03.265381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:43.791751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254074+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:44.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273426+0000","last_change":"2023-10-06T11:16:03.273426+0000","last_active":"2023-10-06T11:16:03.273426+0000","last_peered":"2023-10-06T11:16:03.273426+0000","last_clean":"2023-10-06T11:16:03.273426+0000","last_became_active":"2023-10-06T11:16:03.273151+0000","last_became_peered":"2023-10-06T11:16:03.273151+0000","last_unstale":"2023-10-06T11:16:03.273426+0000","last_undegraded":"2023-10-06T11:16:03.273426+0000","last_fullsized":"2023-10-06T11:16:03.273426+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258548+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:24.031979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.270536+0000","last_change":"2023-10-06T11:16:03.270536+0000","last_active":"2023-10-06T11:16:03.270536+0000","last_peered":"2023-10-06T11:16:03.270536+0000","last_clean":"2023-10-06T11:16:03.270536+0000","last_became_active":"2023-10-06T11:16:03.270254+0000","last_became_peered":"2023-10-06T11:16:03.270254+0000","last_unstale":"2023-10-06T11:16:03.270536+0000","last_undegraded":"2023-10-06T11:16:03.270536+0000","last_fullsized":"2023-10-06T11:16:03.270536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:12.895297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257433+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271934+0000","last_change":"2023-10-06T11:16:03.271934+0000","last_active":"2023-10-06T11:16:03.271934+0000","last_peered":"2023-10-06T11:16:03.271934+0000","last_clean":"2023-10-06T11:16:03.271934+0000","last_became_active":"2023-10-06T11:16:03.271636+0000","last_became_peered":"2023-10-06T11:16:03.271636+0000","last_unstale":"2023-10-06T11:16:03.271934+0000","last_undegraded":"2023-10-06T11:16:03.271934+0000","last_fullsized":"2023-10-06T11:16:03.271934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:50.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269336+0000","last_change":"2023-10-06T11:16:03.269336+0000","last_active":"2023-10-06T11:16:03.269336+0000","last_peered":"2023-10-06T11:16:03.269336+0000","last_clean":"2023-10-06T11:16:03.269336+0000","last_became_active":"2023-10-06T11:16:03.269072+0000","last_became_peered":"2023-10-06T11:16:03.269072+0000","last_unstale":"2023-10-06T11:16:03.269336+0000","last_undegraded":"2023-10-06T11:16:03.269336+0000","last_fullsized":"2023-10-06T11:16:03.269336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.151151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250171+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:02.250171+0000","last_peered":"2023-10-06T11:16:02.250171+0000","last_clean":"2023-10-06T11:16:02.250171+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:02.250171+0000","last_undegraded":"2023-10-06T11:16:02.250171+0000","last_fullsized":"2023-10-06T11:16:02.250171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259252+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.272428+0000","last_change":"2023-10-06T11:16:03.272428+0000","last_active":"2023-10-06T11:16:03.272428+0000","last_peered":"2023-10-06T11:16:03.272428+0000","last_clean":"2023-10-06T11:16:03.272428+0000","last_became_active":"2023-10-06T11:16:03.272148+0000","last_became_peered":"2023-10-06T11:16:03.272148+0000","last_unstale":"2023-10-06T11:16:03.272428+0000","last_undegraded":"2023-10-06T11:16:03.272428+0000","last_fullsized":"2023-10-06T11:16:03.272428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247882+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:02.247882+0000","last_peered":"2023-10-06T11:16:02.247882+0000","last_clean":"2023-10-06T11:16:02.247882+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:02.247882+0000","last_undegraded":"2023-10-06T11:16:02.247882+0000","last_fullsized":"2023-10-06T11:16:02.247882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253854+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:03.569628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266437+0000","last_change":"2023-10-06T11:16:03.266437+0000","last_active":"2023-10-06T11:16:03.266437+0000","last_peered":"2023-10-06T11:16:03.266437+0000","last_clean":"2023-10-06T11:16:03.266437+0000","last_became_active":"2023-10-06T11:16:03.266161+0000","last_became_peered":"2023-10-06T11:16:03.266161+0000","last_unstale":"2023-10-06T11:16:03.266437+0000","last_undegraded":"2023-10-06T11:16:03.266437+0000","last_fullsized":"2023-10-06T11:16:03.266437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.245711+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:02.245711+0000","last_peered":"2023-10-06T11:16:02.245711+0000","last_clean":"2023-10-06T11:16:02.245711+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:02.245711+0000","last_undegraded":"2023-10-06T11:16:02.245711+0000","last_fullsized":"2023-10-06T11:16:02.245711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:22.046036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271072+0000","last_change":"2023-10-06T11:16:03.271072+0000","last_active":"2023-10-06T11:16:03.271072+0000","last_peered":"2023-10-06T11:16:03.271072+0000","last_clean":"2023-10-06T11:16:03.271072+0000","last_became_active":"2023-10-06T11:16:03.270859+0000","last_became_peered":"2023-10-06T11:16:03.270859+0000","last_unstale":"2023-10-06T11:16:03.271072+0000","last_undegraded":"2023-10-06T11:16:03.271072+0000","last_fullsized":"2023-10-06T11:16:03.271072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247883+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:02.247883+0000","last_peered":"2023-10-06T11:16:02.247883+0000","last_clean":"2023-10-06T11:16:02.247883+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:02.247883+0000","last_undegraded":"2023-10-06T11:16:02.247883+0000","last_fullsized":"2023-10-06T11:16:02.247883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260159+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266154+0000","last_change":"2023-10-06T11:16:03.266154+0000","last_active":"2023-10-06T11:16:03.266154+0000","last_peered":"2023-10-06T11:16:03.266154+0000","last_clean":"2023-10-06T11:16:03.266154+0000","last_became_active":"2023-10-06T11:16:03.265870+0000","last_became_peered":"2023-10-06T11:16:03.265870+0000","last_unstale":"2023-10-06T11:16:03.266154+0000","last_undegraded":"2023-10-06T11:16:03.266154+0000","last_fullsized":"2023-10-06T11:16:03.266154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:43.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251429+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:02.251429+0000","last_peered":"2023-10-06T11:16:02.251429+0000","last_clean":"2023-10-06T11:16:02.251429+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:02.251429+0000","last_undegraded":"2023-10-06T11:16:02.251429+0000","last_fullsized":"2023-10-06T11:16:02.251429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258004+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.579290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265091+0000","last_change":"2023-10-06T11:16:03.265091+0000","last_active":"2023-10-06T11:16:03.265091+0000","last_peered":"2023-10-06T11:16:03.265091+0000","last_clean":"2023-10-06T11:16:03.265091+0000","last_became_active":"2023-10-06T11:16:03.264806+0000","last_became_peered":"2023-10-06T11:16:03.264806+0000","last_unstale":"2023-10-06T11:16:03.265091+0000","last_undegraded":"2023-10-06T11:16:03.265091+0000","last_fullsized":"2023-10-06T11:16:03.265091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:40.908155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260202+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:55.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273491+0000","last_change":"2023-10-06T11:16:03.273491+0000","last_active":"2023-10-06T11:16:03.273491+0000","last_peered":"2023-10-06T11:16:03.273491+0000","last_clean":"2023-10-06T11:16:03.273491+0000","last_became_active":"2023-10-06T11:16:03.273217+0000","last_became_peered":"2023-10-06T11:16:03.273217+0000","last_unstale":"2023-10-06T11:16:03.273491+0000","last_undegraded":"2023-10-06T11:16:03.273491+0000","last_fullsized":"2023-10-06T11:16:03.273491+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:04.630874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250469+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:02.250469+0000","last_peered":"2023-10-06T11:16:02.250469+0000","last_clean":"2023-10-06T11:16:02.250469+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:02.250469+0000","last_undegraded":"2023-10-06T11:16:02.250469+0000","last_fullsized":"2023-10-06T11:16:02.250469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:51.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.268311+0000","last_change":"2023-10-06T11:16:03.268311+0000","last_active":"2023-10-06T11:16:03.268311+0000","last_peered":"2023-10-06T11:16:03.268311+0000","last_clean":"2023-10-06T11:16:03.268311+0000","last_became_active":"2023-10-06T11:16:03.266368+0000","last_became_peered":"2023-10-06T11:16:03.266368+0000","last_unstale":"2023-10-06T11:16:03.268311+0000","last_undegraded":"2023-10-06T11:16:03.268311+0000","last_fullsized":"2023-10-06T11:16:03.268311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.252377+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:02.252377+0000","last_peered":"2023-10-06T11:16:02.252377+0000","last_clean":"2023-10-06T11:16:02.252377+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:02.252377+0000","last_undegraded":"2023-10-06T11:16:02.252377+0000","last_fullsized":"2023-10-06T11:16:02.252377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.378}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.26200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":0.496}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.434},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.315},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27900000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.629}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:09.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-06T11:16:09.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259329+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:50:54.124898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-06T11:16:09.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255809+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:25:07.558350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.260455+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:17:06.571060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255705+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.257788+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259929+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-06T11:16:09.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.260316+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.256161+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:26:45.238766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255529+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258540+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259642+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.257049+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.256845+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.264443+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:09:54.877460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258112+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259580+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255539+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.256100+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259544+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:26:36.415872+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.256146+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-06T11:16:09.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258985+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:51:55.934205+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-06T11:16:09.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255195+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:25:34.579388+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-06T11:16:09.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254942+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:16:39.095991+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-06T11:16:09.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259077+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.260861+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255178+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:50:43.932698+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.261171+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-06T11:16:09.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.261858+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254547+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:53:54.043722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.264892+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:36:03.086947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.257643+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258667+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:43:43.497915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-06T11:16:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.262747+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:48:11.618237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.256884+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.262608+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:25:10.645661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254346+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:30:05.498350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.253382+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:05:34.606442+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-06T11:16:09.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259056+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254825+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254129+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:37:11.614960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254020+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254455+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:04:22.679612+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259480+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.260649+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.255327+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.261470+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:18:39.333083+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-06T11:16:09.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.253327+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:58:03.103375+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.262776+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:45:33.366065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.253489+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258850+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:32:08.699526+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.262201+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:52:56.438390+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:09.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258209+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.263556+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:57:02.439611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.254074+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:50:44.007356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258548+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:02:24.031979+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.257433+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258015+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.259252+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-06T11:16:09.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.253854+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:11:03.569628+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.261544+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:22:22.046036+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.260159+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.258004+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:10:03.579290+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.260202+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:59:55.307496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-06T11:16:09.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:03.242332+0000', 'last_change': '2023-10-06T11:16:03.264015+0000', 'last_active': '2023-10-06T11:16:03.242332+0000', 'last_peered': '2023-10-06T11:16:03.242332+0000', 'last_clean': '2023-10-06T11:16:03.242332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:03.242332+0000', 'last_undegraded': '2023-10-06T11:16:03.242332+0000', 'last_fullsized': '2023-10-06T11:16:03.242332+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:03.242332+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:44:51.317079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:09.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:16:09.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.325+0000 7fca80c27700 1 Processor -- start 2023-10-06T11:16:09.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.325+0000 7fca80c27700 1 -- start start 2023-10-06T11:16:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca80c27700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fca7c0b0760 0x7fca7c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca80c27700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0b0c60 con 0x7fca7c0b49a0 2023-10-06T11:16:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca80c27700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0b0f40 con 0x7fca7c159560 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca80c27700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0ab350 con 0x7fca7c0b0760 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca79d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca7c0b49a0 0x7fca7c0aac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49364/0 (socket says 172.21.15.55:49364) 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca79d9b700 1 -- 172.21.15.55:0/3853656987 learned_addr learned my addr 172.21.15.55:0/3853656987 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/3853656987 >> v2:172.21.15.142:3300/0 conn(0x7fca7c0b0760 0x7fca7c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526076108 0 0) 0x7fca7c0b0c60 con 0x7fca7c0b49a0 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca68003570 con 0x7fca7c0b49a0 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261307043 0 0) 0x7fca7c0b0f40 con 0x7fca7c159560 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7c0b0c60 con 0x7fca7c159560 2023-10-06T11:16:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3074496276 0 0) 0x7fca68003570 con 0x7fca7c0b49a0 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 >> v2:172.21.15.142:3300/0 conn(0x7fca7c0b0760 msgr2=0x7fca7c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 --2- 172.21.15.55:0/3853656987 >> v2:172.21.15.142:3300/0 conn(0x7fca7c0b0760 0x7fca7c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 >> v1:172.21.15.142:6789/0 conn(0x7fca7c159560 legacy=0x7fca7c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0b1220 con 0x7fca7c0b49a0 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fca64001470 con 0x7fca7c0b49a0 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 >> v1:172.21.15.55:6789/0 conn(0x7fca7c0b49a0 legacy=0x7fca7c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68003c40 0x7fca68004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca68004810 0x7fca68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca68005210 0x7fca6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0ab350 con 0x7fca68005210 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800c130 con 0x7fca68004810 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.326+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800c2c0 con 0x7fca68003c40 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca68005210 0x7fca6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7a59c700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68003c40 0x7fca68004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca79d9b700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca68004810 0x7fca68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 -- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68003c40 msgr2=0x7fca68004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68003c40 0x7fca68004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 -- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca68004810 msgr2=0x7fca68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca68004810 0x7fca68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 -- 172.21.15.55:0/3853656987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68003570 con 0x7fca68005210 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca79d9b700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca68004810 0x7fca68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 -- 172.21.15.55:0/3853656987 reap_dead start 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca68005210 0x7fca6800ba60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00e240 tx=0x7fca6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f57800e55d2d17e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c009ac0 con 0x7fca68005210 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00f040 con 0x7fca68005210 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.327+0000 7fca7959a700 1 -- 172.21.15.55:0/3853656987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00ed40 con 0x7fca68005210 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 -- 172.21.15.55:0/3853656987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca68005210 msgr2=0x7fca6800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca68005210 0x7fca6800ba60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00e240 tx=0x7fca6c00b040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 -- 172.21.15.55:0/3853656987 shutdown_connections 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 --2- 172.21.15.55:0/3853656987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca68005210 0x7fca6800ba60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 -- 172.21.15.55:0/3853656987 >> 172.21.15.55:0/3853656987 conn(0x7fca7c0997f0 msgr2=0x7fca7c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 -- 172.21.15.55:0/3853656987 shutdown_connections 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.328+0000 7fca80c27700 1 -- 172.21.15.55:0/3853656987 wait complete. 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.329+0000 7fca80c27700 1 Processor -- start 2023-10-06T11:16:09.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.329+0000 7fca80c27700 1 -- start start 2023-10-06T11:16:09.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68005210 0x7fca7c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca7c1549c0 0x7fca7c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 0x7fca7c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15b3d0 con 0x7fca7c151ea0 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15aaa0 con 0x7fca7c1549c0 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15ad80 con 0x7fca68005210 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 0x7fca7c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 0x7fca7c155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60668/0 (socket says 172.21.15.55:60668) 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 -- 172.21.15.55:0/2676695348 learned_addr learned my addr 172.21.15.55:0/2676695348 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca79d9b700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca7c1549c0 0x7fca7c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7a59c700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68005210 0x7fca7c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 -- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68005210 msgr2=0x7fca7c14fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68005210 0x7fca7c14fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 -- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca7c1549c0 msgr2=0x7fca7c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca7c1549c0 0x7fca7c151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 -- 172.21.15.55:0/2676695348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c15b060 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca7ad9d700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 0x7fca7c155eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0b2f10 tx=0x7fca6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c01d650 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c01d7b0 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c1500a0 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.330+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c01db30 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.331+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c153db0 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.331+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c064a90 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.332+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca6c003020 con 0x7fca7c151ea0 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.332+0000 7fca727fc700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.332+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fca6c085cc0 con 0x7fca7c151ea0 2023-10-06T11:16:09.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.333+0000 7fca7a59c700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.334+0000 7fca7a59c700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca5c066f30 0x7fca5c0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca74001130 tx=0x7fca74007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.337+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca6c052c90 con 0x7fca7c151ea0 2023-10-06T11:16:09.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.611+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fca7c0b1500 con 0x7fca7c151ea0 2023-10-06T11:16:09.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.611+0000 7fca727fc700 1 -- 172.21.15.55:0/2676695348 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1456 (secure 0 0 0) 0x7fca6c0185c0 con 0x7fca7c151ea0 2023-10-06T11:16:09.613 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:09.613 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":202,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590778,"num_in_osds":8,"osd_in_since":1696590769,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2445352960,"bytes_avail":770648760320,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":51,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6528}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-06T11:15:50.878616+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:16:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca5c066f30 msgr2=0x7fca5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca5c066f30 0x7fca5c0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca74001130 tx=0x7fca74007d80 comp rx=0 tx=0).stop 2023-10-06T11:16:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 msgr2=0x7fca7c155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 0x7fca7c155eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0b2f10 tx=0x7fca6c019000 comp rx=0 tx=0).stop 2023-10-06T11:16:09.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 shutdown_connections 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca7c151ea0 0x7fca7c155eb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca68005210 0x7fca7c14fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 --2- 172.21.15.55:0/2676695348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca7c1549c0 0x7fca7c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 >> 172.21.15.55:0/2676695348 conn(0x7fca7c0997f0 msgr2=0x7fca7c158970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 shutdown_connections 2023-10-06T11:16:09.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.613+0000 7fca80c27700 1 -- 172.21.15.55:0/2676695348 wait complete. 2023-10-06T11:16:09.627 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:16:09.627 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:09.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.745+0000 7f2254fe7700 1 Processor -- start 2023-10-06T11:16:09.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.745+0000 7f2254fe7700 1 -- start start 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.745+0000 7f2254fe7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2250159560 0x7f22500aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.745+0000 7f2254fe7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22500b0760 0x7f22500b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.745+0000 7f2254fe7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500b0c60 con 0x7f22500b49a0 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.745+0000 7f2254fe7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500b0f40 con 0x7f22500b0760 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f2254fe7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500b1220 con 0x7f2250159560 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22500b0760 0x7f22500b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f22500b0760 0x7f22500b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60674/0 (socket says 172.21.15.55:60674) 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 -- 172.21.15.55:0/168680633 learned_addr learned my addr 172.21.15.55:0/168680633 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224e59c700 1 --2- 172.21.15.55:0/168680633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2250159560 0x7f22500aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 -- 172.21.15.55:0/168680633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2250159560 msgr2=0x7f22500aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 --2- 172.21.15.55:0/168680633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2250159560 0x7f22500aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 -- 172.21.15.55:0/168680633 >> v1:172.21.15.142:6789/0 conn(0x7f22500b49a0 legacy=0x7f22500aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 -- 172.21.15.55:0/168680633 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500b1500 con 0x7f22500b0760 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224ed9d700 1 --2- 172.21.15.55:0/168680633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f22500b1bc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2240009f20 tx=0x7f2240009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469334c33a8e585b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224d59a700 1 -- 172.21.15.55:0/168680633 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000e070 con 0x7f22500b0760 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224d59a700 1 -- 172.21.15.55:0/168680633 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224000b9d0 con 0x7f22500b0760 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.746+0000 7f224d59a700 1 -- 172.21.15.55:0/168680633 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400092e0 con 0x7f22500b0760 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 -- 172.21.15.55:0/168680633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 msgr2=0x7f22500b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 --2- 172.21.15.55:0/168680633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f22500b1bc0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2240009f20 tx=0x7f2240009840 comp rx=0 tx=0).stop 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 -- 172.21.15.55:0/168680633 shutdown_connections 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 --2- 172.21.15.55:0/168680633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f22500b1bc0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 --2- 172.21.15.55:0/168680633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2250159560 0x7f22500aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 -- 172.21.15.55:0/168680633 >> 172.21.15.55:0/168680633 conn(0x7f22500997f0 msgr2=0x7f225006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 -- 172.21.15.55:0/168680633 shutdown_connections 2023-10-06T11:16:09.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.747+0000 7f2254fe7700 1 -- 172.21.15.55:0/168680633 wait complete. 2023-10-06T11:16:09.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.748+0000 7f2254fe7700 1 Processor -- start 2023-10-06T11:16:09.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.748+0000 7f2254fe7700 1 -- start start 2023-10-06T11:16:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f2254fe7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f225016d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f2254fe7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22500b49a0 0x7f2250169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f2254fe7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2250159560 0x7f22500ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f2254fe7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225016aee0 con 0x7f22500b0760 2023-10-06T11:16:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f2254fe7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225016a260 con 0x7f2250159560 2023-10-06T11:16:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f2254fe7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225016a540 con 0x7f22500b49a0 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f225016d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f225016d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60688/0 (socket says 172.21.15.55:60688) 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 -- 172.21.15.55:0/2674861095 learned_addr learned my addr 172.21.15.55:0/2674861095 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224dd9b700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22500b49a0 0x7f2250169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224ed9d700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2250159560 0x7f22500ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 -- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22500b49a0 msgr2=0x7f2250169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22500b49a0 0x7f2250169960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 -- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2250159560 msgr2=0x7f22500ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2250159560 0x7f22500ae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.749+0000 7f224e59c700 1 -- 172.21.15.55:0/2674861095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240009ae0 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.750+0000 7f224e59c700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f225016d9d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f224800ea00 tx=0x7f2248009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.750+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800c850 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.750+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224800c9b0 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.750+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225016a820 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.750+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800cd30 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.750+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2250169ea0 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.751+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250064a90 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.751+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2248013680 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.751+0000 7f22467fc700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2230066f30 0x7f22300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.752+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2248084e10 con 0x7f22500b0760 2023-10-06T11:16:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.752+0000 7f224dd9b700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2230066f30 0x7f22300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.752+0000 7f224dd9b700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2230066f30 0x7f22300693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22500b2410 tx=0x7f2238009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.756+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2248051de0 con 0x7f22500b0760 2023-10-06T11:16:09.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.944+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f225016b020 con 0x7f2230066f30 2023-10-06T11:16:09.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.953+0000 7f22467fc700 1 -- 172.21.15.55:0/2674861095 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308454 (secure 0 0 0) 0x7f2238014420 con 0x7f2230066f30 2023-10-06T11:16:09.959 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:09.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.956+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2230066f30 msgr2=0x7f22300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.956+0000 7f2254fe7700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2230066f30 0x7f22300693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22500b2410 tx=0x7f2238009040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.956+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 msgr2=0x7f225016d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.956+0000 7f2254fe7700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f225016d9d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f224800ea00 tx=0x7f2248009120 comp rx=0 tx=0).stop 2023-10-06T11:16:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 shutdown_connections 2023-10-06T11:16:09.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2230066f30 0x7f22300693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22500b0760 0x7f225016d9d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2250159560 0x7f22500ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 --2- 172.21.15.55:0/2674861095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22500b49a0 0x7f2250169960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 >> 172.21.15.55:0/2674861095 conn(0x7f22500997f0 msgr2=0x7f22500b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 shutdown_connections 2023-10-06T11:16:09.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:09.957+0000 7f2254fe7700 1 -- 172.21.15.55:0/2674861095 wait complete. 2023-10-06T11:16:09.964 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:09.970 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-10-06T11:16:08.882308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388040,"kb_used_data":9736,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586680,"statfs":{"total":773094113280,"available":770648760320,"internally_reserved":0,"allocated":9969664,"data_stored":5293824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001408"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259329+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:54.124898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255809+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:07.558350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:06.571060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255705+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257788+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259929+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260316+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256161+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:45.238766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255529+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258540+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.065262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259642+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257049+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256845+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264443+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:54.877460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258112+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259580+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255539+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:58.226971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256100+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:36.415872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256146+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258985+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:55.934205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255195+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:34.579388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254942+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:39.095991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259077+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260861+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255178+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:43.932698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261171+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261858+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254547+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:54.043722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264892+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:03.086947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257643+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258667+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:43.497915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262747+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.618237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265967+0000","last_change":"2023-10-06T11:16:03.265967+0000","last_active":"2023-10-06T11:16:03.265967+0000","last_peered":"2023-10-06T11:16:03.265967+0000","last_clean":"2023-10-06T11:16:03.265967+0000","last_became_active":"2023-10-06T11:16:03.265053+0000","last_became_peered":"2023-10-06T11:16:03.265053+0000","last_unstale":"2023-10-06T11:16:03.265967+0000","last_undegraded":"2023-10-06T11:16:03.265967+0000","last_fullsized":"2023-10-06T11:16:03.265967+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.256884+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271147+0000","last_change":"2023-10-06T11:16:03.271147+0000","last_active":"2023-10-06T11:16:03.271147+0000","last_peered":"2023-10-06T11:16:03.271147+0000","last_clean":"2023-10-06T11:16:03.271147+0000","last_became_active":"2023-10-06T11:16:03.270881+0000","last_became_peered":"2023-10-06T11:16:03.270881+0000","last_unstale":"2023-10-06T11:16:03.271147+0000","last_undegraded":"2023-10-06T11:16:03.271147+0000","last_fullsized":"2023-10-06T11:16:03.271147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262608+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:10.645661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264964+0000","last_change":"2023-10-06T11:16:03.264964+0000","last_active":"2023-10-06T11:16:03.264964+0000","last_peered":"2023-10-06T11:16:03.264964+0000","last_clean":"2023-10-06T11:16:03.264964+0000","last_became_active":"2023-10-06T11:16:03.264681+0000","last_became_peered":"2023-10-06T11:16:03.264681+0000","last_unstale":"2023-10-06T11:16:03.264964+0000","last_undegraded":"2023-10-06T11:16:03.264964+0000","last_fullsized":"2023-10-06T11:16:03.264964+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254346+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:05.498350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265607+0000","last_change":"2023-10-06T11:16:03.265607+0000","last_active":"2023-10-06T11:16:03.265607+0000","last_peered":"2023-10-06T11:16:03.265607+0000","last_clean":"2023-10-06T11:16:03.265607+0000","last_became_active":"2023-10-06T11:16:03.265304+0000","last_became_peered":"2023-10-06T11:16:03.265304+0000","last_unstale":"2023-10-06T11:16:03.265607+0000","last_undegraded":"2023-10-06T11:16:03.265607+0000","last_fullsized":"2023-10-06T11:16:03.265607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:10.608527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253382+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:34.606442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271423+0000","last_change":"2023-10-06T11:16:03.271423+0000","last_active":"2023-10-06T11:16:03.271423+0000","last_peered":"2023-10-06T11:16:03.271423+0000","last_clean":"2023-10-06T11:16:03.271423+0000","last_became_active":"2023-10-06T11:16:03.271147+0000","last_became_peered":"2023-10-06T11:16:03.271147+0000","last_unstale":"2023-10-06T11:16:03.271423+0000","last_undegraded":"2023-10-06T11:16:03.271423+0000","last_fullsized":"2023-10-06T11:16:03.271423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:26.800474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259056+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:26.867983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273222+0000","last_change":"2023-10-06T11:16:03.273222+0000","last_active":"2023-10-06T11:16:03.273222+0000","last_peered":"2023-10-06T11:16:03.273222+0000","last_clean":"2023-10-06T11:16:03.273222+0000","last_became_active":"2023-10-06T11:16:03.272855+0000","last_became_peered":"2023-10-06T11:16:03.272855+0000","last_unstale":"2023-10-06T11:16:03.273222+0000","last_undegraded":"2023-10-06T11:16:03.273222+0000","last_fullsized":"2023-10-06T11:16:03.273222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:10.786531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254825+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271806+0000","last_change":"2023-10-06T11:16:03.271806+0000","last_active":"2023-10-06T11:16:03.271806+0000","last_peered":"2023-10-06T11:16:03.271806+0000","last_clean":"2023-10-06T11:16:03.271806+0000","last_became_active":"2023-10-06T11:16:03.271561+0000","last_became_peered":"2023-10-06T11:16:03.271561+0000","last_unstale":"2023-10-06T11:16:03.271806+0000","last_undegraded":"2023-10-06T11:16:03.271806+0000","last_fullsized":"2023-10-06T11:16:03.271806+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254129+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:11.614960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269573+0000","last_change":"2023-10-06T11:16:03.269573+0000","last_active":"2023-10-06T11:16:03.269573+0000","last_peered":"2023-10-06T11:16:03.269573+0000","last_clean":"2023-10-06T11:16:03.269573+0000","last_became_active":"2023-10-06T11:16:03.269062+0000","last_became_peered":"2023-10-06T11:16:03.269062+0000","last_unstale":"2023-10-06T11:16:03.269573+0000","last_undegraded":"2023-10-06T11:16:03.269573+0000","last_fullsized":"2023-10-06T11:16:03.269573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:01.433177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254020+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:28.682952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266206+0000","last_change":"2023-10-06T11:16:03.266206+0000","last_active":"2023-10-06T11:16:03.266206+0000","last_peered":"2023-10-06T11:16:03.266206+0000","last_clean":"2023-10-06T11:16:03.266206+0000","last_became_active":"2023-10-06T11:16:03.265914+0000","last_became_peered":"2023-10-06T11:16:03.265914+0000","last_unstale":"2023-10-06T11:16:03.266206+0000","last_undegraded":"2023-10-06T11:16:03.266206+0000","last_fullsized":"2023-10-06T11:16:03.266206+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:48.121863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254455+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:22.679612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266356+0000","last_change":"2023-10-06T11:16:03.266356+0000","last_active":"2023-10-06T11:16:03.266356+0000","last_peered":"2023-10-06T11:16:03.266356+0000","last_clean":"2023-10-06T11:16:03.266356+0000","last_became_active":"2023-10-06T11:16:03.265589+0000","last_became_peered":"2023-10-06T11:16:03.265589+0000","last_unstale":"2023-10-06T11:16:03.266356+0000","last_undegraded":"2023-10-06T11:16:03.266356+0000","last_fullsized":"2023-10-06T11:16:03.266356+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.931454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259480+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266459+0000","last_change":"2023-10-06T11:16:03.266459+0000","last_active":"2023-10-06T11:16:03.266459+0000","last_peered":"2023-10-06T11:16:03.266459+0000","last_clean":"2023-10-06T11:16:03.266459+0000","last_became_active":"2023-10-06T11:16:03.266184+0000","last_became_peered":"2023-10-06T11:16:03.266184+0000","last_unstale":"2023-10-06T11:16:03.266459+0000","last_undegraded":"2023-10-06T11:16:03.266459+0000","last_fullsized":"2023-10-06T11:16:03.266459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260649+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:59.632291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269548+0000","last_change":"2023-10-06T11:16:03.269548+0000","last_active":"2023-10-06T11:16:03.269548+0000","last_peered":"2023-10-06T11:16:03.269548+0000","last_clean":"2023-10-06T11:16:03.269548+0000","last_became_active":"2023-10-06T11:16:03.269297+0000","last_became_peered":"2023-10-06T11:16:03.269297+0000","last_unstale":"2023-10-06T11:16:03.269548+0000","last_undegraded":"2023-10-06T11:16:03.269548+0000","last_fullsized":"2023-10-06T11:16:03.269548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.255327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.267342+0000","last_change":"2023-10-06T11:16:03.267342+0000","last_active":"2023-10-06T11:16:03.267342+0000","last_peered":"2023-10-06T11:16:03.267342+0000","last_clean":"2023-10-06T11:16:03.267342+0000","last_became_active":"2023-10-06T11:16:03.266327+0000","last_became_peered":"2023-10-06T11:16:03.266327+0000","last_unstale":"2023-10-06T11:16:03.267342+0000","last_undegraded":"2023-10-06T11:16:03.267342+0000","last_fullsized":"2023-10-06T11:16:03.267342+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:23.538191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261470+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:39.333083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.275983+0000","last_change":"2023-10-06T11:16:03.275983+0000","last_active":"2023-10-06T11:16:03.275983+0000","last_peered":"2023-10-06T11:16:03.275983+0000","last_clean":"2023-10-06T11:16:03.275983+0000","last_became_active":"2023-10-06T11:16:03.275473+0000","last_became_peered":"2023-10-06T11:16:03.275473+0000","last_unstale":"2023-10-06T11:16:03.275983+0000","last_undegraded":"2023-10-06T11:16:03.275983+0000","last_fullsized":"2023-10-06T11:16:03.275983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:41.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253327+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:03.103375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.264078+0000","last_change":"2023-10-06T11:16:03.264078+0000","last_active":"2023-10-06T11:16:03.264078+0000","last_peered":"2023-10-06T11:16:03.264078+0000","last_clean":"2023-10-06T11:16:03.264078+0000","last_became_active":"2023-10-06T11:16:03.263683+0000","last_became_peered":"2023-10-06T11:16:03.263683+0000","last_unstale":"2023-10-06T11:16:03.264078+0000","last_undegraded":"2023-10-06T11:16:03.264078+0000","last_fullsized":"2023-10-06T11:16:03.264078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262776+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:33.366065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271127+0000","last_change":"2023-10-06T11:16:03.271127+0000","last_active":"2023-10-06T11:16:03.271127+0000","last_peered":"2023-10-06T11:16:03.271127+0000","last_clean":"2023-10-06T11:16:03.271127+0000","last_became_active":"2023-10-06T11:16:03.270133+0000","last_became_peered":"2023-10-06T11:16:03.270133+0000","last_unstale":"2023-10-06T11:16:03.271127+0000","last_undegraded":"2023-10-06T11:16:03.271127+0000","last_fullsized":"2023-10-06T11:16:03.271127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:50.310646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253489+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:38.768695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265577+0000","last_change":"2023-10-06T11:16:03.265577+0000","last_active":"2023-10-06T11:16:03.265577+0000","last_peered":"2023-10-06T11:16:03.265577+0000","last_clean":"2023-10-06T11:16:03.265577+0000","last_became_active":"2023-10-06T11:16:03.265337+0000","last_became_peered":"2023-10-06T11:16:03.265337+0000","last_unstale":"2023-10-06T11:16:03.265577+0000","last_undegraded":"2023-10-06T11:16:03.265577+0000","last_fullsized":"2023-10-06T11:16:03.265577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:29.052675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258850+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:08.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271695+0000","last_change":"2023-10-06T11:16:03.271695+0000","last_active":"2023-10-06T11:16:03.271695+0000","last_peered":"2023-10-06T11:16:03.271695+0000","last_clean":"2023-10-06T11:16:03.271695+0000","last_became_active":"2023-10-06T11:16:03.271426+0000","last_became_peered":"2023-10-06T11:16:03.271426+0000","last_unstale":"2023-10-06T11:16:03.271695+0000","last_undegraded":"2023-10-06T11:16:03.271695+0000","last_fullsized":"2023-10-06T11:16:03.271695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:58.625857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.262201+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:56.438390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.259310+0000","last_change":"2023-10-06T11:16:03.259310+0000","last_active":"2023-10-06T11:16:03.259310+0000","last_peered":"2023-10-06T11:16:03.259310+0000","last_clean":"2023-10-06T11:16:03.259310+0000","last_became_active":"2023-10-06T11:16:03.259025+0000","last_became_peered":"2023-10-06T11:16:03.259025+0000","last_unstale":"2023-10-06T11:16:03.259310+0000","last_undegraded":"2023-10-06T11:16:03.259310+0000","last_fullsized":"2023-10-06T11:16:03.259310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:02.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258209+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:46.937887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265765+0000","last_change":"2023-10-06T11:16:03.265765+0000","last_active":"2023-10-06T11:16:03.265765+0000","last_peered":"2023-10-06T11:16:03.265765+0000","last_clean":"2023-10-06T11:16:03.265765+0000","last_became_active":"2023-10-06T11:16:03.265563+0000","last_became_peered":"2023-10-06T11:16:03.265563+0000","last_unstale":"2023-10-06T11:16:03.265765+0000","last_undegraded":"2023-10-06T11:16:03.265765+0000","last_fullsized":"2023-10-06T11:16:03.265765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:17.485665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.263556+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:02.439611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265381+0000","last_change":"2023-10-06T11:16:03.265381+0000","last_active":"2023-10-06T11:16:03.265381+0000","last_peered":"2023-10-06T11:16:03.265381+0000","last_clean":"2023-10-06T11:16:03.265381+0000","last_became_active":"2023-10-06T11:16:03.264912+0000","last_became_peered":"2023-10-06T11:16:03.264912+0000","last_unstale":"2023-10-06T11:16:03.265381+0000","last_undegraded":"2023-10-06T11:16:03.265381+0000","last_fullsized":"2023-10-06T11:16:03.265381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:43.791751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.254074+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:44.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273426+0000","last_change":"2023-10-06T11:16:03.273426+0000","last_active":"2023-10-06T11:16:03.273426+0000","last_peered":"2023-10-06T11:16:03.273426+0000","last_clean":"2023-10-06T11:16:03.273426+0000","last_became_active":"2023-10-06T11:16:03.273151+0000","last_became_peered":"2023-10-06T11:16:03.273151+0000","last_unstale":"2023-10-06T11:16:03.273426+0000","last_undegraded":"2023-10-06T11:16:03.273426+0000","last_fullsized":"2023-10-06T11:16:03.273426+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258548+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:24.031979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.270536+0000","last_change":"2023-10-06T11:16:03.270536+0000","last_active":"2023-10-06T11:16:03.270536+0000","last_peered":"2023-10-06T11:16:03.270536+0000","last_clean":"2023-10-06T11:16:03.270536+0000","last_became_active":"2023-10-06T11:16:03.270254+0000","last_became_peered":"2023-10-06T11:16:03.270254+0000","last_unstale":"2023-10-06T11:16:03.270536+0000","last_undegraded":"2023-10-06T11:16:03.270536+0000","last_fullsized":"2023-10-06T11:16:03.270536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:12.895297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.257433+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:22.373332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271934+0000","last_change":"2023-10-06T11:16:03.271934+0000","last_active":"2023-10-06T11:16:03.271934+0000","last_peered":"2023-10-06T11:16:03.271934+0000","last_clean":"2023-10-06T11:16:03.271934+0000","last_became_active":"2023-10-06T11:16:03.271636+0000","last_became_peered":"2023-10-06T11:16:03.271636+0000","last_unstale":"2023-10-06T11:16:03.271934+0000","last_undegraded":"2023-10-06T11:16:03.271934+0000","last_fullsized":"2023-10-06T11:16:03.271934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:50.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:13.901730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.269336+0000","last_change":"2023-10-06T11:16:03.269336+0000","last_active":"2023-10-06T11:16:03.269336+0000","last_peered":"2023-10-06T11:16:03.269336+0000","last_clean":"2023-10-06T11:16:03.269336+0000","last_became_active":"2023-10-06T11:16:03.269072+0000","last_became_peered":"2023-10-06T11:16:03.269072+0000","last_unstale":"2023-10-06T11:16:03.269336+0000","last_undegraded":"2023-10-06T11:16:03.269336+0000","last_fullsized":"2023-10-06T11:16:03.269336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.151151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250171+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:02.250171+0000","last_peered":"2023-10-06T11:16:02.250171+0000","last_clean":"2023-10-06T11:16:02.250171+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:02.250171+0000","last_undegraded":"2023-10-06T11:16:02.250171+0000","last_fullsized":"2023-10-06T11:16:02.250171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.259252+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:59.787675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.272428+0000","last_change":"2023-10-06T11:16:03.272428+0000","last_active":"2023-10-06T11:16:03.272428+0000","last_peered":"2023-10-06T11:16:03.272428+0000","last_clean":"2023-10-06T11:16:03.272428+0000","last_became_active":"2023-10-06T11:16:03.272148+0000","last_became_peered":"2023-10-06T11:16:03.272148+0000","last_unstale":"2023-10-06T11:16:03.272428+0000","last_undegraded":"2023-10-06T11:16:03.272428+0000","last_fullsized":"2023-10-06T11:16:03.272428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247882+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:02.247882+0000","last_peered":"2023-10-06T11:16:02.247882+0000","last_clean":"2023-10-06T11:16:02.247882+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:02.247882+0000","last_undegraded":"2023-10-06T11:16:02.247882+0000","last_fullsized":"2023-10-06T11:16:02.247882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.253854+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:03.569628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266437+0000","last_change":"2023-10-06T11:16:03.266437+0000","last_active":"2023-10-06T11:16:03.266437+0000","last_peered":"2023-10-06T11:16:03.266437+0000","last_clean":"2023-10-06T11:16:03.266437+0000","last_became_active":"2023-10-06T11:16:03.266161+0000","last_became_peered":"2023-10-06T11:16:03.266161+0000","last_unstale":"2023-10-06T11:16:03.266437+0000","last_undegraded":"2023-10-06T11:16:03.266437+0000","last_fullsized":"2023-10-06T11:16:03.266437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.245711+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:02.245711+0000","last_peered":"2023-10-06T11:16:02.245711+0000","last_clean":"2023-10-06T11:16:02.245711+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:02.245711+0000","last_undegraded":"2023-10-06T11:16:02.245711+0000","last_fullsized":"2023-10-06T11:16:02.245711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.261544+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:22.046036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.271072+0000","last_change":"2023-10-06T11:16:03.271072+0000","last_active":"2023-10-06T11:16:03.271072+0000","last_peered":"2023-10-06T11:16:03.271072+0000","last_clean":"2023-10-06T11:16:03.271072+0000","last_became_active":"2023-10-06T11:16:03.270859+0000","last_became_peered":"2023-10-06T11:16:03.270859+0000","last_unstale":"2023-10-06T11:16:03.271072+0000","last_undegraded":"2023-10-06T11:16:03.271072+0000","last_fullsized":"2023-10-06T11:16:03.271072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.247883+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:02.247883+0000","last_peered":"2023-10-06T11:16:02.247883+0000","last_clean":"2023-10-06T11:16:02.247883+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:02.247883+0000","last_undegraded":"2023-10-06T11:16:02.247883+0000","last_fullsized":"2023-10-06T11:16:02.247883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260159+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:35.012634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.266154+0000","last_change":"2023-10-06T11:16:03.266154+0000","last_active":"2023-10-06T11:16:03.266154+0000","last_peered":"2023-10-06T11:16:03.266154+0000","last_clean":"2023-10-06T11:16:03.266154+0000","last_became_active":"2023-10-06T11:16:03.265870+0000","last_became_peered":"2023-10-06T11:16:03.265870+0000","last_unstale":"2023-10-06T11:16:03.266154+0000","last_undegraded":"2023-10-06T11:16:03.266154+0000","last_fullsized":"2023-10-06T11:16:03.266154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:43.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251429+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:02.251429+0000","last_peered":"2023-10-06T11:16:02.251429+0000","last_clean":"2023-10-06T11:16:02.251429+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:02.251429+0000","last_undegraded":"2023-10-06T11:16:02.251429+0000","last_fullsized":"2023-10-06T11:16:02.251429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.258004+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.579290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.265091+0000","last_change":"2023-10-06T11:16:03.265091+0000","last_active":"2023-10-06T11:16:03.265091+0000","last_peered":"2023-10-06T11:16:03.265091+0000","last_clean":"2023-10-06T11:16:03.265091+0000","last_became_active":"2023-10-06T11:16:03.264806+0000","last_became_peered":"2023-10-06T11:16:03.264806+0000","last_unstale":"2023-10-06T11:16:03.265091+0000","last_undegraded":"2023-10-06T11:16:03.265091+0000","last_fullsized":"2023-10-06T11:16:03.265091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:40.908155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.251336+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:02.251336+0000","last_peered":"2023-10-06T11:16:02.251336+0000","last_clean":"2023-10-06T11:16:02.251336+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:02.251336+0000","last_undegraded":"2023-10-06T11:16:02.251336+0000","last_fullsized":"2023-10-06T11:16:02.251336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.260202+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:55.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.273491+0000","last_change":"2023-10-06T11:16:03.273491+0000","last_active":"2023-10-06T11:16:03.273491+0000","last_peered":"2023-10-06T11:16:03.273491+0000","last_clean":"2023-10-06T11:16:03.273491+0000","last_became_active":"2023-10-06T11:16:03.273217+0000","last_became_peered":"2023-10-06T11:16:03.273217+0000","last_unstale":"2023-10-06T11:16:03.273491+0000","last_undegraded":"2023-10-06T11:16:03.273491+0000","last_fullsized":"2023-10-06T11:16:03.273491+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:04.630874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.250469+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:02.250469+0000","last_peered":"2023-10-06T11:16:02.250469+0000","last_clean":"2023-10-06T11:16:02.250469+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:02.250469+0000","last_undegraded":"2023-10-06T11:16:02.250469+0000","last_fullsized":"2023-10-06T11:16:02.250469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:03.242332+0000","last_change":"2023-10-06T11:16:03.264015+0000","last_active":"2023-10-06T11:16:03.242332+0000","last_peered":"2023-10-06T11:16:03.242332+0000","last_clean":"2023-10-06T11:16:03.242332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:03.242332+0000","last_undegraded":"2023-10-06T11:16:03.242332+0000","last_fullsized":"2023-10-06T11:16:03.242332+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:51.317079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-06T11:16:03.268311+0000","last_change":"2023-10-06T11:16:03.268311+0000","last_active":"2023-10-06T11:16:03.268311+0000","last_peered":"2023-10-06T11:16:03.268311+0000","last_clean":"2023-10-06T11:16:03.268311+0000","last_became_active":"2023-10-06T11:16:03.266368+0000","last_became_peered":"2023-10-06T11:16:03.266368+0000","last_unstale":"2023-10-06T11:16:03.268311+0000","last_undegraded":"2023-10-06T11:16:03.268311+0000","last_fullsized":"2023-10-06T11:16:03.268311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:16:02.252377+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:02.252377+0000","last_peered":"2023-10-06T11:16:02.252377+0000","last_clean":"2023-10-06T11:16:02.252377+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:02.252377+0000","last_undegraded":"2023-10-06T11:16:02.252377+0000","last_fullsized":"2023-10-06T11:16:02.252377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.378}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.40799999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.501},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.499,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69299999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.439,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77800000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.26200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":0.496}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1104504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.745},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.41199999999999998,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.1600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.755,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48699999999999999,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.434},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80900000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.315},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.439,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.39100000000000001},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39700000000000002,"15min":0.40500000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47199999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.47899999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27900000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76500000000000001,"5min":0.997,"15min":0.997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.48299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79200000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72899999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.754,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69399999999999995,"5min":1.115,"15min":1.115},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77800000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77700000000000002,"5min":1.276,"15min":1.276},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.66200000000000003,"15min":0.67400000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.747,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.40300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.996,"15min":0.996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.629}]},{"osd":5,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.372,"5min":0.307,"15min":0.307},"max":{"1min":0.88300000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.745,"5min":1.014,"15min":1.014},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85499999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.038,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":514136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.41199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69299999999999995,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:12.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:13.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.114+0000 7fbd80917700 1 Processor -- start 2023-10-06T11:16:13.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.114+0000 7fbd80917700 1 -- start start 2023-10-06T11:16:13.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd80917700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd7c159440 0x7fbd7c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd80917700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0b35d0 0x7fbd7c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd80917700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c0cb7a0 con 0x7fbd7c0cc170 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd80917700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b0860 con 0x7fbd7c159440 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd80917700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0cb150 con 0x7fbd7c0b35d0 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd7b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd7c159440 0x7fbd7c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd7bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbd7c0cc170 0x7fbd7c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49370/0 (socket says 172.21.15.55:49370) 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd7b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd7c159440 0x7fbd7c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60692/0 (socket says 172.21.15.55:60692) 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.115+0000 7fbd7bfff700 1 -- 172.21.15.55:0/2138215964 learned_addr learned my addr 172.21.15.55:0/2138215964 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7affd700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0b35d0 0x7fbd7c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7b7fe700 1 -- 172.21.15.55:0/2138215964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0b35d0 msgr2=0x7fbd7c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7b7fe700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0b35d0 0x7fbd7c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7b7fe700 1 -- 172.21.15.55:0/2138215964 >> v1:172.21.15.55:6789/0 conn(0x7fbd7c0cc170 legacy=0x7fbd7c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7b7fe700 1 -- 172.21.15.55:0/2138215964 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c0cb430 con 0x7fbd7c159440 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7affd700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0b35d0 0x7fbd7c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7a7fc700 1 -- 172.21.15.55:0/2138215964 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632451198 0 0) 0x7fbd7c0cb7a0 con 0x7fbd7c0cc170 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7b7fe700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c0b3090 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0098e0 tx=0x7fbd6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f76b786d841ed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7a7fc700 1 -- 172.21.15.55:0/2138215964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c009e80 con 0x7fbd7c159440 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7a7fc700 1 -- 172.21.15.55:0/2138215964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00b860 con 0x7fbd7c159440 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.116+0000 7fbd7a7fc700 1 -- 172.21.15.55:0/2138215964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00bbe0 con 0x7fbd7c159440 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 -- 172.21.15.55:0/2138215964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 msgr2=0x7fbd7c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c0b3090 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0098e0 tx=0x7fbd6c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 -- 172.21.15.55:0/2138215964 shutdown_connections 2023-10-06T11:16:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c0b3090 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 --2- 172.21.15.55:0/2138215964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0b35d0 0x7fbd7c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 -- 172.21.15.55:0/2138215964 >> 172.21.15.55:0/2138215964 conn(0x7fbd7c06ece0 msgr2=0x7fbd7c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 -- 172.21.15.55:0/2138215964 shutdown_connections 2023-10-06T11:16:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.117+0000 7fbd80917700 1 -- 172.21.15.55:0/2138215964 wait complete. 2023-10-06T11:16:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.118+0000 7fbd80917700 1 Processor -- start 2023-10-06T11:16:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.119+0000 7fbd80917700 1 -- start start 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd7c0b35d0 0x7fbd7c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0cc170 0x7fbd7c154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c15b670 con 0x7fbd7c159440 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c15c2f0 con 0x7fbd7c0b35d0 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c154cd0 con 0x7fbd7c0cc170 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60694/0 (socket says 172.21.15.55:60694) 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 -- 172.21.15.55:0/2435176894 learned_addr learned my addr 172.21.15.55:0/2435176894 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7affd700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0cc170 0x7fbd7c154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7b7fe700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd7c0b35d0 0x7fbd7c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 -- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0cc170 msgr2=0x7fbd7c154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0cc170 0x7fbd7c154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 -- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd7c0b35d0 msgr2=0x7fbd7c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd7c0b35d0 0x7fbd7c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 -- 172.21.15.55:0/2435176894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009420 con 0x7fbd7c159440 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7affd700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0cc170 0x7fbd7c154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7b7fe700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd7c0b35d0 0x7fbd7c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd7bfff700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c156ac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400cc90 tx=0x7fbd74001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400cea0 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7400ab70 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c15aa60 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.120+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740070f0 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.121+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c15b020 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.122+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c05f230 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.122+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd740074a0 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.122+0000 7fbd637fe700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd68066f30 0x7fbd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.122+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbd74084c40 con 0x7fbd7c159440 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.122+0000 7fbd7b7fe700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd68066f30 0x7fbd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.123+0000 7fbd7b7fe700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd68066f30 0x7fbd680693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c003080 tx=0x7fbd6c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.127+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd74051c90 con 0x7fbd7c159440 2023-10-06T11:16:13.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.317+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd7c159810 con 0x7fbd68066f30 2023-10-06T11:16:13.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.326+0000 7fbd637fe700 1 -- 172.21.15.55:0/2435176894 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311702 (secure 0 0 0) 0x7fbd7c159810 con 0x7fbd68066f30 2023-10-06T11:16:13.331 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd68066f30 msgr2=0x7fbd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd68066f30 0x7fbd680693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c003080 tx=0x7fbd6c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 msgr2=0x7fbd7c156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c156ac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400cc90 tx=0x7fbd74001a80 comp rx=0 tx=0).stop 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 shutdown_connections 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbd68066f30 0x7fbd680693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd7c159440 0x7fbd7c156ac0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd7c0b35d0 0x7fbd7c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 --2- 172.21.15.55:0/2435176894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd7c0cc170 0x7fbd7c154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 >> 172.21.15.55:0/2435176894 conn(0x7fbd7c06ece0 msgr2=0x7fbd7c0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 shutdown_connections 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.329+0000 7fbd80917700 1 -- 172.21.15.55:0/2435176894 wait complete. 2023-10-06T11:16:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:13.343 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-10-06T11:16:12.883332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388296,"kb_used_data":9992,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586424,"statfs":{"total":773094113280,"available":770648498176,"internally_reserved":0,"allocated":10231808,"data_stored":5413612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.629834"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290251+0000","last_change":"2023-10-06T11:16:04.275853+0000","last_active":"2023-10-06T11:16:04.290251+0000","last_peered":"2023-10-06T11:16:04.290251+0000","last_clean":"2023-10-06T11:16:04.290251+0000","last_became_active":"2023-10-06T11:16:04.275585+0000","last_became_peered":"2023-10-06T11:16:04.275585+0000","last_unstale":"2023-10-06T11:16:04.290251+0000","last_undegraded":"2023-10-06T11:16:04.290251+0000","last_fullsized":"2023-10-06T11:16:04.290251+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:48.349890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289210+0000","last_change":"2023-10-06T11:16:04.282784+0000","last_active":"2023-10-06T11:16:04.289210+0000","last_peered":"2023-10-06T11:16:04.289210+0000","last_clean":"2023-10-06T11:16:04.289210+0000","last_became_active":"2023-10-06T11:16:04.280896+0000","last_became_peered":"2023-10-06T11:16:04.280896+0000","last_unstale":"2023-10-06T11:16:04.289210+0000","last_undegraded":"2023-10-06T11:16:04.289210+0000","last_fullsized":"2023-10-06T11:16:04.289210+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:44.839319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290027+0000","last_change":"2023-10-06T11:16:04.276110+0000","last_active":"2023-10-06T11:16:04.290027+0000","last_peered":"2023-10-06T11:16:04.290027+0000","last_clean":"2023-10-06T11:16:04.290027+0000","last_became_active":"2023-10-06T11:16:04.275830+0000","last_became_peered":"2023-10-06T11:16:04.275830+0000","last_unstale":"2023-10-06T11:16:04.290027+0000","last_undegraded":"2023-10-06T11:16:04.290027+0000","last_fullsized":"2023-10-06T11:16:04.290027+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:06.331686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.280264+0000","last_change":"2023-10-06T11:16:04.277826+0000","last_active":"2023-10-06T11:16:04.280264+0000","last_peered":"2023-10-06T11:16:04.280264+0000","last_clean":"2023-10-06T11:16:04.280264+0000","last_became_active":"2023-10-06T11:16:04.277515+0000","last_became_peered":"2023-10-06T11:16:04.277515+0000","last_unstale":"2023-10-06T11:16:04.280264+0000","last_undegraded":"2023-10-06T11:16:04.280264+0000","last_fullsized":"2023-10-06T11:16:04.280264+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:44.798184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.274534+0000","last_change":"2023-10-06T11:16:04.271362+0000","last_active":"2023-10-06T11:16:04.274534+0000","last_peered":"2023-10-06T11:16:04.274534+0000","last_clean":"2023-10-06T11:16:04.274534+0000","last_became_active":"2023-10-06T11:16:04.271093+0000","last_became_peered":"2023-10-06T11:16:04.271093+0000","last_unstale":"2023-10-06T11:16:04.274534+0000","last_undegraded":"2023-10-06T11:16:04.274534+0000","last_fullsized":"2023-10-06T11:16:04.274534+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:06.651645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.277303+0000","last_change":"2023-10-06T11:16:04.267944+0000","last_active":"2023-10-06T11:16:04.277303+0000","last_peered":"2023-10-06T11:16:04.277303+0000","last_clean":"2023-10-06T11:16:04.277303+0000","last_became_active":"2023-10-06T11:16:04.267513+0000","last_became_peered":"2023-10-06T11:16:04.267513+0000","last_unstale":"2023-10-06T11:16:04.277303+0000","last_undegraded":"2023-10-06T11:16:04.277303+0000","last_fullsized":"2023-10-06T11:16:04.277303+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.277382+0000","last_change":"2023-10-06T11:16:04.267831+0000","last_active":"2023-10-06T11:16:04.277382+0000","last_peered":"2023-10-06T11:16:04.277382+0000","last_clean":"2023-10-06T11:16:04.277382+0000","last_became_active":"2023-10-06T11:16:04.267533+0000","last_became_peered":"2023-10-06T11:16:04.267533+0000","last_unstale":"2023-10-06T11:16:04.277382+0000","last_undegraded":"2023-10-06T11:16:04.277382+0000","last_fullsized":"2023-10-06T11:16:04.277382+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289272+0000","last_change":"2023-10-06T11:16:04.283216+0000","last_active":"2023-10-06T11:16:04.289272+0000","last_peered":"2023-10-06T11:16:04.289272+0000","last_clean":"2023-10-06T11:16:04.289272+0000","last_became_active":"2023-10-06T11:16:04.282928+0000","last_became_peered":"2023-10-06T11:16:04.282928+0000","last_unstale":"2023-10-06T11:16:04.289272+0000","last_undegraded":"2023-10-06T11:16:04.289272+0000","last_fullsized":"2023-10-06T11:16:04.289272+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:38.174068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.281995+0000","last_change":"2023-10-06T11:16:04.274500+0000","last_active":"2023-10-06T11:16:04.281995+0000","last_peered":"2023-10-06T11:16:04.281995+0000","last_clean":"2023-10-06T11:16:04.281995+0000","last_became_active":"2023-10-06T11:16:04.274291+0000","last_became_peered":"2023-10-06T11:16:04.274291+0000","last_unstale":"2023-10-06T11:16:04.281995+0000","last_undegraded":"2023-10-06T11:16:04.281995+0000","last_fullsized":"2023-10-06T11:16:04.281995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:07.558350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279727+0000","last_change":"2023-10-06T11:16:04.276484+0000","last_active":"2023-10-06T11:16:04.279727+0000","last_peered":"2023-10-06T11:16:04.279727+0000","last_clean":"2023-10-06T11:16:04.279727+0000","last_became_active":"2023-10-06T11:16:04.276198+0000","last_became_peered":"2023-10-06T11:16:04.276198+0000","last_unstale":"2023-10-06T11:16:04.279727+0000","last_undegraded":"2023-10-06T11:16:04.279727+0000","last_fullsized":"2023-10-06T11:16:04.279727+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:38.711749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.280779+0000","last_change":"2023-10-06T11:16:04.280390+0000","last_active":"2023-10-06T11:16:04.280779+0000","last_peered":"2023-10-06T11:16:04.280779+0000","last_clean":"2023-10-06T11:16:04.280779+0000","last_became_active":"2023-10-06T11:16:04.280121+0000","last_became_peered":"2023-10-06T11:16:04.280121+0000","last_unstale":"2023-10-06T11:16:04.280779+0000","last_undegraded":"2023-10-06T11:16:04.280779+0000","last_fullsized":"2023-10-06T11:16:04.280779+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290295+0000","last_change":"2023-10-06T11:16:04.288754+0000","last_active":"2023-10-06T11:16:04.290295+0000","last_peered":"2023-10-06T11:16:04.290295+0000","last_clean":"2023-10-06T11:16:04.290295+0000","last_became_active":"2023-10-06T11:16:04.288447+0000","last_became_peered":"2023-10-06T11:16:04.288447+0000","last_unstale":"2023-10-06T11:16:04.290295+0000","last_undegraded":"2023-10-06T11:16:04.290295+0000","last_fullsized":"2023-10-06T11:16:04.290295+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279728+0000","last_change":"2023-10-06T11:16:04.272870+0000","last_active":"2023-10-06T11:16:04.279728+0000","last_peered":"2023-10-06T11:16:04.279728+0000","last_clean":"2023-10-06T11:16:04.279728+0000","last_became_active":"2023-10-06T11:16:04.272663+0000","last_became_peered":"2023-10-06T11:16:04.272663+0000","last_unstale":"2023-10-06T11:16:04.279728+0000","last_undegraded":"2023-10-06T11:16:04.279728+0000","last_fullsized":"2023-10-06T11:16:04.279728+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:35.622395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.284548+0000","last_change":"2023-10-06T11:16:04.275407+0000","last_active":"2023-10-06T11:16:04.284548+0000","last_peered":"2023-10-06T11:16:04.284548+0000","last_clean":"2023-10-06T11:16:04.284548+0000","last_became_active":"2023-10-06T11:16:04.274706+0000","last_became_peered":"2023-10-06T11:16:04.274706+0000","last_unstale":"2023-10-06T11:16:04.284548+0000","last_undegraded":"2023-10-06T11:16:04.284548+0000","last_fullsized":"2023-10-06T11:16:04.284548+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:10.645661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.288889+0000","last_change":"2023-10-06T11:16:04.288118+0000","last_active":"2023-10-06T11:16:04.288889+0000","last_peered":"2023-10-06T11:16:04.288889+0000","last_clean":"2023-10-06T11:16:04.288889+0000","last_became_active":"2023-10-06T11:16:04.287825+0000","last_became_peered":"2023-10-06T11:16:04.287825+0000","last_unstale":"2023-10-06T11:16:04.288889+0000","last_undegraded":"2023-10-06T11:16:04.288889+0000","last_fullsized":"2023-10-06T11:16:04.288889+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:06.651645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.285957+0000","last_change":"2023-10-06T11:16:04.284956+0000","last_active":"2023-10-06T11:16:04.285957+0000","last_peered":"2023-10-06T11:16:04.285957+0000","last_clean":"2023-10-06T11:16:04.285957+0000","last_became_active":"2023-10-06T11:16:04.284656+0000","last_became_peered":"2023-10-06T11:16:04.284656+0000","last_unstale":"2023-10-06T11:16:04.285957+0000","last_undegraded":"2023-10-06T11:16:04.285957+0000","last_fullsized":"2023-10-06T11:16:04.285957+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:11.792964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289601+0000","last_change":"2023-10-06T11:16:04.283172+0000","last_active":"2023-10-06T11:16:04.289601+0000","last_peered":"2023-10-06T11:16:04.289601+0000","last_clean":"2023-10-06T11:16:04.289601+0000","last_became_active":"2023-10-06T11:16:04.282949+0000","last_became_peered":"2023-10-06T11:16:04.282949+0000","last_unstale":"2023-10-06T11:16:04.289601+0000","last_undegraded":"2023-10-06T11:16:04.289601+0000","last_fullsized":"2023-10-06T11:16:04.289601+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:25.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.283269+0000","last_change":"2023-10-06T11:16:04.282315+0000","last_active":"2023-10-06T11:16:04.283269+0000","last_peered":"2023-10-06T11:16:04.283269+0000","last_clean":"2023-10-06T11:16:04.283269+0000","last_became_active":"2023-10-06T11:16:04.282005+0000","last_became_peered":"2023-10-06T11:16:04.282005+0000","last_unstale":"2023-10-06T11:16:04.283269+0000","last_undegraded":"2023-10-06T11:16:04.283269+0000","last_fullsized":"2023-10-06T11:16:04.283269+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:44.007356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289012+0000","last_change":"2023-10-06T11:16:04.277018+0000","last_active":"2023-10-06T11:16:04.289012+0000","last_peered":"2023-10-06T11:16:04.289012+0000","last_clean":"2023-10-06T11:16:04.289012+0000","last_became_active":"2023-10-06T11:16:04.276690+0000","last_became_peered":"2023-10-06T11:16:04.276690+0000","last_unstale":"2023-10-06T11:16:04.289012+0000","last_undegraded":"2023-10-06T11:16:04.289012+0000","last_fullsized":"2023-10-06T11:16:04.289012+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:06.571060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.282065+0000","last_change":"2023-10-06T11:16:04.275817+0000","last_active":"2023-10-06T11:16:04.282065+0000","last_peered":"2023-10-06T11:16:04.282065+0000","last_clean":"2023-10-06T11:16:04.282065+0000","last_became_active":"2023-10-06T11:16:04.275548+0000","last_became_peered":"2023-10-06T11:16:04.275548+0000","last_unstale":"2023-10-06T11:16:04.282065+0000","last_undegraded":"2023-10-06T11:16:04.282065+0000","last_fullsized":"2023-10-06T11:16:04.282065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:26:45.238766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279031+0000","last_change":"2023-10-06T11:16:04.265498+0000","last_active":"2023-10-06T11:16:04.279031+0000","last_peered":"2023-10-06T11:16:04.279031+0000","last_clean":"2023-10-06T11:16:04.279031+0000","last_became_active":"2023-10-06T11:16:04.265220+0000","last_became_peered":"2023-10-06T11:16:04.265220+0000","last_unstale":"2023-10-06T11:16:04.279031+0000","last_undegraded":"2023-10-06T11:16:04.279031+0000","last_fullsized":"2023-10-06T11:16:04.279031+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:08.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.287204+0000","last_change":"2023-10-06T11:16:04.281158+0000","last_active":"2023-10-06T11:16:04.287204+0000","last_peered":"2023-10-06T11:16:04.287204+0000","last_clean":"2023-10-06T11:16:04.287204+0000","last_became_active":"2023-10-06T11:16:04.280868+0000","last_became_peered":"2023-10-06T11:16:04.280868+0000","last_unstale":"2023-10-06T11:16:04.287204+0000","last_undegraded":"2023-10-06T11:16:04.287204+0000","last_fullsized":"2023-10-06T11:16:04.287204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:30.381280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.287252+0000","last_change":"2023-10-06T11:16:04.281845+0000","last_active":"2023-10-06T11:16:04.287252+0000","last_peered":"2023-10-06T11:16:04.287252+0000","last_clean":"2023-10-06T11:16:04.287252+0000","last_became_active":"2023-10-06T11:16:04.281546+0000","last_became_peered":"2023-10-06T11:16:04.281546+0000","last_unstale":"2023-10-06T11:16:04.287252+0000","last_undegraded":"2023-10-06T11:16:04.287252+0000","last_fullsized":"2023-10-06T11:16:04.287252+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:41.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.292778+0000","last_change":"2023-10-06T11:16:04.291700+0000","last_active":"2023-10-06T11:16:04.292778+0000","last_peered":"2023-10-06T11:16:04.292778+0000","last_clean":"2023-10-06T11:16:04.292778+0000","last_became_active":"2023-10-06T11:16:04.291431+0000","last_became_peered":"2023-10-06T11:16:04.291431+0000","last_unstale":"2023-10-06T11:16:04.292778+0000","last_undegraded":"2023-10-06T11:16:04.292778+0000","last_fullsized":"2023-10-06T11:16:04.292778+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:38.711749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.285886+0000","last_change":"2023-10-06T11:16:04.284661+0000","last_active":"2023-10-06T11:16:04.285886+0000","last_peered":"2023-10-06T11:16:04.285886+0000","last_clean":"2023-10-06T11:16:04.285886+0000","last_became_active":"2023-10-06T11:16:04.284394+0000","last_became_peered":"2023-10-06T11:16:04.284394+0000","last_unstale":"2023-10-06T11:16:04.285886+0000","last_undegraded":"2023-10-06T11:16:04.285886+0000","last_fullsized":"2023-10-06T11:16:04.285886+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:50.514857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289246+0000","last_change":"2023-10-06T11:16:04.287869+0000","last_active":"2023-10-06T11:16:04.289246+0000","last_peered":"2023-10-06T11:16:04.289246+0000","last_clean":"2023-10-06T11:16:04.289246+0000","last_became_active":"2023-10-06T11:16:04.287589+0000","last_became_peered":"2023-10-06T11:16:04.287589+0000","last_unstale":"2023-10-06T11:16:04.289246+0000","last_undegraded":"2023-10-06T11:16:04.289246+0000","last_fullsized":"2023-10-06T11:16:04.289246+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:04.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.280610+0000","last_change":"2023-10-06T11:16:04.278358+0000","last_active":"2023-10-06T11:16:04.280610+0000","last_peered":"2023-10-06T11:16:04.280610+0000","last_clean":"2023-10-06T11:16:04.280610+0000","last_became_active":"2023-10-06T11:16:04.278039+0000","last_became_peered":"2023-10-06T11:16:04.278039+0000","last_unstale":"2023-10-06T11:16:04.280610+0000","last_undegraded":"2023-10-06T11:16:04.280610+0000","last_fullsized":"2023-10-06T11:16:04.280610+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:35.622395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279500+0000","last_change":"2023-10-06T11:16:04.277167+0000","last_active":"2023-10-06T11:16:04.279500+0000","last_peered":"2023-10-06T11:16:04.279500+0000","last_clean":"2023-10-06T11:16:04.279500+0000","last_became_active":"2023-10-06T11:16:04.276887+0000","last_became_peered":"2023-10-06T11:16:04.276887+0000","last_unstale":"2023-10-06T11:16:04.279500+0000","last_undegraded":"2023-10-06T11:16:04.279500+0000","last_fullsized":"2023-10-06T11:16:04.279500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290307+0000","last_change":"2023-10-06T11:16:04.288793+0000","last_active":"2023-10-06T11:16:04.290307+0000","last_peered":"2023-10-06T11:16:04.290307+0000","last_clean":"2023-10-06T11:16:04.290307+0000","last_became_active":"2023-10-06T11:16:04.288536+0000","last_became_peered":"2023-10-06T11:16:04.288536+0000","last_unstale":"2023-10-06T11:16:04.290307+0000","last_undegraded":"2023-10-06T11:16:04.290307+0000","last_fullsized":"2023-10-06T11:16:04.290307+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:25.446593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.291796+0000","last_change":"2023-10-06T11:16:04.289597+0000","last_active":"2023-10-06T11:16:04.291796+0000","last_peered":"2023-10-06T11:16:04.291796+0000","last_clean":"2023-10-06T11:16:04.291796+0000","last_became_active":"2023-10-06T11:16:04.289316+0000","last_became_peered":"2023-10-06T11:16:04.289316+0000","last_unstale":"2023-10-06T11:16:04.291796+0000","last_undegraded":"2023-10-06T11:16:04.291796+0000","last_fullsized":"2023-10-06T11:16:04.291796+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:39.333083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279623+0000","last_change":"2023-10-06T11:16:04.273750+0000","last_active":"2023-10-06T11:16:04.279623+0000","last_peered":"2023-10-06T11:16:04.279623+0000","last_clean":"2023-10-06T11:16:04.279623+0000","last_became_active":"2023-10-06T11:16:04.273493+0000","last_became_peered":"2023-10-06T11:16:04.273493+0000","last_unstale":"2023-10-06T11:16:04.279623+0000","last_undegraded":"2023-10-06T11:16:04.279623+0000","last_fullsized":"2023-10-06T11:16:04.279623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:08.385208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.291016+0000","last_change":"2023-10-06T11:16:04.284369+0000","last_active":"2023-10-06T11:16:04.291016+0000","last_peered":"2023-10-06T11:16:04.291016+0000","last_clean":"2023-10-06T11:16:04.291016+0000","last_became_active":"2023-10-06T11:16:04.284103+0000","last_became_peered":"2023-10-06T11:16:04.284103+0000","last_unstale":"2023-10-06T11:16:04.291016+0000","last_undegraded":"2023-10-06T11:16:04.291016+0000","last_fullsized":"2023-10-06T11:16:04.291016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:38.864479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290897+0000","last_change":"2023-10-06T11:16:04.281638+0000","last_active":"2023-10-06T11:16:04.290897+0000","last_peered":"2023-10-06T11:16:04.290897+0000","last_clean":"2023-10-06T11:16:04.290897+0000","last_became_active":"2023-10-06T11:16:04.281347+0000","last_became_peered":"2023-10-06T11:16:04.281347+0000","last_unstale":"2023-10-06T11:16:04.290897+0000","last_undegraded":"2023-10-06T11:16:04.290897+0000","last_fullsized":"2023-10-06T11:16:04.290897+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:49.128296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"90'4","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.287405+0000","last_change":"2023-10-06T11:16:03.265967+0000","last_active":"2023-10-06T11:16:04.287405+0000","last_peered":"2023-10-06T11:16:04.287405+0000","last_clean":"2023-10-06T11:16:04.287405+0000","last_became_active":"2023-10-06T11:16:03.265053+0000","last_became_peered":"2023-10-06T11:16:03.265053+0000","last_unstale":"2023-10-06T11:16:04.287405+0000","last_undegraded":"2023-10-06T11:16:04.287405+0000","last_fullsized":"2023-10-06T11:16:04.287405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.280407+0000","last_change":"2023-10-06T11:16:04.279601+0000","last_active":"2023-10-06T11:16:04.280407+0000","last_peered":"2023-10-06T11:16:04.280407+0000","last_clean":"2023-10-06T11:16:04.280407+0000","last_became_active":"2023-10-06T11:16:04.279284+0000","last_became_peered":"2023-10-06T11:16:04.279284+0000","last_unstale":"2023-10-06T11:16:04.280407+0000","last_undegraded":"2023-10-06T11:16:04.280407+0000","last_fullsized":"2023-10-06T11:16:04.280407+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:03.103375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.287392+0000","last_change":"2023-10-06T11:16:03.271147+0000","last_active":"2023-10-06T11:16:04.287392+0000","last_peered":"2023-10-06T11:16:04.287392+0000","last_clean":"2023-10-06T11:16:04.287392+0000","last_became_active":"2023-10-06T11:16:03.270881+0000","last_became_peered":"2023-10-06T11:16:03.270881+0000","last_unstale":"2023-10-06T11:16:04.287392+0000","last_undegraded":"2023-10-06T11:16:04.287392+0000","last_fullsized":"2023-10-06T11:16:04.287392+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290515+0000","last_change":"2023-10-06T11:16:04.287848+0000","last_active":"2023-10-06T11:16:04.290515+0000","last_peered":"2023-10-06T11:16:04.290515+0000","last_clean":"2023-10-06T11:16:04.290515+0000","last_became_active":"2023-10-06T11:16:04.287522+0000","last_became_peered":"2023-10-06T11:16:04.287522+0000","last_unstale":"2023-10-06T11:16:04.290515+0000","last_undegraded":"2023-10-06T11:16:04.290515+0000","last_fullsized":"2023-10-06T11:16:04.290515+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:27.633958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.285319+0000","last_change":"2023-10-06T11:16:03.264964+0000","last_active":"2023-10-06T11:16:04.285319+0000","last_peered":"2023-10-06T11:16:04.285319+0000","last_clean":"2023-10-06T11:16:04.285319+0000","last_became_active":"2023-10-06T11:16:03.264681+0000","last_became_peered":"2023-10-06T11:16:03.264681+0000","last_unstale":"2023-10-06T11:16:04.285319+0000","last_undegraded":"2023-10-06T11:16:04.285319+0000","last_fullsized":"2023-10-06T11:16:04.285319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279439+0000","last_change":"2023-10-06T11:16:04.272071+0000","last_active":"2023-10-06T11:16:04.279439+0000","last_peered":"2023-10-06T11:16:04.279439+0000","last_clean":"2023-10-06T11:16:04.279439+0000","last_became_active":"2023-10-06T11:16:04.271346+0000","last_became_peered":"2023-10-06T11:16:04.271346+0000","last_unstale":"2023-10-06T11:16:04.279439+0000","last_undegraded":"2023-10-06T11:16:04.279439+0000","last_fullsized":"2023-10-06T11:16:04.279439+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:39.095991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.283671+0000","last_change":"2023-10-06T11:16:03.265607+0000","last_active":"2023-10-06T11:16:04.283671+0000","last_peered":"2023-10-06T11:16:04.283671+0000","last_clean":"2023-10-06T11:16:04.283671+0000","last_became_active":"2023-10-06T11:16:03.265304+0000","last_became_peered":"2023-10-06T11:16:03.265304+0000","last_unstale":"2023-10-06T11:16:04.283671+0000","last_undegraded":"2023-10-06T11:16:04.283671+0000","last_fullsized":"2023-10-06T11:16:04.283671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:10.608527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.278270+0000","last_change":"2023-10-06T11:16:04.274290+0000","last_active":"2023-10-06T11:16:04.278270+0000","last_peered":"2023-10-06T11:16:04.278270+0000","last_clean":"2023-10-06T11:16:04.278270+0000","last_became_active":"2023-10-06T11:16:04.274025+0000","last_became_peered":"2023-10-06T11:16:04.274025+0000","last_unstale":"2023-10-06T11:16:04.278270+0000","last_undegraded":"2023-10-06T11:16:04.278270+0000","last_fullsized":"2023-10-06T11:16:04.278270+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:18.492098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.287392+0000","last_change":"2023-10-06T11:16:03.271423+0000","last_active":"2023-10-06T11:16:04.287392+0000","last_peered":"2023-10-06T11:16:04.287392+0000","last_clean":"2023-10-06T11:16:04.287392+0000","last_became_active":"2023-10-06T11:16:03.271147+0000","last_became_peered":"2023-10-06T11:16:03.271147+0000","last_unstale":"2023-10-06T11:16:04.287392+0000","last_undegraded":"2023-10-06T11:16:04.287392+0000","last_fullsized":"2023-10-06T11:16:04.287392+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:26.800474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.278145+0000","last_change":"2023-10-06T11:16:04.272843+0000","last_active":"2023-10-06T11:16:04.278145+0000","last_peered":"2023-10-06T11:16:04.278145+0000","last_clean":"2023-10-06T11:16:04.278145+0000","last_became_active":"2023-10-06T11:16:04.272567+0000","last_became_peered":"2023-10-06T11:16:04.272567+0000","last_unstale":"2023-10-06T11:16:04.278145+0000","last_undegraded":"2023-10-06T11:16:04.278145+0000","last_fullsized":"2023-10-06T11:16:04.278145+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:59.248336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289403+0000","last_change":"2023-10-06T11:16:03.273222+0000","last_active":"2023-10-06T11:16:04.289403+0000","last_peered":"2023-10-06T11:16:04.289403+0000","last_clean":"2023-10-06T11:16:04.289403+0000","last_became_active":"2023-10-06T11:16:03.272855+0000","last_became_peered":"2023-10-06T11:16:03.272855+0000","last_unstale":"2023-10-06T11:16:04.289403+0000","last_undegraded":"2023-10-06T11:16:04.289403+0000","last_fullsized":"2023-10-06T11:16:04.289403+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:10.786531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.280223+0000","last_change":"2023-10-06T11:16:04.278012+0000","last_active":"2023-10-06T11:16:04.280223+0000","last_peered":"2023-10-06T11:16:04.280223+0000","last_clean":"2023-10-06T11:16:04.280223+0000","last_became_active":"2023-10-06T11:16:04.277733+0000","last_became_peered":"2023-10-06T11:16:04.277733+0000","last_unstale":"2023-10-06T11:16:04.280223+0000","last_undegraded":"2023-10-06T11:16:04.280223+0000","last_fullsized":"2023-10-06T11:16:04.280223+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:11.792964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.266898+0000","last_change":"2023-10-06T11:16:03.271806+0000","last_active":"2023-10-06T11:16:04.266898+0000","last_peered":"2023-10-06T11:16:04.266898+0000","last_clean":"2023-10-06T11:16:04.266898+0000","last_became_active":"2023-10-06T11:16:03.271561+0000","last_became_peered":"2023-10-06T11:16:03.271561+0000","last_unstale":"2023-10-06T11:16:04.266898+0000","last_undegraded":"2023-10-06T11:16:04.266898+0000","last_fullsized":"2023-10-06T11:16:04.266898+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279459+0000","last_change":"2023-10-06T11:16:04.270810+0000","last_active":"2023-10-06T11:16:04.279459+0000","last_peered":"2023-10-06T11:16:04.279459+0000","last_clean":"2023-10-06T11:16:04.279459+0000","last_became_active":"2023-10-06T11:16:04.270540+0000","last_became_peered":"2023-10-06T11:16:04.270540+0000","last_unstale":"2023-10-06T11:16:04.279459+0000","last_undegraded":"2023-10-06T11:16:04.279459+0000","last_fullsized":"2023-10-06T11:16:04.279459+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:54.043722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.263712+0000","last_change":"2023-10-06T11:16:03.269573+0000","last_active":"2023-10-06T11:16:04.263712+0000","last_peered":"2023-10-06T11:16:04.263712+0000","last_clean":"2023-10-06T11:16:04.263712+0000","last_became_active":"2023-10-06T11:16:03.269062+0000","last_became_peered":"2023-10-06T11:16:03.269062+0000","last_unstale":"2023-10-06T11:16:04.263712+0000","last_undegraded":"2023-10-06T11:16:04.263712+0000","last_fullsized":"2023-10-06T11:16:04.263712+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:01.433177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289230+0000","last_change":"2023-10-06T11:16:04.282983+0000","last_active":"2023-10-06T11:16:04.289230+0000","last_peered":"2023-10-06T11:16:04.289230+0000","last_clean":"2023-10-06T11:16:04.289230+0000","last_became_active":"2023-10-06T11:16:04.280833+0000","last_became_peered":"2023-10-06T11:16:04.280833+0000","last_unstale":"2023-10-06T11:16:04.289230+0000","last_undegraded":"2023-10-06T11:16:04.289230+0000","last_fullsized":"2023-10-06T11:16:04.289230+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:41.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.263590+0000","last_change":"2023-10-06T11:16:03.266206+0000","last_active":"2023-10-06T11:16:04.263590+0000","last_peered":"2023-10-06T11:16:04.263590+0000","last_clean":"2023-10-06T11:16:04.263590+0000","last_became_active":"2023-10-06T11:16:03.265914+0000","last_became_peered":"2023-10-06T11:16:03.265914+0000","last_unstale":"2023-10-06T11:16:04.263590+0000","last_undegraded":"2023-10-06T11:16:04.263590+0000","last_fullsized":"2023-10-06T11:16:04.263590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:48.121863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279314+0000","last_change":"2023-10-06T11:16:04.270596+0000","last_active":"2023-10-06T11:16:04.279314+0000","last_peered":"2023-10-06T11:16:04.279314+0000","last_clean":"2023-10-06T11:16:04.279314+0000","last_became_active":"2023-10-06T11:16:04.270086+0000","last_became_peered":"2023-10-06T11:16:04.270086+0000","last_unstale":"2023-10-06T11:16:04.279314+0000","last_undegraded":"2023-10-06T11:16:04.279314+0000","last_fullsized":"2023-10-06T11:16:04.279314+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:43.932698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.253035+0000","last_change":"2023-10-06T11:16:03.266356+0000","last_active":"2023-10-06T11:16:04.253035+0000","last_peered":"2023-10-06T11:16:04.253035+0000","last_clean":"2023-10-06T11:16:04.253035+0000","last_became_active":"2023-10-06T11:16:03.265589+0000","last_became_peered":"2023-10-06T11:16:03.265589+0000","last_unstale":"2023-10-06T11:16:04.253035+0000","last_undegraded":"2023-10-06T11:16:04.253035+0000","last_fullsized":"2023-10-06T11:16:04.253035+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:45.931454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.285725+0000","last_change":"2023-10-06T11:16:04.283162+0000","last_active":"2023-10-06T11:16:04.285725+0000","last_peered":"2023-10-06T11:16:04.285725+0000","last_clean":"2023-10-06T11:16:04.285725+0000","last_became_active":"2023-10-06T11:16:04.282908+0000","last_became_peered":"2023-10-06T11:16:04.282908+0000","last_unstale":"2023-10-06T11:16:04.285725+0000","last_undegraded":"2023-10-06T11:16:04.285725+0000","last_fullsized":"2023-10-06T11:16:04.285725+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:23.157585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279895+0000","last_change":"2023-10-06T11:16:03.266459+0000","last_active":"2023-10-06T11:16:04.279895+0000","last_peered":"2023-10-06T11:16:04.279895+0000","last_clean":"2023-10-06T11:16:04.279895+0000","last_became_active":"2023-10-06T11:16:03.266184+0000","last_became_peered":"2023-10-06T11:16:03.266184+0000","last_unstale":"2023-10-06T11:16:04.279895+0000","last_undegraded":"2023-10-06T11:16:04.279895+0000","last_fullsized":"2023-10-06T11:16:04.279895+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:25.420501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.286994+0000","last_change":"2023-10-06T11:16:04.285377+0000","last_active":"2023-10-06T11:16:04.286994+0000","last_peered":"2023-10-06T11:16:04.286994+0000","last_clean":"2023-10-06T11:16:04.286994+0000","last_became_active":"2023-10-06T11:16:04.284609+0000","last_became_peered":"2023-10-06T11:16:04.284609+0000","last_unstale":"2023-10-06T11:16:04.286994+0000","last_undegraded":"2023-10-06T11:16:04.286994+0000","last_fullsized":"2023-10-06T11:16:04.286994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:06.651645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"90'6","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.292064+0000","last_change":"2023-10-06T11:16:03.269548+0000","last_active":"2023-10-06T11:16:04.292064+0000","last_peered":"2023-10-06T11:16:04.292064+0000","last_clean":"2023-10-06T11:16:04.292064+0000","last_became_active":"2023-10-06T11:16:03.269297+0000","last_became_peered":"2023-10-06T11:16:03.269297+0000","last_unstale":"2023-10-06T11:16:04.292064+0000","last_undegraded":"2023-10-06T11:16:04.292064+0000","last_fullsized":"2023-10-06T11:16:04.292064+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:07.378775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279630+0000","last_change":"2023-10-06T11:16:04.273086+0000","last_active":"2023-10-06T11:16:04.279630+0000","last_peered":"2023-10-06T11:16:04.279630+0000","last_clean":"2023-10-06T11:16:04.279630+0000","last_became_active":"2023-10-06T11:16:04.271884+0000","last_became_peered":"2023-10-06T11:16:04.271884+0000","last_unstale":"2023-10-06T11:16:04.279630+0000","last_undegraded":"2023-10-06T11:16:04.279630+0000","last_fullsized":"2023-10-06T11:16:04.279630+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:38.711749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.284429+0000","last_change":"2023-10-06T11:16:03.267342+0000","last_active":"2023-10-06T11:16:04.284429+0000","last_peered":"2023-10-06T11:16:04.284429+0000","last_clean":"2023-10-06T11:16:04.284429+0000","last_became_active":"2023-10-06T11:16:03.266327+0000","last_became_peered":"2023-10-06T11:16:03.266327+0000","last_unstale":"2023-10-06T11:16:04.284429+0000","last_undegraded":"2023-10-06T11:16:04.284429+0000","last_fullsized":"2023-10-06T11:16:04.284429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:23.538191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290402+0000","last_change":"2023-10-06T11:16:04.287291+0000","last_active":"2023-10-06T11:16:04.290402+0000","last_peered":"2023-10-06T11:16:04.290402+0000","last_clean":"2023-10-06T11:16:04.290402+0000","last_became_active":"2023-10-06T11:16:04.287013+0000","last_became_peered":"2023-10-06T11:16:04.287013+0000","last_unstale":"2023-10-06T11:16:04.290402+0000","last_undegraded":"2023-10-06T11:16:04.290402+0000","last_fullsized":"2023-10-06T11:16:04.290402+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:09:41.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.260350+0000","last_change":"2023-10-06T11:16:03.275983+0000","last_active":"2023-10-06T11:16:04.260350+0000","last_peered":"2023-10-06T11:16:04.260350+0000","last_clean":"2023-10-06T11:16:04.260350+0000","last_became_active":"2023-10-06T11:16:03.275473+0000","last_became_peered":"2023-10-06T11:16:03.275473+0000","last_unstale":"2023-10-06T11:16:04.260350+0000","last_undegraded":"2023-10-06T11:16:04.260350+0000","last_fullsized":"2023-10-06T11:16:04.260350+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:41.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279423+0000","last_change":"2023-10-06T11:16:04.270228+0000","last_active":"2023-10-06T11:16:04.279423+0000","last_peered":"2023-10-06T11:16:04.279423+0000","last_clean":"2023-10-06T11:16:04.279423+0000","last_became_active":"2023-10-06T11:16:04.269934+0000","last_became_peered":"2023-10-06T11:16:04.269934+0000","last_unstale":"2023-10-06T11:16:04.279423+0000","last_undegraded":"2023-10-06T11:16:04.279423+0000","last_fullsized":"2023-10-06T11:16:04.279423+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:34.579388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.256852+0000","last_change":"2023-10-06T11:16:03.264078+0000","last_active":"2023-10-06T11:16:04.256852+0000","last_peered":"2023-10-06T11:16:04.256852+0000","last_clean":"2023-10-06T11:16:04.256852+0000","last_became_active":"2023-10-06T11:16:03.263683+0000","last_became_peered":"2023-10-06T11:16:03.263683+0000","last_unstale":"2023-10-06T11:16:04.256852+0000","last_undegraded":"2023-10-06T11:16:04.256852+0000","last_fullsized":"2023-10-06T11:16:04.256852+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290751+0000","last_change":"2023-10-06T11:16:04.277107+0000","last_active":"2023-10-06T11:16:04.290751+0000","last_peered":"2023-10-06T11:16:04.290751+0000","last_clean":"2023-10-06T11:16:04.290751+0000","last_became_active":"2023-10-06T11:16:04.276744+0000","last_became_peered":"2023-10-06T11:16:04.276744+0000","last_unstale":"2023-10-06T11:16:04.290751+0000","last_undegraded":"2023-10-06T11:16:04.290751+0000","last_fullsized":"2023-10-06T11:16:04.290751+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:54.124898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"90'8","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290955+0000","last_change":"2023-10-06T11:16:03.271127+0000","last_active":"2023-10-06T11:16:04.290955+0000","last_peered":"2023-10-06T11:16:04.290955+0000","last_clean":"2023-10-06T11:16:04.290955+0000","last_became_active":"2023-10-06T11:16:03.270133+0000","last_became_peered":"2023-10-06T11:16:03.270133+0000","last_unstale":"2023-10-06T11:16:04.290955+0000","last_undegraded":"2023-10-06T11:16:04.290955+0000","last_fullsized":"2023-10-06T11:16:04.290955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:50.310646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.287174+0000","last_change":"2023-10-06T11:16:04.281182+0000","last_active":"2023-10-06T11:16:04.287174+0000","last_peered":"2023-10-06T11:16:04.287174+0000","last_clean":"2023-10-06T11:16:04.287174+0000","last_became_active":"2023-10-06T11:16:04.274477+0000","last_became_peered":"2023-10-06T11:16:04.274477+0000","last_unstale":"2023-10-06T11:16:04.287174+0000","last_undegraded":"2023-10-06T11:16:04.287174+0000","last_fullsized":"2023-10-06T11:16:04.287174+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:13.692849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.275100+0000","last_change":"2023-10-06T11:16:03.265577+0000","last_active":"2023-10-06T11:16:04.275100+0000","last_peered":"2023-10-06T11:16:04.275100+0000","last_clean":"2023-10-06T11:16:04.275100+0000","last_became_active":"2023-10-06T11:16:03.265337+0000","last_became_peered":"2023-10-06T11:16:03.265337+0000","last_unstale":"2023-10-06T11:16:04.275100+0000","last_undegraded":"2023-10-06T11:16:04.275100+0000","last_fullsized":"2023-10-06T11:16:04.275100+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:29.052675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290273+0000","last_change":"2023-10-06T11:16:04.285543+0000","last_active":"2023-10-06T11:16:04.290273+0000","last_peered":"2023-10-06T11:16:04.290273+0000","last_clean":"2023-10-06T11:16:04.290273+0000","last_became_active":"2023-10-06T11:16:04.285248+0000","last_became_peered":"2023-10-06T11:16:04.285248+0000","last_unstale":"2023-10-06T11:16:04.290273+0000","last_undegraded":"2023-10-06T11:16:04.290273+0000","last_fullsized":"2023-10-06T11:16:04.290273+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:30.059108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"91'1","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T11:16:05.481431+0000","last_change":"2023-10-06T11:16:03.271695+0000","last_active":"2023-10-06T11:16:05.481431+0000","last_peered":"2023-10-06T11:16:05.481431+0000","last_clean":"2023-10-06T11:16:05.481431+0000","last_became_active":"2023-10-06T11:16:03.271426+0000","last_became_peered":"2023-10-06T11:16:03.271426+0000","last_unstale":"2023-10-06T11:16:05.481431+0000","last_undegraded":"2023-10-06T11:16:05.481431+0000","last_fullsized":"2023-10-06T11:16:05.481431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:58.625857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290503+0000","last_change":"2023-10-06T11:16:04.287275+0000","last_active":"2023-10-06T11:16:04.290503+0000","last_peered":"2023-10-06T11:16:04.290503+0000","last_clean":"2023-10-06T11:16:04.290503+0000","last_became_active":"2023-10-06T11:16:04.286995+0000","last_became_peered":"2023-10-06T11:16:04.286995+0000","last_unstale":"2023-10-06T11:16:04.290503+0000","last_undegraded":"2023-10-06T11:16:04.290503+0000","last_fullsized":"2023-10-06T11:16:04.290503+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:59.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.273715+0000","last_change":"2023-10-06T11:16:03.259310+0000","last_active":"2023-10-06T11:16:04.273715+0000","last_peered":"2023-10-06T11:16:04.273715+0000","last_clean":"2023-10-06T11:16:04.273715+0000","last_became_active":"2023-10-06T11:16:03.259025+0000","last_became_peered":"2023-10-06T11:16:03.259025+0000","last_unstale":"2023-10-06T11:16:04.273715+0000","last_undegraded":"2023-10-06T11:16:04.273715+0000","last_fullsized":"2023-10-06T11:16:04.273715+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:02.096942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.282005+0000","last_change":"2023-10-06T11:16:04.277702+0000","last_active":"2023-10-06T11:16:04.282005+0000","last_peered":"2023-10-06T11:16:04.282005+0000","last_clean":"2023-10-06T11:16:04.282005+0000","last_became_active":"2023-10-06T11:16:04.277440+0000","last_became_peered":"2023-10-06T11:16:04.277440+0000","last_unstale":"2023-10-06T11:16:04.282005+0000","last_undegraded":"2023-10-06T11:16:04.282005+0000","last_fullsized":"2023-10-06T11:16:04.282005+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:35.622395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.268120+0000","last_change":"2023-10-06T11:16:03.265765+0000","last_active":"2023-10-06T11:16:04.268120+0000","last_peered":"2023-10-06T11:16:04.268120+0000","last_clean":"2023-10-06T11:16:04.268120+0000","last_became_active":"2023-10-06T11:16:03.265563+0000","last_became_peered":"2023-10-06T11:16:03.265563+0000","last_unstale":"2023-10-06T11:16:04.268120+0000","last_undegraded":"2023-10-06T11:16:04.268120+0000","last_fullsized":"2023-10-06T11:16:04.268120+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:18:17.485665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.284568+0000","last_change":"2023-10-06T11:16:04.275590+0000","last_active":"2023-10-06T11:16:04.284568+0000","last_peered":"2023-10-06T11:16:04.284568+0000","last_clean":"2023-10-06T11:16:04.284568+0000","last_became_active":"2023-10-06T11:16:04.275068+0000","last_became_peered":"2023-10-06T11:16:04.275068+0000","last_unstale":"2023-10-06T11:16:04.284568+0000","last_undegraded":"2023-10-06T11:16:04.284568+0000","last_fullsized":"2023-10-06T11:16:04.284568+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:48.349890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.273580+0000","last_change":"2023-10-06T11:16:03.265381+0000","last_active":"2023-10-06T11:16:04.273580+0000","last_peered":"2023-10-06T11:16:04.273580+0000","last_clean":"2023-10-06T11:16:04.273580+0000","last_became_active":"2023-10-06T11:16:03.264912+0000","last_became_peered":"2023-10-06T11:16:03.264912+0000","last_unstale":"2023-10-06T11:16:04.273580+0000","last_undegraded":"2023-10-06T11:16:04.273580+0000","last_fullsized":"2023-10-06T11:16:04.273580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:43.791751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.273761+0000","last_change":"2023-10-06T11:16:04.264462+0000","last_active":"2023-10-06T11:16:04.273761+0000","last_peered":"2023-10-06T11:16:04.273761+0000","last_clean":"2023-10-06T11:16:04.273761+0000","last_became_active":"2023-10-06T11:16:04.264198+0000","last_became_peered":"2023-10-06T11:16:04.264198+0000","last_unstale":"2023-10-06T11:16:04.273761+0000","last_undegraded":"2023-10-06T11:16:04.273761+0000","last_fullsized":"2023-10-06T11:16:04.273761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:41.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.266813+0000","last_change":"2023-10-06T11:16:03.273426+0000","last_active":"2023-10-06T11:16:04.266813+0000","last_peered":"2023-10-06T11:16:04.266813+0000","last_clean":"2023-10-06T11:16:04.266813+0000","last_became_active":"2023-10-06T11:16:03.273151+0000","last_became_peered":"2023-10-06T11:16:03.273151+0000","last_unstale":"2023-10-06T11:16:04.266813+0000","last_undegraded":"2023-10-06T11:16:04.266813+0000","last_fullsized":"2023-10-06T11:16:04.266813+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:11:02.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290892+0000","last_change":"2023-10-06T11:16:04.278215+0000","last_active":"2023-10-06T11:16:04.290892+0000","last_peered":"2023-10-06T11:16:04.290892+0000","last_clean":"2023-10-06T11:16:04.290892+0000","last_became_active":"2023-10-06T11:16:04.277865+0000","last_became_peered":"2023-10-06T11:16:04.277865+0000","last_unstale":"2023-10-06T11:16:04.290892+0000","last_undegraded":"2023-10-06T11:16:04.290892+0000","last_fullsized":"2023-10-06T11:16:04.290892+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:12.413887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.253712+0000","last_change":"2023-10-06T11:16:03.270536+0000","last_active":"2023-10-06T11:16:04.253712+0000","last_peered":"2023-10-06T11:16:04.253712+0000","last_clean":"2023-10-06T11:16:04.253712+0000","last_became_active":"2023-10-06T11:16:03.270254+0000","last_became_peered":"2023-10-06T11:16:03.270254+0000","last_unstale":"2023-10-06T11:16:04.253712+0000","last_undegraded":"2023-10-06T11:16:04.253712+0000","last_fullsized":"2023-10-06T11:16:04.253712+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:17:12.895297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.282061+0000","last_change":"2023-10-06T11:16:04.278615+0000","last_active":"2023-10-06T11:16:04.282061+0000","last_peered":"2023-10-06T11:16:04.282061+0000","last_clean":"2023-10-06T11:16:04.282061+0000","last_became_active":"2023-10-06T11:16:04.278349+0000","last_became_peered":"2023-10-06T11:16:04.278349+0000","last_unstale":"2023-10-06T11:16:04.282061+0000","last_undegraded":"2023-10-06T11:16:04.282061+0000","last_fullsized":"2023-10-06T11:16:04.282061+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:11.792964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.261715+0000","last_change":"2023-10-06T11:16:03.271934+0000","last_active":"2023-10-06T11:16:04.261715+0000","last_peered":"2023-10-06T11:16:04.261715+0000","last_clean":"2023-10-06T11:16:04.261715+0000","last_became_active":"2023-10-06T11:16:03.271636+0000","last_became_peered":"2023-10-06T11:16:03.271636+0000","last_unstale":"2023-10-06T11:16:04.261715+0000","last_undegraded":"2023-10-06T11:16:04.261715+0000","last_fullsized":"2023-10-06T11:16:04.261715+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:50.906176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289554+0000","last_change":"2023-10-06T11:16:04.287864+0000","last_active":"2023-10-06T11:16:04.289554+0000","last_peered":"2023-10-06T11:16:04.289554+0000","last_clean":"2023-10-06T11:16:04.289554+0000","last_became_active":"2023-10-06T11:16:04.287621+0000","last_became_peered":"2023-10-06T11:16:04.287621+0000","last_unstale":"2023-10-06T11:16:04.289554+0000","last_undegraded":"2023-10-06T11:16:04.289554+0000","last_fullsized":"2023-10-06T11:16:04.289554+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.273183+0000","last_change":"2023-10-06T11:16:03.269336+0000","last_active":"2023-10-06T11:16:04.273183+0000","last_peered":"2023-10-06T11:16:04.273183+0000","last_clean":"2023-10-06T11:16:04.273183+0000","last_became_active":"2023-10-06T11:16:03.269072+0000","last_became_peered":"2023-10-06T11:16:03.269072+0000","last_unstale":"2023-10-06T11:16:04.273183+0000","last_undegraded":"2023-10-06T11:16:04.273183+0000","last_fullsized":"2023-10-06T11:16:04.273183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.151151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.270338+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:04.270338+0000","last_peered":"2023-10-06T11:16:04.270338+0000","last_clean":"2023-10-06T11:16:04.270338+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:04.270338+0000","last_undegraded":"2023-10-06T11:16:04.270338+0000","last_fullsized":"2023-10-06T11:16:04.270338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.279401+0000","last_change":"2023-10-06T11:16:04.276053+0000","last_active":"2023-10-06T11:16:04.279401+0000","last_peered":"2023-10-06T11:16:04.279401+0000","last_clean":"2023-10-06T11:16:04.279401+0000","last_became_active":"2023-10-06T11:16:04.275609+0000","last_became_peered":"2023-10-06T11:16:04.275609+0000","last_unstale":"2023-10-06T11:16:04.279401+0000","last_undegraded":"2023-10-06T11:16:04.279401+0000","last_fullsized":"2023-10-06T11:16:04.279401+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:15.268218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.277940+0000","last_change":"2023-10-06T11:16:03.272428+0000","last_active":"2023-10-06T11:16:04.277940+0000","last_peered":"2023-10-06T11:16:04.277940+0000","last_clean":"2023-10-06T11:16:04.277940+0000","last_became_active":"2023-10-06T11:16:03.272148+0000","last_became_peered":"2023-10-06T11:16:03.272148+0000","last_unstale":"2023-10-06T11:16:04.277940+0000","last_undegraded":"2023-10-06T11:16:04.277940+0000","last_fullsized":"2023-10-06T11:16:04.277940+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:05.645212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.258966+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:04.258966+0000","last_peered":"2023-10-06T11:16:04.258966+0000","last_clean":"2023-10-06T11:16:04.258966+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:04.258966+0000","last_undegraded":"2023-10-06T11:16:04.258966+0000","last_fullsized":"2023-10-06T11:16:04.258966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.266855+0000","last_change":"2023-10-06T11:16:04.264648+0000","last_active":"2023-10-06T11:16:04.266855+0000","last_peered":"2023-10-06T11:16:04.266855+0000","last_clean":"2023-10-06T11:16:04.266855+0000","last_became_active":"2023-10-06T11:16:04.264379+0000","last_became_peered":"2023-10-06T11:16:04.264379+0000","last_unstale":"2023-10-06T11:16:04.266855+0000","last_undegraded":"2023-10-06T11:16:04.266855+0000","last_fullsized":"2023-10-06T11:16:04.266855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:43.777997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.273754+0000","last_change":"2023-10-06T11:16:03.266437+0000","last_active":"2023-10-06T11:16:04.273754+0000","last_peered":"2023-10-06T11:16:04.273754+0000","last_clean":"2023-10-06T11:16:04.273754+0000","last_became_active":"2023-10-06T11:16:03.266161+0000","last_became_peered":"2023-10-06T11:16:03.266161+0000","last_unstale":"2023-10-06T11:16:04.273754+0000","last_undegraded":"2023-10-06T11:16:04.273754+0000","last_fullsized":"2023-10-06T11:16:04.273754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.264327+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:04.264327+0000","last_peered":"2023-10-06T11:16:04.264327+0000","last_clean":"2023-10-06T11:16:04.264327+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:04.264327+0000","last_undegraded":"2023-10-06T11:16:04.264327+0000","last_fullsized":"2023-10-06T11:16:04.264327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290776+0000","last_change":"2023-10-06T11:16:04.277733+0000","last_active":"2023-10-06T11:16:04.290776+0000","last_peered":"2023-10-06T11:16:04.290776+0000","last_clean":"2023-10-06T11:16:04.290776+0000","last_became_active":"2023-10-06T11:16:04.277407+0000","last_became_peered":"2023-10-06T11:16:04.277407+0000","last_unstale":"2023-10-06T11:16:04.290776+0000","last_undegraded":"2023-10-06T11:16:04.290776+0000","last_fullsized":"2023-10-06T11:16:04.290776+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:56.438390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.276213+0000","last_change":"2023-10-06T11:16:03.271072+0000","last_active":"2023-10-06T11:16:04.276213+0000","last_peered":"2023-10-06T11:16:04.276213+0000","last_clean":"2023-10-06T11:16:04.276213+0000","last_became_active":"2023-10-06T11:16:03.270859+0000","last_became_peered":"2023-10-06T11:16:03.270859+0000","last_unstale":"2023-10-06T11:16:04.276213+0000","last_undegraded":"2023-10-06T11:16:04.276213+0000","last_fullsized":"2023-10-06T11:16:04.276213+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:33.600008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.259108+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:04.259108+0000","last_peered":"2023-10-06T11:16:04.259108+0000","last_clean":"2023-10-06T11:16:04.259108+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:04.259108+0000","last_undegraded":"2023-10-06T11:16:04.259108+0000","last_fullsized":"2023-10-06T11:16:04.259108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.265189+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:04.265189+0000","last_peered":"2023-10-06T11:16:04.265189+0000","last_clean":"2023-10-06T11:16:04.265189+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:04.265189+0000","last_undegraded":"2023-10-06T11:16:04.265189+0000","last_fullsized":"2023-10-06T11:16:04.265189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.278448+0000","last_change":"2023-10-06T11:16:04.276630+0000","last_active":"2023-10-06T11:16:04.278448+0000","last_peered":"2023-10-06T11:16:04.278448+0000","last_clean":"2023-10-06T11:16:04.278448+0000","last_became_active":"2023-10-06T11:16:04.276366+0000","last_became_peered":"2023-10-06T11:16:04.276366+0000","last_unstale":"2023-10-06T11:16:04.278448+0000","last_undegraded":"2023-10-06T11:16:04.278448+0000","last_fullsized":"2023-10-06T11:16:04.278448+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:18.596926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.270288+0000","last_change":"2023-10-06T11:16:03.266154+0000","last_active":"2023-10-06T11:16:04.270288+0000","last_peered":"2023-10-06T11:16:04.270288+0000","last_clean":"2023-10-06T11:16:04.270288+0000","last_became_active":"2023-10-06T11:16:03.265870+0000","last_became_peered":"2023-10-06T11:16:03.265870+0000","last_unstale":"2023-10-06T11:16:04.270288+0000","last_undegraded":"2023-10-06T11:16:04.270288+0000","last_fullsized":"2023-10-06T11:16:04.270288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:50:43.000923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.265359+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:04.265359+0000","last_peered":"2023-10-06T11:16:04.265359+0000","last_clean":"2023-10-06T11:16:04.265359+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:04.265359+0000","last_undegraded":"2023-10-06T11:16:04.265359+0000","last_fullsized":"2023-10-06T11:16:04.265359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.289046+0000","last_change":"2023-10-06T11:16:04.277049+0000","last_active":"2023-10-06T11:16:04.289046+0000","last_peered":"2023-10-06T11:16:04.289046+0000","last_clean":"2023-10-06T11:16:04.289046+0000","last_became_active":"2023-10-06T11:16:04.276652+0000","last_became_peered":"2023-10-06T11:16:04.276652+0000","last_unstale":"2023-10-06T11:16:04.289046+0000","last_undegraded":"2023-10-06T11:16:04.289046+0000","last_fullsized":"2023-10-06T11:16:04.289046+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:43.497915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.258832+0000","last_change":"2023-10-06T11:16:03.265091+0000","last_active":"2023-10-06T11:16:04.258832+0000","last_peered":"2023-10-06T11:16:04.258832+0000","last_clean":"2023-10-06T11:16:04.258832+0000","last_became_active":"2023-10-06T11:16:03.264806+0000","last_became_peered":"2023-10-06T11:16:03.264806+0000","last_unstale":"2023-10-06T11:16:04.258832+0000","last_undegraded":"2023-10-06T11:16:04.258832+0000","last_fullsized":"2023-10-06T11:16:04.258832+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:40.908155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.267310+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:04.267310+0000","last_peered":"2023-10-06T11:16:04.267310+0000","last_clean":"2023-10-06T11:16:04.267310+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:04.267310+0000","last_undegraded":"2023-10-06T11:16:04.267310+0000","last_fullsized":"2023-10-06T11:16:04.267310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.290854+0000","last_change":"2023-10-06T11:16:04.278964+0000","last_active":"2023-10-06T11:16:04.290854+0000","last_peered":"2023-10-06T11:16:04.290854+0000","last_clean":"2023-10-06T11:16:04.290854+0000","last_became_active":"2023-10-06T11:16:04.275096+0000","last_became_peered":"2023-10-06T11:16:04.275096+0000","last_unstale":"2023-10-06T11:16:04.290854+0000","last_undegraded":"2023-10-06T11:16:04.290854+0000","last_fullsized":"2023-10-06T11:16:04.290854+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:27.806907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.258833+0000","last_change":"2023-10-06T11:16:03.273491+0000","last_active":"2023-10-06T11:16:04.258833+0000","last_peered":"2023-10-06T11:16:04.258833+0000","last_clean":"2023-10-06T11:16:04.258833+0000","last_became_active":"2023-10-06T11:16:03.273217+0000","last_became_peered":"2023-10-06T11:16:03.273217+0000","last_unstale":"2023-10-06T11:16:04.258833+0000","last_undegraded":"2023-10-06T11:16:04.258833+0000","last_fullsized":"2023-10-06T11:16:04.258833+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:04.630874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.263758+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:04.263758+0000","last_peered":"2023-10-06T11:16:04.263758+0000","last_clean":"2023-10-06T11:16:04.263758+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:04.263758+0000","last_undegraded":"2023-10-06T11:16:04.263758+0000","last_fullsized":"2023-10-06T11:16:04.263758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.284467+0000","last_change":"2023-10-06T11:16:04.272888+0000","last_active":"2023-10-06T11:16:04.284467+0000","last_peered":"2023-10-06T11:16:04.284467+0000","last_clean":"2023-10-06T11:16:04.284467+0000","last_became_active":"2023-10-06T11:16:04.272315+0000","last_became_peered":"2023-10-06T11:16:04.272315+0000","last_unstale":"2023-10-06T11:16:04.284467+0000","last_undegraded":"2023-10-06T11:16:04.284467+0000","last_fullsized":"2023-10-06T11:16:04.284467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:03.242332+0000","last_clean_scrub_stamp":"2023-10-06T11:16:03.242332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:06.331686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.291078+0000","last_change":"2023-10-06T11:16:03.268311+0000","last_active":"2023-10-06T11:16:04.291078+0000","last_peered":"2023-10-06T11:16:04.291078+0000","last_clean":"2023-10-06T11:16:04.291078+0000","last_became_active":"2023-10-06T11:16:03.266368+0000","last_became_peered":"2023-10-06T11:16:03.266368+0000","last_unstale":"2023-10-06T11:16:04.291078+0000","last_undegraded":"2023-10-06T11:16:04.291078+0000","last_fullsized":"2023-10-06T11:16:04.291078+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:02.235899+0000","last_clean_scrub_stamp":"2023-10-06T11:16:02.235899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:38:37.705316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-06T11:16:04.268273+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:04.268273+0000","last_peered":"2023-10-06T11:16:04.268273+0000","last_clean":"2023-10-06T11:16:04.268273+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:04.268273+0000","last_undegraded":"2023-10-06T11:16:04.268273+0000","last_fullsized":"2023-10-06T11:16:04.268273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298972,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072868,"statfs":{"total":96636764160,"available":96330616832,"internally_reserved":0,"allocated":1724416,"data_stored":1119013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.623},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298392,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073448,"statfs":{"total":96636764160,"available":96331210752,"internally_reserved":0,"allocated":1130496,"data_stored":529157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.505}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.056,"15min":1.056},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63},{"interface":"front","average":{"1min":0.62,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298384,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073456,"statfs":{"total":96636764160,"available":96331218944,"internally_reserved":0,"allocated":1122304,"data_stored":528533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.25}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.62},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":0.75}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1720320,"data_stored":1119455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.437}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.745},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.871}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.80800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298388,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073452,"statfs":{"total":96636764160,"available":96331214848,"internally_reserved":0,"allocated":1126400,"data_stored":528567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60999999999999999,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.249},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.434,"15min":0.432},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47199999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.28499999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":1.056,"15min":1.056},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.438,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.30299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56999999999999995,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.374},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.55400000000000005,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65700000000000003,"15min":0.67900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78400000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66500000000000004,"15min":0.68700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.745,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.335,"15min":2.335},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72399999999999998,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298400,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073440,"statfs":{"total":96636764160,"available":96331202560,"internally_reserved":0,"allocated":1138688,"data_stored":530091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.218,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36799999999999999,"15min":0.38},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.24099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42899999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.252},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.497,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38700000000000001,"15min":0.40100000000000002},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.36899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83499999999999996,"5min":0.997,"15min":0.997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.872,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":1.115,"15min":1.115},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80500000000000005,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84299999999999997,"5min":1.276,"15min":1.276},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298404,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073436,"statfs":{"total":96636764160,"available":96331198464,"internally_reserved":0,"allocated":1142784,"data_stored":530193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.628},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.996,"15min":0.996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.371},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71399999999999997,"5min":1.014,"15min":1.014},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.55700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298388,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073452,"statfs":{"total":96636764160,"available":96331214848,"internally_reserved":0,"allocated":1126400,"data_stored":528603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":1.369,"15min":1.369},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77200000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70599999999999996,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81000000000000005,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":1.355,"15min":1.355},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":1.512,"15min":1.512},"last":0.499}]},{"osd":6,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.627},{"interface":"front","average":{"1min":0.495,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:13.352 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:16:13.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:16:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.511+0000 7f9dddc41700 1 Processor -- start 2023-10-06T11:16:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.511+0000 7f9dddc41700 1 -- start start 2023-10-06T11:16:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dddc41700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9dd80cc820 0x7f9dd80ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dddc41700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd80cbf70 con 0x7f9dd806efb0 2023-10-06T11:16:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dddc41700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd8159db0 con 0x7f9dd80675b0 2023-10-06T11:16:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dddc41700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd8159bc0 con 0x7f9dd80cc820 2023-10-06T11:16:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dd6ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9dd806efb0 0x7f9dd80c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49374/0 (socket says 172.21.15.55:49374) 2023-10-06T11:16:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dd6ffd700 1 -- 172.21.15.55:0/2262337684 learned_addr learned my addr 172.21.15.55:0/2262337684 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dd77fe700 1 --2- 172.21.15.55:0/2262337684 >> v2:172.21.15.142:3300/0 conn(0x7f9dd80cc820 0x7f9dd80ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485384106 0 0) 0x7f9dd80cbf70 con 0x7f9dd806efb0 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc4003570 con 0x7f9dd806efb0 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.512+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875174133 0 0) 0x7f9dc4003570 con 0x7f9dd806efb0 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 >> v2:172.21.15.142:3300/0 conn(0x7f9dd80cc820 msgr2=0x7f9dd80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 --2- 172.21.15.55:0/2262337684 >> v2:172.21.15.142:3300/0 conn(0x7f9dd80cc820 0x7f9dd80ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 >> v1:172.21.15.142:6789/0 conn(0x7f9dd80675b0 legacy=0x7f9dd815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd815a090 con 0x7f9dd806efb0 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f9dc0001470 con 0x7f9dd806efb0 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 >> v1:172.21.15.55:6789/0 conn(0x7f9dd806efb0 legacy=0x7f9dd80c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc4003a60 0x7f9dc4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc4004810 0x7f9dc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dc40051c0 0x7f9dc400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc400c130 con 0x7f9dc40051c0 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc400c2a0 con 0x7f9dc4004810 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc400c460 con 0x7f9dc4003a60 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dc40051c0 0x7f9dc400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd6ffd700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc4004810 0x7f9dc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd77fe700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc4003a60 0x7f9dc4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc4003a60 msgr2=0x7f9dc4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc4003a60 0x7f9dc4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc4004810 msgr2=0x7f9dc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc4004810 0x7f9dc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2262337684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4003570 con 0x7f9dc40051c0 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2262337684 reap_dead start 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dc40051c0 0x7f9dc400ba60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80018e0 tx=0x7f9dc8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b93f4070ebabc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8012420 con 0x7f9dc40051c0 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc80125a0 con 0x7f9dc40051c0 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.513+0000 7f9dd67fc700 1 -- 172.21.15.55:0/2262337684 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8012960 con 0x7f9dc40051c0 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 -- 172.21.15.55:0/2262337684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dc40051c0 msgr2=0x7f9dc400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dc40051c0 0x7f9dc400ba60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80018e0 tx=0x7f9dc8007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 -- 172.21.15.55:0/2262337684 shutdown_connections 2023-10-06T11:16:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2262337684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dc40051c0 0x7f9dc400ba60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 -- 172.21.15.55:0/2262337684 >> 172.21.15.55:0/2262337684 conn(0x7f9dd8069190 msgr2=0x7f9dd80cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 -- 172.21.15.55:0/2262337684 shutdown_connections 2023-10-06T11:16:13.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.514+0000 7f9dddc41700 1 -- 172.21.15.55:0/2262337684 wait complete. 2023-10-06T11:16:13.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.515+0000 7f9dddc41700 1 Processor -- start 2023-10-06T11:16:13.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.515+0000 7f9dddc41700 1 -- start start 2023-10-06T11:16:13.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dddc41700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc40051c0 0x7f9dd81577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dddc41700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd80ac240 0x7f9dd8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dddc41700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 0x7f9dd8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dddc41700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8154710 con 0x7f9dd8166090 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dddc41700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8157da0 con 0x7f9dd80ac240 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dddc41700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8158080 con 0x7f9dc40051c0 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dd7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 0x7f9dd8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dd7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 0x7f9dd8154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60706/0 (socket says 172.21.15.55:60706) 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2312264463 learned_addr learned my addr 172.21.15.55:0/2312264463 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dd6ffd700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd80ac240 0x7f9dd8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.516+0000 7f9dd77fe700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc40051c0 0x7f9dd81577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc40051c0 msgr2=0x7f9dd81577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc40051c0 0x7f9dd81577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd80ac240 msgr2=0x7f9dd8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd80ac240 0x7f9dd8153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd7fff700 1 -- 172.21.15.55:0/2312264463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8158360 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd6ffd700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd80ac240 0x7f9dd8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd77fe700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc40051c0 0x7f9dd81577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dd7fff700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 0x7f9dd8154e10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80b3180 tx=0x7f9dc8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8012420 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8001230 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd8158640 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800ce90 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.517+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd8155350 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.518+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd81587d0 con 0x7f9dd8166090 2023-10-06T11:16:13.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.518+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dc801e640 con 0x7f9dd8166090 2023-10-06T11:16:13.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.519+0000 7f9dcf7fe700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9db8066f30 0x7f9db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.519+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9dc8085d60 con 0x7f9dd8166090 2023-10-06T11:16:13.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.519+0000 7f9dd77fe700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9db8066f30 0x7f9db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.519+0000 7f9dd77fe700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9db8066f30 0x7f9db80693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00094a0 tx=0x7f9dd000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.523+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dc8052d30 con 0x7f9dd8166090 2023-10-06T11:16:13.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.795+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9dd8064a90 con 0x7f9dd8166090 2023-10-06T11:16:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.804+0000 7f9dcf7fe700 1 -- 172.21.15.55:0/2312264463 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9dc8017070 con 0x7f9dd8166090 2023-10-06T11:16:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9db8066f30 msgr2=0x7f9db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9db8066f30 0x7f9db80693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00094a0 tx=0x7f9dd000b040 comp rx=0 tx=0).stop 2023-10-06T11:16:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 msgr2=0x7f9dd8154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 0x7f9dd8154e10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80b3180 tx=0x7f9dc8015000 comp rx=0 tx=0).stop 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 shutdown_connections 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9db8066f30 0x7f9db80693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9dd8166090 0x7f9dd8154e10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc40051c0 0x7f9dd81577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 --2- 172.21.15.55:0/2312264463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd80ac240 0x7f9dd8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 >> 172.21.15.55:0/2312264463 conn(0x7f9dd8069190 msgr2=0x7f9dd806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 shutdown_connections 2023-10-06T11:16:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.806+0000 7f9dddc41700 1 -- 172.21.15.55:0/2312264463 wait complete. 2023-10-06T11:16:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-10-06T11:16:13.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:13.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 Processor -- start 2023-10-06T11:16:13.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 -- start start 2023-10-06T11:16:13.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa91c0cb5f0 0x7fa91c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c0696e0 0x7fa91c159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa91c15a010 0x7fa91c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c069b30 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c154020 con 0x7fa91c15a010 2023-10-06T11:16:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.938+0000 7fa922a84700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c15a450 con 0x7fa91c0696e0 2023-10-06T11:16:13.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa91c0cb5f0 0x7fa91c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa91c0cb5f0 0x7fa91c0691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60716/0 (socket says 172.21.15.55:60716) 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 -- 172.21.15.55:0/3439660305 learned_addr learned my addr 172.21.15.55:0/3439660305 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa91bfff700 1 --2- 172.21.15.55:0/3439660305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c0696e0 0x7fa91c159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa921021700 1 --2- 172.21.15.55:0/3439660305 >> v2:172.21.15.142:3300/0 conn(0x7fa91c15a010 0x7fa91c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 -- 172.21.15.55:0/3439660305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c0696e0 msgr2=0x7fa91c159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 --2- 172.21.15.55:0/3439660305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c0696e0 0x7fa91c159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 -- 172.21.15.55:0/3439660305 >> v2:172.21.15.142:3300/0 conn(0x7fa91c15a010 msgr2=0x7fa91c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 --2- 172.21.15.55:0/3439660305 >> v2:172.21.15.142:3300/0 conn(0x7fa91c15a010 0x7fa91c0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 -- 172.21.15.55:0/3439660305 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c068d10 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa920820700 1 --2- 172.21.15.55:0/3439660305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c0691a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0c8800 tx=0x7fa914009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efabb9e427ec5ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa91b7fe700 1 -- 172.21.15.55:0/3439660305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400e070 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa91b7fe700 1 -- 172.21.15.55:0/3439660305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400ba40 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.939+0000 7fa91b7fe700 1 -- 172.21.15.55:0/3439660305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9140092e0 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 -- 172.21.15.55:0/3439660305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 msgr2=0x7fa91c0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 --2- 172.21.15.55:0/3439660305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c0691a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0c8800 tx=0x7fa914009840 comp rx=0 tx=0).stop 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 -- 172.21.15.55:0/3439660305 shutdown_connections 2023-10-06T11:16:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 --2- 172.21.15.55:0/3439660305 >> v2:172.21.15.142:3300/0 conn(0x7fa91c15a010 0x7fa91c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 --2- 172.21.15.55:0/3439660305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c0691a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 --2- 172.21.15.55:0/3439660305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c0696e0 0x7fa91c159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 -- 172.21.15.55:0/3439660305 >> 172.21.15.55:0/3439660305 conn(0x7fa91c0707d0 msgr2=0x7fa91c070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 -- 172.21.15.55:0/3439660305 shutdown_connections 2023-10-06T11:16:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.940+0000 7fa922a84700 1 -- 172.21.15.55:0/3439660305 wait complete. 2023-10-06T11:16:13.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.941+0000 7fa922a84700 1 Processor -- start 2023-10-06T11:16:13.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.941+0000 7fa922a84700 1 -- start start 2023-10-06T11:16:13.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa922a84700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa91c0696e0 0x7fa91c16a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa922a84700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa922a84700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c15a010 0x7fa91c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa922a84700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c16ad60 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa922a84700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0cca30 con 0x7fa91c0696e0 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa922a84700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b38b0 con 0x7fa91c15a010 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c15ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60728/0 (socket says 172.21.15.55:60728) 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 -- 172.21.15.55:0/4248946664 learned_addr learned my addr 172.21.15.55:0/4248946664 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa920820700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa91c0696e0 0x7fa91c16a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa921021700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c15a010 0x7fa91c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 -- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c15a010 msgr2=0x7fa91c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c15a010 0x7fa91c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 -- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa91c0696e0 msgr2=0x7fa91c16a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa91c0696e0 0x7fa91c16a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 -- 172.21.15.55:0/4248946664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009ae0 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa921021700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c15a010 0x7fa91c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.942+0000 7fa91bfff700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c15ad50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa91000d890 tx=0x7fa910008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.943+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9100125f0 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.943+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa910012750 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.943+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c0b3b90 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.943+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910012ad0 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.943+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c0cd1b0 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.944+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c0b3710 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.944+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa91001e460 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.944+0000 7fa918ff9700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa908066f30 0x7fa9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.945+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa910084dc0 con 0x7fa91c0cb5f0 2023-10-06T11:16:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.945+0000 7fa920820700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa908066f30 0x7fa9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.945+0000 7fa920820700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa908066f30 0x7fa9080693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa914009ea0 tx=0x7fa914018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:13.949+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa91c0b3710 con 0x7fa91c0cb5f0 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.186+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa91c0b3710 con 0x7fa91c0cb5f0 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.187+0000 7fa918ff9700 1 -- 172.21.15.55:0/4248946664 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa91c0b3710 con 0x7fa91c0cb5f0 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa908066f30 msgr2=0x7fa9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa908066f30 0x7fa9080693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa914009ea0 tx=0x7fa914018000 comp rx=0 tx=0).stop 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 msgr2=0x7fa91c15ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c15ad50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa91000d890 tx=0x7fa910008040 comp rx=0 tx=0).stop 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 shutdown_connections 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa908066f30 0x7fa9080693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa91c15a010 0x7fa91c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa91c0696e0 0x7fa91c16a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 --2- 172.21.15.55:0/4248946664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c0cb5f0 0x7fa91c15ad50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 >> 172.21.15.55:0/4248946664 conn(0x7fa91c0707d0 msgr2=0x7fa91c0cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 shutdown_connections 2023-10-06T11:16:14.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.189+0000 7fa922a84700 1 -- 172.21.15.55:0/4248946664 wait complete. 2023-10-06T11:16:14.192 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:14.605 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:03.661929+0000', 'modified': '2023-10-06T11:16:07.288412+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6528}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6528': {'gid': 6528, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6834/550471849', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 550471849}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 550471849}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:14.605 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:16:14.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:16:14.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 Processor -- start 2023-10-06T11:16:14.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 -- start start 2023-10-06T11:16:14.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60ac159560 0x7f60ac0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac0b0c60 con 0x7f60ac0b0760 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0b0f40 con 0x7f60ac159560 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.730+0000 7f60b1b52700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0b1220 con 0x7f60ac0b49a0 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60ab7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60ac159560 0x7f60ac0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60abfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60ac0b0760 0x7f60ac0b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47840/0 (socket says 172.21.15.55:47840) 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60abfff700 1 -- 172.21.15.55:0/3845679955 learned_addr learned my addr 172.21.15.55:0/3845679955 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60aaffd700 1 --2- 172.21.15.55:0/3845679955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60ab7fe700 1 -- 172.21.15.55:0/3845679955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 msgr2=0x7f60ac0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/3845679955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac0aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60ab7fe700 1 -- 172.21.15.55:0/3845679955 >> v1:172.21.15.55:6789/0 conn(0x7f60ac0b0760 legacy=0x7f60ac0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60ab7fe700 1 -- 172.21.15.55:0/3845679955 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0b1500 con 0x7f60ac159560 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60aa7fc700 1 -- 172.21.15.55:0/3845679955 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881684653 0 0) 0x7f60ac0b0c60 con 0x7f60ac0b0760 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/3845679955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac0aa530 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f60940098d0 tx=0x7f6094009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1a590f1932258b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60aa7fc700 1 -- 172.21.15.55:0/3845679955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094009e70 con 0x7f60ac159560 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60aa7fc700 1 -- 172.21.15.55:0/3845679955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094005c10 con 0x7f60ac159560 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.731+0000 7f60aa7fc700 1 -- 172.21.15.55:0/3845679955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400b650 con 0x7f60ac159560 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 -- 172.21.15.55:0/3845679955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 msgr2=0x7f60ac0aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 --2- 172.21.15.55:0/3845679955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac0aa530 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f60940098d0 tx=0x7f6094009120 comp rx=0 tx=0).stop 2023-10-06T11:16:14.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 -- 172.21.15.55:0/3845679955 shutdown_connections 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 --2- 172.21.15.55:0/3845679955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac0aa530 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 --2- 172.21.15.55:0/3845679955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 -- 172.21.15.55:0/3845679955 >> 172.21.15.55:0/3845679955 conn(0x7f60ac0997f0 msgr2=0x7f60ac06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 -- 172.21.15.55:0/3845679955 shutdown_connections 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.732+0000 7f60b1b52700 1 -- 172.21.15.55:0/3845679955 wait complete. 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.733+0000 7f60b1b52700 1 Processor -- start 2023-10-06T11:16:14.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.733+0000 7f60b1b52700 1 -- start start 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60b1b52700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60ac0b0760 0x7f60ac15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60b1b52700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac16cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60b1b52700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac14dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60b1b52700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac153200 con 0x7f60ac159560 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60b1b52700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac14e170 con 0x7f60ac0b0760 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60b1b52700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac152ed0 con 0x7f60ac0b49a0 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac14dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac14dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45096/0 (socket says 172.21.15.55:45096) 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 -- 172.21.15.55:0/2410928467 learned_addr learned my addr 172.21.15.55:0/2410928467 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:14.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60ac0b0760 0x7f60ac15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60aaffd700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac16cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 -- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 msgr2=0x7f60ac16cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac16cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 -- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60ac0b0760 msgr2=0x7f60ac15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60ac0b0760 0x7f60ac15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 -- 172.21.15.55:0/2410928467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940093c0 con 0x7f60ac159560 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.734+0000 7f60abfff700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac14dc30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f60a400cc90 tx=0x7f60a4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.735+0000 7f60a37fe700 1 -- 172.21.15.55:0/2410928467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400cea0 con 0x7f60ac159560 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.735+0000 7f60a37fe700 1 -- 172.21.15.55:0/2410928467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400ab70 con 0x7f60ac159560 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.735+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac16d630 con 0x7f60ac159560 2023-10-06T11:16:14.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.735+0000 7f60a37fe700 1 -- 172.21.15.55:0/2410928467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40070f0 con 0x7f60ac159560 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.735+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac16dbf0 con 0x7f60ac159560 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.736+0000 7f60a37fe700 1 -- 172.21.15.55:0/2410928467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60a40074a0 con 0x7f60ac159560 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.736+0000 7f60a37fe700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f608c066f30 0x7f608c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.736+0000 7f60a37fe700 1 -- 172.21.15.55:0/2410928467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f60a4084c50 con 0x7f60ac159560 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.737+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f608c066f30 0x7f608c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.737+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f608c066f30 0x7f608c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6094009160 tx=0x7f6094016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.738+0000 7f60bae4ab80 1 Processor -- start 2023-10-06T11:16:14.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.738+0000 7f60bae4ab80 1 -- start start 2023-10-06T11:16:14.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a9a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a961580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a961ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a8e1c80 con 0x56262a962bd0 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a8b8a70 con 0x56262a9a8a90 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56262a8b6270 con 0x56262a9649a0 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60abfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a961ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60abfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a961ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45098/0 (socket says 172.21.15.55:45098) 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60abfff700 1 -- 172.21.15.55:0/3063356735 learned_addr learned my addr 172.21.15.55:0/3063356735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a9a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.739+0000 7f60aaffd700 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a961580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60abfff700 1 -- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 msgr2=0x56262a961580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60abfff700 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a961580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60abfff700 1 -- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 msgr2=0x56262a9a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60abfff700 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a9a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60abfff700 1 -- 172.21.15.55:0/3063356735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56262a74c270 con 0x56262a962bd0 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60aaffd700 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a961580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60abfff700 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a961ac0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f60a4082f00 tx=0x7f60a4082e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785547e06c706c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60a0ff9700 1 -- 172.21.15.55:0/3063356735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4081070 con 0x56262a962bd0 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60a0ff9700 1 -- 172.21.15.55:0/3063356735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a40554a0 con 0x56262a962bd0 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60a0ff9700 1 -- 172.21.15.55:0/3063356735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a405c900 con 0x56262a962bd0 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60bae4ab80 1 -- 172.21.15.55:0/3063356735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 msgr2=0x56262a961ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.740+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a961ac0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f60a4082f00 tx=0x7f60a4082e30 comp rx=0 tx=0).stop 2023-10-06T11:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 -- 172.21.15.55:0/3063356735 shutdown_connections 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a961ac0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a9a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/3063356735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a961580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 -- 172.21.15.55:0/3063356735 >> 172.21.15.55:0/3063356735 conn(0x56262a963070 msgr2=0x56262a963440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 -- 172.21.15.55:0/3063356735 shutdown_connections 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 -- 172.21.15.55:0/3063356735 wait complete. 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 -- start start 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.741+0000 7f60bae4ab80 1 Processor -- start 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a98c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a98db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a98e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a8b2060 con 0x56262a962bd0 2023-10-06T11:16:14.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a85d890 con 0x56262a9a8a90 2023-10-06T11:16:14.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56262a878ea0 con 0x56262a9649a0 2023-10-06T11:16:14.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60bae4ab80 10 client.0 _ll_register_callbacks cb 0x56262a74ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:14.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60ab7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a98c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60ab7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a98c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45100/0 (socket says 172.21.15.55:45100) 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60ab7fe700 1 -- 172.21.15.55:0/888886843 learned_addr learned my addr 172.21.15.55:0/888886843 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60aaffd700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a98db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.742+0000 7f60abfff700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a98e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60ab7fe700 1 -- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 msgr2=0x56262a98db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a98db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60ab7fe700 1 -- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 msgr2=0x56262a98e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a98e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60ab7fe700 1 -- 172.21.15.55:0/888886843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac16dbf0 con 0x56262a962bd0 2023-10-06T11:16:14.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60abfff700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a98e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60aaffd700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a98db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a98c020 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6094012000 tx=0x7f6094022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2254cef6d26c9d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f6089ffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f6089ffb700 1 -- 172.21.15.55:0/888886843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094031070 con 0x56262a962bd0 2023-10-06T11:16:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f6089ffb700 1 -- 172.21.15.55:0/888886843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6094006670 con 0x56262a962bd0 2023-10-06T11:16:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56262a956690 con 0x56262a962bd0 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f6089ffb700 1 -- 172.21.15.55:0/888886843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6094022070 con 0x56262a962bd0 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 10 client.6699 fetch_fsmap learned FSMap version 51 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x56262a6eefe0 con 0x56262a962bd0 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f6089ffb700 1 -- 172.21.15.55:0/888886843 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56262a956690 con 0x56262a962bd0 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f6089ffb700 1 -- 172.21.15.55:0/888886843 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6094034020 con 0x56262a962bd0 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 10 client.6699 fetch_fsmap finished waiting for FSMap version 51 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 10 client.6699 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 20 client.6699 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262a9bb750 0x56262a9bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 4 client.6699 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.743+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 --> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56262a9335c0 con 0x56262a9bb750 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.744+0000 7f60aaffd700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262a9bb750 0x56262a9bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.744+0000 7f6089ffb700 10 client.6699 ms_handle_connect on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.744+0000 7f60aaffd700 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262a9bb750 0x56262a9bbb20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdcf60097c1a75ba server_cookie=e5ffccdde1ca4e95 in_seq=0 out_seq=0 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.744+0000 7f6089ffb700 1 -- 172.21.15.55:0/888886843 <== mds.0 v2:172.21.15.55:6832/550471849 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56262a9335c0 con 0x56262a9bb750 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.744+0000 7f6089ffb700 10 client.6699 handle_command_reply: tid=0 2023-10-06T11:16:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.744+0000 7f60bae4ab80 1 client.6699 shutdown 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 msgr2=0x56262a98c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a98c020 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6094012000 tx=0x7f6094022000 comp rx=0 tx=0).stop 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 shutdown_connections 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262a9bb750 0x56262a9bbb20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a962bd0 0x56262a98c020 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9a8a90 0x56262a98e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/888886843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9649a0 0x56262a98db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f6089ffb700 0 client.6699 ms_handle_reset on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 >> 172.21.15.55:0/888886843 conn(0x56262a963070 msgr2=0x56262a9a7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 shutdown_connections 2023-10-06T11:16:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 1 -- 172.21.15.55:0/888886843 wait complete. 2023-10-06T11:16:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.745+0000 7f60bae4ab80 20 client.6699 trim_cache size 0 max 16384 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 Processor -- start 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 -- start start 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a98b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 0x56262a963610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a963b50 0x56262a95c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a734e30 con 0x56262a9a8a90 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a9a6fa0 con 0x56262a9649a0 2023-10-06T11:16:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.762+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56262a964860 con 0x56262a963b50 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 0x56262a963610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 0x56262a963610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45116/0 (socket says 172.21.15.55:45116) 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 -- 172.21.15.55:0/836363743 learned_addr learned my addr 172.21.15.55:0/836363743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a98b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60abfff700 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a963b50 0x56262a95c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 -- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a963b50 msgr2=0x56262a95c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a963b50 0x56262a95c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 -- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 msgr2=0x56262a98b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a98b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 -- 172.21.15.55:0/836363743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56262a880780 con 0x56262a9a8a90 2023-10-06T11:16:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60abfff700 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a963b50 0x56262a95c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60aaffd700 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 0x56262a963610 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x56262a98ea10 tx=0x7f609c01a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbcc64472071fed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60a17fa700 1 -- 172.21.15.55:0/836363743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c014770 con 0x56262a9a8a90 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60a17fa700 1 -- 172.21.15.55:0/836363743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c01a040 con 0x56262a9a8a90 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.763+0000 7f60a17fa700 1 -- 172.21.15.55:0/836363743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c014b20 con 0x56262a9a8a90 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 -- 172.21.15.55:0/836363743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 msgr2=0x56262a963610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 0x56262a963610 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x56262a98ea10 tx=0x7f609c01a250 comp rx=0 tx=0).stop 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 -- 172.21.15.55:0/836363743 shutdown_connections 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a963b50 0x56262a95c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a98b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/836363743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a9a8a90 0x56262a963610 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 -- 172.21.15.55:0/836363743 >> 172.21.15.55:0/836363743 conn(0x56262a963070 msgr2=0x56262a98c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 -- 172.21.15.55:0/836363743 shutdown_connections 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 -- 172.21.15.55:0/836363743 wait complete. 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 -- start start 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.764+0000 7f60bae4ab80 1 Processor -- start 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 0x56262a963610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a99e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9a8a90 0x56262a99e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a98a960 con 0x56262a963b50 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262a9b7ab0 con 0x56262a9649a0 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56262aa0e590 con 0x56262a9a8a90 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60bae4ab80 10 client.0 _ll_register_callbacks cb 0x56262a74ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:14.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 0x56262a963610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 0x56262a963610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45126/0 (socket says 172.21.15.55:45126) 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 -- 172.21.15.55:0/456386911 learned_addr learned my addr 172.21.15.55:0/456386911 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60abfff700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9a8a90 0x56262a99e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60aaffd700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a99e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 -- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9a8a90 msgr2=0x56262a99e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9a8a90 0x56262a99e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 -- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 msgr2=0x56262a99e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a99e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60ab7fe700 1 -- 172.21.15.55:0/456386911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c00b990 con 0x56262a963b50 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.765+0000 7f60abfff700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9a8a90 0x56262a99e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60ab7fe700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 0x56262a963610 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x56262a95ed90 tx=0x7f609400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32d5da8820e17c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f6089ffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f6089ffb700 1 -- 172.21.15.55:0/456386911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094022070 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f6089ffb700 1 -- 172.21.15.55:0/456386911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f609402a630 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60a40554a0 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f6089ffb700 1 -- 172.21.15.55:0/456386911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6094031040 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 10 client.6705 fetch_fsmap learned FSMap version 51 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x56262a867470 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f6089ffb700 1 -- 172.21.15.55:0/456386911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a40554a0 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f6089ffb700 1 -- 172.21.15.55:0/456386911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f609400bc10 con 0x56262a963b50 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 10 client.6705 fetch_fsmap finished waiting for FSMap version 51 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 10 client.6705 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 20 client.6705 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262aa11890 0x56262aa11c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 4 client.6705 mds_command: new command op to 6528 tid=0[{"prefix": "status"}] 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 --> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56262a854e00 con 0x56262aa11890 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.766+0000 7f60aaffd700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262aa11890 0x56262aa11c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f6089ffb700 10 client.6705 ms_handle_connect on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60aaffd700 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262aa11890 0x56262aa11c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248f6ede7732909e server_cookie=578c14607ceca5cb in_seq=0 out_seq=0 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f6089ffb700 1 -- 172.21.15.55:0/456386911 <== mds.0 v2:172.21.15.55:6832/550471849 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56262a854e00 con 0x56262aa11890 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f6089ffb700 10 client.6705 handle_command_reply: tid=0 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 client.6705 shutdown 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 msgr2=0x56262a963610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 0x56262a963610 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x56262a95ed90 tx=0x7f609400b050 comp rx=0 tx=0).stop 2023-10-06T11:16:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 shutdown_connections 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x56262aa11890 0x56262aa11c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56262a963b50 0x56262a963610 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56262a9a8a90 0x56262a99e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f6089ffb700 0 client.6705 ms_handle_reset on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 --2- 172.21.15.55:0/456386911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56262a9649a0 0x56262a99e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 >> 172.21.15.55:0/456386911 conn(0x56262a963070 msgr2=0x56262a9a7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 shutdown_connections 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 1 -- 172.21.15.55:0/456386911 wait complete. 2023-10-06T11:16:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.767+0000 7f60bae4ab80 20 client.6705 trim_cache size 0 max 16384 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6528, 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.517573475000001, 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 51, 2023-10-06T11:16:14.778 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 91, 2023-10-06T11:16:14.779 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 91, 2023-10-06T11:16:14.779 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.593026897000001 2023-10-06T11:16:14.779 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f608c066f30 msgr2=0x7f608c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f608c066f30 0x7f608c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6094009160 tx=0x7f6094016000 comp rx=0 tx=0).stop 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 msgr2=0x7f60ac14dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac14dc30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f60a400cc90 tx=0x7f60a4001a80 comp rx=0 tx=0).stop 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 shutdown_connections 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f608c066f30 0x7f608c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60ac159560 0x7f60ac14dc30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60ac0b0760 0x7f60ac15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 --2- 172.21.15.55:0/2410928467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60ac0b49a0 0x7f60ac16cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 >> 172.21.15.55:0/2410928467 conn(0x7f60ac0997f0 msgr2=0x7f60ac0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 shutdown_connections 2023-10-06T11:16:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.768+0000 7f60b1b52700 1 -- 172.21.15.55:0/2410928467 wait complete. 2023-10-06T11:16:14.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:14.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.899+0000 7fe10b723700 1 Processor -- start 2023-10-06T11:16:14.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.899+0000 7fe10b723700 1 -- start start 2023-10-06T11:16:14.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe10b723700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1040adf20 0x7fe1040ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe10b723700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe104069c30 0x7fe10406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe10b723700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040c7330 con 0x7fe10406e240 2023-10-06T11:16:14.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe10b723700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe104156110 con 0x7fe1040adf20 2023-10-06T11:16:14.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe10b723700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040ac540 con 0x7fe104069c30 2023-10-06T11:16:14.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe108cbe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe10406e240 0x7fe104069520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47844/0 (socket says 172.21.15.55:47844) 2023-10-06T11:16:14.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe108cbe700 1 -- 172.21.15.55:0/62952895 learned_addr learned my addr 172.21.15.55:0/62952895 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe109cc0700 1 --2- 172.21.15.55:0/62952895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe104069c30 0x7fe10406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe1094bf700 1 --2- 172.21.15.55:0/62952895 >> v2:172.21.15.142:3300/0 conn(0x7fe1040adf20 0x7fe1040ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe0fbfff700 1 -- 172.21.15.55:0/62952895 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583304586 0 0) 0x7fe1040c7330 con 0x7fe10406e240 2023-10-06T11:16:14.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe0fbfff700 1 -- 172.21.15.55:0/62952895 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f0003570 con 0x7fe10406e240 2023-10-06T11:16:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe109cc0700 1 -- 172.21.15.55:0/62952895 >> v2:172.21.15.142:3300/0 conn(0x7fe1040adf20 msgr2=0x7fe1040ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe109cc0700 1 --2- 172.21.15.55:0/62952895 >> v2:172.21.15.142:3300/0 conn(0x7fe1040adf20 0x7fe1040ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe109cc0700 1 -- 172.21.15.55:0/62952895 >> v1:172.21.15.55:6789/0 conn(0x7fe10406e240 legacy=0x7fe104069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe0fbfff700 1 -- 172.21.15.55:0/62952895 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2379206889 0 0) 0x7fe0f0003570 con 0x7fe10406e240 2023-10-06T11:16:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe109cc0700 1 -- 172.21.15.55:0/62952895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040c6720 con 0x7fe104069c30 2023-10-06T11:16:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.900+0000 7fe1094bf700 1 --2- 172.21.15.55:0/62952895 >> v2:172.21.15.142:3300/0 conn(0x7fe1040adf20 0x7fe1040ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe109cc0700 1 --2- 172.21.15.55:0/62952895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe104069c30 0x7fe10406e6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009e60 tx=0x7fe0fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5d6aa236956bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe0fbfff700 1 -- 172.21.15.55:0/62952895 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00e070 con 0x7fe104069c30 2023-10-06T11:16:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe0fbfff700 1 -- 172.21.15.55:0/62952895 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00b7a0 con 0x7fe104069c30 2023-10-06T11:16:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe0fbfff700 1 -- 172.21.15.55:0/62952895 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100001470 con 0x7fe104069c30 2023-10-06T11:16:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 -- 172.21.15.55:0/62952895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe104069c30 msgr2=0x7fe10406e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 --2- 172.21.15.55:0/62952895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe104069c30 0x7fe10406e6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009e60 tx=0x7fe0fc009780 comp rx=0 tx=0).stop 2023-10-06T11:16:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 -- 172.21.15.55:0/62952895 shutdown_connections 2023-10-06T11:16:14.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 --2- 172.21.15.55:0/62952895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe104069c30 0x7fe10406e6b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 --2- 172.21.15.55:0/62952895 >> v2:172.21.15.142:3300/0 conn(0x7fe1040adf20 0x7fe1040ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 -- 172.21.15.55:0/62952895 >> 172.21.15.55:0/62952895 conn(0x7fe104068080 msgr2=0x7fe1040cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 -- 172.21.15.55:0/62952895 shutdown_connections 2023-10-06T11:16:14.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.901+0000 7fe10b723700 1 -- 172.21.15.55:0/62952895 wait complete. 2023-10-06T11:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.902+0000 7fe10b723700 1 Processor -- start 2023-10-06T11:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 -- start start 2023-10-06T11:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe104069c30 0x7fe10414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 0x7fe104159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1040adf20 0x7fe1040caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c19a0 con 0x7fe10406e240 2023-10-06T11:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c1c80 con 0x7fe104069c30 2023-10-06T11:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe10b723700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040c1f60 con 0x7fe1040adf20 2023-10-06T11:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe108cbe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 0x7fe104159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe108cbe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 0x7fe104159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45132/0 (socket says 172.21.15.55:45132) 2023-10-06T11:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.903+0000 7fe108cbe700 1 -- 172.21.15.55:0/2143992812 learned_addr learned my addr 172.21.15.55:0/2143992812 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe109cc0700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1040adf20 0x7fe1040caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe1094bf700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe104069c30 0x7fe10414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe108cbe700 1 -- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1040adf20 msgr2=0x7fe1040caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe108cbe700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1040adf20 0x7fe1040caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe108cbe700 1 -- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe104069c30 msgr2=0x7fe10414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe108cbe700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe104069c30 0x7fe10414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe108cbe700 1 -- 172.21.15.55:0/2143992812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4009420 con 0x7fe10406e240 2023-10-06T11:16:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe108cbe700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 0x7fe104159890 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe10000cb90 tx=0x7fe100001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100001d60 con 0x7fe10406e240 2023-10-06T11:16:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100007360 con 0x7fe10406e240 2023-10-06T11:16:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100007700 con 0x7fe10406e240 2023-10-06T11:16:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc009a20 con 0x7fe10406e240 2023-10-06T11:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.904+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1040c2520 con 0x7fe10406e240 2023-10-06T11:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.905+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1040c2710 con 0x7fe10406e240 2023-10-06T11:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.906+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe100004a40 con 0x7fe10406e240 2023-10-06T11:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.906+0000 7fe0f97fa700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0e8066f30 0x7fe0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.906+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe100084110 con 0x7fe10406e240 2023-10-06T11:16:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.906+0000 7fe1094bf700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0e8066f30 0x7fe0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.907+0000 7fe1094bf700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0e8066f30 0x7fe0e80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40093f0 tx=0x7fe0f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:14.910+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe100051160 con 0x7fe10406e240 2023-10-06T11:16:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.147+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe104064a90 con 0x7fe10406e240 2023-10-06T11:16:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.148+0000 7fe0f97fa700 1 -- 172.21.15.55:0/2143992812 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe100018060 con 0x7fe10406e240 2023-10-06T11:16:15.150 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:15.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0e8066f30 msgr2=0x7fe0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0e8066f30 0x7fe0e80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40093f0 tx=0x7fe0f4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:15.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 msgr2=0x7fe104159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 0x7fe104159890 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe10000cb90 tx=0x7fe100001ad0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 shutdown_connections 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe0e8066f30 0x7fe0e80693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1040adf20 0x7fe1040caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe104069c30 0x7fe10414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 --2- 172.21.15.55:0/2143992812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe10406e240 0x7fe104159890 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 >> 172.21.15.55:0/2143992812 conn(0x7fe104068080 msgr2=0x7fe10406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 shutdown_connections 2023-10-06T11:16:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.150+0000 7fe10b723700 1 -- 172.21.15.55:0/2143992812 wait complete. 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:16:15.164 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:15.165 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:15.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.165 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:15.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.187 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:15.262 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:16:15.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.263 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:16:15.327 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:16:15.327 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:15.327 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:16:15.328 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:16:15.328 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:15.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.328 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:16:15.328 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:16:15.328 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:16:15.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:16:15.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:16:15.329 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:16:15.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.433 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:16:15.450 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:16:15.451 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:16:15.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:15.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:16:15.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:15.519 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:15.579 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:15.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:15.579 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:15.637 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:16:15.637 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:15.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:15.720 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:15.720 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:15.738 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:15.738 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:15.738 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:15.738 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:15.738 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:15.739 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:15.739 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:15.739 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:15.759 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:16:15.760 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:16:15.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:16:15.762 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:16:15.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:15.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:15.828 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.985+0000 7f506b59e700 1 Processor -- start 2023-10-06T11:16:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.986+0000 7f506b59e700 1 -- start start 2023-10-06T11:16:15.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.986+0000 7f506b59e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f506c06f310 0x7f506c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.986+0000 7f506b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cc5d0 0x7f506c159450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.986+0000 7f506b59e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c06e040 con 0x7f506c0cb5a0 2023-10-06T11:16:15.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.986+0000 7f506b59e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c06ebc0 con 0x7f506c06f310 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.986+0000 7f506b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c06e320 con 0x7f506c0cc5d0 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f5069d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f506c06f310 0x7f506c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506a59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f506c0cb5a0 0x7f506c06d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47860/0 (socket says 172.21.15.55:47860) 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506a59c700 1 -- 172.21.15.55:0/3785442345 learned_addr learned my addr 172.21.15.55:0/3785442345 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f5069d9b700 1 -- 172.21.15.55:0/3785442345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cc5d0 msgr2=0x7f506c159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506ad9d700 1 --2- 172.21.15.55:0/3785442345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cc5d0 0x7f506c159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f5069d9b700 1 --2- 172.21.15.55:0/3785442345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cc5d0 0x7f506c159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506959a700 1 -- 172.21.15.55:0/3785442345 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656415771 0 0) 0x7f506c06e040 con 0x7f506c0cb5a0 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f5069d9b700 1 -- 172.21.15.55:0/3785442345 >> v1:172.21.15.55:6789/0 conn(0x7f506c0cb5a0 legacy=0x7f506c06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f5069d9b700 1 -- 172.21.15.55:0/3785442345 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c06e600 con 0x7f506c06f310 2023-10-06T11:16:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f5069d9b700 1 --2- 172.21.15.55:0/3785442345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c06f310 0x7f506c0cb970 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f50540098e0 tx=0x7f50540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2dc988715d7c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506959a700 1 -- 172.21.15.55:0/3785442345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054009e80 con 0x7f506c06f310 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506959a700 1 -- 172.21.15.55:0/3785442345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400b860 con 0x7f506c06f310 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.987+0000 7f506959a700 1 -- 172.21.15.55:0/3785442345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400bbe0 con 0x7f506c06f310 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 -- 172.21.15.55:0/3785442345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c06f310 msgr2=0x7f506c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 --2- 172.21.15.55:0/3785442345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c06f310 0x7f506c0cb970 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f50540098e0 tx=0x7f50540091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 -- 172.21.15.55:0/3785442345 shutdown_connections 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 --2- 172.21.15.55:0/3785442345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cc5d0 0x7f506c159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 --2- 172.21.15.55:0/3785442345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c06f310 0x7f506c0cb970 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 -- 172.21.15.55:0/3785442345 >> 172.21.15.55:0/3785442345 conn(0x7f506c068080 msgr2=0x7f506c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 -- 172.21.15.55:0/3785442345 shutdown_connections 2023-10-06T11:16:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.988+0000 7f506b59e700 1 -- 172.21.15.55:0/3785442345 wait complete. 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.989+0000 7f506b59e700 1 Processor -- start 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.989+0000 7f506b59e700 1 -- start start 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cb5a0 0x7f506c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f506c0cc5d0 0x7f506c06a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 0x7f506c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506b59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0b1ba0 con 0x7f506c0c57b0 2023-10-06T11:16:15.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c06a540 con 0x7f506c0cc5d0 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0b1020 con 0x7f506c0cb5a0 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 0x7f506c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 0x7f506c14c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45146/0 (socket says 172.21.15.55:45146) 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 -- 172.21.15.55:0/1025705117 learned_addr learned my addr 172.21.15.55:0/1025705117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f5069d9b700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f506c0cc5d0 0x7f506c06a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506a59c700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cb5a0 0x7f506c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 -- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cb5a0 msgr2=0x7f506c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cb5a0 0x7f506c0b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 -- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f506c0cc5d0 msgr2=0x7f506c06a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f506c0cc5d0 0x7f506c06a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 -- 172.21.15.55:0/1025705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054009420 con 0x7f506c0c57b0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f5069d9b700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f506c0cc5d0 0x7f506c06a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506a59c700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cb5a0 0x7f506c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.990+0000 7f506ad9d700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 0x7f506c14c280 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f505c00ceb0 tx=0x7f505c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.991+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c00ae40 con 0x7f506c0c57b0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.991+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c016420 con 0x7f506c0c57b0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.991+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c0b1300 con 0x7f506c0c57b0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.991+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0167e0 con 0x7f506c0c57b0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.991+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0b18c0 con 0x7f506c0c57b0 2023-10-06T11:16:15.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.991+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c05f230 con 0x7f506c0c57b0 2023-10-06T11:16:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.992+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f505c009030 con 0x7f506c0c57b0 2023-10-06T11:16:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.992+0000 7f50627fc700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f504c066f30 0x7f504c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.993+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f505c012070 con 0x7f506c0c57b0 2023-10-06T11:16:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.993+0000 7f506a59c700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f504c066f30 0x7f504c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.993+0000 7f506a59c700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f504c066f30 0x7f504c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f50640018d0 tx=0x7f5064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:15.997+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f505c04e5a0 con 0x7f506c0c57b0 2023-10-06T11:16:16.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.236+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f506c06e8e0 con 0x7f506c0c57b0 2023-10-06T11:16:16.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.236+0000 7f50627fc700 1 -- 172.21.15.55:0/1025705117 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f505c051df0 con 0x7f506c0c57b0 2023-10-06T11:16:16.238 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:16.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f504c066f30 msgr2=0x7f504c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f504c066f30 0x7f504c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f50640018d0 tx=0x7f5064009040 comp rx=0 tx=0).stop 2023-10-06T11:16:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 msgr2=0x7f506c14c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 0x7f506c14c280 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f505c00ceb0 tx=0x7f505c007870 comp rx=0 tx=0).stop 2023-10-06T11:16:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 shutdown_connections 2023-10-06T11:16:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f504c066f30 0x7f504c0693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f506c0c57b0 0x7f506c14c280 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f506c0cb5a0 0x7f506c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 --2- 172.21.15.55:0/1025705117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f506c0cc5d0 0x7f506c06a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 >> 172.21.15.55:0/1025705117 conn(0x7f506c068080 msgr2=0x7f506c0cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:16.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 shutdown_connections 2023-10-06T11:16:16.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:16.238+0000 7f506b59e700 1 -- 172.21.15.55:0/1025705117 wait complete. 2023-10-06T11:16:16.252 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:16:16.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:16.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:16:16.253 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:16:16.253 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:16.253 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:16:16.253 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:16:16.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:16.253 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:16.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.253 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:16:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42319sec preferred_lft 42319sec 2023-10-06T11:16:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:16:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.274 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:16:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.275 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:16:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:16:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.276 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:16:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:16:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:16.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.277 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:16.338 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:16:16.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.340 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:16:16.397 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:16:16.397 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:16.398 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:16:16.398 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:16:16.398 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:16.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.398 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:16:16.398 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:16:16.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:16:16.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:16:16.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:16:16.399 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:16:16.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.502 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:16:16.517 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:16:16.517 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:16:16.517 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:16.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:16:16.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:16.583 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:16.639 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:16.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:16.640 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:16.694 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:16:16.695 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:16.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:16.776 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:16.776 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:16.794 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:16.795 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:16.816 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:16:16.817 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:16:16.818 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:16:16.818 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:16:16.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:16.884 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:16:16.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:16.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:16.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:16:16.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:16.928 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:16:16.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:16:16.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:16.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:17.029 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:16:17.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:17.030 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:16:17.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.169+0000 7fa97a019700 1 Processor -- start 2023-10-06T11:16:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.169+0000 7fa97a019700 1 -- start start 2023-10-06T11:16:17.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa97a019700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9740ad210 0x7fa9740cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa97a019700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9740ad5e0 0x7fa97415d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa97a019700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa97415d940 0x7fa9740686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa97a019700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97415dde0 con 0x7fa9740ad5e0 2023-10-06T11:16:17.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa97a019700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740cecf0 con 0x7fa9740ad210 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa97a019700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740cefd0 con 0x7fa97415d940 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9740ad5e0 0x7fa97415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9740ad5e0 0x7fa97415d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45148/0 (socket says 172.21.15.55:45148) 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 -- 172.21.15.55:0/163837751 learned_addr learned my addr 172.21.15.55:0/163837751 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa9737fe700 1 --2- 172.21.15.55:0/163837751 >> v2:172.21.15.142:3300/0 conn(0x7fa9740ad210 0x7fa9740cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa973fff700 1 --2- 172.21.15.55:0/163837751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa97415d940 0x7fa9740686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 -- 172.21.15.55:0/163837751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa97415d940 msgr2=0x7fa9740686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 --2- 172.21.15.55:0/163837751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa97415d940 0x7fa9740686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 -- 172.21.15.55:0/163837751 >> v2:172.21.15.142:3300/0 conn(0x7fa9740ad210 msgr2=0x7fa9740cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 --2- 172.21.15.55:0/163837751 >> v2:172.21.15.142:3300/0 conn(0x7fa9740ad210 0x7fa9740cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa972ffd700 1 -- 172.21.15.55:0/163837751 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740cca90 con 0x7fa9740ad5e0 2023-10-06T11:16:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.170+0000 7fa9737fe700 1 --2- 172.21.15.55:0/163837751 >> v2:172.21.15.142:3300/0 conn(0x7fa9740ad210 0x7fa9740cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa972ffd700 1 --2- 172.21.15.55:0/163837751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa97415d400 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa9740cacb0 tx=0x7fa968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446f1d93a44253ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa9727fc700 1 -- 172.21.15.55:0/163837751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800b860 con 0x7fa9740ad5e0 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa9727fc700 1 -- 172.21.15.55:0/163837751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800b9c0 con 0x7fa9740ad5e0 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa9727fc700 1 -- 172.21.15.55:0/163837751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800bd60 con 0x7fa9740ad5e0 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 -- 172.21.15.55:0/163837751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 msgr2=0x7fa97415d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 --2- 172.21.15.55:0/163837751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa97415d400 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa9740cacb0 tx=0x7fa968009250 comp rx=0 tx=0).stop 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 -- 172.21.15.55:0/163837751 shutdown_connections 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 --2- 172.21.15.55:0/163837751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa97415d940 0x7fa9740686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 --2- 172.21.15.55:0/163837751 >> v2:172.21.15.142:3300/0 conn(0x7fa9740ad210 0x7fa9740cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 --2- 172.21.15.55:0/163837751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa97415d400 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 -- 172.21.15.55:0/163837751 >> 172.21.15.55:0/163837751 conn(0x7fa974067d90 msgr2=0x7fa9740ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 -- 172.21.15.55:0/163837751 shutdown_connections 2023-10-06T11:16:17.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.171+0000 7fa97a019700 1 -- 172.21.15.55:0/163837751 wait complete. 2023-10-06T11:16:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 Processor -- start 2023-10-06T11:16:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 -- start start 2023-10-06T11:16:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9740ad210 0x7fa9740b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa9740afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97415d940 0x7fa9740b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740b3dc0 con 0x7fa9740ad5e0 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740b31b0 con 0x7fa97415d940 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa97a019700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740b3490 con 0x7fa9740ad210 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa972ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa9740afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa972ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa9740afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45164/0 (socket says 172.21.15.55:45164) 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.173+0000 7fa972ffd700 1 -- 172.21.15.55:0/2407015614 learned_addr learned my addr 172.21.15.55:0/2407015614 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa973fff700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97415d940 0x7fa9740b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa9737fe700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9740ad210 0x7fa9740b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa972ffd700 1 -- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9740ad210 msgr2=0x7fa9740b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa972ffd700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9740ad210 0x7fa9740b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa972ffd700 1 -- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97415d940 msgr2=0x7fa9740b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa972ffd700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97415d940 0x7fa9740b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa972ffd700 1 -- 172.21.15.55:0/2407015614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680094f0 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa972ffd700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa9740afbd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa968009290 tx=0x7fa968017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968011e40 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96801f070 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9740b3770 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680266d0 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.174+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9740b2dc0 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.175+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa974064a90 con 0x7fa9740ad5e0 2023-10-06T11:16:17.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.176+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa968026a40 con 0x7fa9740ad5e0 2023-10-06T11:16:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.176+0000 7fa95b7fe700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa960066f30 0x7fa9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.176+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa968021070 con 0x7fa9740ad5e0 2023-10-06T11:16:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.176+0000 7fa9737fe700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa960066f30 0x7fa9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.177+0000 7fa9737fe700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa960066f30 0x7fa9600693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa964006ea0 tx=0x7fa964008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.180+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa968053530 con 0x7fa9740ad5e0 2023-10-06T11:16:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.417+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9740ccd70 con 0x7fa9740ad5e0 2023-10-06T11:16:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.418+0000 7fa95b7fe700 1 -- 172.21.15.55:0/2407015614 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa968056b50 con 0x7fa9740ad5e0 2023-10-06T11:16:17.419 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:17.420 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.419+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa960066f30 msgr2=0x7fa9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.419+0000 7fa97a019700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa960066f30 0x7fa9600693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa964006ea0 tx=0x7fa964008040 comp rx=0 tx=0).stop 2023-10-06T11:16:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.419+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 msgr2=0x7fa9740afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.419+0000 7fa97a019700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa9740afbd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa968009290 tx=0x7fa968017000 comp rx=0 tx=0).stop 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 shutdown_connections 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa960066f30 0x7fa9600693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97415d940 0x7fa9740b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9740ad210 0x7fa9740b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 --2- 172.21.15.55:0/2407015614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9740ad5e0 0x7fa9740afbd0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 >> 172.21.15.55:0/2407015614 conn(0x7fa974067d90 msgr2=0x7fa9740ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 shutdown_connections 2023-10-06T11:16:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.420+0000 7fa97a019700 1 -- 172.21.15.55:0/2407015614 wait complete. 2023-10-06T11:16:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:17.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2023-10-06T11:16:17.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.553+0000 7fb96dcf3700 1 Processor -- start 2023-10-06T11:16:17.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.553+0000 7fb96dcf3700 1 -- start start 2023-10-06T11:16:17.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb96dcf3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96806d670 0x7fb96815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb96dcf3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb96806da40 0x7fb9680b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb96dcf3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96815ab50 con 0x7fb96806ce10 2023-10-06T11:16:17.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb96dcf3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96815d650 con 0x7fb96806da40 2023-10-06T11:16:17.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb96dcf3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96815a590 con 0x7fb96806d670 2023-10-06T11:16:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb967fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb96806da40 0x7fb9680b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96806d670 0x7fb96815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb966ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb96806ce10 0x7fb968159af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:52576/0 (socket says 172.21.15.55:52576) 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.554+0000 7fb966ffd700 1 -- 172.21.15.55:0/3088276245 learned_addr learned my addr 172.21.15.55:0/3088276245 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb9667fc700 1 -- 172.21.15.55:0/3088276245 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605095661 0 0) 0x7fb95c001110 con 0x7fb96806ce10 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb9667fc700 1 -- 172.21.15.55:0/3088276245 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb950003570 con 0x7fb96806ce10 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb967fff700 1 -- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96806d670 msgr2=0x7fb96815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb967fff700 1 --2- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96806d670 0x7fb96815dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb967fff700 1 -- 172.21.15.55:0/3088276245 >> v1:172.21.15.142:6789/0 conn(0x7fb96806ce10 legacy=0x7fb968159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb967fff700 1 -- 172.21.15.55:0/3088276245 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96815a870 con 0x7fb96806da40 2023-10-06T11:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb9677fe700 1 --2- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96806d670 0x7fb96815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb967fff700 1 --2- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806da40 0x7fb9680b1080 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb960009e60 tx=0x7fb960009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17232f5db169e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb9667fc700 1 -- 172.21.15.55:0/3088276245 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96000e070 con 0x7fb96806da40 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb9667fc700 1 -- 172.21.15.55:0/3088276245 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96000bab0 con 0x7fb96806da40 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.555+0000 7fb9667fc700 1 -- 172.21.15.55:0/3088276245 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96000be70 con 0x7fb96806da40 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 -- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806da40 msgr2=0x7fb9680b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806da40 0x7fb9680b1080 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb960009e60 tx=0x7fb960009780 comp rx=0 tx=0).stop 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 -- 172.21.15.55:0/3088276245 shutdown_connections 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806da40 0x7fb9680b1080 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/3088276245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb96806d670 0x7fb96815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 -- 172.21.15.55:0/3088276245 >> 172.21.15.55:0/3088276245 conn(0x7fb96806b600 msgr2=0x7fb96806ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 -- 172.21.15.55:0/3088276245 shutdown_connections 2023-10-06T11:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.556+0000 7fb96dcf3700 1 -- 172.21.15.55:0/3088276245 wait complete. 2023-10-06T11:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.557+0000 7fb96dcf3700 1 Processor -- start 2023-10-06T11:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.557+0000 7fb96dcf3700 1 -- start start 2023-10-06T11:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806d670 0x7fb968155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 0x7fb9680cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb968142680 0x7fb9680cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9680c8ad0 con 0x7fb96806da40 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9680ce0d0 con 0x7fb96806d670 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9680ce910 con 0x7fb968142680 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 0x7fb9680cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 0x7fb9680cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45166/0 (socket says 172.21.15.55:45166) 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 -- 172.21.15.55:0/1758432267 learned_addr learned my addr 172.21.15.55:0/1758432267 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb9677fe700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806d670 0x7fb968155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb967fff700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb968142680 0x7fb9680cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 -- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb968142680 msgr2=0x7fb9680cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb968142680 0x7fb9680cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 -- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806d670 msgr2=0x7fb968155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806d670 0x7fb968155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 -- 172.21.15.55:0/1758432267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580093c0 con 0x7fb96806da40 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb966ffd700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 0x7fb9680cdb90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c790 tx=0x7fb95c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb94f7fe700 1 -- 172.21.15.55:0/1758432267 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c005b30 con 0x7fb96806da40 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb94f7fe700 1 -- 172.21.15.55:0/1758432267 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c005c90 con 0x7fb96806da40 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb960009a20 con 0x7fb96806da40 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.558+0000 7fb94f7fe700 1 -- 172.21.15.55:0/1758432267 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007340 con 0x7fb96806da40 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.559+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9680ce630 con 0x7fb96806da40 2023-10-06T11:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.560+0000 7fb94f7fe700 1 -- 172.21.15.55:0/1758432267 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb95c01b400 con 0x7fb96806da40 2023-10-06T11:16:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.560+0000 7fb94f7fe700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb954066f30 0x7fb9540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.560+0000 7fb94f7fe700 1 -- 172.21.15.55:0/1758432267 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb95c084220 con 0x7fb96806da40 2023-10-06T11:16:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.561+0000 7fb9677fe700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb954066f30 0x7fb9540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.561+0000 7fb9677fe700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb954066f30 0x7fb9540693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb958009390 tx=0x7fb958008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.562+0000 7fb976febb80 1 Processor -- start 2023-10-06T11:16:17.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.562+0000 7fb976febb80 1 -- start start 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb976febb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef56eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef5275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef527b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb976febb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef4a7cd0 con 0x55daef56eae0 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef47eac0 con 0x55daef52a9f0 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daef47c2c0 con 0x55daef528c20 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef56eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef56eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45172/0 (socket says 172.21.15.55:45172) 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb9677fe700 1 -- 172.21.15.55:0/3674153082 learned_addr learned my addr 172.21.15.55:0/3674153082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb966ffd700 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef5275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.563+0000 7fb967fff700 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef527b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb9677fe700 1 -- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 msgr2=0x55daef527b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb9677fe700 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef527b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb9677fe700 1 -- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 msgr2=0x55daef5275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb9677fe700 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef5275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb9677fe700 1 -- 172.21.15.55:0/3674153082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daef3122c0 con 0x55daef56eae0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb9677fe700 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef56eeb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb958011f80 tx=0x7fb958018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946095dfd09f567e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb94cff9700 1 -- 172.21.15.55:0/3674153082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958015bb0 con 0x55daef56eae0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb94cff9700 1 -- 172.21.15.55:0/3674153082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb958015d10 con 0x55daef56eae0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb94cff9700 1 -- 172.21.15.55:0/3674153082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958015e80 con 0x55daef56eae0 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb976febb80 1 -- 172.21.15.55:0/3674153082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 msgr2=0x55daef56eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.564+0000 7fb976febb80 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef56eeb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb958011f80 tx=0x7fb958018000 comp rx=0 tx=0).stop 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 -- 172.21.15.55:0/3674153082 shutdown_connections 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef56eeb0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef527b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 --2- 172.21.15.55:0/3674153082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef5275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 -- 172.21.15.55:0/3674153082 >> 172.21.15.55:0/3674153082 conn(0x55daef5290c0 msgr2=0x55daef529490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 -- 172.21.15.55:0/3674153082 shutdown_connections 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 -- 172.21.15.55:0/3674153082 wait complete. 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 -- start start 2023-10-06T11:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.565+0000 7fb976febb80 1 Processor -- start 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 0x55daef54e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef553c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef56eae0 0x55daef522790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef4780b0 con 0x55daef528c20 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef4238e0 con 0x55daef52a9f0 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daef43eef0 con 0x55daef56eae0 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb976febb80 10 client.0 _ll_register_callbacks cb 0x55daef314f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 0x55daef54e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 0x55daef54e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45188/0 (socket says 172.21.15.55:45188) 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb9677fe700 1 -- 172.21.15.55:0/62807639 learned_addr learned my addr 172.21.15.55:0/62807639 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb966ffd700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef553c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.566+0000 7fb967fff700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef56eae0 0x55daef522790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb9677fe700 1 -- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef56eae0 msgr2=0x55daef522790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb9677fe700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef56eae0 0x55daef522790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb9677fe700 1 -- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 msgr2=0x55daef553c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb9677fe700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef553c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb9677fe700 1 -- 172.21.15.55:0/62807639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb958011b80 con 0x55daef528c20 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb9677fe700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 0x55daef54e2b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb958008010 tx=0x7fb95801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eae7a5d872a40e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb945ffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb945ffb700 1 -- 172.21.15.55:0/62807639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958015b30 con 0x55daef528c20 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb945ffb700 1 -- 172.21.15.55:0/62807639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb958031070 con 0x55daef528c20 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daef51c6e0 con 0x55daef528c20 2023-10-06T11:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb945ffb700 1 -- 172.21.15.55:0/62807639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb958036690 con 0x55daef528c20 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 10 client.6735 fetch_fsmap learned FSMap version 51 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55daef2b5030 con 0x55daef528c20 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb945ffb700 1 -- 172.21.15.55:0/62807639 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daef51c6e0 con 0x55daef528c20 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb945ffb700 1 -- 172.21.15.55:0/62807639 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb9580367f0 con 0x55daef528c20 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 10 client.6735 fetch_fsmap finished waiting for FSMap version 51 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 10 client.6735 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 20 client.6735 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef522cd0 0x55daef5275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 4 client.6735 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 --> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daef4f9610 con 0x55daef522cd0 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.567+0000 7fb966ffd700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef522cd0 0x55daef5275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb966ffd700 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef522cd0 0x55daef5275d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=943af4e7045f635d server_cookie=97ffa541c178f289 in_seq=0 out_seq=0 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb945ffb700 10 client.6735 ms_handle_connect on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb945ffb700 1 -- 172.21.15.55:0/62807639 <== mds.0 v2:172.21.15.55:6832/550471849 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55daef4f9610 con 0x55daef522cd0 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb945ffb700 10 client.6735 handle_command_reply: tid=0 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 client.6735 shutdown 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 msgr2=0x55daef54e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 0x55daef54e2b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb958008010 tx=0x7fb95801b000 comp rx=0 tx=0).stop 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 shutdown_connections 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef522cd0 0x55daef5275d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef528c20 0x55daef54e2b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef56eae0 0x55daef522790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb945ffb700 0 client.6735 ms_handle_reset on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:17.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 --2- 172.21.15.55:0/62807639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef553c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.568+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 >> 172.21.15.55:0/62807639 conn(0x55daef5290c0 msgr2=0x55daef56c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.569+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 shutdown_connections 2023-10-06T11:16:17.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.569+0000 7fb976febb80 1 -- 172.21.15.55:0/62807639 wait complete. 2023-10-06T11:16:17.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.569+0000 7fb976febb80 20 client.6735 trim_cache size 0 max 16384 2023-10-06T11:16:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 Processor -- start 2023-10-06T11:16:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 -- start start 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef56a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef529490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef527e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef2fae80 con 0x55daef56eae0 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef550fd0 con 0x55daef52a9f0 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daef553470 con 0x55daef528c20 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb967fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef527e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.586+0000 7fb967fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef527e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45200/0 (socket says 172.21.15.55:45200) 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 -- 172.21.15.55:0/1603850561 learned_addr learned my addr 172.21.15.55:0/1603850561 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb966ffd700 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef529490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 -- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 msgr2=0x55daef56a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef56a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 -- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 msgr2=0x55daef529490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef529490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 -- 172.21.15.55:0/1603850561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daef4467d0 con 0x55daef56eae0 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb966ffd700 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef529490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb967fff700 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef527e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb96806e840 tx=0x7fb960019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a161146753834d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb94d7fa700 1 -- 172.21.15.55:0/1603850561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96002c070 con 0x55daef56eae0 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb94d7fa700 1 -- 172.21.15.55:0/1603850561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960024040 con 0x55daef56eae0 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.587+0000 7fb94d7fa700 1 -- 172.21.15.55:0/1603850561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960012870 con 0x55daef56eae0 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 -- 172.21.15.55:0/1603850561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 msgr2=0x55daef527e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef527e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb96806e840 tx=0x7fb960019000 comp rx=0 tx=0).stop 2023-10-06T11:16:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 -- 172.21.15.55:0/1603850561 shutdown_connections 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef56eae0 0x55daef527e80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef56a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 --2- 172.21.15.55:0/1603850561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef52a9f0 0x55daef529490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 -- 172.21.15.55:0/1603850561 >> 172.21.15.55:0/1603850561 conn(0x55daef5290c0 msgr2=0x55daef527670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 -- 172.21.15.55:0/1603850561 shutdown_connections 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 -- 172.21.15.55:0/1603850561 wait complete. 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 -- start start 2023-10-06T11:16:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.588+0000 7fb976febb80 1 Processor -- start 2023-10-06T11:16:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef581c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 0x55daef56d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef56eae0 0x55daef527670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef5d4970 con 0x55daef52a9f0 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daef56de90 con 0x55daef56eae0 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daef581790 con 0x55daef528c20 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb976febb80 10 client.0 _ll_register_callbacks cb 0x55daef314f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb966ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 0x55daef56d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb966ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 0x55daef56d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45216/0 (socket says 172.21.15.55:45216) 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef581c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb966ffd700 1 -- 172.21.15.55:0/732370460 learned_addr learned my addr 172.21.15.55:0/732370460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb967fff700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef56eae0 0x55daef527670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb9677fe700 1 -- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef56eae0 msgr2=0x55daef527670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb9677fe700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef56eae0 0x55daef527670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb9677fe700 1 -- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 msgr2=0x55daef56d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb9677fe700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 0x55daef56d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb9677fe700 1 -- 172.21.15.55:0/732370460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96815a870 con 0x55daef528c20 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.589+0000 7fb966ffd700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 0x55daef56d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb9677fe700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef581c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb958000c00 tx=0x7fb95802d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7576e750ccbf1126 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb945ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3301/0 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb945ffb700 1 -- 172.21.15.55:0/732370460 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958015e80 con 0x55daef528c20 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb945ffb700 1 -- 172.21.15.55:0/732370460 <== mon.2 v2:172.21.15.142:3301/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb958031070 con 0x55daef528c20 2023-10-06T11:16:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb958015d10 con 0x55daef528c20 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb945ffb700 1 -- 172.21.15.55:0/732370460 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb958015ab0 con 0x55daef528c20 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 10 client.5684 fetch_fsmap learned FSMap version 51 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55daef42d4c0 con 0x55daef528c20 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb945ffb700 1 -- 172.21.15.55:0/732370460 <== mon.2 v2:172.21.15.142:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb958015d10 con 0x55daef528c20 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb945ffb700 1 -- 172.21.15.55:0/732370460 <== mon.2 v2:172.21.15.142:3301/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb958042690 con 0x55daef528c20 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 10 client.5684 fetch_fsmap finished waiting for FSMap version 51 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 10 client.5684 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 20 client.5684 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef527bb0 0x55daef54e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 4 client.5684 mds_command: new command op to 6528 tid=0[{"prefix": "session ls"}] 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 --> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] -- command(tid 0: {"prefix": "session ls"}) v1 -- 0x55daef41ae50 con 0x55daef527bb0 2023-10-06T11:16:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.590+0000 7fb966ffd700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef527bb0 0x55daef54e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb945ffb700 10 client.5684 ms_handle_connect on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb966ffd700 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef527bb0 0x55daef54e2b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8692dde28e01608e server_cookie=4246229b8bfcde07 in_seq=0 out_seq=0 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb945ffb700 1 -- 172.21.15.55:0/732370460 <== mds.0 v2:172.21.15.55:6832/550471849 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55daef41ae50 con 0x55daef527bb0 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb945ffb700 10 client.5684 handle_command_reply: tid=0 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 client.5684 shutdown 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 msgr2=0x55daef581c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef581c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb958000c00 tx=0x7fb95802d070 comp rx=0 tx=0).stop 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 shutdown_connections 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:6832/550471849,v1:172.21.15.55:6834/550471849] conn(0x55daef527bb0 0x55daef54e2b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55daef56eae0 0x55daef527670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55daef528c20 0x55daef581c20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 --2- 172.21.15.55:0/732370460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55daef52a9f0 0x55daef56d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 >> 172.21.15.55:0/732370460 conn(0x55daef5290c0 msgr2=0x55daef56a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb945ffb700 0 client.5684 ms_handle_reset on v2:172.21.15.55:6832/550471849 2023-10-06T11:16:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 shutdown_connections 2023-10-06T11:16:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 1 -- 172.21.15.55:0/732370460 wait complete. 2023-10-06T11:16:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb976febb80 20 client.5684 trim_cache size 0 max 16384 2023-10-06T11:16:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb954066f30 msgr2=0x7fb9540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb954066f30 0x7fb9540693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb958009390 tx=0x7fb958008040 comp rx=0 tx=0).stop 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 msgr2=0x7fb9680cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.591+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 0x7fb9680cdb90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c790 tx=0x7fb95c007c50 comp rx=0 tx=0).stop 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 shutdown_connections 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb954066f30 0x7fb9540693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb968142680 0x7fb9680cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb96806d670 0x7fb968155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 --2- 172.21.15.55:0/1758432267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb96806da40 0x7fb9680cdb90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 >> 172.21.15.55:0/1758432267 conn(0x7fb96806b600 msgr2=0x7fb9680686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 shutdown_connections 2023-10-06T11:16:17.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.592+0000 7fb96dcf3700 1 -- 172.21.15.55:0/1758432267 wait complete. 2023-10-06T11:16:17.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-06T11:16:17.743 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2023-10-06T11:16:17.744 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-10-06T11:16:17.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:16:17.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:17.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:17.828 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:16:17.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:17.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.945+0000 7f493dc50700 1 Processor -- start 2023-10-06T11:16:17.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.946+0000 7f493dc50700 1 -- start start 2023-10-06T11:16:17.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.946+0000 7f493dc50700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49380cb5f0 0x7f49380691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.946+0000 7f493dc50700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f4938159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.946+0000 7f493dc50700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4938068d10 con 0x7f493815a010 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.946+0000 7f493dc50700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4938069b30 con 0x7f49380cb5f0 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.946+0000 7f493dc50700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4938154020 con 0x7f49380696e0 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4937fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f493815a010 0x7f49380ca670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47866/0 (socket says 172.21.15.55:47866) 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4937fff700 1 -- 172.21.15.55:0/716421794 learned_addr learned my addr 172.21.15.55:0/716421794 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49377fe700 1 --2- 172.21.15.55:0/716421794 >> v2:172.21.15.142:3300/0 conn(0x7f49380cb5f0 0x7f49380691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4936ffd700 1 --2- 172.21.15.55:0/716421794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f4938159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49367fc700 1 -- 172.21.15.55:0/716421794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429871630 0 0) 0x7f4938068d10 con 0x7f493815a010 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49367fc700 1 -- 172.21.15.55:0/716421794 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4920003570 con 0x7f493815a010 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4936ffd700 1 -- 172.21.15.55:0/716421794 >> v2:172.21.15.142:3300/0 conn(0x7f49380cb5f0 msgr2=0x7f49380691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4936ffd700 1 --2- 172.21.15.55:0/716421794 >> v2:172.21.15.142:3300/0 conn(0x7f49380cb5f0 0x7f49380691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4936ffd700 1 -- 172.21.15.55:0/716421794 >> v1:172.21.15.55:6789/0 conn(0x7f493815a010 legacy=0x7f49380ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49367fc700 1 -- 172.21.15.55:0/716421794 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196373599 0 0) 0x7f4920003570 con 0x7f493815a010 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4936ffd700 1 -- 172.21.15.55:0/716421794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493815a670 con 0x7f49380696e0 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49377fe700 1 --2- 172.21.15.55:0/716421794 >> v2:172.21.15.142:3300/0 conn(0x7f49380cb5f0 0x7f49380691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f4936ffd700 1 --2- 172.21.15.55:0/716421794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f4938159ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28601ab2d971bbcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49367fc700 1 -- 172.21.15.55:0/716421794 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300017f0 con 0x7f49380696e0 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49367fc700 1 -- 172.21.15.55:0/716421794 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011420 con 0x7f49380696e0 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.947+0000 7f49367fc700 1 -- 172.21.15.55:0/716421794 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c0117c0 con 0x7f49380696e0 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 -- 172.21.15.55:0/716421794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 msgr2=0x7f4938159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 --2- 172.21.15.55:0/716421794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f4938159ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 -- 172.21.15.55:0/716421794 shutdown_connections 2023-10-06T11:16:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 --2- 172.21.15.55:0/716421794 >> v2:172.21.15.142:3300/0 conn(0x7f49380cb5f0 0x7f49380691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 --2- 172.21.15.55:0/716421794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f4938159ad0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 -- 172.21.15.55:0/716421794 >> 172.21.15.55:0/716421794 conn(0x7f49380707d0 msgr2=0x7f4938070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 -- 172.21.15.55:0/716421794 shutdown_connections 2023-10-06T11:16:17.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.948+0000 7f493dc50700 1 -- 172.21.15.55:0/716421794 wait complete. 2023-10-06T11:16:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.949+0000 7f493dc50700 1 Processor -- start 2023-10-06T11:16:17.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.949+0000 7f493dc50700 1 -- start start 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f493dc50700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f49380b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f493dc50700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 0x7f49380b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f493dc50700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f493815a010 0x7f49381566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f493dc50700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b2eb0 con 0x7f49380cb5f0 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f493dc50700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b24e0 con 0x7f493815a010 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f493dc50700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b18d0 con 0x7f49380696e0 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f4936ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 0x7f49380b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f4936ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 0x7f49380b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45230/0 (socket says 172.21.15.55:45230) 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f4936ffd700 1 -- 172.21.15.55:0/1990417782 learned_addr learned my addr 172.21.15.55:0/1990417782 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f49377fe700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f49380b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.950+0000 7f4937fff700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f493815a010 0x7f49381566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f4936ffd700 1 -- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 msgr2=0x7f49380b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f4936ffd700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f49380b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f4936ffd700 1 -- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f493815a010 msgr2=0x7f49381566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f4936ffd700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f493815a010 0x7f49381566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f4936ffd700 1 -- 172.21.15.55:0/1990417782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009420 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f4936ffd700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 0x7f49380b1080 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f492c0030c0 tx=0x7f492c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c01cc00 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c01cd60 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c009420 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c025680 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.951+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49380b1e90 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.952+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4938064a90 con 0x7f49380cb5f0 2023-10-06T11:16:17.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.952+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f492c0193f0 con 0x7f49380cb5f0 2023-10-06T11:16:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.953+0000 7f491f7fe700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.953+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f492c085ae0 con 0x7f49380cb5f0 2023-10-06T11:16:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.953+0000 7f49377fe700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.953+0000 7f49377fe700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4924066f30 0x7f49240693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4928009ea0 tx=0x7f49280091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:17.957+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f492c052ab0 con 0x7f49380cb5f0 2023-10-06T11:16:18.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.194+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49380b2620 con 0x7f49380cb5f0 2023-10-06T11:16:18.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.195+0000 7f491f7fe700 1 -- 172.21.15.55:0/1990417782 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f492c02a090 con 0x7f49380cb5f0 2023-10-06T11:16:18.197 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:18.197 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:18.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4924066f30 msgr2=0x7f49240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4924066f30 0x7f49240693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4928009ea0 tx=0x7f49280091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 msgr2=0x7f49380b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 0x7f49380b1080 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f492c0030c0 tx=0x7f492c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 shutdown_connections 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f493815a010 0x7f49381566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49380696e0 0x7f49380b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 --2- 172.21.15.55:0/1990417782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49380cb5f0 0x7f49380b1080 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 >> 172.21.15.55:0/1990417782 conn(0x7f49380707d0 msgr2=0x7f49380ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 shutdown_connections 2023-10-06T11:16:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.197+0000 7f493dc50700 1 -- 172.21.15.55:0/1990417782 wait complete. 2023-10-06T11:16:18.200 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:18.211 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:18.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.329+0000 7f3edd194700 1 Processor -- start 2023-10-06T11:16:18.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.329+0000 7f3edd194700 1 -- start start 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3edd194700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ed8159560 0x7f3ed80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3edd194700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ed80b0760 0x7f3ed80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3edd194700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed80b0c60 con 0x7f3ed80b49a0 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3edd194700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80b0f40 con 0x7f3ed8159560 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3edd194700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80b1220 con 0x7f3ed80b0760 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ed8159560 0x7f3ed80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ed8159560 0x7f3ed80aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45242/0 (socket says 172.21.15.55:45242) 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/1273547739 learned_addr learned my addr 172.21.15.55:0/1273547739 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:18.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed759e700 1 --2- 172.21.15.55:0/1273547739 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80b0760 0x7f3ed80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/1273547739 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80b0760 msgr2=0x7f3ed80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 --2- 172.21.15.55:0/1273547739 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80b0760 0x7f3ed80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/1273547739 >> v1:172.21.15.142:6789/0 conn(0x7f3ed80b49a0 legacy=0x7f3ed80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.330+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/1273547739 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80b1500 con 0x7f3ed8159560 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3ed6d9d700 1 --2- 172.21.15.55:0/1273547739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed8159560 0x7f3ed80aa530 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009f70 tx=0x7f3ed0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee5509d668ca69e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3ed5d9b700 1 -- 172.21.15.55:0/1273547739 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000e070 con 0x7f3ed8159560 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3ed5d9b700 1 -- 172.21.15.55:0/1273547739 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed000b9e0 con 0x7f3ed8159560 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3ed5d9b700 1 -- 172.21.15.55:0/1273547739 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00092e0 con 0x7f3ed8159560 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 -- 172.21.15.55:0/1273547739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed8159560 msgr2=0x7f3ed80aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 --2- 172.21.15.55:0/1273547739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed8159560 0x7f3ed80aa530 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009f70 tx=0x7f3ed0009840 comp rx=0 tx=0).stop 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 -- 172.21.15.55:0/1273547739 shutdown_connections 2023-10-06T11:16:18.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 --2- 172.21.15.55:0/1273547739 >> v2:172.21.15.142:3300/0 conn(0x7f3ed80b0760 0x7f3ed80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 --2- 172.21.15.55:0/1273547739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed8159560 0x7f3ed80aa530 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 -- 172.21.15.55:0/1273547739 >> 172.21.15.55:0/1273547739 conn(0x7f3ed80997f0 msgr2=0x7f3ed806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 -- 172.21.15.55:0/1273547739 shutdown_connections 2023-10-06T11:16:18.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.331+0000 7f3edd194700 1 -- 172.21.15.55:0/1273547739 wait complete. 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.332+0000 7f3edd194700 1 Processor -- start 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 -- start start 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 0x7f3ed809cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ed80b49a0 0x7f3ed809b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed8159560 0x7f3ed80ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed809b9f0 con 0x7f3ed80b0760 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed809aa60 con 0x7f3ed8159560 2023-10-06T11:16:18.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3edd194700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed809b020 con 0x7f3ed80b49a0 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3ed6d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 0x7f3ed809cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3ed6d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 0x7f3ed809cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45246/0 (socket says 172.21.15.55:45246) 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/695293467 learned_addr learned my addr 172.21.15.55:0/695293467 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.333+0000 7f3ed759e700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed8159560 0x7f3ed80ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed659c700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ed80b49a0 0x7f3ed809b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ed80b49a0 msgr2=0x7f3ed809b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed6d9d700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ed80b49a0 0x7f3ed809b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed8159560 msgr2=0x7f3ed80ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed6d9d700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed8159560 0x7f3ed80ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed6d9d700 1 -- 172.21.15.55:0/695293467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009ae0 con 0x7f3ed80b0760 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed759e700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed8159560 0x7f3ed80ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed659c700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ed80b49a0 0x7f3ed809b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3ed6d9d700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 0x7f3ed809cc90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8067c20 tx=0x7f3ed0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0008ad0 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0008c30 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed809da60 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0025460 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.334+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed809acb0 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.335+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed8064a90 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.335+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ed0003040 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.336+0000 7f3eceffd700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb8066f30 0x7f3eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.336+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3ed00862c0 con 0x7f3ed80b0760 2023-10-06T11:16:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.336+0000 7f3ed659c700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb8066f30 0x7f3eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.336+0000 7f3ed659c700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb8066f30 0x7f3eb80693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0007fd0 tx=0x7f3ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.340+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ed0053290 con 0x7f3ed80b0760 2023-10-06T11:16:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.535+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ed80b17e0 con 0x7f3ed80b0760 2023-10-06T11:16:18.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.536+0000 7f3eceffd700 1 -- 172.21.15.55:0/695293467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f3ed00568b0 con 0x7f3ed80b0760 2023-10-06T11:16:18.537 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:18.538 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:05.249987+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:01.403615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:02.635607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb8066f30 msgr2=0x7f3eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb8066f30 0x7f3eb80693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0007fd0 tx=0x7f3ec0009040 comp rx=0 tx=0).stop 2023-10-06T11:16:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 msgr2=0x7f3ed809cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 0x7f3ed809cc90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8067c20 tx=0x7f3ed0018000 comp rx=0 tx=0).stop 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 shutdown_connections 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3eb8066f30 0x7f3eb80693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80b0760 0x7f3ed809cc90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ed8159560 0x7f3ed80ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 --2- 172.21.15.55:0/695293467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ed80b49a0 0x7f3ed809b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 >> 172.21.15.55:0/695293467 conn(0x7f3ed80997f0 msgr2=0x7f3ed80ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 shutdown_connections 2023-10-06T11:16:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.538+0000 7f3edd194700 1 -- 172.21.15.55:0/695293467 wait complete. 2023-10-06T11:16:18.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:16:01.403615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:16:02.635607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:16:18.553 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:16:18.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.675+0000 7f1817dd5700 1 Processor -- start 2023-10-06T11:16:18.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.675+0000 7f1817dd5700 1 -- start start 2023-10-06T11:16:18.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1817dd5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1810159470 0x7f18100ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1817dd5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100cbb80 con 0x7f1810159840 2023-10-06T11:16:18.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1817dd5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100c6f00 con 0x7f18100cd020 2023-10-06T11:16:18.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1817dd5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100cb530 con 0x7f1810159470 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815b71700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1810159470 0x7f18100ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815370700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1810159840 0x7f18100c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47870/0 (socket says 172.21.15.55:47870) 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815b71700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1810159470 0x7f18100ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45256/0 (socket says 172.21.15.55:45256) 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815370700 1 -- 172.21.15.55:0/2966282463 learned_addr learned my addr 172.21.15.55:0/2966282463 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815b71700 1 -- 172.21.15.55:0/2966282463 >> v1:172.21.15.142:6789/0 conn(0x7f18100cd020 legacy=0x7f1810163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815b71700 1 -- 172.21.15.55:0/2966282463 >> v1:172.21.15.55:6789/0 conn(0x7f1810159840 legacy=0x7f18100c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815b71700 1 -- 172.21.15.55:0/2966282463 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100cb810 con 0x7f1810159470 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1814b6f700 1 -- 172.21.15.55:0/2966282463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694353591 0 0) 0x7f18100cbb80 con 0x7f1810159840 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1815b71700 1 --2- 172.21.15.55:0/2966282463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159470 0x7f18100ce980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f180c0098d0 tx=0x7f180c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1280287cedc5481 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1814b6f700 1 -- 172.21.15.55:0/2966282463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c009e70 con 0x7f1810159470 2023-10-06T11:16:18.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1814b6f700 1 -- 172.21.15.55:0/2966282463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c005c10 con 0x7f1810159470 2023-10-06T11:16:18.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.676+0000 7f1814b6f700 1 -- 172.21.15.55:0/2966282463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00b650 con 0x7f1810159470 2023-10-06T11:16:18.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 -- 172.21.15.55:0/2966282463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159470 msgr2=0x7f18100ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 --2- 172.21.15.55:0/2966282463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159470 0x7f18100ce980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f180c0098d0 tx=0x7f180c009120 comp rx=0 tx=0).stop 2023-10-06T11:16:18.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 -- 172.21.15.55:0/2966282463 shutdown_connections 2023-10-06T11:16:18.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 --2- 172.21.15.55:0/2966282463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159470 0x7f18100ce980 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 -- 172.21.15.55:0/2966282463 >> 172.21.15.55:0/2966282463 conn(0x7f18100996e0 msgr2=0x7f181006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:18.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 -- 172.21.15.55:0/2966282463 shutdown_connections 2023-10-06T11:16:18.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.677+0000 7f1817dd5700 1 -- 172.21.15.55:0/2966282463 wait complete. 2023-10-06T11:16:18.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.678+0000 7f1817dd5700 1 Processor -- start 2023-10-06T11:16:18.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.678+0000 7f1817dd5700 1 -- start start 2023-10-06T11:16:18.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1817dd5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18100cd020 0x7f1810146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1817dd5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810159470 0x7f18101697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1817dd5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 0x7f181015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1817dd5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100c8200 con 0x7f1810159840 2023-10-06T11:16:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1817dd5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1810147460 con 0x7f18100cd020 2023-10-06T11:16:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1817dd5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100c75f0 con 0x7f1810159470 2023-10-06T11:16:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 0x7f181015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1815b71700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18100cd020 0x7f1810146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 0x7f181015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45258/0 (socket says 172.21.15.55:45258) 2023-10-06T11:16:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 -- 172.21.15.55:0/3956764174 learned_addr learned my addr 172.21.15.55:0/3956764174 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:18.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1815370700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810159470 0x7f18101697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 -- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810159470 msgr2=0x7f18101697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810159470 0x7f18101697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 -- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18100cd020 msgr2=0x7f1810146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18100cd020 0x7f1810146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1816372700 1 -- 172.21.15.55:0/3956764174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0093c0 con 0x7f1810159840 2023-10-06T11:16:18.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.679+0000 7f1815b71700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18100cd020 0x7f1810146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:18.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.680+0000 7f1816372700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 0x7f181015ba00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f180800c8e0 tx=0x7f1808001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.680+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808012630 con 0x7f1810159840 2023-10-06T11:16:18.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.680+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808012790 con 0x7f1810159840 2023-10-06T11:16:18.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.680+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18100c78d0 con 0x7f1810159840 2023-10-06T11:16:18.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.680+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808012b50 con 0x7f1810159840 2023-10-06T11:16:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.680+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18100c7e90 con 0x7f1810159840 2023-10-06T11:16:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.681+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18100c83b0 con 0x7f1810159840 2023-10-06T11:16:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.681+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f180801a3a0 con 0x7f1810159840 2023-10-06T11:16:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.682+0000 7f1805ffb700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17f4066f30 0x7f17f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.682+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f18080849b0 con 0x7f1810159840 2023-10-06T11:16:18.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.682+0000 7f1815b71700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17f4066f30 0x7f17f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.682+0000 7f1815b71700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17f4066f30 0x7f17f40693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f180c009160 tx=0x7f180c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.686+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18100c83b0 con 0x7f1810159840 2023-10-06T11:16:18.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.879+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1810064a90 con 0x7f1810159840 2023-10-06T11:16:18.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.879+0000 7f1805ffb700 1 -- 172.21.15.55:0/3956764174 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18080518e0 con 0x7f1810159840 2023-10-06T11:16:18.881 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.881+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17f4066f30 msgr2=0x7f17f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.881+0000 7f1817dd5700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17f4066f30 0x7f17f40693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f180c009160 tx=0x7f180c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.881+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 msgr2=0x7f181015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 0x7f181015ba00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f180800c8e0 tx=0x7f1808001710 comp rx=0 tx=0).stop 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 shutdown_connections 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17f4066f30 0x7f17f40693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1810159840 0x7f181015ba00 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18100cd020 0x7f1810146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 --2- 172.21.15.55:0/3956764174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810159470 0x7f18101697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 >> 172.21.15.55:0/3956764174 conn(0x7f18100996e0 msgr2=0x7f1810153c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:18.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 shutdown_connections 2023-10-06T11:16:18.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:18.882+0000 7f1817dd5700 1 -- 172.21.15.55:0/3956764174 wait complete. 2023-10-06T11:16:18.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:16:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.016+0000 7f01f1b39700 1 Processor -- start 2023-10-06T11:16:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.016+0000 7f01f1b39700 1 -- start start 2023-10-06T11:16:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01f1b39700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01ec1539c0 0x7f01ec069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01f1b39700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01ec069a90 0x7f01ec15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01f1b39700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01f1b39700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec15ab70 con 0x7f01ec069a90 2023-10-06T11:16:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01f1b39700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec15db90 con 0x7f01ec1539c0 2023-10-06T11:16:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01f1b39700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec15de70 con 0x7f01ec153d90 2023-10-06T11:16:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01ec069a90 0x7f01ec15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01ec069a90 0x7f01ec15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45266/0 (socket says 172.21.15.55:45266) 2023-10-06T11:16:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 -- 172.21.15.55:0/2297892286 learned_addr learned my addr 172.21.15.55:0/2297892286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eb7fe700 1 --2- 172.21.15.55:0/2297892286 >> v2:172.21.15.142:3300/0 conn(0x7f01ec1539c0 0x7f01ec069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01ebfff700 1 --2- 172.21.15.55:0/2297892286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 -- 172.21.15.55:0/2297892286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 msgr2=0x7f01ec0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 --2- 172.21.15.55:0/2297892286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 -- 172.21.15.55:0/2297892286 >> v2:172.21.15.142:3300/0 conn(0x7f01ec1539c0 msgr2=0x7f01ec069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 --2- 172.21.15.55:0/2297892286 >> v2:172.21.15.142:3300/0 conn(0x7f01ec1539c0 0x7f01ec069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.017+0000 7f01eaffd700 1 -- 172.21.15.55:0/2297892286 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec068d50 con 0x7f01ec069a90 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01eaffd700 1 --2- 172.21.15.55:0/2297892286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec15d110 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f01ec06af20 tx=0x7f01e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87af5a85f4051375 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01ea7fc700 1 -- 172.21.15.55:0/2297892286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000b640 con 0x7f01ec069a90 2023-10-06T11:16:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01ea7fc700 1 -- 172.21.15.55:0/2297892286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000b7a0 con 0x7f01ec069a90 2023-10-06T11:16:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01ea7fc700 1 -- 172.21.15.55:0/2297892286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000bb60 con 0x7f01ec069a90 2023-10-06T11:16:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 -- 172.21.15.55:0/2297892286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 msgr2=0x7f01ec15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 --2- 172.21.15.55:0/2297892286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec15d110 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f01ec06af20 tx=0x7f01e0009250 comp rx=0 tx=0).stop 2023-10-06T11:16:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 -- 172.21.15.55:0/2297892286 shutdown_connections 2023-10-06T11:16:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 --2- 172.21.15.55:0/2297892286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 --2- 172.21.15.55:0/2297892286 >> v2:172.21.15.142:3300/0 conn(0x7f01ec1539c0 0x7f01ec069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 --2- 172.21.15.55:0/2297892286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec15d110 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 -- 172.21.15.55:0/2297892286 >> 172.21.15.55:0/2297892286 conn(0x7f01ec06b610 msgr2=0x7f01ec06ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 -- 172.21.15.55:0/2297892286 shutdown_connections 2023-10-06T11:16:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.018+0000 7f01f1b39700 1 -- 172.21.15.55:0/2297892286 wait complete. 2023-10-06T11:16:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.019+0000 7f01f1b39700 1 Processor -- start 2023-10-06T11:16:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.019+0000 7f01f1b39700 1 -- start start 2023-10-06T11:16:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01f1b39700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01f1b39700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec1539c0 0x7f01ec0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01f1b39700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01f1b39700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec155f20 con 0x7f01ec069a90 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01f1b39700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1546c0 con 0x7f01ec1539c0 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01f1b39700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1549a0 con 0x7f01ec153d90 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01eb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01eb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec14fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45280/0 (socket says 172.21.15.55:45280) 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.020+0000 7f01eb7fe700 1 -- 172.21.15.55:0/1040783410 learned_addr learned my addr 172.21.15.55:0/1040783410 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eaffd700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec1539c0 0x7f01ec0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01ebfff700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eb7fe700 1 -- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 msgr2=0x7f01ec151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eb7fe700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eb7fe700 1 -- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec1539c0 msgr2=0x7f01ec0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eb7fe700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec1539c0 0x7f01ec0cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eb7fe700 1 -- 172.21.15.55:0/1040783410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e00094f0 con 0x7f01ec069a90 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eaffd700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec1539c0 0x7f01ec0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01eb7fe700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec14fcb0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00ec80 tx=0x7f01dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00c9d0 con 0x7f01ec069a90 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc00cb30 con 0x7f01ec069a90 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec154c80 con 0x7f01ec069a90 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc013470 con 0x7f01ec069a90 2023-10-06T11:16:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.021+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0cc090 con 0x7f01ec069a90 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.022+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec068a10 con 0x7f01ec069a90 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.022+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01dc013820 con 0x7f01ec069a90 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.023+0000 7f01d37fe700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f01d8066f30 0x7f01d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.023+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f01dc084b60 con 0x7f01ec069a90 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.023+0000 7f01eaffd700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f01d8066f30 0x7f01d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.023+0000 7f01eaffd700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f01d8066f30 0x7f01d80693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f01ec06af20 tx=0x7f01e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.027+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01dc051b30 con 0x7f01ec069a90 2023-10-06T11:16:19.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.221+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f01ec064a90 con 0x7f01ec069a90 2023-10-06T11:16:19.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.222+0000 7f01d37fe700 1 -- 172.21.15.55:0/1040783410 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f01dc055150 con 0x7f01ec069a90 2023-10-06T11:16:19.224 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:16:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f01d8066f30 msgr2=0x7f01d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f01d8066f30 0x7f01d80693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f01ec06af20 tx=0x7f01e0017000 comp rx=0 tx=0).stop 2023-10-06T11:16:19.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 msgr2=0x7f01ec14fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec14fcb0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00ec80 tx=0x7f01dc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 shutdown_connections 2023-10-06T11:16:19.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f01d8066f30 0x7f01d80693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec069a90 0x7f01ec14fcb0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec153d90 0x7f01ec151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 --2- 172.21.15.55:0/1040783410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec1539c0 0x7f01ec0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 >> 172.21.15.55:0/1040783410 conn(0x7f01ec06b610 msgr2=0x7f01ec159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 shutdown_connections 2023-10-06T11:16:19.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.224+0000 7f01f1b39700 1 -- 172.21.15.55:0/1040783410 wait complete. 2023-10-06T11:16:19.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:16:19.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.359+0000 7f45a375f700 1 Processor -- start 2023-10-06T11:16:19.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.360+0000 7f45a375f700 1 -- start start 2023-10-06T11:16:19.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.360+0000 7f45a375f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c159470 0x7f459c0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a375f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f459c159840 0x7f459c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a375f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0cbb80 con 0x7f459c0c6170 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a375f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0c6d00 con 0x7f459c159840 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a375f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0c6f00 con 0x7f459c159470 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a0cfa700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f459c159840 0x7f459c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a1cfc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f459c0c6170 0x7f459c0c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47878/0 (socket says 172.21.15.55:47878) 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a1cfc700 1 -- 172.21.15.55:0/1410704482 learned_addr learned my addr 172.21.15.55:0/1410704482 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a14fb700 1 --2- 172.21.15.55:0/1410704482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c159470 0x7f459c0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1410704482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c159470 msgr2=0x7f459c0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a0cfa700 1 --2- 172.21.15.55:0/1410704482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c159470 0x7f459c0ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1410704482 >> v1:172.21.15.55:6789/0 conn(0x7f459c0c6170 legacy=0x7f459c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1410704482 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0cb530 con 0x7f459c159840 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f459bfff700 1 -- 172.21.15.55:0/1410704482 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611112910 0 0) 0x7f459c0cbb80 con 0x7f459c0c6170 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f45a0cfa700 1 --2- 172.21.15.55:0/1410704482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159840 0x7f459c0ceec0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f45900098e0 tx=0x7f45900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b27dfe94145a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f459bfff700 1 -- 172.21.15.55:0/1410704482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590009e80 con 0x7f459c159840 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f459bfff700 1 -- 172.21.15.55:0/1410704482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459000b860 con 0x7f459c159840 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.361+0000 7f459bfff700 1 -- 172.21.15.55:0/1410704482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000bbe0 con 0x7f459c159840 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 -- 172.21.15.55:0/1410704482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159840 msgr2=0x7f459c0ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 --2- 172.21.15.55:0/1410704482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159840 0x7f459c0ceec0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f45900098e0 tx=0x7f45900091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 -- 172.21.15.55:0/1410704482 shutdown_connections 2023-10-06T11:16:19.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 --2- 172.21.15.55:0/1410704482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c159470 0x7f459c0ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 --2- 172.21.15.55:0/1410704482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159840 0x7f459c0ceec0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 -- 172.21.15.55:0/1410704482 >> 172.21.15.55:0/1410704482 conn(0x7f459c0996e0 msgr2=0x7f459c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 -- 172.21.15.55:0/1410704482 shutdown_connections 2023-10-06T11:16:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.362+0000 7f45a375f700 1 -- 172.21.15.55:0/1410704482 wait complete. 2023-10-06T11:16:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.363+0000 7f45a375f700 1 Processor -- start 2023-10-06T11:16:19.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.363+0000 7f45a375f700 1 -- start start 2023-10-06T11:16:19.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a375f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0c6170 0x7f459c153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a375f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 0x7f459c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a375f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c159840 0x7f459c152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a375f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c152e90 con 0x7f459c159470 2023-10-06T11:16:19.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a375f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c16aad0 con 0x7f459c159840 2023-10-06T11:16:19.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a375f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0c7710 con 0x7f459c0c6170 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 0x7f459c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 0x7f459c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45288/0 (socket says 172.21.15.55:45288) 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1319780587 learned_addr learned my addr 172.21.15.55:0/1319780587 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a14fb700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0c6170 0x7f459c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a1cfc700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c159840 0x7f459c152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0c6170 msgr2=0x7f459c153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0c6170 0x7f459c153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c159840 msgr2=0x7f459c152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c159840 0x7f459c152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a0cfa700 1 -- 172.21.15.55:0/1319780587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590009420 con 0x7f459c159470 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.364+0000 7f45a1cfc700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c159840 0x7f459c152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:19.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.365+0000 7f45a0cfa700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 0x7f459c159c10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f459c067c70 tx=0x7f4590017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.365+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000b9d0 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.365+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459000bb50 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.365+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590025670 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.365+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c169be0 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.365+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c16a1a0 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.366+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c064a90 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.366+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4590023070 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.366+0000 7f45997fa700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4588066f30 0x7f45880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.367+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4590085c90 con 0x7f459c159470 2023-10-06T11:16:19.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.367+0000 7f45a14fb700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4588066f30 0x7f45880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.367+0000 7f45a14fb700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4588066f30 0x7f45880693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4594006aa0 tx=0x7f4594008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.371+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4590052c60 con 0x7f459c159470 2023-10-06T11:16:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.563+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f459c0cb810 con 0x7f459c159470 2023-10-06T11:16:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.563+0000 7f45997fa700 1 -- 172.21.15.55:0/1319780587 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4590056280 con 0x7f459c159470 2023-10-06T11:16:19.565 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:16:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4588066f30 msgr2=0x7f45880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4588066f30 0x7f45880693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4594006aa0 tx=0x7f4594008040 comp rx=0 tx=0).stop 2023-10-06T11:16:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 msgr2=0x7f459c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 0x7f459c159c10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f459c067c70 tx=0x7f4590017000 comp rx=0 tx=0).stop 2023-10-06T11:16:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 shutdown_connections 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4588066f30 0x7f45880693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c159840 0x7f459c152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0c6170 0x7f459c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 --2- 172.21.15.55:0/1319780587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f459c159470 0x7f459c159c10 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 >> 172.21.15.55:0/1319780587 conn(0x7f459c0996e0 msgr2=0x7f459c15e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.565+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 shutdown_connections 2023-10-06T11:16:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.566+0000 7f45a375f700 1 -- 172.21.15.55:0/1319780587 wait complete. 2023-10-06T11:16:19.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:16:19.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.699+0000 7f48a4073700 1 Processor -- start 2023-10-06T11:16:19.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a4073700 1 -- start start 2023-10-06T11:16:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a4073700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a4073700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f489c156740 0x7f489c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a4073700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c0c84a0 con 0x7f489c06e8d0 2023-10-06T11:16:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a4073700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c06ed10 con 0x7f489c156740 2023-10-06T11:16:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a4073700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0c7890 con 0x7f489c156370 2023-10-06T11:16:19.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.700+0000 7f48a160e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f489c156740 0x7f489c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f489c156740 0x7f489c06e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45292/0 (socket says 172.21.15.55:45292) 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 -- 172.21.15.55:0/2927856577 learned_addr learned my addr 172.21.15.55:0/2927856577 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a1e0f700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 -- 172.21.15.55:0/2927856577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 msgr2=0x7f489c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 -- 172.21.15.55:0/2927856577 >> v1:172.21.15.142:6789/0 conn(0x7f489c06e8d0 legacy=0x7f489c06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 -- 172.21.15.55:0/2927856577 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0c7b70 con 0x7f489c156740 2023-10-06T11:16:19.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a1e0f700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a160e700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c156740 0x7f489c06e390 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f48900099b0 tx=0x7f4890009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279ad067ab69b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a0e0d700 1 -- 172.21.15.55:0/2927856577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489000b860 con 0x7f489c156740 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a0e0d700 1 -- 172.21.15.55:0/2927856577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489000b9c0 con 0x7f489c156740 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.701+0000 7f48a0e0d700 1 -- 172.21.15.55:0/2927856577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489000bd60 con 0x7f489c156740 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 -- 172.21.15.55:0/2927856577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c156740 msgr2=0x7f489c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c156740 0x7f489c06e390 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f48900099b0 tx=0x7f4890009250 comp rx=0 tx=0).stop 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 -- 172.21.15.55:0/2927856577 shutdown_connections 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 --2- 172.21.15.55:0/2927856577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c156740 0x7f489c06e390 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 -- 172.21.15.55:0/2927856577 >> 172.21.15.55:0/2927856577 conn(0x7f489c069150 msgr2=0x7f489c0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 -- 172.21.15.55:0/2927856577 shutdown_connections 2023-10-06T11:16:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.702+0000 7f48a4073700 1 -- 172.21.15.55:0/2927856577 wait complete. 2023-10-06T11:16:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.703+0000 7f48a4073700 1 Processor -- start 2023-10-06T11:16:19.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.703+0000 7f48a4073700 1 -- start start 2023-10-06T11:16:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 0x7f489c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f489c156740 0x7f489c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0c57d0 con 0x7f489c06e8d0 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0c4bc0 con 0x7f489c156740 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0c4ea0 con 0x7f489c156370 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 0x7f489c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 0x7f489c155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45296/0 (socket says 172.21.15.55:45296) 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 -- 172.21.15.55:0/2491273317 learned_addr learned my addr 172.21.15.55:0/2491273317 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:19.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a160e700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a2610700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f489c156740 0x7f489c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 -- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 msgr2=0x7f489c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 -- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f489c156740 msgr2=0x7f489c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f489c156740 0x7f489c159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 -- 172.21.15.55:0/2491273317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900094f0 con 0x7f489c06e8d0 2023-10-06T11:16:19.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a1e0f700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 0x7f489c155600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f489400e920 tx=0x7f4894008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894005a00 con 0x7f489c06e8d0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894005b60 con 0x7f489c06e8d0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c0c5180 con 0x7f489c06e8d0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.704+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894006020 con 0x7f489c06e8d0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.705+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c155b40 con 0x7f489c06e8d0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.706+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c167840 con 0x7f489c06e8d0 2023-10-06T11:16:19.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.706+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4894006410 con 0x7f489c06e8d0 2023-10-06T11:16:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.706+0000 7f4899ffb700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4888066f30 0x7f48880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.706+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4894084900 con 0x7f489c06e8d0 2023-10-06T11:16:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.707+0000 7f48a160e700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4888066f30 0x7f48880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.707+0000 7f48a160e700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4888066f30 0x7f48880693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48900099b0 tx=0x7f4890017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.710+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48940518d0 con 0x7f489c06e8d0 2023-10-06T11:16:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.903+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f489c064a90 con 0x7f489c06e8d0 2023-10-06T11:16:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.904+0000 7f4899ffb700 1 -- 172.21.15.55:0/2491273317 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4894054ef0 con 0x7f489c06e8d0 2023-10-06T11:16:19.905 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4888066f30 msgr2=0x7f48880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4888066f30 0x7f48880693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48900099b0 tx=0x7f4890017000 comp rx=0 tx=0).stop 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 msgr2=0x7f489c155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 0x7f489c155600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f489400e920 tx=0x7f4894008040 comp rx=0 tx=0).stop 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 shutdown_connections 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4888066f30 0x7f48880693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f489c06e8d0 0x7f489c155600 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f489c156740 0x7f489c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 --2- 172.21.15.55:0/2491273317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f489c156370 0x7f489c158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 >> 172.21.15.55:0/2491273317 conn(0x7f489c069150 msgr2=0x7f489c0af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 shutdown_connections 2023-10-06T11:16:19.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:19.906+0000 7f48a4073700 1 -- 172.21.15.55:0/2491273317 wait complete. 2023-10-06T11:16:19.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:20.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.037+0000 7f7e9ba58700 1 Processor -- start 2023-10-06T11:16:20.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.037+0000 7f7e9ba58700 1 -- start start 2023-10-06T11:16:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e9ba58700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e94159560 0x7f7e940aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e9ba58700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e940b0760 0x7f7e940b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e9ba58700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940b0c60 con 0x7f7e940b49a0 2023-10-06T11:16:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e9ba58700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940b0f40 con 0x7f7e94159560 2023-10-06T11:16:20.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e9ba58700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940b1220 con 0x7f7e940b0760 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e997f4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e94159560 0x7f7e940aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e98ff3700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e940b49a0 0x7f7e940aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47882/0 (socket says 172.21.15.55:47882) 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e98ff3700 1 -- 172.21.15.55:0/97240536 learned_addr learned my addr 172.21.15.55:0/97240536 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.038+0000 7f7e997f4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e94159560 0x7f7e940aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45302/0 (socket says 172.21.15.55:45302) 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e997f4700 1 -- 172.21.15.55:0/97240536 >> v2:172.21.15.142:3300/0 conn(0x7f7e940b0760 msgr2=0x7f7e940b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e997f4700 1 --2- 172.21.15.55:0/97240536 >> v2:172.21.15.142:3300/0 conn(0x7f7e940b0760 0x7f7e940b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e997f4700 1 -- 172.21.15.55:0/97240536 >> v1:172.21.15.55:6789/0 conn(0x7f7e940b49a0 legacy=0x7f7e940aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e93fff700 1 -- 172.21.15.55:0/97240536 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414938493 0 0) 0x7f7e940b0c60 con 0x7f7e940b49a0 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e997f4700 1 -- 172.21.15.55:0/97240536 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940b1500 con 0x7f7e94159560 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e997f4700 1 --2- 172.21.15.55:0/97240536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e94159560 0x7f7e940aa530 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0098d0 tx=0x7f7e8c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327318017a8e6bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e93fff700 1 -- 172.21.15.55:0/97240536 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c009e70 con 0x7f7e94159560 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e93fff700 1 -- 172.21.15.55:0/97240536 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c005c10 con 0x7f7e94159560 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e93fff700 1 -- 172.21.15.55:0/97240536 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00b610 con 0x7f7e94159560 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e9ba58700 1 -- 172.21.15.55:0/97240536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e94159560 msgr2=0x7f7e940aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.039+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/97240536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e94159560 0x7f7e940aa530 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0098d0 tx=0x7f7e8c009120 comp rx=0 tx=0).stop 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.040+0000 7f7e9ba58700 1 -- 172.21.15.55:0/97240536 shutdown_connections 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.040+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/97240536 >> v2:172.21.15.142:3300/0 conn(0x7f7e940b0760 0x7f7e940b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.040+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/97240536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e94159560 0x7f7e940aa530 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.040+0000 7f7e9ba58700 1 -- 172.21.15.55:0/97240536 >> 172.21.15.55:0/97240536 conn(0x7f7e940997f0 msgr2=0x7f7e9406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.040+0000 7f7e9ba58700 1 -- 172.21.15.55:0/97240536 shutdown_connections 2023-10-06T11:16:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.040+0000 7f7e9ba58700 1 -- 172.21.15.55:0/97240536 wait complete. 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.041+0000 7f7e9ba58700 1 Processor -- start 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.041+0000 7f7e9ba58700 1 -- start start 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 0x7f7e9414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e940b49a0 0x7f7e9416cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e94159560 0x7f7e94069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9409c8a0 con 0x7f7e940b0760 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9416d910 con 0x7f7e940b49a0 2023-10-06T11:16:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9416dbf0 con 0x7f7e94159560 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 0x7f7e9414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 0x7f7e9414d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45310/0 (socket says 172.21.15.55:45310) 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 -- 172.21.15.55:0/50438132 learned_addr learned my addr 172.21.15.55:0/50438132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e98ff3700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e940b49a0 0x7f7e9416cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e99ff5700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e94159560 0x7f7e94069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 -- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e94159560 msgr2=0x7f7e94069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e94159560 0x7f7e94069670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 -- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e940b49a0 msgr2=0x7f7e9416cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e940b49a0 0x7f7e9416cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 -- 172.21.15.55:0/50438132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0093c0 con 0x7f7e940b0760 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e99ff5700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e94159560 0x7f7e94069670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e997f4700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 0x7f7e9414d6d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009160 tx=0x7f7e8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c006290 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0063f0 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9409c530 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0067b0 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.042+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e94157be0 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.043+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e94064a90 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.044+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e8c01b690 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.044+0000 7f7e917fa700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e80066f30 0x7f7e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.044+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7e8c086970 con 0x7f7e940b0760 2023-10-06T11:16:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.044+0000 7f7e98ff3700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e80066f30 0x7f7e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.045+0000 7f7e98ff3700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e80066f30 0x7f7e800693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7e940cfc80 tx=0x7f7e88007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.048+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e8c053940 con 0x7f7e940b0760 2023-10-06T11:16:20.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.290+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e940b17e0 con 0x7f7e940b0760 2023-10-06T11:16:20.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.290+0000 7f7e917fa700 1 -- 172.21.15.55:0/50438132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f7e8c056f60 con 0x7f7e940b0760 2023-10-06T11:16:20.292 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:20.292 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e80066f30 msgr2=0x7f7e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e80066f30 0x7f7e800693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7e940cfc80 tx=0x7f7e88007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 msgr2=0x7f7e9414d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 0x7f7e9414d6d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009160 tx=0x7f7e8c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:20.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 shutdown_connections 2023-10-06T11:16:20.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7e80066f30 0x7f7e800693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e940b0760 0x7f7e9414d6d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e94159560 0x7f7e94069670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 --2- 172.21.15.55:0/50438132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e940b49a0 0x7f7e9416cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 >> 172.21.15.55:0/50438132 conn(0x7f7e940997f0 msgr2=0x7f7e94158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 shutdown_connections 2023-10-06T11:16:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.293+0000 7f7e9ba58700 1 -- 172.21.15.55:0/50438132 wait complete. 2023-10-06T11:16:20.297 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:20.306 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:20.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.425+0000 7f78819bd700 1 Processor -- start 2023-10-06T11:16:20.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.425+0000 7f78819bd700 1 -- start start 2023-10-06T11:16:20.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f78819bd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f78819bd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f787c067cc0 0x7f787c0ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f78819bd700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0aec90 con 0x7f787c0cdb00 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f78819bd700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0c4030 con 0x7f787c067cc0 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f78819bd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c06f3b0 con 0x7f787c157460 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f787c067cc0 0x7f787c0ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f787c067cc0 0x7f787c0ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45312/0 (socket says 172.21.15.55:45312) 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 -- 172.21.15.55:0/3866755200 learned_addr learned my addr 172.21.15.55:0/3866755200 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787affd700 1 --2- 172.21.15.55:0/3866755200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 -- 172.21.15.55:0/3866755200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 msgr2=0x7f787c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 --2- 172.21.15.55:0/3866755200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 -- 172.21.15.55:0/3866755200 >> v1:172.21.15.142:6789/0 conn(0x7f787c0cdb00 legacy=0x7f787c0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 -- 172.21.15.55:0/3866755200 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0aef70 con 0x7f787c067cc0 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f787b7fe700 1 --2- 172.21.15.55:0/3866755200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c0ac5a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7874009990 tx=0x7f7874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7a8a3f302c3cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.426+0000 7f7879ffb700 1 -- 172.21.15.55:0/3866755200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874009e80 con 0x7f787c067cc0 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f7879ffb700 1 -- 172.21.15.55:0/3866755200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7874005c60 con 0x7f787c067cc0 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f7879ffb700 1 -- 172.21.15.55:0/3866755200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400b650 con 0x7f787c067cc0 2023-10-06T11:16:20.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 -- 172.21.15.55:0/3866755200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 msgr2=0x7f787c0ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 --2- 172.21.15.55:0/3866755200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c0ac5a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7874009990 tx=0x7f7874009250 comp rx=0 tx=0).stop 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 -- 172.21.15.55:0/3866755200 shutdown_connections 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 --2- 172.21.15.55:0/3866755200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c0ac5a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 --2- 172.21.15.55:0/3866755200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 -- 172.21.15.55:0/3866755200 >> 172.21.15.55:0/3866755200 conn(0x7f787c069140 msgr2=0x7f787c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 -- 172.21.15.55:0/3866755200 shutdown_connections 2023-10-06T11:16:20.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.427+0000 7f78819bd700 1 -- 172.21.15.55:0/3866755200 wait complete. 2023-10-06T11:16:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.428+0000 7f78819bd700 1 Processor -- start 2023-10-06T11:16:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.428+0000 7f78819bd700 1 -- start start 2023-10-06T11:16:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f78819bd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f78819bd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f787c0cdb00 0x7f787c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f78819bd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f78819bd700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c15cf50 con 0x7f787c067cc0 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f78819bd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0c5890 con 0x7f787c0cdb00 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f78819bd700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c154ff0 con 0x7f787c157460 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f787affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f787affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45314/0 (socket says 172.21.15.55:45314) 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f787affd700 1 -- 172.21.15.55:0/2602080631 learned_addr learned my addr 172.21.15.55:0/2602080631 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f787b7fe700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.429+0000 7f787a7fc700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f787c0cdb00 0x7f787c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f787affd700 1 -- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 msgr2=0x7f787c06a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f787affd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f787affd700 1 -- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f787c0cdb00 msgr2=0x7f787c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f787affd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f787c0cdb00 0x7f787c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f787affd700 1 -- 172.21.15.55:0/2602080631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740094d0 con 0x7f787c067cc0 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f787affd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c154ab0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e960 tx=0x7f786c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c013680 con 0x7f787c067cc0 2023-10-06T11:16:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c0137e0 con 0x7f787c067cc0 2023-10-06T11:16:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c0c5560 con 0x7f787c067cc0 2023-10-06T11:16:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c013b80 con 0x7f787c067cc0 2023-10-06T11:16:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.430+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c15c760 con 0x7f787c067cc0 2023-10-06T11:16:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.431+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c0c5b70 con 0x7f787c067cc0 2023-10-06T11:16:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.431+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f786c0123d0 con 0x7f787c067cc0 2023-10-06T11:16:20.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.432+0000 7f7862ffd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7868066f30 0x7f78680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.432+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f786c084bf0 con 0x7f787c067cc0 2023-10-06T11:16:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.432+0000 7f787a7fc700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7868066f30 0x7f78680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.432+0000 7f787a7fc700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7868066f30 0x7f78680693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f787c0cd7e0 tx=0x7f78700016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.436+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f786c051bc0 con 0x7f787c067cc0 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.631+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f787c15cd90 con 0x7f787c067cc0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.632+0000 7f7862ffd700 1 -- 172.21.15.55:0/2602080631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f786c017090 con 0x7f787c067cc0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:20.635 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:05.249987+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:01.403615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:02.635607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.634+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7868066f30 msgr2=0x7f78680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.634+0000 7f78819bd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7868066f30 0x7f78680693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f787c0cd7e0 tx=0x7f78700016f0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 msgr2=0x7f787c154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c154ab0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e960 tx=0x7f786c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 shutdown_connections 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7868066f30 0x7f78680693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f787c067cc0 0x7f787c154ab0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f787c157460 0x7f787c06a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 --2- 172.21.15.55:0/2602080631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f787c0cdb00 0x7f787c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 >> 172.21.15.55:0/2602080631 conn(0x7f787c069140 msgr2=0x7f787c0c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 shutdown_connections 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.635+0000 7f78819bd700 1 -- 172.21.15.55:0/2602080631 wait complete. 2023-10-06T11:16:20.649 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:16:20.649 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:20.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.766+0000 7f73d7221700 1 Processor -- start 2023-10-06T11:16:20.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.766+0000 7f73d7221700 1 -- start start 2023-10-06T11:16:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d7221700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d7221700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d00cb7a0 con 0x7f73d00b2100 2023-10-06T11:16:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d7221700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d00b0860 con 0x7f73d00b35d0 2023-10-06T11:16:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d7221700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d00cb150 con 0x7f73d0159440 2023-10-06T11:16:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d6a20700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73d00b2100 0x7f73d00b2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47894/0 (socket says 172.21.15.55:47894) 2023-10-06T11:16:20.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d6a20700 1 -- 172.21.15.55:0/891856421 learned_addr learned my addr 172.21.15.55:0/891856421 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d621f700 1 --2- 172.21.15.55:0/891856421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140049052 0 0) 0x7f73d00cb7a0 con 0x7f73d00b2100 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b8003570 con 0x7f73d00b2100 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229216558 0 0) 0x7f73d00b0860 con 0x7f73d00b35d0 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d00cb7a0 con 0x7f73d00b35d0 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.767+0000 7f73d621f700 1 -- 172.21.15.55:0/891856421 >> v1:172.21.15.142:6789/0 conn(0x7f73d00b35d0 legacy=0x7f73d00cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d621f700 1 -- 172.21.15.55:0/891856421 >> v1:172.21.15.55:6789/0 conn(0x7f73d00b2100 legacy=0x7f73d00b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d621f700 1 -- 172.21.15.55:0/891856421 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d00cb430 con 0x7f73d0159440 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d621f700 1 --2- 172.21.15.55:0/891856421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d00b3090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009910 tx=0x7f73c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f673a54e6b726b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8011630 con 0x7f73d0159440 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8011790 con 0x7f73d0159440 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d521d700 1 -- 172.21.15.55:0/891856421 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8011b10 con 0x7f73d0159440 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d7221700 1 -- 172.21.15.55:0/891856421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 msgr2=0x7f73d00b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d7221700 1 --2- 172.21.15.55:0/891856421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d00b3090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73c8009910 tx=0x7f73c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d7221700 1 -- 172.21.15.55:0/891856421 shutdown_connections 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d7221700 1 --2- 172.21.15.55:0/891856421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d00b3090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.768+0000 7f73d7221700 1 -- 172.21.15.55:0/891856421 >> 172.21.15.55:0/891856421 conn(0x7f73d006ece0 msgr2=0x7f73d006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.769+0000 7f73d7221700 1 -- 172.21.15.55:0/891856421 shutdown_connections 2023-10-06T11:16:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.769+0000 7f73d7221700 1 -- 172.21.15.55:0/891856421 wait complete. 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 Processor -- start 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 -- start start 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 0x7f73d01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d00b35d0 0x7f73d00ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0154df0 con 0x7f73d00b2100 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d00ce4e0 con 0x7f73d00b35d0 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d7221700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d00ceeb0 con 0x7f73d0159440 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d621f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 0x7f73d01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d621f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 0x7f73d01548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45316/0 (socket says 172.21.15.55:45316) 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.770+0000 7f73d621f700 1 -- 172.21.15.55:0/1686549864 learned_addr learned my addr 172.21.15.55:0/1686549864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d6a20700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d621f700 1 -- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 msgr2=0x7f73d015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d621f700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d5a1e700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d00b35d0 0x7f73d00ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d621f700 1 -- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d00b35d0 msgr2=0x7f73d00ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d621f700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d00b35d0 0x7f73d00ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d621f700 1 -- 172.21.15.55:0/1686549864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8009420 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d6a20700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d5a1e700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d00b35d0 0x7f73d00ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d621f700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 0x7f73d01548b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f73d0069150 tx=0x7f73c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8011b10 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8000c90 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8025660 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d015c570 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.771+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d00cde90 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.772+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d005f230 con 0x7f73d00b2100 2023-10-06T11:16:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.772+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c80259d0 con 0x7f73d00b2100 2023-10-06T11:16:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.773+0000 7f73ce7fc700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73bc066f30 0x7f73bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.773+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f73c8085f80 con 0x7f73d00b2100 2023-10-06T11:16:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.773+0000 7f73d5a1e700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73bc066f30 0x7f73bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.773+0000 7f73d5a1e700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73bc066f30 0x7f73bc0693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f73d015b490 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:20.777+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c80b75a0 con 0x7f73d00b2100 2023-10-06T11:16:21.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.014+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73d00ce7c0 con 0x7f73d00b2100 2023-10-06T11:16:21.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.014+0000 7f73ce7fc700 1 -- 172.21.15.55:0/1686549864 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f73c8015090 con 0x7f73d00b2100 2023-10-06T11:16:21.016 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:21.016 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:21.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73bc066f30 msgr2=0x7f73bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73bc066f30 0x7f73bc0693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f73d015b490 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 msgr2=0x7f73d01548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 0x7f73d01548b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f73d0069150 tx=0x7f73c8017000 comp rx=0 tx=0).stop 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 shutdown_connections 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73bc066f30 0x7f73bc0693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d00b2100 0x7f73d01548b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d0159440 0x7f73d015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 --2- 172.21.15.55:0/1686549864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73d00b35d0 0x7f73d00ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 >> 172.21.15.55:0/1686549864 conn(0x7f73d006ece0 msgr2=0x7f73d00b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:21.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 shutdown_connections 2023-10-06T11:16:21.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.017+0000 7f73d7221700 1 -- 172.21.15.55:0/1686549864 wait complete. 2023-10-06T11:16:21.020 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:21.030 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.147+0000 7f1807d03700 1 Processor -- start 2023-10-06T11:16:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.148+0000 7f1807d03700 1 -- start start 2023-10-06T11:16:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.148+0000 7f1807d03700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18000ad210 0x7f18000cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.148+0000 7f1807d03700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000cecf0 con 0x7f18000ad5e0 2023-10-06T11:16:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.148+0000 7f1807d03700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000cefd0 con 0x7f180015db10 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.148+0000 7f1807d03700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cca90 con 0x7f18000ad210 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1805a9f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18000ad210 0x7f18000cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f180529e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f18000ad5e0 0x7f180015d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47910/0 (socket says 172.21.15.55:47910) 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f180529e700 1 -- 172.21.15.55:0/2583126996 learned_addr learned my addr 172.21.15.55:0/2583126996 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1805a9f700 1 -- 172.21.15.55:0/2583126996 >> v1:172.21.15.142:6789/0 conn(0x7f180015db10 legacy=0x7f18000ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1805a9f700 1 -- 172.21.15.55:0/2583126996 >> v1:172.21.15.55:6789/0 conn(0x7f18000ad5e0 legacy=0x7f180015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1805a9f700 1 -- 172.21.15.55:0/2583126996 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000ccd70 con 0x7f18000ad210 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1804a9d700 1 -- 172.21.15.55:0/2583126996 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238364186 0 0) 0x7f18000cecf0 con 0x7f18000ad5e0 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1805a9f700 1 --2- 172.21.15.55:0/2583126996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18000ad210 0x7f18000cd290 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009eb0 tx=0x7f17f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07d1ee7aafebb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1804a9d700 1 -- 172.21.15.55:0/2583126996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800e070 con 0x7f18000ad210 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1804a9d700 1 -- 172.21.15.55:0/2583126996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800bbf0 con 0x7f18000ad210 2023-10-06T11:16:21.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.149+0000 7f1804a9d700 1 -- 172.21.15.55:0/2583126996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8012430 con 0x7f18000ad210 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 -- 172.21.15.55:0/2583126996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18000ad210 msgr2=0x7f18000cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 --2- 172.21.15.55:0/2583126996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18000ad210 0x7f18000cd290 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009eb0 tx=0x7f17f8009780 comp rx=0 tx=0).stop 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 -- 172.21.15.55:0/2583126996 shutdown_connections 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 --2- 172.21.15.55:0/2583126996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18000ad210 0x7f18000cd290 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 -- 172.21.15.55:0/2583126996 >> 172.21.15.55:0/2583126996 conn(0x7f1800067d90 msgr2=0x7f18000ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 -- 172.21.15.55:0/2583126996 shutdown_connections 2023-10-06T11:16:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.150+0000 7f1807d03700 1 -- 172.21.15.55:0/2583126996 wait complete. 2023-10-06T11:16:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.151+0000 7f1807d03700 1 Processor -- start 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.151+0000 7f1807d03700 1 -- start start 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ad210 0x7f18000af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ad5e0 0x7f18000ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 0x7f1800169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000aeae0 con 0x7f180015db10 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000afae0 con 0x7f18000ad5e0 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000afdc0 con 0x7f18000ad210 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 0x7f1800169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 0x7f1800169eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45338/0 (socket says 172.21.15.55:45338) 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 -- 172.21.15.55:0/3900801710 learned_addr learned my addr 172.21.15.55:0/3900801710 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1805a9f700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ad210 0x7f18000af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f180529e700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ad5e0 0x7f18000ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 -- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ad210 msgr2=0x7f18000af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ad210 0x7f18000af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 -- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ad5e0 msgr2=0x7f18000ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ad5e0 0x7f18000ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 -- 172.21.15.55:0/3900801710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009a20 con 0x7f180015db10 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f18062a0700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 0x7f1800169eb0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f17f000b470 tx=0x7f17f0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000be20 con 0x7f180015db10 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f000f510 con 0x7f180015db10 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000b00a0 con 0x7f180015db10 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.152+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000f8d0 con 0x7f180015db10 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.153+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180015a370 con 0x7f180015db10 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.154+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180015a590 con 0x7f180015db10 2023-10-06T11:16:21.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.154+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17f000fcc0 con 0x7f180015db10 2023-10-06T11:16:21.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.155+0000 7f17fdffb700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17ec066f30 0x7f17ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.155+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f17f00840f0 con 0x7f180015db10 2023-10-06T11:16:21.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.155+0000 7f1805a9f700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17ec066f30 0x7f17ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.155+0000 7f1805a9f700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17ec066f30 0x7f17ec0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18000b3ed0 tx=0x7f17f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.159+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17f00510c0 con 0x7f180015db10 2023-10-06T11:16:21.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.396+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1800064a90 con 0x7f180015db10 2023-10-06T11:16:21.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.397+0000 7f17fdffb700 1 -- 172.21.15.55:0/3900801710 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f17f00546e0 con 0x7f180015db10 2023-10-06T11:16:21.398 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:21.398 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:03.661929+0000","modified":"2023-10-06T11:16:07.288412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/550471849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":550471849},{"type":"v1","addr":"172.21.15.55:6834","nonce":550471849}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:16:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.398+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17ec066f30 msgr2=0x7f17ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.398+0000 7f1807d03700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17ec066f30 0x7f17ec0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18000b3ed0 tx=0x7f17f8016000 comp rx=0 tx=0).stop 2023-10-06T11:16:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.398+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 msgr2=0x7f1800169eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.398+0000 7f1807d03700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 0x7f1800169eb0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f17f000b470 tx=0x7f17f0006f90 comp rx=0 tx=0).stop 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 shutdown_connections 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17ec066f30 0x7f17ec0693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180015db10 0x7f1800169eb0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ad210 0x7f18000af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 --2- 172.21.15.55:0/3900801710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ad5e0 0x7f18000ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 >> 172.21.15.55:0/3900801710 conn(0x7f1800067d90 msgr2=0x7f18000ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 shutdown_connections 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.399+0000 7f1807d03700 1 -- 172.21.15.55:0/3900801710 wait complete. 2023-10-06T11:16:21.401 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-10-06T11:16:21.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.529+0000 7f2192f11700 1 Processor -- start 2023-10-06T11:16:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2192f11700 1 -- start start 2023-10-06T11:16:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2192f11700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f218c0cad80 0x7f218c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2192f11700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c068d10 con 0x7f218c0cb5f0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2192f11700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c15a670 con 0x7f218c159ad0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2192f11700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c15a490 con 0x7f218c0cad80 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2190cad700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f218c0cb5f0 0x7f218c0691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47922/0 (socket says 172.21.15.55:47922) 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.530+0000 7f2190cad700 1 -- 172.21.15.55:0/1683312687 learned_addr learned my addr 172.21.15.55:0/1683312687 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f21914ae700 1 --2- 172.21.15.55:0/1683312687 >> v2:172.21.15.142:3300/0 conn(0x7f218c0cad80 0x7f218c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920609180 0 0) 0x7f218c068d10 con 0x7f218c0cb5f0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2178003570 con 0x7f218c0cb5f0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505738672 0 0) 0x7f218c15a670 con 0x7f218c159ad0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f218c068d10 con 0x7f218c159ad0 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f21914ae700 1 -- 172.21.15.55:0/1683312687 >> v1:172.21.15.142:6789/0 conn(0x7f218c159ad0 legacy=0x7f218c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f21914ae700 1 -- 172.21.15.55:0/1683312687 >> v1:172.21.15.55:6789/0 conn(0x7f218c0cb5f0 legacy=0x7f218c0691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f21914ae700 1 -- 172.21.15.55:0/1683312687 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c15a950 con 0x7f218c0cad80 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f21914ae700 1 --2- 172.21.15.55:0/1683312687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c159f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f21740098e0 tx=0x7f21740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a1acfc3a4245f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174011630 con 0x7f218c0cad80 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174011790 con 0x7f218c0cad80 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.531+0000 7f218b7fe700 1 -- 172.21.15.55:0/1683312687 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174011b30 con 0x7f218c0cad80 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 -- 172.21.15.55:0/1683312687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 msgr2=0x7f218c159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 --2- 172.21.15.55:0/1683312687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c159f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f21740098e0 tx=0x7f21740091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 -- 172.21.15.55:0/1683312687 shutdown_connections 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 --2- 172.21.15.55:0/1683312687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c159f50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 -- 172.21.15.55:0/1683312687 >> 172.21.15.55:0/1683312687 conn(0x7f218c0707d0 msgr2=0x7f218c070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 -- 172.21.15.55:0/1683312687 shutdown_connections 2023-10-06T11:16:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.532+0000 7f2192f11700 1 -- 172.21.15.55:0/1683312687 wait complete. 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.533+0000 7f2192f11700 1 Processor -- start 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.533+0000 7f2192f11700 1 -- start start 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2192f11700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2192f11700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cb5f0 0x7f218c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2192f11700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 0x7f218c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2192f11700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0b2ac0 con 0x7f218c159ad0 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2192f11700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0c29f0 con 0x7f218c0cad80 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2192f11700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0b1f40 con 0x7f218c0cb5f0 2023-10-06T11:16:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 0x7f218c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 0x7f218c0b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45352/0 (socket says 172.21.15.55:45352) 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 -- 172.21.15.55:0/3492180192 learned_addr learned my addr 172.21.15.55:0/3492180192 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f2190cad700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f218bfff700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cb5f0 0x7f218c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 -- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cb5f0 msgr2=0x7f218c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cb5f0 0x7f218c0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 -- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 msgr2=0x7f218c0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 -- 172.21.15.55:0/3492180192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009420 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.534+0000 7f21914ae700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 0x7f218c0b39c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f21740097b0 tx=0x7f2174017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.535+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217401f070 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.535+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174002f70 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.535+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c0b2220 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.535+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174023640 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.535+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c0b27e0 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.536+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c064a90 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.536+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f217402c3b0 con 0x7f218c159ad0 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.536+0000 7f2188ff9700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.536+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2174085b60 con 0x7f218c159ad0 2023-10-06T11:16:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.537+0000 7f2190cad700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.537+0000 7f2190cad700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f216c066f30 0x7f216c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2184007fd0 tx=0x7f2184009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.541+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2174052b30 con 0x7f218c159ad0 2023-10-06T11:16:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.735+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f218c15a250 con 0x7f218c159ad0 2023-10-06T11:16:21.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.736+0000 7f2188ff9700 1 -- 172.21.15.55:0/3492180192 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f2174028090 con 0x7f218c159ad0 2023-10-06T11:16:21.738 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:21.738 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:05.249987+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:01.403615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:02.635607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f216c066f30 msgr2=0x7f216c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f216c066f30 0x7f216c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2184007fd0 tx=0x7f2184009040 comp rx=0 tx=0).stop 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 msgr2=0x7f218c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 0x7f218c0b39c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f21740097b0 tx=0x7f2174017000 comp rx=0 tx=0).stop 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 shutdown_connections 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f216c066f30 0x7f216c0693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f218c159ad0 0x7f218c0b39c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cad80 0x7f218c0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 --2- 172.21.15.55:0/3492180192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cb5f0 0x7f218c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 >> 172.21.15.55:0/3492180192 conn(0x7f218c0707d0 msgr2=0x7f218c152c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:21.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 shutdown_connections 2023-10-06T11:16:21.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.738+0000 7f2192f11700 1 -- 172.21.15.55:0/3492180192 wait complete. 2023-10-06T11:16:21.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:16:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 Processor -- start 2023-10-06T11:16:21.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 -- start start 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25cc159830 0x7f25cc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc0cbfa0 con 0x7f25cc0b29b0 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc0cb390 con 0x7f25cc159830 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.871+0000 7f25d2a5b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0cb670 con 0x7f25cc0b25e0 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25d0ff8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25cc159830 0x7f25cc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25cb7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25cc0b29b0 0x7f25cc159120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47926/0 (socket says 172.21.15.55:47926) 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25cb7fe700 1 -- 172.21.15.55:0/300281840 learned_addr learned my addr 172.21.15.55:0/300281840 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25cbfff700 1 --2- 172.21.15.55:0/300281840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25d0ff8700 1 -- 172.21.15.55:0/300281840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 msgr2=0x7f25cc0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25d0ff8700 1 --2- 172.21.15.55:0/300281840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25d0ff8700 1 -- 172.21.15.55:0/300281840 >> v1:172.21.15.55:6789/0 conn(0x7f25cc0b29b0 legacy=0x7f25cc159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25d0ff8700 1 -- 172.21.15.55:0/300281840 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0cb950 con 0x7f25cc159830 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25d0ff8700 1 --2- 172.21.15.55:0/300281840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0cc430 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009e60 tx=0x7f25c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8487a836ba4cd6bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25caffd700 1 -- 172.21.15.55:0/300281840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400e070 con 0x7f25cc159830 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25caffd700 1 -- 172.21.15.55:0/300281840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400bc30 con 0x7f25cc159830 2023-10-06T11:16:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.872+0000 7f25caffd700 1 -- 172.21.15.55:0/300281840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4012430 con 0x7f25cc159830 2023-10-06T11:16:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 -- 172.21.15.55:0/300281840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 msgr2=0x7f25cc0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/300281840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0cc430 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009e60 tx=0x7f25c4009780 comp rx=0 tx=0).stop 2023-10-06T11:16:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 -- 172.21.15.55:0/300281840 shutdown_connections 2023-10-06T11:16:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/300281840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0cc430 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/300281840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 -- 172.21.15.55:0/300281840 >> 172.21.15.55:0/300281840 conn(0x7f25cc06ece0 msgr2=0x7f25cc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 -- 172.21.15.55:0/300281840 shutdown_connections 2023-10-06T11:16:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.873+0000 7f25d2a5b700 1 -- 172.21.15.55:0/300281840 wait complete. 2023-10-06T11:16:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.874+0000 7f25d2a5b700 1 Processor -- start 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.874+0000 7f25d2a5b700 1 -- start start 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d2a5b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d2a5b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25cc0b29b0 0x7f25cc0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d2a5b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d2a5b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc158130 con 0x7f25cc159830 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d2a5b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1533b0 con 0x7f25cc0b29b0 2023-10-06T11:16:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d2a5b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc157520 con 0x7f25cc0b25e0 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45374/0 (socket says 172.21.15.55:45374) 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 -- 172.21.15.55:0/3918922505 learned_addr learned my addr 172.21.15.55:0/3918922505 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25cb7fe700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25cc0b29b0 0x7f25cc0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25cbfff700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 -- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 msgr2=0x7f25cc152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 -- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25cc0b29b0 msgr2=0x7f25cc0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25cc0b29b0 0x7f25cc0ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.875+0000 7f25d0ff8700 1 -- 172.21.15.55:0/3918922505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009a20 con 0x7f25cc159830 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.876+0000 7f25d0ff8700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0ce940 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f25c4013000 tx=0x7f25c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.876+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4027470 con 0x7f25cc159830 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.876+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c40275f0 con 0x7f25cc159830 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.876+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc157800 con 0x7f25cc159830 2023-10-06T11:16:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.876+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40279b0 con 0x7f25cc159830 2023-10-06T11:16:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.876+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc157dc0 con 0x7f25cc159830 2023-10-06T11:16:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.877+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc1582e0 con 0x7f25cc159830 2023-10-06T11:16:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.877+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25c4024070 con 0x7f25cc159830 2023-10-06T11:16:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.877+0000 7f25b3fff700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f25b8066f30 0x7f25b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.878+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f25c40871e0 con 0x7f25cc159830 2023-10-06T11:16:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.878+0000 7f25cbfff700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f25b8066f30 0x7f25b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.878+0000 7f25cbfff700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f25b8066f30 0x7f25b80693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006aa0 tx=0x7f25bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:21.882+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25cc1582e0 con 0x7f25cc159830 2023-10-06T11:16:22.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.121+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f25cc1582e0 con 0x7f25cc159830 2023-10-06T11:16:22.123 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:16:22.121+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:16:22.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.125+0000 7f25b3fff700 1 -- 172.21.15.55:0/3918922505 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f25cc1582e0 con 0x7f25cc159830 2023-10-06T11:16:22.128 INFO:tasks.ceph.mds.c.smithi055.stderr: -702> 2023-10-06T11:16:08.569+0000 7f9fbde4a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.130+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f25b8066f30 msgr2=0x7f25b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.130+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f25b8066f30 0x7f25b80693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006aa0 tx=0x7f25bc008040 comp rx=0 tx=0).stop 2023-10-06T11:16:22.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.130+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 msgr2=0x7f25cc0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.130+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0ce940 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f25c4013000 tx=0x7f25c4019000 comp rx=0 tx=0).stop 2023-10-06T11:16:22.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 shutdown_connections 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f25b8066f30 0x7f25b80693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25cc159830 0x7f25cc0ce940 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25cc0b25e0 0x7f25cc152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 --2- 172.21.15.55:0/3918922505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25cc0b29b0 0x7f25cc0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 >> 172.21.15.55:0/3918922505 conn(0x7f25cc06ece0 msgr2=0x7f25cc1542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 shutdown_connections 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.131+0000 7f25d2a5b700 1 -- 172.21.15.55:0/3918922505 wait complete. 2023-10-06T11:16:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:16:22.145 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:16:22.151 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:16:22.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.265+0000 7f3785404700 1 Processor -- start 2023-10-06T11:16:22.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.265+0000 7f3785404700 1 -- start start 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f3785404700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37800ac170 0x7f37800aa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f3785404700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378015ab40 con 0x7f37801576d0 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f3785404700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3780159f50 con 0x7f37800cdc10 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f3785404700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378015a210 con 0x7f37800ac170 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37800ac170 0x7f37800aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37801576d0 0x7f378015d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47932/0 (socket says 172.21.15.55:47932) 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377effd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37800ac170 0x7f37800aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45392/0 (socket says 172.21.15.55:45392) 2023-10-06T11:16:22.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377f7fe700 1 -- 172.21.15.55:0/168856099 learned_addr learned my addr 172.21.15.55:0/168856099 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377effd700 1 -- 172.21.15.55:0/168856099 >> v1:172.21.15.142:6789/0 conn(0x7f37800cdc10 legacy=0x7f3780156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377effd700 1 -- 172.21.15.55:0/168856099 >> v1:172.21.15.55:6789/0 conn(0x7f37801576d0 legacy=0x7f378015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377effd700 1 -- 172.21.15.55:0/168856099 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378015a4f0 con 0x7f37800ac170 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.266+0000 7f377dffb700 1 -- 172.21.15.55:0/168856099 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958345241 0 0) 0x7f378015ab40 con 0x7f37801576d0 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f377effd700 1 --2- 172.21.15.55:0/168856099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37800ac170 0x7f37800aa140 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3770009e60 tx=0x7f3770009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11176c6fed7e386 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f377dffb700 1 -- 172.21.15.55:0/168856099 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000e070 con 0x7f37800ac170 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f377dffb700 1 -- 172.21.15.55:0/168856099 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000bc30 con 0x7f37800ac170 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f377dffb700 1 -- 172.21.15.55:0/168856099 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770012430 con 0x7f37800ac170 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 -- 172.21.15.55:0/168856099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37800ac170 msgr2=0x7f37800aa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 --2- 172.21.15.55:0/168856099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37800ac170 0x7f37800aa140 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3770009e60 tx=0x7f3770009780 comp rx=0 tx=0).stop 2023-10-06T11:16:22.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 -- 172.21.15.55:0/168856099 shutdown_connections 2023-10-06T11:16:22.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 --2- 172.21.15.55:0/168856099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37800ac170 0x7f37800aa140 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 -- 172.21.15.55:0/168856099 >> 172.21.15.55:0/168856099 conn(0x7f37800686c0 msgr2=0x7f3780068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:22.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 -- 172.21.15.55:0/168856099 shutdown_connections 2023-10-06T11:16:22.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.267+0000 7f3785404700 1 -- 172.21.15.55:0/168856099 wait complete. 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.268+0000 7f3785404700 1 Processor -- start 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 -- start start 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800ac170 0x7f3780155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37800cdc10 0x7f3780152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 0x7f37800c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c27d0 con 0x7f37801576d0 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c1ea0 con 0x7f37800cdc10 2023-10-06T11:16:22.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f3785404700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c2180 con 0x7f37800ac170 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f377f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 0x7f37800c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f377f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 0x7f37800c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45402/0 (socket says 172.21.15.55:45402) 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.269+0000 7f377f7fe700 1 -- 172.21.15.55:0/572566908 learned_addr learned my addr 172.21.15.55:0/572566908 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377effd700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800ac170 0x7f3780155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377e7fc700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37800cdc10 0x7f3780152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377f7fe700 1 -- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800ac170 msgr2=0x7f3780155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377f7fe700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800ac170 0x7f3780155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377f7fe700 1 -- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37800cdc10 msgr2=0x7f3780152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377f7fe700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37800cdc10 0x7f3780152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377f7fe700 1 -- 172.21.15.55:0/572566908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009a20 con 0x7f37801576d0 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377e7fc700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37800cdc10 0x7f3780152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f377f7fe700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 0x7f37800c3860 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f37780011e0 tx=0x7f3778007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778005b30 con 0x7f37801576d0 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778005c90 con 0x7f37801576d0 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778007300 con 0x7f37801576d0 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800c2460 con 0x7f37801576d0 2023-10-06T11:16:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.270+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3780155c80 con 0x7f37801576d0 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.271+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780155ea0 con 0x7f37801576d0 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.271+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3778007670 con 0x7f37801576d0 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.272+0000 7f3776ffd700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3760066f30 0x7f37600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.272+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3778083e10 con 0x7f37801576d0 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.272+0000 7f377effd700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3760066f30 0x7f37600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.272+0000 7f377effd700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3760066f30 0x7f37600693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3770009e60 tx=0x7f3770019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:22.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.276+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3778050d00 con 0x7f37801576d0 2023-10-06T11:16:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:22.513+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f378006fc70 con 0x7f37801576d0 2023-10-06T11:16:23.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.128+0000 7f3776ffd700 1 -- 172.21.15.55:0/572566908 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37780170a0 con 0x7f37801576d0 2023-10-06T11:16:23.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3760066f30 msgr2=0x7f37600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3760066f30 0x7f37600693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3770009e60 tx=0x7f3770019000 comp rx=0 tx=0).stop 2023-10-06T11:16:23.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 msgr2=0x7f37800c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 0x7f37800c3860 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f37780011e0 tx=0x7f3778007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:23.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 shutdown_connections 2023-10-06T11:16:23.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3760066f30 0x7f37600693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37801576d0 0x7f37800c3860 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800ac170 0x7f3780155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 --2- 172.21.15.55:0/572566908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37800cdc10 0x7f3780152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 >> 172.21.15.55:0/572566908 conn(0x7f37800686c0 msgr2=0x7f3780157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:23.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 shutdown_connections 2023-10-06T11:16:23.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.131+0000 7f3785404700 1 -- 172.21.15.55:0/572566908 wait complete. 2023-10-06T11:16:23.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:16:23.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.313+0000 7fa321d06700 1 Processor -- start 2023-10-06T11:16:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.313+0000 7fa321d06700 1 -- start start 2023-10-06T11:16:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa321d06700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c153950 0x7fa31c15c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa321d06700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa31c15ad30 0x7fa31c15b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa321d06700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c15c400 con 0x7fa31c153d20 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa321d06700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c158200 con 0x7fa31c15ad30 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa321d06700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c15b7f0 con 0x7fa31c153950 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31affd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa31c153d20 0x7fa31c1577a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47948/0 (socket says 172.21.15.55:47948) 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31affd700 1 -- 172.21.15.55:0/4224997377 learned_addr learned my addr 172.21.15.55:0/4224997377 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31b7fe700 1 --2- 172.21.15.55:0/4224997377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c153950 0x7fa31c15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31bfff700 1 --2- 172.21.15.55:0/4224997377 >> v2:172.21.15.142:3300/0 conn(0x7fa31c15ad30 0x7fa31c15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31a7fc700 1 -- 172.21.15.55:0/4224997377 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056150861 0 0) 0x7fa31c15c400 con 0x7fa31c153d20 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31a7fc700 1 -- 172.21.15.55:0/4224997377 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa304003570 con 0x7fa31c153d20 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31a7fc700 1 -- 172.21.15.55:0/4224997377 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 441723823 0 0) 0x7fa304003570 con 0x7fa31c153d20 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31b7fe700 1 -- 172.21.15.55:0/4224997377 >> v2:172.21.15.142:3300/0 conn(0x7fa31c15ad30 msgr2=0x7fa31c15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31b7fe700 1 --2- 172.21.15.55:0/4224997377 >> v2:172.21.15.142:3300/0 conn(0x7fa31c15ad30 0x7fa31c15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31b7fe700 1 -- 172.21.15.55:0/4224997377 >> v1:172.21.15.55:6789/0 conn(0x7fa31c153d20 legacy=0x7fa31c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.314+0000 7fa31b7fe700 1 -- 172.21.15.55:0/4224997377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c15bad0 con 0x7fa31c153950 2023-10-06T11:16:23.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa31b7fe700 1 --2- 172.21.15.55:0/4224997377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c153950 0x7fa31c15c890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0098d0 tx=0x7fa30c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c70b220dbba81d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:23.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa31a7fc700 1 -- 172.21.15.55:0/4224997377 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310001470 con 0x7fa31c153950 2023-10-06T11:16:23.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa31a7fc700 1 -- 172.21.15.55:0/4224997377 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c011420 con 0x7fa31c153950 2023-10-06T11:16:23.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa31a7fc700 1 -- 172.21.15.55:0/4224997377 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0117c0 con 0x7fa31c153950 2023-10-06T11:16:23.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 -- 172.21.15.55:0/4224997377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c153950 msgr2=0x7fa31c15c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 --2- 172.21.15.55:0/4224997377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c153950 0x7fa31c15c890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0098d0 tx=0x7fa30c009120 comp rx=0 tx=0).stop 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 -- 172.21.15.55:0/4224997377 shutdown_connections 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 --2- 172.21.15.55:0/4224997377 >> v2:172.21.15.142:3300/0 conn(0x7fa31c15ad30 0x7fa31c15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 --2- 172.21.15.55:0/4224997377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c153950 0x7fa31c15c890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 -- 172.21.15.55:0/4224997377 >> 172.21.15.55:0/4224997377 conn(0x7fa31c06ece0 msgr2=0x7fa31c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 -- 172.21.15.55:0/4224997377 shutdown_connections 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.315+0000 7fa321d06700 1 -- 172.21.15.55:0/4224997377 wait complete. 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 Processor -- start 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 -- start start 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 0x7fa31c0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa31c153d20 0x7fa31c1440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c15ad30 0x7fa31c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c16d310 con 0x7fa31c153950 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c16d560 con 0x7fa31c153d20 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa321d06700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c16d840 con 0x7fa31c15ad30 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa31b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 0x7fa31c0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa31b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 0x7fa31c0c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45410/0 (socket says 172.21.15.55:45410) 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.317+0000 7fa31b7fe700 1 -- 172.21.15.55:0/2644776690 learned_addr learned my addr 172.21.15.55:0/2644776690 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31bfff700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c15ad30 0x7fa31c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31affd700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa31c153d20 0x7fa31c1440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31b7fe700 1 -- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c15ad30 msgr2=0x7fa31c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31b7fe700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c15ad30 0x7fa31c0b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31b7fe700 1 -- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa31c153d20 msgr2=0x7fa31c1440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31b7fe700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa31c153d20 0x7fa31c1440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31b7fe700 1 -- 172.21.15.55:0/2644776690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0093c0 con 0x7fa31c153950 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31affd700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa31c153d20 0x7fa31c1440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa31b7fe700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 0x7fa31c0c68b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009390 tx=0x7fa30c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c01ccb0 con 0x7fa31c153950 2023-10-06T11:16:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c01ce30 con 0x7fa31c153950 2023-10-06T11:16:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c16db20 con 0x7fa31c153950 2023-10-06T11:16:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c01a6a0 con 0x7fa31c153950 2023-10-06T11:16:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.318+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c16e0e0 con 0x7fa31c153950 2023-10-06T11:16:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.319+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c064a90 con 0x7fa31c153950 2023-10-06T11:16:23.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.319+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa30c01aa50 con 0x7fa31c153950 2023-10-06T11:16:23.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.320+0000 7fa3037fe700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.320+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa30c085e90 con 0x7fa31c153950 2023-10-06T11:16:23.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.320+0000 7fa31affd700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.321+0000 7fa31affd700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa31c1531f0 tx=0x7fa3100015e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:23.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.324+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa30c052e10 con 0x7fa31c153950 2023-10-06T11:16:23.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:23.520+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa31c15bdb0 con 0x7fa31c153950 2023-10-06T11:16:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.131+0000 7fa3037fe700 1 -- 172.21.15.55:0/2644776690 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa30c029020 con 0x7fa31c153950 2023-10-06T11:16:24.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa308066f30 msgr2=0x7fa3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa31c1531f0 tx=0x7fa3100015e0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 msgr2=0x7fa31c0c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 0x7fa31c0c68b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009390 tx=0x7fa30c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 shutdown_connections 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa31c1531f0 tx=0x7fa3100015e0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa31c153950 0x7fa31c0c68b0 secure :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009390 tx=0x7fa30c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa31c15ad30 0x7fa31c0b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 --2- 172.21.15.55:0/2644776690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa31c153d20 0x7fa31c1440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 >> 172.21.15.55:0/2644776690 conn(0x7fa31c06ece0 msgr2=0x7fa31c0b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.138+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 shutdown_connections 2023-10-06T11:16:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.139+0000 7fa321d06700 1 -- 172.21.15.55:0/2644776690 wait complete. 2023-10-06T11:16:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:16:24.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:16:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.284+0000 7fcdd8a6e700 1 Processor -- start 2023-10-06T11:16:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.284+0000 7fcdd8a6e700 1 -- start start 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd8a6e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdd40ae570 0x7fcdd40675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd8a6e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd4067af0 0x7fcdd406a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd8a6e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd4067f50 con 0x7fcdd40a7be0 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd8a6e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40c9a50 con 0x7fcdd40ae570 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd8a6e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40c9440 con 0x7fcdd4067af0 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdd40ae570 0x7fcdd40675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdd40ae570 0x7fcdd40675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45414/0 (socket says 172.21.15.55:45414) 2023-10-06T11:16:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 -- 172.21.15.55:0/3038098393 learned_addr learned my addr 172.21.15.55:0/3038098393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd2d9d700 1 --2- 172.21.15.55:0/3038098393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd4067af0 0x7fcdd406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 -- 172.21.15.55:0/3038098393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd4067af0 msgr2=0x7fcdd406a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 --2- 172.21.15.55:0/3038098393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd4067af0 0x7fcdd406a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 -- 172.21.15.55:0/3038098393 >> v1:172.21.15.142:6789/0 conn(0x7fcdd40a7be0 legacy=0x7fcdd415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 -- 172.21.15.55:0/3038098393 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40ad0d0 con 0x7fcdd40ae570 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd1d9b700 1 --2- 172.21.15.55:0/3038098393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40ae570 0x7fcdd40675b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0099b0 tx=0x7fcdbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a3edd3fc185aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd159a700 1 -- 172.21.15.55:0/3038098393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00b860 con 0x7fcdd40ae570 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd159a700 1 -- 172.21.15.55:0/3038098393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00b9c0 con 0x7fcdd40ae570 2023-10-06T11:16:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.285+0000 7fcdd159a700 1 -- 172.21.15.55:0/3038098393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00bd60 con 0x7fcdd40ae570 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3038098393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40ae570 msgr2=0x7fcdd40675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3038098393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40ae570 0x7fcdd40675b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0099b0 tx=0x7fcdbc009250 comp rx=0 tx=0).stop 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3038098393 shutdown_connections 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3038098393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd4067af0 0x7fcdd406a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3038098393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40ae570 0x7fcdd40675b0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3038098393 >> 172.21.15.55:0/3038098393 conn(0x7fcdd40cd1e0 msgr2=0x7fcdd40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3038098393 shutdown_connections 2023-10-06T11:16:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.286+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3038098393 wait complete. 2023-10-06T11:16:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.287+0000 7fcdd8a6e700 1 Processor -- start 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.287+0000 7fcdd8a6e700 1 -- start start 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd8a6e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 0x7fcdd414aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd8a6e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd40a7be0 0x7fcdd41495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd8a6e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40ae570 0x7fcdd40cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd8a6e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd414af50 con 0x7fcdd4067af0 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd8a6e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40b1170 con 0x7fcdd40ae570 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd8a6e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd414b4b0 con 0x7fcdd40a7be0 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 0x7fcdd414aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 0x7fcdd414aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45416/0 (socket says 172.21.15.55:45416) 2023-10-06T11:16:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 -- 172.21.15.55:0/3894977917 learned_addr learned my addr 172.21.15.55:0/3894977917 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd1d9b700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd40a7be0 0x7fcdd41495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd2d9d700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40ae570 0x7fcdd40cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 -- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd40a7be0 msgr2=0x7fcdd41495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd40a7be0 0x7fcdd41495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 -- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40ae570 msgr2=0x7fcdd40cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40ae570 0x7fcdd40cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 -- 172.21.15.55:0/3894977917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0094f0 con 0x7fcdd4067af0 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.288+0000 7fcdd259c700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 0x7fcdd414aa10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c8e0 tx=0x7fcdc4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.289+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400ce80 con 0x7fcdd4067af0 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.289+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400a7e0 con 0x7fcdd4067af0 2023-10-06T11:16:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.289+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd414b1d0 con 0x7fcdd4067af0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.289+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400aba0 con 0x7fcdd4067af0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.289+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd40b16f0 con 0x7fcdd4067af0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.290+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd40b0fd0 con 0x7fcdd4067af0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.290+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdc4003030 con 0x7fcdd4067af0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.290+0000 7fcdca7fc700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdb4066f30 0x7fcdb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.291+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6026+0+0 (secure 0 0 0) 0x7fcdc4084560 con 0x7fcdd4067af0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.291+0000 7fcdd1d9b700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdb4066f30 0x7fcdb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.291+0000 7fcdd1d9b700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdb4066f30 0x7fcdb40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0099b0 tx=0x7fcdbc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.295+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdd40b0fd0 con 0x7fcdd4067af0 2023-10-06T11:16:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:24.492+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcdd4067f50 con 0x7fcdd4067af0 2023-10-06T11:16:25.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.138+0000 7fcdca7fc700 1 -- 172.21.15.55:0/3894977917 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcdd4067f50 con 0x7fcdd4067af0 2023-10-06T11:16:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdb4066f30 msgr2=0x7fcdb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdb4066f30 0x7fcdb40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0099b0 tx=0x7fcdbc017000 comp rx=0 tx=0).stop 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 msgr2=0x7fcdd414aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 0x7fcdd414aa10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c8e0 tx=0x7fcdc4001710 comp rx=0 tx=0).stop 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 shutdown_connections 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcdb4066f30 0x7fcdb40693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd4067af0 0x7fcdd414aa10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd40ae570 0x7fcdd40cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 --2- 172.21.15.55:0/3894977917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdd40a7be0 0x7fcdd41495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 >> 172.21.15.55:0/3894977917 conn(0x7fcdd40cd1e0 msgr2=0x7fcdd406abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 shutdown_connections 2023-10-06T11:16:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.142+0000 7fcdd8a6e700 1 -- 172.21.15.55:0/3894977917 wait complete. 2023-10-06T11:16:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:16:25.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:16:25.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.286+0000 7fac752da700 1 Processor -- start 2023-10-06T11:16:25.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.286+0000 7fac752da700 1 -- start start 2023-10-06T11:16:25.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac752da700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac7015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac752da700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac700cca70 0x7fac700d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac752da700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac700d07f0 0x7fac7015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac752da700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700d0c50 con 0x7fac700cca70 2023-10-06T11:16:25.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac752da700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700cdbf0 con 0x7fac700d07f0 2023-10-06T11:16:25.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac752da700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700cb4c0 con 0x7fac70153990 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac6f7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac700cca70 0x7fac700d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac6f7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac700cca70 0x7fac700d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53052/0 (socket says 172.21.15.55:53052) 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac6f7fe700 1 -- 172.21.15.55:0/1351841304 learned_addr learned my addr 172.21.15.55:0/1351841304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac6ffff700 1 --2- 172.21.15.55:0/1351841304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac7015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.287+0000 7fac74ad9700 1 --2- 172.21.15.55:0/1351841304 >> v2:172.21.15.142:3300/0 conn(0x7fac700d07f0 0x7fac7015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6f7fe700 1 -- 172.21.15.55:0/1351841304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 msgr2=0x7fac7015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6f7fe700 1 --2- 172.21.15.55:0/1351841304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac7015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6f7fe700 1 -- 172.21.15.55:0/1351841304 >> v2:172.21.15.142:3300/0 conn(0x7fac700d07f0 msgr2=0x7fac7015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6f7fe700 1 --2- 172.21.15.55:0/1351841304 >> v2:172.21.15.142:3300/0 conn(0x7fac700d07f0 0x7fac7015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6f7fe700 1 -- 172.21.15.55:0/1351841304 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7015a8b0 con 0x7fac700cca70 2023-10-06T11:16:25.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac74ad9700 1 --2- 172.21.15.55:0/1351841304 >> v2:172.21.15.142:3300/0 conn(0x7fac700d07f0 0x7fac7015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6f7fe700 1 --2- 172.21.15.55:0/1351841304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700cca70 0x7fac700d02b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fac70089290 tx=0x7fac64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd63bf9349f1977 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6effd700 1 -- 172.21.15.55:0/1351841304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400b860 con 0x7fac700cca70 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6effd700 1 -- 172.21.15.55:0/1351841304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6400b9c0 con 0x7fac700cca70 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac6effd700 1 -- 172.21.15.55:0/1351841304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400bd60 con 0x7fac700cca70 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 -- 172.21.15.55:0/1351841304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700cca70 msgr2=0x7fac700d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 --2- 172.21.15.55:0/1351841304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700cca70 0x7fac700d02b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fac70089290 tx=0x7fac64009250 comp rx=0 tx=0).stop 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 -- 172.21.15.55:0/1351841304 shutdown_connections 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 --2- 172.21.15.55:0/1351841304 >> v2:172.21.15.142:3300/0 conn(0x7fac700d07f0 0x7fac7015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 --2- 172.21.15.55:0/1351841304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac7015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 --2- 172.21.15.55:0/1351841304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700cca70 0x7fac700d02b0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 -- 172.21.15.55:0/1351841304 >> 172.21.15.55:0/1351841304 conn(0x7fac700680c0 msgr2=0x7fac70068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:25.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.288+0000 7fac752da700 1 -- 172.21.15.55:0/1351841304 shutdown_connections 2023-10-06T11:16:25.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.289+0000 7fac752da700 1 -- 172.21.15.55:0/1351841304 wait complete. 2023-10-06T11:16:25.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.290+0000 7fac752da700 1 Processor -- start 2023-10-06T11:16:25.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.290+0000 7fac752da700 1 -- start start 2023-10-06T11:16:25.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.290+0000 7fac752da700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac700cca70 0x7fac7014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.290+0000 7fac752da700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 0x7fac7015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac752da700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac700c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac752da700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7015d3d0 con 0x7fac700d07f0 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac752da700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac701504c0 con 0x7fac700cca70 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac752da700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7015cdf0 con 0x7fac70153990 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 0x7fac7015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 0x7fac7015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53054/0 (socket says 172.21.15.55:53054) 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 -- 172.21.15.55:0/3337754846 learned_addr learned my addr 172.21.15.55:0/3337754846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac74ad9700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac700c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6ffff700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac700cca70 0x7fac7014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 -- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 msgr2=0x7fac700c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac700c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 -- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac700cca70 msgr2=0x7fac7014f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac700cca70 0x7fac7014f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 -- 172.21.15.55:0/3337754846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac640094f0 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6ffff700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac700cca70 0x7fac7014f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac74ad9700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac700c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac6f7fe700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 0x7fac7015d860 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b3c0 tx=0x7fac64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64024440 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac640245a0 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac700c7720 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64024960 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.291+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7014ff20 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.292+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7005f230 con 0x7fac700d07f0 2023-10-06T11:16:25.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.293+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac6401a420 con 0x7fac700d07f0 2023-10-06T11:16:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.293+0000 7fac57fff700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac5c066f30 0x7fac5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.293+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fac64086300 con 0x7fac700d07f0 2023-10-06T11:16:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.293+0000 7fac6ffff700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac5c066f30 0x7fac5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.294+0000 7fac6ffff700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac5c066f30 0x7fac5c0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac60009990 tx=0x7fac60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:25.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.298+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac640535d0 con 0x7fac700d07f0 2023-10-06T11:16:25.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.490+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fac700ccfe0 con 0x7fac700d07f0 2023-10-06T11:16:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.494+0000 7fac57fff700 1 -- 172.21.15.55:0/3337754846 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac64056bf0 con 0x7fac700d07f0 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac5c066f30 msgr2=0x7fac5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac5c066f30 0x7fac5c0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac60009990 tx=0x7fac60008040 comp rx=0 tx=0).stop 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 msgr2=0x7fac7015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 0x7fac7015d860 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b3c0 tx=0x7fac64017000 comp rx=0 tx=0).stop 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 shutdown_connections 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fac5c066f30 0x7fac5c0693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac70153990 0x7fac700c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac700cca70 0x7fac7014f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 --2- 172.21.15.55:0/3337754846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac700d07f0 0x7fac7015d860 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 >> 172.21.15.55:0/3337754846 conn(0x7fac700680c0 msgr2=0x7fac70151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 shutdown_connections 2023-10-06T11:16:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.496+0000 7fac752da700 1 -- 172.21.15.55:0/3337754846 wait complete. 2023-10-06T11:16:25.510 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2023-10-06T11:16:25.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.627+0000 7fc71306d700 1 Processor -- start 2023-10-06T11:16:25.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.627+0000 7fc71306d700 1 -- start start 2023-10-06T11:16:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71306d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc70c156010 0x7fc70c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71306d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71306d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c15ad50 con 0x7fc70c1563e0 2023-10-06T11:16:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71306d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0b1ae0 con 0x7fc70c156010 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71306d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c159e60 con 0x7fc70c0b1120 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71206b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc70c156010 0x7fc70c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71206b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc70c156010 0x7fc70c0c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53060/0 (socket says 172.21.15.55:53060) 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71206b700 1 -- 172.21.15.55:0/2117464084 learned_addr learned my addr 172.21.15.55:0/2117464084 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.628+0000 7fc71286c700 1 --2- 172.21.15.55:0/2117464084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc71206b700 1 -- 172.21.15.55:0/2117464084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 msgr2=0x7fc70c0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc71206b700 1 --2- 172.21.15.55:0/2117464084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c0b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc71206b700 1 -- 172.21.15.55:0/2117464084 >> v1:172.21.15.142:6789/0 conn(0x7fc70c1563e0 legacy=0x7fc70c0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc71206b700 1 -- 172.21.15.55:0/2117464084 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c15a140 con 0x7fc70c156010 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc71206b700 1 --2- 172.21.15.55:0/2117464084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c0c9c00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc704009f20 tx=0x7fc704009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32d702f4b8e2556 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc711069700 1 -- 172.21.15.55:0/2117464084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70400e070 con 0x7fc70c156010 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc711069700 1 -- 172.21.15.55:0/2117464084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70400b9d0 con 0x7fc70c156010 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.629+0000 7fc711069700 1 -- 172.21.15.55:0/2117464084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040092e0 con 0x7fc70c156010 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 -- 172.21.15.55:0/2117464084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 msgr2=0x7fc70c0c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 --2- 172.21.15.55:0/2117464084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c0c9c00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc704009f20 tx=0x7fc704009840 comp rx=0 tx=0).stop 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 -- 172.21.15.55:0/2117464084 shutdown_connections 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 --2- 172.21.15.55:0/2117464084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 --2- 172.21.15.55:0/2117464084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c0c9c00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 -- 172.21.15.55:0/2117464084 >> 172.21.15.55:0/2117464084 conn(0x7fc70c069190 msgr2=0x7fc70c0aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 -- 172.21.15.55:0/2117464084 shutdown_connections 2023-10-06T11:16:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.630+0000 7fc71306d700 1 -- 172.21.15.55:0/2117464084 wait complete. 2023-10-06T11:16:25.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.631+0000 7fc71306d700 1 Processor -- start 2023-10-06T11:16:25.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.631+0000 7fc71306d700 1 -- start start 2023-10-06T11:16:25.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.631+0000 7fc71306d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.631+0000 7fc71306d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c16b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71306d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc70c1563e0 0x7fc70c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71306d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c16bf80 con 0x7fc70c156010 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71306d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c5bf0 con 0x7fc70c1563e0 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71306d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c16b9c0 con 0x7fc70c0b1120 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c16b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c16b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53064/0 (socket says 172.21.15.55:53064) 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 -- 172.21.15.55:0/1337450170 learned_addr learned my addr 172.21.15.55:0/1337450170 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71206b700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71286c700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc70c1563e0 0x7fc70c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 -- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 msgr2=0x7fc70c147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 -- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc70c1563e0 msgr2=0x7fc70c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc70c1563e0 0x7fc70c158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 -- 172.21.15.55:0/1337450170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704009ae0 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71186a700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c16b000 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c590 tx=0x7fc70000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700011590 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700011710 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c16bca0 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700011ad0 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.632+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c148420 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.633+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c0c5da0 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.634+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc70001b3b0 con 0x7fc70c156010 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.634+0000 7fc70a7fc700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc6f8066f30 0x7fc6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.634+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc700083900 con 0x7fc70c156010 2023-10-06T11:16:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.634+0000 7fc71206b700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc6f8066f30 0x7fc6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.635+0000 7fc71206b700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc6f8066f30 0x7fc6f80693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc704009880 tx=0x7fc704018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.639+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc70c0c5da0 con 0x7fc70c156010 2023-10-06T11:16:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:25.915+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) v1 -- 0x7fc70c0c5d60 con 0x7fc70c156010 2023-10-06T11:16:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.142+0000 7fc70a7fc700 1 -- 172.21.15.55:0/1337450170 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v209) v1 ==== 145+0+0 (secure 0 0 0) 0x7fc700017070 con 0x7fc70c156010 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc6f8066f30 msgr2=0x7fc6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc6f8066f30 0x7fc6f80693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc704009880 tx=0x7fc704018000 comp rx=0 tx=0).stop 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 msgr2=0x7fc70c16b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c16b000 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c590 tx=0x7fc70000c8a0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 shutdown_connections 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc6f8066f30 0x7fc6f80693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc70c1563e0 0x7fc70c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc70c0b1120 0x7fc70c147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 --2- 172.21.15.55:0/1337450170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc70c156010 0x7fc70c16b000 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 >> 172.21.15.55:0/1337450170 conn(0x7fc70c069190 msgr2=0x7fc70c152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 shutdown_connections 2023-10-06T11:16:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.145+0000 7fc71306d700 1 -- 172.21.15.55:0/1337450170 wait complete. 2023-10-06T11:16:26.159 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2023-10-06T11:16:26.159 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2023-10-06T11:16:26.159 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-06T11:16:26.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2023-10-06T11:16:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.284+0000 7f1bba0b4700 1 Processor -- start 2023-10-06T11:16:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.284+0000 7f1bba0b4700 1 -- start start 2023-10-06T11:16:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.284+0000 7f1bba0b4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bba0b4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bb40b0760 0x7f1bb40b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bba0b4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb40b0c60 con 0x7f1bb40b49a0 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bba0b4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb40b0f40 con 0x7f1bb40b0760 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bba0b4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b1220 con 0x7f1bb4159560 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bb40b0760 0x7f1bb40b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb37fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb2ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1bb40b49a0 0x7f1bb40aaa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:58288/0 (socket says 172.21.15.55:58288) 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb2ffd700 1 -- 172.21.15.55:0/3082530436 learned_addr learned my addr 172.21.15.55:0/3082530436 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb3fff700 1 -- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 msgr2=0x7f1bb40aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb3fff700 1 --2- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb3fff700 1 -- 172.21.15.55:0/3082530436 >> v1:172.21.15.142:6789/0 conn(0x7f1bb40b49a0 legacy=0x7f1bb40aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb3fff700 1 -- 172.21.15.55:0/3082530436 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40b1500 con 0x7f1bb40b0760 2023-10-06T11:16:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb27fc700 1 -- 172.21.15.55:0/3082530436 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470091699 0 0) 0x7f1bb40b0c60 con 0x7f1bb40b49a0 2023-10-06T11:16:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.285+0000 7f1bb37fe700 1 --2- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bb3fff700 1 --2- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb40b1bc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0098e0 tx=0x7f1bac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797629de9396baa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bb27fc700 1 -- 172.21.15.55:0/3082530436 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00b640 con 0x7f1bb40b0760 2023-10-06T11:16:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bb27fc700 1 -- 172.21.15.55:0/3082530436 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac00b7a0 con 0x7f1bb40b0760 2023-10-06T11:16:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bb27fc700 1 -- 172.21.15.55:0/3082530436 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00bb40 con 0x7f1bb40b0760 2023-10-06T11:16:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 -- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 msgr2=0x7f1bb40b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb40b1bc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0098e0 tx=0x7f1bac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 -- 172.21.15.55:0/3082530436 shutdown_connections 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb40b1bc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/3082530436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 -- 172.21.15.55:0/3082530436 >> 172.21.15.55:0/3082530436 conn(0x7f1bb40997f0 msgr2=0x7f1bb406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 -- 172.21.15.55:0/3082530436 shutdown_connections 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.286+0000 7f1bba0b4700 1 -- 172.21.15.55:0/3082530436 wait complete. 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.288+0000 7f1bba0b4700 1 Processor -- start 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.288+0000 7f1bba0b4700 1 -- start start 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bba0b4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb4157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bba0b4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 0x7f1bb415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bba0b4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bba0b4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb416a310 con 0x7f1bb40b49a0 2023-10-06T11:16:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bba0b4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb4169700 con 0x7f1bb40b0760 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bba0b4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb41699e0 con 0x7f1bb4159560 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 0x7f1bb415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 0x7f1bb415d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53072/0 (socket says 172.21.15.55:53072) 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 -- 172.21.15.55:0/2057542117 learned_addr learned my addr 172.21.15.55:0/2057542117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb37fe700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb4157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb3fff700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 -- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 msgr2=0x7f1bb40ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 -- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 msgr2=0x7f1bb4157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb4157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 -- 172.21.15.55:0/2057542117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4009a20 con 0x7f1bb40b49a0 2023-10-06T11:16:26.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb37fe700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb4157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bb2ffd700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 0x7f1bb415d9a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c810 tx=0x7f1b9c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.289+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c005c00 con 0x7f1bb40b49a0 2023-10-06T11:16:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.290+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c005d60 con 0x7f1bb40b49a0 2023-10-06T11:16:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.290+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c007320 con 0x7f1bb40b49a0 2023-10-06T11:16:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.290+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac009420 con 0x7f1bb40b49a0 2023-10-06T11:16:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.290+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb4169fa0 con 0x7f1bb40b49a0 2023-10-06T11:16:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.291+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb416a480 con 0x7f1bb40b49a0 2023-10-06T11:16:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.291+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b9c01b400 con 0x7f1bb40b49a0 2023-10-06T11:16:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.291+0000 7f1bab7fe700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b94066f30 0x7f1b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.291+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f1b9c084020 con 0x7f1bb40b49a0 2023-10-06T11:16:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.292+0000 7f1bb37fe700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b94066f30 0x7f1b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.292+0000 7f1bb37fe700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b94066f30 0x7f1b940693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40099f0 tx=0x7f1ba400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:26.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.296+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b9c0512f0 con 0x7f1bb40b49a0 2023-10-06T11:16:26.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:26.567+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7f1bb4064a90 con 0x7f1bb40b49a0 2023-10-06T11:16:27.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.151+0000 7f1bab7fe700 1 -- 172.21.15.55:0/2057542117 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v210) v1 ==== 148+0+0 (secure 0 0 0) 0x7f1b9c054910 con 0x7f1bb40b49a0 2023-10-06T11:16:27.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.153+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b94066f30 msgr2=0x7f1b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.153+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b94066f30 0x7f1b940693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40099f0 tx=0x7f1ba400b040 comp rx=0 tx=0).stop 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.153+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 msgr2=0x7f1bb415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.153+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 0x7f1bb415d9a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c810 tx=0x7f1b9c007db0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 shutdown_connections 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1b94066f30 0x7f1b940693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bb4159560 0x7f1bb40ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb40b0760 0x7f1bb4157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 --2- 172.21.15.55:0/2057542117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb40b49a0 0x7f1bb415d9a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 >> 172.21.15.55:0/2057542117 conn(0x7f1bb40997f0 msgr2=0x7f1bb4158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 shutdown_connections 2023-10-06T11:16:27.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.154+0000 7f1bba0b4700 1 -- 172.21.15.55:0/2057542117 wait complete. 2023-10-06T11:16:27.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:16:27.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.296+0000 7f73dc027700 1 Processor -- start 2023-10-06T11:16:27.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73dc027700 1 -- start start 2023-10-06T11:16:27.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73dc027700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73d41594d0 0x7f73d40cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73dc027700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73d40ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73dc027700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d40cbeb0 con 0x7f73d41598a0 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73dc027700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d40cf5d0 con 0x7f73d41594d0 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73dc027700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cf8b0 con 0x7f73d40cbaa0 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73d95c2700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73d41598a0 0x7f73d40ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37774/0 (socket says 172.21.15.55:37774) 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.297+0000 7f73d95c2700 1 -- 172.21.15.55:0/3614668299 learned_addr learned my addr 172.21.15.55:0/3614668299 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/3614668299 >> v2:172.21.15.142:3300/0 conn(0x7f73d41594d0 0x7f73d40cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760165917 0 0) 0x7f73d40cbeb0 con 0x7f73d41598a0 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73bc003570 con 0x7f73d41598a0 2023-10-06T11:16:27.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73da5c4700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73d40ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274466334 0 0) 0x7f73bc003570 con 0x7f73d41598a0 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 msgr2=0x7f73d40ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73d40ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 >> v2:172.21.15.142:3300/0 conn(0x7f73d41594d0 msgr2=0x7f73d40cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 --2- 172.21.15.55:0/3614668299 >> v2:172.21.15.142:3300/0 conn(0x7f73d41594d0 0x7f73d40cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40cfb90 con 0x7f73d41598a0 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f73c8001470 con 0x7f73d41598a0 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 >> v1:172.21.15.55:6789/0 conn(0x7f73d41598a0 legacy=0x7f73d40ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc003a60 0x7f73bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc004d50 0x7f73bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cf5d0 con 0x7f73bc003a60 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cf8b0 con 0x7f73bc004d50 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc00bae0 con 0x7f73d40cbaa0 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc003a60 0x7f73bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d95c2700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73da5c4700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc004d50 0x7f73bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d9dc3700 1 -- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 msgr2=0x7f73bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d9dc3700 1 -- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc004d50 msgr2=0x7f73bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.298+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc004d50 0x7f73bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73d9dc3700 1 -- 172.21.15.55:0/3614668299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc003570 con 0x7f73bc003a60 2023-10-06T11:16:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73d95c2700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40cbaa0 0x7f73bc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc003a60 0x7f73bc003e70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f73c400e210 tx=0x7f73c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46e7f4fb31a89fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400eac0 con 0x7f73bc003a60 2023-10-06T11:16:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c400f040 con 0x7f73bc003a60 2023-10-06T11:16:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73d8dc1700 1 -- 172.21.15.55:0/3614668299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400ee70 con 0x7f73bc003a60 2023-10-06T11:16:27.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73dc027700 1 -- 172.21.15.55:0/3614668299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc003a60 msgr2=0x7f73bc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73dc027700 1 --2- 172.21.15.55:0/3614668299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73bc003a60 0x7f73bc003e70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f73c400e210 tx=0x7f73c400b040 comp rx=0 tx=0).stop 2023-10-06T11:16:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73da5c4700 1 -- 172.21.15.55:0/3614668299 reap_dead start 2023-10-06T11:16:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73dc027700 1 -- 172.21.15.55:0/3614668299 shutdown_connections 2023-10-06T11:16:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73dc027700 1 -- 172.21.15.55:0/3614668299 >> 172.21.15.55:0/3614668299 conn(0x7f73d4089e50 msgr2=0x7f73d4099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73dc027700 1 -- 172.21.15.55:0/3614668299 shutdown_connections 2023-10-06T11:16:27.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.299+0000 7f73dc027700 1 -- 172.21.15.55:0/3614668299 wait complete. 2023-10-06T11:16:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 Processor -- start 2023-10-06T11:16:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 -- start start 2023-10-06T11:16:27.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc003a60 0x7f73d4159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 0x7f73d40b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40b45e0 0x7f73d40b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d415b810 con 0x7f73d415a480 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4147860 con 0x7f73bc003a60 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.301+0000 7f73dc027700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d415ac90 con 0x7f73d40b45e0 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 0x7f73d40b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 0x7f73d40b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53092/0 (socket says 172.21.15.55:53092) 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 -- 172.21.15.55:0/193712081 learned_addr learned my addr 172.21.15.55:0/193712081 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 -- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40b45e0 msgr2=0x7f73d40b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40b45e0 0x7f73d40b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 -- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc003a60 msgr2=0x7f73d4159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc003a60 0x7f73d4159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 -- 172.21.15.55:0/193712081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d415af70 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d95c2700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 0x7f73d40b40a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f73c8001ed0 tx=0x7f73c80014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800c7b0 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c800c910 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d415b250 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800cc90 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.302+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d40b4f70 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.303+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d4064a90 con 0x7f73d415a480 2023-10-06T11:16:27.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.304+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c8013630 con 0x7f73d415a480 2023-10-06T11:16:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.304+0000 7f73d1ffb700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73c0066f60 0x7f73c0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.304+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f73c8084690 con 0x7f73d415a480 2023-10-06T11:16:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.304+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73c0066f60 0x7f73c0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.305+0000 7f73d9dc3700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73c0066f60 0x7f73c0069410 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f73c40094a0 tx=0x7f73c401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.308+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c80518d0 con 0x7f73d415a480 2023-10-06T11:16:27.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.500+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f73d40cfe70 con 0x7f73d415a480 2023-10-06T11:16:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.508+0000 7f73d1ffb700 1 -- 172.21.15.55:0/193712081 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73c8054ef0 con 0x7f73d415a480 2023-10-06T11:16:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73c0066f60 msgr2=0x7f73c0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73c0066f60 0x7f73c0069410 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f73c40094a0 tx=0x7f73c401a000 comp rx=0 tx=0).stop 2023-10-06T11:16:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 msgr2=0x7f73d40b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 0x7f73d40b40a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f73c8001ed0 tx=0x7f73c80014e0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 shutdown_connections 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f73c0066f60 0x7f73c0069410 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73d40b45e0 0x7f73d40b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73bc003a60 0x7f73d4159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 --2- 172.21.15.55:0/193712081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d415a480 0x7f73d40b40a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 >> 172.21.15.55:0/193712081 conn(0x7f73d4089e50 msgr2=0x7f73d4068370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 shutdown_connections 2023-10-06T11:16:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.510+0000 7f73dc027700 1 -- 172.21.15.55:0/193712081 wait complete. 2023-10-06T11:16:27.524 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:16:27.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:27.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:27.615 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:16:27.615 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:16:27.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.733+0000 7fb28e1b9700 1 Processor -- start 2023-10-06T11:16:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.733+0000 7fb28e1b9700 1 -- start start 2023-10-06T11:16:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28e1b9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2880cd330 0x7fb2880ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28e1b9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2880c6220 0x7fb2880ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28e1b9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880cc800 con 0x7fb288159470 2023-10-06T11:16:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28e1b9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880cbc30 con 0x7fb2880cd330 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28e1b9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880cf400 con 0x7fb2880c6220 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28c9b6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2880cd330 0x7fb2880ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28d1b7700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb288159470 0x7fb2880ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37782/0 (socket says 172.21.15.55:37782) 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28d1b7700 1 -- 172.21.15.55:0/3481732710 learned_addr learned my addr 172.21.15.55:0/3481732710 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3481732710 >> v2:172.21.15.142:3300/0 conn(0x7fb2880c6220 msgr2=0x7fb2880ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28d9b8700 1 --2- 172.21.15.55:0/3481732710 >> v2:172.21.15.142:3300/0 conn(0x7fb2880c6220 0x7fb2880ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28c9b6700 1 --2- 172.21.15.55:0/3481732710 >> v2:172.21.15.142:3300/0 conn(0x7fb2880c6220 0x7fb2880ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb287fff700 1 -- 172.21.15.55:0/3481732710 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238310038 0 0) 0x7fb2880cc800 con 0x7fb288159470 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3481732710 >> v1:172.21.15.55:6789/0 conn(0x7fb288159470 legacy=0x7fb2880ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3481732710 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880cbed0 con 0x7fb2880cd330 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.734+0000 7fb28d9b8700 1 --2- 172.21.15.55:0/3481732710 >> v2:172.21.15.142:3300/0 conn(0x7fb2880c6220 0x7fb2880ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28c9b6700 1 --2- 172.21.15.55:0/3481732710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880ce980 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb2880ca8d0 tx=0x7fb27c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cd1f469a4dcd85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb287fff700 1 -- 172.21.15.55:0/3481732710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c005c10 con 0x7fb2880cd330 2023-10-06T11:16:27.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb287fff700 1 -- 172.21.15.55:0/3481732710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c005d70 con 0x7fb2880cd330 2023-10-06T11:16:27.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb287fff700 1 -- 172.21.15.55:0/3481732710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c006280 con 0x7fb2880cd330 2023-10-06T11:16:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3481732710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 msgr2=0x7fb2880ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3481732710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880ce980 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb2880ca8d0 tx=0x7fb27c009120 comp rx=0 tx=0).stop 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3481732710 shutdown_connections 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3481732710 >> v2:172.21.15.142:3300/0 conn(0x7fb2880c6220 0x7fb2880ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3481732710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880ce980 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3481732710 >> 172.21.15.55:0/3481732710 conn(0x7fb2880995c0 msgr2=0x7fb28806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3481732710 shutdown_connections 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.735+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3481732710 wait complete. 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.736+0000 7fb28e1b9700 1 Processor -- start 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 -- start start 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2880c6220 0x7fb2880c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb288159470 0x7fb288154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c83a0 con 0x7fb2880cd330 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c8680 con 0x7fb288159470 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.737+0000 7fb28e1b9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c8960 con 0x7fb2880c6220 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53112/0 (socket says 172.21.15.55:53112) 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3918894898 learned_addr learned my addr 172.21.15.55:0/3918894898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2880c6220 msgr2=0x7fb2880c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2880c6220 0x7fb2880c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28d9b8700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb288159470 0x7fb288154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb288159470 msgr2=0x7fb288154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb288159470 0x7fb288154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 -- 172.21.15.55:0/3918894898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0093c0 con 0x7fb2880cd330 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28c9b6700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880c9df0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb28806fc20 tx=0x7fb27c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00bc60 con 0x7fb2880cd330 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c00bde0 con 0x7fb2880cd330 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2880c8c40 con 0x7fb2880cd330 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c01b6d0 con 0x7fb2880cd330 2023-10-06T11:16:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.738+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28815a000 con 0x7fb2880cd330 2023-10-06T11:16:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.739+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28815a1f0 con 0x7fb2880cd330 2023-10-06T11:16:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.740+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb27c01ba80 con 0x7fb2880cd330 2023-10-06T11:16:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.740+0000 7fb2857fa700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb274066f30 0x7fb2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.740+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb27c086890 con 0x7fb2880cd330 2023-10-06T11:16:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.740+0000 7fb28d1b7700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb274066f30 0x7fb2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.741+0000 7fb28d1b7700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb274066f30 0x7fb2740693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb280001d40 tx=0x7fb280007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.745+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb27c053b60 con 0x7fb2880cd330 2023-10-06T11:16:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.980+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb28805f230 con 0x7fb2880cd330 2023-10-06T11:16:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.980+0000 7fb2857fa700 1 -- 172.21.15.55:0/3918894898 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fb27c057180 con 0x7fb2880cd330 2023-10-06T11:16:27.982 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:27.982 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1398474372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1398474372},{"type":"v1","addr":"172.21.15.55:6835","nonce":1398474372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6115,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6836/18166346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":18166346},{"type":"v1","addr":"172.21.15.142:6836","nonce":18166346}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1059535836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":1059535836},{"type":"v1","addr":"172.21.15.142:6837","nonce":1059535836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6831,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1625501393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1625501393},{"type":"v1","addr":"172.21.15.55:6834","nonce":1625501393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[]} 2023-10-06T11:16:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.982+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb274066f30 msgr2=0x7fb2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.982+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb274066f30 0x7fb2740693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb280001d40 tx=0x7fb280007dc0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.982+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 msgr2=0x7fb2880c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.982+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880c9df0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb28806fc20 tx=0x7fb27c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 shutdown_connections 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb274066f30 0x7fb2740693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb288159470 0x7fb288154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2880c6220 0x7fb2880c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 --2- 172.21.15.55:0/3918894898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2880cd330 0x7fb2880c9df0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 >> 172.21.15.55:0/3918894898 conn(0x7fb2880995c0 msgr2=0x7fb288069130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 shutdown_connections 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:27.983+0000 7fb28e1b9700 1 -- 172.21.15.55:0/3918894898 wait complete. 2023-10-06T11:16:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 53 2023-10-06T11:16:27.997 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:16:27.997 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:16:27.997 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:16:27.997 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:27.997 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:16:27.997 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:16:27.998 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:16:27.998 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:27.998 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:16:27.998 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:16:27.998 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:16:27.998 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:27.998 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:16:27.999 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:16:27.999 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:16:27.999 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:28.006 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:16:28.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:16:28.007 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:16:28.007 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:16:28.010 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:16:28.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:16:28.011 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:16:28.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:16:28.049 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:16:28.054 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:28.055 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:16:28.055 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:28.056 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:16:28.056 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:28.057 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:16:28.057 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:28.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:16:28.125 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:16:28.125 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:16:28.137 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:16:28.138 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:16:28.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.186+0000 7fe38fc21700 1 Processor -- start 2023-10-06T11:16:28.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.186+0000 7fe38fc21700 1 -- start start 2023-10-06T11:16:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38fc21700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b49a0 0x7fe3880aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38fc21700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3880b0760 0x7fe3880b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38fc21700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3880b0c60 con 0x7fe388159560 2023-10-06T11:16:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38fc21700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3880b0f40 con 0x7fe3880b0760 2023-10-06T11:16:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38fc21700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3880b1220 con 0x7fe3880b49a0 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3880b0760 0x7fe3880b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3880b0760 0x7fe3880b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53144/0 (socket says 172.21.15.55:53144) 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 -- 172.21.15.55:0/1899913849 learned_addr learned my addr 172.21.15.55:0/1899913849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38d1bc700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b49a0 0x7fe3880aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 -- 172.21.15.55:0/1899913849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b49a0 msgr2=0x7fe3880aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b49a0 0x7fe3880aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 -- 172.21.15.55:0/1899913849 >> v1:172.21.15.142:6789/0 conn(0x7fe388159560 legacy=0x7fe3880aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 -- 172.21.15.55:0/1899913849 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880b1500 con 0x7fe3880b0760 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38d1bc700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b49a0 0x7fe3880aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.187+0000 7fe38e1be700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3880b0760 0x7fe3880b1bc0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe3800099b0 tx=0x7fe380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a498fea3e22673 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38c9bb700 1 -- 172.21.15.55:0/1899913849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000b820 con 0x7fe3880b0760 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38c9bb700 1 -- 172.21.15.55:0/1899913849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000b980 con 0x7fe3880b0760 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38c9bb700 1 -- 172.21.15.55:0/1899913849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000bd20 con 0x7fe3880b0760 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 -- 172.21.15.55:0/1899913849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3880b0760 msgr2=0x7fe3880b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3880b0760 0x7fe3880b1bc0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe3800099b0 tx=0x7fe380009250 comp rx=0 tx=0).stop 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 -- 172.21.15.55:0/1899913849 shutdown_connections 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3880b0760 0x7fe3880b1bc0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 --2- 172.21.15.55:0/1899913849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b49a0 0x7fe3880aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 -- 172.21.15.55:0/1899913849 >> 172.21.15.55:0/1899913849 conn(0x7fe3880997f0 msgr2=0x7fe38806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 -- 172.21.15.55:0/1899913849 shutdown_connections 2023-10-06T11:16:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.188+0000 7fe38fc21700 1 -- 172.21.15.55:0/1899913849 wait complete. 2023-10-06T11:16:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.189+0000 7fe38fc21700 1 Processor -- start 2023-10-06T11:16:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.189+0000 7fe38fc21700 1 -- start start 2023-10-06T11:16:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38fc21700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b0760 0x7fe38815c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38fc21700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3880b49a0 0x7fe38816ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38fc21700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 0x7fe38816cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38fc21700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38815aeb0 con 0x7fe388159560 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38fc21700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38815b190 con 0x7fe3880b49a0 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38fc21700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38809a050 con 0x7fe3880b0760 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38e1be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 0x7fe38816cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38e1be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 0x7fe38816cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53146/0 (socket says 172.21.15.55:53146) 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38e1be700 1 -- 172.21.15.55:0/940546725 learned_addr learned my addr 172.21.15.55:0/940546725 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38d9bd700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b0760 0x7fe38815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.190+0000 7fe38d1bc700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3880b49a0 0x7fe38816ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38e1be700 1 -- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b0760 msgr2=0x7fe38815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38e1be700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b0760 0x7fe38815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38e1be700 1 -- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3880b49a0 msgr2=0x7fe38816ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38e1be700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3880b49a0 0x7fe38816ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38e1be700 1 -- 172.21.15.55:0/940546725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800094f0 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38e1be700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 0x7fe38816cf60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe3800030c0 tx=0x7fe380016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011ea0 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380020070 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38809a330 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38001b6a0 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.191+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38815c570 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.192+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38815aff0 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.192+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe380022030 con 0x7fe388159560 2023-10-06T11:16:28.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.193+0000 7fe37dffb700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe36c066f30 0x7fe36c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.193+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe3800864a0 con 0x7fe388159560 2023-10-06T11:16:28.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.193+0000 7fe38d9bd700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe36c066f30 0x7fe36c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.194+0000 7fe38d9bd700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe36c066f30 0x7fe36c0693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe384007560 tx=0x7fe384009760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.197+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe38815aff0 con 0x7fe388159560 2023-10-06T11:16:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:28.406+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe38815aff0 con 0x7fe388159560 2023-10-06T11:16:29.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.180+0000 7fe37dffb700 1 -- 172.21.15.55:0/940546725 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe38815aff0 con 0x7fe388159560 2023-10-06T11:16:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe36c066f30 msgr2=0x7fe36c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe36c066f30 0x7fe36c0693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe384007560 tx=0x7fe384009760 comp rx=0 tx=0).stop 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 msgr2=0x7fe38816cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 0x7fe38816cf60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe3800030c0 tx=0x7fe380016000 comp rx=0 tx=0).stop 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 shutdown_connections 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe36c066f30 0x7fe36c0693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe388159560 0x7fe38816cf60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3880b0760 0x7fe38815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 --2- 172.21.15.55:0/940546725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3880b49a0 0x7fe38816ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 >> 172.21.15.55:0/940546725 conn(0x7fe3880997f0 msgr2=0x7fe3880683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 shutdown_connections 2023-10-06T11:16:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.183+0000 7fe38fc21700 1 -- 172.21.15.55:0/940546725 wait complete. 2023-10-06T11:16:29.186 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-10-06T11:16:29.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:16:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 Processor -- start 2023-10-06T11:16:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 -- start start 2023-10-06T11:16:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f169815cab0 0x7f169806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16980caa90 0x7f16980cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980675b0 0x7f16980679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169806ecd0 con 0x7f169815cab0 2023-10-06T11:16:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1698067ee0 con 0x7f16980caa90 2023-10-06T11:16:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.324+0000 7f169ebb9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980cb870 con 0x7f16980675b0 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f169815cab0 0x7f169806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f169815cab0 0x7f169806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53160/0 (socket says 172.21.15.55:53160) 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 -- 172.21.15.55:0/1891433924 learned_addr learned my addr 172.21.15.55:0/1891433924 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169d156700 1 --2- 172.21.15.55:0/1891433924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980675b0 0x7f16980679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f1697fff700 1 --2- 172.21.15.55:0/1891433924 >> v2:172.21.15.142:3300/0 conn(0x7f16980caa90 0x7f16980cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 -- 172.21.15.55:0/1891433924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980675b0 msgr2=0x7f16980679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 --2- 172.21.15.55:0/1891433924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980675b0 0x7f16980679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 -- 172.21.15.55:0/1891433924 >> v2:172.21.15.142:3300/0 conn(0x7f16980caa90 msgr2=0x7f16980cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 --2- 172.21.15.55:0/1891433924 >> v2:172.21.15.142:3300/0 conn(0x7f16980caa90 0x7f16980cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 -- 172.21.15.55:0/1891433924 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980cbb50 con 0x7f169815cab0 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f169c955700 1 --2- 172.21.15.55:0/1891433924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169806f160 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f169806b900 tx=0x7f1688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757e356c0bd375fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f16977fe700 1 -- 172.21.15.55:0/1891433924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800b640 con 0x7f169815cab0 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f16977fe700 1 -- 172.21.15.55:0/1891433924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168800b7a0 con 0x7f169815cab0 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.325+0000 7f16977fe700 1 -- 172.21.15.55:0/1891433924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800bb60 con 0x7f169815cab0 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 -- 172.21.15.55:0/1891433924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 msgr2=0x7f169806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 --2- 172.21.15.55:0/1891433924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169806f160 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f169806b900 tx=0x7f1688009250 comp rx=0 tx=0).stop 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 -- 172.21.15.55:0/1891433924 shutdown_connections 2023-10-06T11:16:29.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 --2- 172.21.15.55:0/1891433924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980675b0 0x7f16980679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 --2- 172.21.15.55:0/1891433924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169806f160 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 --2- 172.21.15.55:0/1891433924 >> v2:172.21.15.142:3300/0 conn(0x7f16980caa90 0x7f16980cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 -- 172.21.15.55:0/1891433924 >> 172.21.15.55:0/1891433924 conn(0x7f16980cdeb0 msgr2=0x7f16980c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 -- 172.21.15.55:0/1891433924 shutdown_connections 2023-10-06T11:16:29.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.326+0000 7f169ebb9700 1 -- 172.21.15.55:0/1891433924 wait complete. 2023-10-06T11:16:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.327+0000 7f169ebb9700 1 Processor -- start 2023-10-06T11:16:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.327+0000 7f169ebb9700 1 -- start start 2023-10-06T11:16:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169ebb9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16980675b0 0x7f169814aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169ebb9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980caa90 0x7f16981594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169ebb9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169ebb9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169815ab10 con 0x7f169815cab0 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169ebb9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1698159f00 con 0x7f16980675b0 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169ebb9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169815a1e0 con 0x7f16980caa90 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53166/0 (socket says 172.21.15.55:53166) 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 -- 172.21.15.55:0/45105875 learned_addr learned my addr 172.21.15.55:0/45105875 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f1697fff700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980caa90 0x7f16981594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169c955700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16980675b0 0x7f169814aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 -- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980caa90 msgr2=0x7f16981594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980caa90 0x7f16981594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 -- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16980675b0 msgr2=0x7f169814aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16980675b0 0x7f169814aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 -- 172.21.15.55:0/45105875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880094f0 con 0x7f169815cab0 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f1697fff700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980caa90 0x7f16981594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.328+0000 7f169d156700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169815afa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1690009e90 tx=0x7f169000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.329+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000cc20 con 0x7f169815cab0 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.329+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000f040 con 0x7f169815cab0 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.329+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169815a4c0 con 0x7f169815cab0 2023-10-06T11:16:29.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.329+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690014480 con 0x7f169815cab0 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.329+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16980af430 con 0x7f169815cab0 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.329+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169815acc0 con 0x7f169815cab0 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.330+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1690014830 con 0x7f169815cab0 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.330+0000 7f1694ff9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1684066f30 0x7f16840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.330+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1690085130 con 0x7f169815cab0 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.331+0000 7f169c955700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1684066f30 0x7f16840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.331+0000 7f169c955700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1684066f30 0x7f16840693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f169806b900 tx=0x7f1688017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.335+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f169815acc0 con 0x7f169815cab0 2023-10-06T11:16:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.607+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1698064a90 con 0x7f169815cab0 2023-10-06T11:16:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.608+0000 7f1694ff9700 1 -- 172.21.15.55:0/45105875 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1690055ee0 con 0x7f169815cab0 2023-10-06T11:16:29.609 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9l/1ZlKhAAPZmgL3ZXgYVku1Q+5TxLMQ==", 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.610 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9ljyzoNRAAmrQTdfoalYsxvTloRcH8dg==", 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.611 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lR6BiMRAAoLFlQY7rEntfRQQiQpTC/Q==", 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-10-06T11:16:29.612 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lDiUeARAAJ/QmtC2CiCbV4r9MZqPDag==", 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCR6x9lXSrtIBAAt6IKi44Luuq/cg7UnSg2Hw==", 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.613 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCU6x9lRmX7IBAA7lSyPcqkmXqhslVYcHJnLw==", 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.614 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCX6x9lwfxKHxAAz5HNj97Egk2lcAhKJAYPFA==", 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.615 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCa6x9lhD+vHhAAnZkUNFALZJ+9obduG2VWIA==", 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.616 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCg6x9lmF0iHxAAeo7QBUUmi2XmoNaHzUU4uQ==", 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCj6x9lCQF8HBAALahhMjR1gb3PtafdrsOXug==", 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCm6x9lNgYtGhAAkShLK6u9G812C9BD3db8Lw==", 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.618 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCp6x9loOmqGhAA16xw+8tdqz3qg4mjoW3aTg==", 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.619 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lFRETBRAAR145KOo3NsLHHHGsuzVU+w==", 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:16:29.620 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lcC+fDRAAVilZep1i/2cNeYZWylsvbg==", 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.621 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9lvmKRChAArlg7ES2gu4Fh3Gz1IqPJeQ==", 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-10-06T11:16:29.622 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCL6x9l4FP1EhAAbcC0/HbBou0F6tE9oQh5OA==", 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9loAeQDxAAHRWvLBSoBR/HeRdtrvbGCw==", 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lPpZIJxAAMyvQnJu2Jf8owSjpm9S1sA==", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:16:29.624 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQCK6x9lrEnwIxAA9qrR8twsVrfLPsf+1zoh/g==", 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-10-06T11:16:29.625 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-10-06T11:16:29.626 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.626 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:29.626 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:16:29.626 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:16:29.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1684066f30 msgr2=0x7f16840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1684066f30 0x7f16840693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f169806b900 tx=0x7f1688017000 comp rx=0 tx=0).stop 2023-10-06T11:16:29.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 msgr2=0x7f169815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169815afa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1690009e90 tx=0x7f169000b040 comp rx=0 tx=0).stop 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 shutdown_connections 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1684066f30 0x7f16840693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169815cab0 0x7f169815afa0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16980675b0 0x7f169814aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 --2- 172.21.15.55:0/45105875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16980caa90 0x7f16981594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 >> 172.21.15.55:0/45105875 conn(0x7f16980cdeb0 msgr2=0x7f16980a98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 shutdown_connections 2023-10-06T11:16:29.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.610+0000 7f169ebb9700 1 -- 172.21.15.55:0/45105875 wait complete. 2023-10-06T11:16:29.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:29.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.745+0000 7ff848811700 1 Processor -- start 2023-10-06T11:16:29.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.745+0000 7ff848811700 1 -- start start 2023-10-06T11:16:29.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff848811700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 0x7ff8440691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff848811700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff84415a1e0 0x7ff8440ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff848811700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff844068d10 con 0x7ff8440696e0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff848811700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff844154020 con 0x7ff84415a1e0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff848811700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84415a670 con 0x7ff8440cb5f0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff841d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8440696e0 0x7ff844159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37796/0 (socket says 172.21.15.55:37796) 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.746+0000 7ff841d9b700 1 -- 172.21.15.55:0/2537882653 learned_addr learned my addr 172.21.15.55:0/2537882653 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff842d9d700 1 --2- 172.21.15.55:0/2537882653 >> v2:172.21.15.142:3300/0 conn(0x7ff84415a1e0 0x7ff8440ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84259c700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 0x7ff8440691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442183547 0 0) 0x7ff844068d10 con 0x7ff8440696e0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff830003570 con 0x7ff8440696e0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915297121 0 0) 0x7ff830003570 con 0x7ff8440696e0 2023-10-06T11:16:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 msgr2=0x7ff8440691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 0x7ff8440691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 >> v2:172.21.15.142:3300/0 conn(0x7ff84415a1e0 msgr2=0x7ff8440ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 --2- 172.21.15.55:0/2537882653 >> v2:172.21.15.142:3300/0 conn(0x7ff84415a1e0 0x7ff8440ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84415a950 con 0x7ff8440696e0 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff842d9d700 1 --2- 172.21.15.55:0/2537882653 >> v2:172.21.15.142:3300/0 conn(0x7ff84415a1e0 0x7ff8440ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7ff82c001470 con 0x7ff8440696e0 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 >> v1:172.21.15.55:6789/0 conn(0x7ff8440696e0 legacy=0x7ff844159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 0x7ff830003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff830003fe0 0x7ff830004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844154020 con 0x7ff830004d50 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84415a670 con 0x7ff830003fe0 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83000ba90 con 0x7ff8440cb5f0 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff842d9d700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff84259c700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 0x7ff830003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.747+0000 7ff841d9b700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff830003fe0 0x7ff830004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 -- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 msgr2=0x7ff830003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8440cb5f0 0x7ff830003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 -- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff830003fe0 msgr2=0x7ff830004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff830003fe0 0x7ff830004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 -- 172.21.15.55:0/2537882653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830003570 con 0x7ff830004d50 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e3c0 tx=0x7ff83c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71c8282650a406c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00ec10 con 0x7ff830004d50 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00f040 con 0x7ff830004d50 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff84159a700 1 -- 172.21.15.55:0/2537882653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c014480 con 0x7ff830004d50 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff848811700 1 -- 172.21.15.55:0/2537882653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff830004d50 msgr2=0x7ff8300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff848811700 1 --2- 172.21.15.55:0/2537882653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff830004d50 0x7ff8300051c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e3c0 tx=0x7ff83c00b040 comp rx=0 tx=0).stop 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff842d9d700 1 -- 172.21.15.55:0/2537882653 reap_dead start 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff848811700 1 -- 172.21.15.55:0/2537882653 shutdown_connections 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff848811700 1 -- 172.21.15.55:0/2537882653 >> 172.21.15.55:0/2537882653 conn(0x7ff8440707d0 msgr2=0x7ff844070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.748+0000 7ff848811700 1 -- 172.21.15.55:0/2537882653 shutdown_connections 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.749+0000 7ff848811700 1 -- 172.21.15.55:0/2537882653 wait complete. 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 Processor -- start 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 -- start start 2023-10-06T11:16:29.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff830004d50 0x7ff8441588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 0x7ff8440c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff844169a90 0x7ff844169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84416a470 con 0x7ff8440c26c0 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c2bc0 con 0x7ff844169a90 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff848811700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c2ea0 con 0x7ff830004d50 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff841d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 0x7ff8440c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff841d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 0x7ff8440c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53192/0 (socket says 172.21.15.55:53192) 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.750+0000 7ff841d9b700 1 -- 172.21.15.55:0/2533212044 learned_addr learned my addr 172.21.15.55:0/2533212044 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff841d9b700 1 -- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff830004d50 msgr2=0x7ff8441588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff841d9b700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff830004d50 0x7ff8441588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff841d9b700 1 -- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff844169a90 msgr2=0x7ff844169f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff841d9b700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff844169a90 0x7ff844169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff841d9b700 1 -- 172.21.15.55:0/2533212044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440c3180 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff841d9b700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 0x7ff8440c7d30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff82c001d20 tx=0x7ff82c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c018030 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c001430 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00faf0 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8440c3460 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.751+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8440c5490 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.752+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff844064a90 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.752+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff82c01b070 con 0x7ff8440c26c0 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.753+0000 7ff83a7fc700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff824066f30 0x7ff8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.753+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff82c019070 con 0x7ff8440c26c0 2023-10-06T11:16:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.753+0000 7ff84259c700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff824066f30 0x7ff8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.754+0000 7ff84259c700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff824066f30 0x7ff8240693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff834006eb0 tx=0x7ff8340091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.757+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff82c051740 con 0x7ff8440c26c0 2023-10-06T11:16:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.951+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8440c1a90 con 0x7ff8440c26c0 2023-10-06T11:16:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.952+0000 7ff83a7fc700 1 -- 172.21.15.55:0/2533212044 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+13856 (secure 0 0 0) 0x7ff82c054d60 con 0x7ff8440c26c0 2023-10-06T11:16:29.954 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:29.954 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:29.177276+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff824066f30 msgr2=0x7ff8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff824066f30 0x7ff8240693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff834006eb0 tx=0x7ff8340091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 msgr2=0x7ff8440c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 0x7ff8440c7d30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff82c001d20 tx=0x7ff82c001e90 comp rx=0 tx=0).stop 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 shutdown_connections 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff824066f30 0x7ff8240693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff844169a90 0x7ff844169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff830004d50 0x7ff8441588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 --2- 172.21.15.55:0/2533212044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8440c26c0 0x7ff8440c7d30 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 >> 172.21.15.55:0/2533212044 conn(0x7ff8440707d0 msgr2=0x7ff8440ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 shutdown_connections 2023-10-06T11:16:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:29.954+0000 7ff848811700 1 -- 172.21.15.55:0/2533212044 wait complete. 2023-10-06T11:16:29.968 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T11:16:29.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:16:30.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.088+0000 7f3ae5691700 1 Processor -- start 2023-10-06T11:16:30.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.088+0000 7f3ae5691700 1 -- start start 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae5691700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ae00cb060 0x7f3ae0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae5691700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ae015a080 0x7f3ae00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae5691700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00ca5b0 con 0x7f3ae013c430 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae5691700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae015a8e0 con 0x7f3ae015a080 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae5691700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae006d500 con 0x7f3ae00cb060 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ae015a080 0x7f3ae00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ae015a080 0x7f3ae00c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53194/0 (socket says 172.21.15.55:53194) 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 -- 172.21.15.55:0/26499151 learned_addr learned my addr 172.21.15.55:0/26499151 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3adf7fe700 1 --2- 172.21.15.55:0/26499151 >> v2:172.21.15.142:3300/0 conn(0x7f3ae00cb060 0x7f3ae0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 -- 172.21.15.55:0/26499151 >> v2:172.21.15.142:3300/0 conn(0x7f3ae00cb060 msgr2=0x7f3ae0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 --2- 172.21.15.55:0/26499151 >> v2:172.21.15.142:3300/0 conn(0x7f3ae00cb060 0x7f3ae0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 -- 172.21.15.55:0/26499151 >> v1:172.21.15.142:6789/0 conn(0x7f3ae013c430 legacy=0x7f3ae00ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.089+0000 7f3ae4e90700 1 -- 172.21.15.55:0/26499151 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae013c800 con 0x7f3ae015a080 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae4e90700 1 --2- 172.21.15.55:0/26499151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae00c86f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00c5010 tx=0x7f3ad8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a37a65a0e3952c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3adeffd700 1 -- 172.21.15.55:0/26499151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800e070 con 0x7f3ae015a080 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3adeffd700 1 -- 172.21.15.55:0/26499151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800ba20 con 0x7f3ae015a080 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3adeffd700 1 -- 172.21.15.55:0/26499151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80092e0 con 0x7f3ae015a080 2023-10-06T11:16:30.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 -- 172.21.15.55:0/26499151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 msgr2=0x7f3ae00c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 --2- 172.21.15.55:0/26499151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae00c86f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00c5010 tx=0x7f3ad8009840 comp rx=0 tx=0).stop 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 -- 172.21.15.55:0/26499151 shutdown_connections 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 --2- 172.21.15.55:0/26499151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae00c86f0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 --2- 172.21.15.55:0/26499151 >> v2:172.21.15.142:3300/0 conn(0x7f3ae00cb060 0x7f3ae0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 -- 172.21.15.55:0/26499151 >> 172.21.15.55:0/26499151 conn(0x7f3ae006b330 msgr2=0x7f3ae006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 -- 172.21.15.55:0/26499151 shutdown_connections 2023-10-06T11:16:30.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.090+0000 7f3ae5691700 1 -- 172.21.15.55:0/26499151 wait complete. 2023-10-06T11:16:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.091+0000 7f3ae5691700 1 Processor -- start 2023-10-06T11:16:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 -- start start 2023-10-06T11:16:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ae00cb060 0x7f3ae015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae013c430 0x7f3ae01696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae013f130 con 0x7f3ae015a080 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae013f9f0 con 0x7f3ae013c430 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae5691700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae015abe0 con 0x7f3ae00cb060 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae4e90700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae4e90700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae013ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53208/0 (socket says 172.21.15.55:53208) 2023-10-06T11:16:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.092+0000 7f3ae4e90700 1 -- 172.21.15.55:0/2186222533 learned_addr learned my addr 172.21.15.55:0/2186222533 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3adf7fe700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae013c430 0x7f3ae01696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae4e90700 1 -- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ae00cb060 msgr2=0x7f3ae015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3adffff700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ae00cb060 0x7f3ae015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae4e90700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ae00cb060 0x7f3ae015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae4e90700 1 -- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae013c430 msgr2=0x7f3ae01696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae4e90700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae013c430 0x7f3ae01696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae4e90700 1 -- 172.21.15.55:0/2186222533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8009ae0 con 0x7f3ae015a080 2023-10-06T11:16:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3adf7fe700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae013c430 0x7f3ae01696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3adffff700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ae00cb060 0x7f3ae015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae4e90700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae013ea30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009880 tx=0x7f3ad8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8008be0 con 0x7f3ae015a080 2023-10-06T11:16:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8008d40 con 0x7f3ae015a080 2023-10-06T11:16:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80256b0 con 0x7f3ae015a080 2023-10-06T11:16:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae013f430 con 0x7f3ae015a080 2023-10-06T11:16:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.093+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae016c570 con 0x7f3ae015a080 2023-10-06T11:16:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.094+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae005f230 con 0x7f3ae015a080 2023-10-06T11:16:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.094+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ad8003040 con 0x7f3ae015a080 2023-10-06T11:16:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.095+0000 7f3ac7fff700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.095+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3ad8086110 con 0x7f3ae015a080 2023-10-06T11:16:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.095+0000 7f3adffff700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.096+0000 7f3adffff700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3acc066f30 0x7f3acc0693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0001840 tx=0x7f3ad0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.099+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ad8053440 con 0x7f3ae015a080 2023-10-06T11:16:30.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.295+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ae006cbd0 con 0x7f3ae015a080 2023-10-06T11:16:30.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.295+0000 7f3ac7fff700 1 -- 172.21.15.55:0/2186222533 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ad8056a60 con 0x7f3ae015a080 2023-10-06T11:16:30.297 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:16:30.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.297+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3acc066f30 msgr2=0x7f3acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.297+0000 7f3ae5691700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3acc066f30 0x7f3acc0693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0001840 tx=0x7f3ad0009040 comp rx=0 tx=0).stop 2023-10-06T11:16:30.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 msgr2=0x7f3ae013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae013ea30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009880 tx=0x7f3ad8018000 comp rx=0 tx=0).stop 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 shutdown_connections 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ae015a080 0x7f3ae013ea30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ae00cb060 0x7f3ae015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 --2- 172.21.15.55:0/2186222533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae013c430 0x7f3ae01696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 >> 172.21.15.55:0/2186222533 conn(0x7f3ae006b330 msgr2=0x7f3ae00c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 shutdown_connections 2023-10-06T11:16:30.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.298+0000 7f3ae5691700 1 -- 172.21.15.55:0/2186222533 wait complete. 2023-10-06T11:16:30.311 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:16:30.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.432+0000 7ff2f17ee700 1 Processor -- start 2023-10-06T11:16:30.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.432+0000 7ff2f17ee700 1 -- start start 2023-10-06T11:16:30.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.432+0000 7ff2f17ee700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2ec0cf090 0x7ff2ec0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.432+0000 7ff2f17ee700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec0cbb80 con 0x7ff2ec159840 2023-10-06T11:16:30.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.432+0000 7ff2f17ee700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec0c6f00 con 0x7ff2ec159470 2023-10-06T11:16:30.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.432+0000 7ff2f17ee700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0cb530 con 0x7ff2ec0cf090 2023-10-06T11:16:30.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2ea7fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff2ec159840 0x7ff2ec0c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37806/0 (socket says 172.21.15.55:37806) 2023-10-06T11:16:30.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2ea7fc700 1 -- 172.21.15.55:0/4006552973 learned_addr learned my addr 172.21.15.55:0/4006552973 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2eb7fe700 1 --2- 172.21.15.55:0/4006552973 >> v2:172.21.15.142:3300/0 conn(0x7ff2ec0cf090 0x7ff2ec0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2e9ffb700 1 -- 172.21.15.55:0/4006552973 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232430601 0 0) 0x7ff2ec0cbb80 con 0x7ff2ec159840 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2e9ffb700 1 -- 172.21.15.55:0/4006552973 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d8003570 con 0x7ff2ec159840 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2eb7fe700 1 -- 172.21.15.55:0/4006552973 >> v1:172.21.15.142:6789/0 conn(0x7ff2ec159470 legacy=0x7ff2ec0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2e9ffb700 1 -- 172.21.15.55:0/4006552973 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239721582 0 0) 0x7ff2ec0c6f00 con 0x7ff2ec159470 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2eb7fe700 1 -- 172.21.15.55:0/4006552973 >> v1:172.21.15.55:6789/0 conn(0x7ff2ec159840 legacy=0x7ff2ec0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2eb7fe700 1 -- 172.21.15.55:0/4006552973 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0cb810 con 0x7ff2ec0cf090 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2eb7fe700 1 --2- 172.21.15.55:0/4006552973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec0c6880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009e60 tx=0x7ff2dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba562b03f525ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.433+0000 7ff2e9ffb700 1 -- 172.21.15.55:0/4006552973 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00e070 con 0x7ff2ec0cf090 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2e9ffb700 1 -- 172.21.15.55:0/4006552973 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00b850 con 0x7ff2ec0cf090 2023-10-06T11:16:30.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2e9ffb700 1 -- 172.21.15.55:0/4006552973 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4001470 con 0x7ff2ec0cf090 2023-10-06T11:16:30.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 -- 172.21.15.55:0/4006552973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec0cf090 msgr2=0x7ff2ec0c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/4006552973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec0c6880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009e60 tx=0x7ff2dc009780 comp rx=0 tx=0).stop 2023-10-06T11:16:30.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 -- 172.21.15.55:0/4006552973 shutdown_connections 2023-10-06T11:16:30.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/4006552973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec0c6880 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 -- 172.21.15.55:0/4006552973 >> 172.21.15.55:0/4006552973 conn(0x7ff2ec0996e0 msgr2=0x7ff2ec06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 -- 172.21.15.55:0/4006552973 shutdown_connections 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.434+0000 7ff2f17ee700 1 -- 172.21.15.55:0/4006552973 wait complete. 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.435+0000 7ff2f17ee700 1 Processor -- start 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.435+0000 7ff2f17ee700 1 -- start start 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2f17ee700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2f17ee700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec159470 0x7ff2ec09cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2f17ee700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2ec159840 0x7ff2ec0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2f17ee700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1454d0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2f17ee700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec09e090 con 0x7ff2ec159470 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2f17ee700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec09a7f0 con 0x7ff2ec159840 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec144f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53216/0 (socket says 172.21.15.55:53216) 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2eaffd700 1 -- 172.21.15.55:0/3840382160 learned_addr learned my addr 172.21.15.55:0/3840382160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2eb7fe700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2ec159840 0x7ff2ec0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.436+0000 7ff2ea7fc700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec159470 0x7ff2ec09cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2eaffd700 1 -- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2ec159840 msgr2=0x7ff2ec0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2eaffd700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2ec159840 0x7ff2ec0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2eaffd700 1 -- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec159470 msgr2=0x7ff2ec09cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2eaffd700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec159470 0x7ff2ec09cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2eaffd700 1 -- 172.21.15.55:0/3840382160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009a20 con 0x7ff2ec0cf090 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2eaffd700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec144f90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c630 tx=0x7ff2e4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4011590 con 0x7ff2ec0cf090 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40116f0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec09d1c0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4011ab0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.437+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec09d760 con 0x7ff2ec0cf090 2023-10-06T11:16:30.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.438+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec064a90 con 0x7ff2ec0cf090 2023-10-06T11:16:30.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.438+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2e401b3b0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.439+0000 7ff2e2ffd700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff2cc066f30 0x7ff2cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.439+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5526+0+0 (secure 0 0 0) 0x7ff2e40839b0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.439+0000 7ff2ea7fc700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff2cc066f30 0x7ff2cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.439+0000 7ff2ea7fc700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff2cc066f30 0x7ff2cc0693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0b5b50 tx=0x7ff2d4000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.443+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2e4050cd0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.634+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2ec0cb1e0 con 0x7ff2ec0cf090 2023-10-06T11:16:30.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.635+0000 7ff2e2ffd700 1 -- 172.21.15.55:0/3840382160 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2e4017070 con 0x7ff2ec0cf090 2023-10-06T11:16:30.637 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:16:30.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff2cc066f30 msgr2=0x7ff2cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff2cc066f30 0x7ff2cc0693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0b5b50 tx=0x7ff2d4000bc0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 msgr2=0x7ff2ec144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec144f90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c630 tx=0x7ff2e4007d90 comp rx=0 tx=0).stop 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 shutdown_connections 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff2cc066f30 0x7ff2cc0693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2ec0cf090 0x7ff2ec144f90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2ec159840 0x7ff2ec0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 --2- 172.21.15.55:0/3840382160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2ec159470 0x7ff2ec09cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 >> 172.21.15.55:0/3840382160 conn(0x7ff2ec0996e0 msgr2=0x7ff2ec0ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 shutdown_connections 2023-10-06T11:16:30.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.636+0000 7ff2f17ee700 1 -- 172.21.15.55:0/3840382160 wait complete. 2023-10-06T11:16:30.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:16:30.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.769+0000 7f6e1759e700 1 Processor -- start 2023-10-06T11:16:30.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.769+0000 7f6e1759e700 1 -- start start 2023-10-06T11:16:30.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1759e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e180b2810 0x7f6e180cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1759e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180cb7a0 con 0x7f6e18159440 2023-10-06T11:16:30.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180b0860 con 0x7f6e180cbc30 2023-10-06T11:16:30.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1759e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e180cb150 con 0x7f6e180b2810 2023-10-06T11:16:30.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e16d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e180b2810 0x7f6e180cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1659c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6e18159440 0x7f6e180b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37820/0 (socket says 172.21.15.55:37820) 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1659c700 1 -- 172.21.15.55:0/1131581730 learned_addr learned my addr 172.21.15.55:0/1131581730 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e16d9d700 1 -- 172.21.15.55:0/1131581730 >> v1:172.21.15.142:6789/0 conn(0x7f6e180cbc30 legacy=0x7f6e180b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e16d9d700 1 -- 172.21.15.55:0/1131581730 >> v1:172.21.15.55:6789/0 conn(0x7f6e18159440 legacy=0x7f6e180b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e16d9d700 1 -- 172.21.15.55:0/1131581730 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180cb430 con 0x7f6e180b2810 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.770+0000 7f6e1559a700 1 -- 172.21.15.55:0/1131581730 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546400892 0 0) 0x7f6e180cb7a0 con 0x7f6e18159440 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e16d9d700 1 --2- 172.21.15.55:0/1131581730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e180b2810 0x7f6e180cc080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6e100098e0 tx=0x7f6e100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131b74e392c08983 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1559a700 1 -- 172.21.15.55:0/1131581730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10009e80 con 0x7f6e180b2810 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1559a700 1 -- 172.21.15.55:0/1131581730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000b860 con 0x7f6e180b2810 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1559a700 1 -- 172.21.15.55:0/1131581730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000bbe0 con 0x7f6e180b2810 2023-10-06T11:16:30.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1759e700 1 -- 172.21.15.55:0/1131581730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e180b2810 msgr2=0x7f6e180cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1759e700 1 --2- 172.21.15.55:0/1131581730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e180b2810 0x7f6e180cc080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6e100098e0 tx=0x7f6e100091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1759e700 1 -- 172.21.15.55:0/1131581730 shutdown_connections 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1759e700 1 --2- 172.21.15.55:0/1131581730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e180b2810 0x7f6e180cc080 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1759e700 1 -- 172.21.15.55:0/1131581730 >> 172.21.15.55:0/1131581730 conn(0x7f6e1806ece0 msgr2=0x7f6e1806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.771+0000 7f6e1759e700 1 -- 172.21.15.55:0/1131581730 shutdown_connections 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.772+0000 7f6e1759e700 1 -- 172.21.15.55:0/1131581730 wait complete. 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 Processor -- start 2023-10-06T11:16:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 -- start start 2023-10-06T11:16:30.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e180b2810 0x7f6e18154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e180cbc30 0x7f6e1815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 0x7f6e18157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180cddf0 con 0x7f6e18159440 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180ce620 con 0x7f6e180cbc30 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e1759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1815c950 con 0x7f6e180b2810 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e16d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 0x7f6e18157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e16d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 0x7f6e18157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53230/0 (socket says 172.21.15.55:53230) 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.773+0000 7f6e16d9d700 1 -- 172.21.15.55:0/2427966231 learned_addr learned my addr 172.21.15.55:0/2427966231 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e1659c700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e180b2810 0x7f6e18154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e16d9d700 1 -- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e180b2810 msgr2=0x7f6e18154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e16d9d700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e180b2810 0x7f6e18154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e15d9b700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e180cbc30 0x7f6e1815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e16d9d700 1 -- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e180cbc30 msgr2=0x7f6e1815bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e16d9d700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e180cbc30 0x7f6e1815bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e16d9d700 1 -- 172.21.15.55:0/2427966231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10009420 con 0x7f6e18159440 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e15d9b700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e180cbc30 0x7f6e1815bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e16d9d700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 0x7f6e18157be0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6e18069150 tx=0x7f6e10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1001b680 con 0x7f6e18159440 2023-10-06T11:16:30.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1001b7e0 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e180cdfd0 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1001bba0 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.774+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1815b1d0 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.775+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e180ce7b0 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.776+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e1001c450 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.776+0000 7f6e0e7fc700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6df8066f30 0x7f6df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.776+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6e100863a0 con 0x7f6e18159440 2023-10-06T11:16:30.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.776+0000 7f6e1659c700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6df8066f30 0x7f6df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:30.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.777+0000 7f6e1659c700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6df8066f30 0x7f6df80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6e08002180 tx=0x7f6e08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:30.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.780+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e100536c0 con 0x7f6e18159440 2023-10-06T11:16:30.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.976+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6e1805f230 con 0x7f6e18159440 2023-10-06T11:16:30.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.976+0000 7f6e0e7fc700 1 -- 172.21.15.55:0/2427966231 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6e10056ce0 con 0x7f6e18159440 2023-10-06T11:16:30.978 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:30.978 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-10-06T11:16:30.979 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-10-06T11:16:30.980 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:30.980 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-10-06T11:16:30.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.978+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6df8066f30 msgr2=0x7f6df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.978+0000 7f6e1759e700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6df8066f30 0x7f6df80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6e08002180 tx=0x7f6e08009040 comp rx=0 tx=0).stop 2023-10-06T11:16:30.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.978+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 msgr2=0x7f6e18157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:30.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.978+0000 7f6e1759e700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 0x7f6e18157be0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6e18069150 tx=0x7f6e10016000 comp rx=0 tx=0).stop 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 shutdown_connections 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6df8066f30 0x7f6df80693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e18159440 0x7f6e18157be0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e180b2810 0x7f6e18154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 --2- 172.21.15.55:0/2427966231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e180cbc30 0x7f6e1815bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 >> 172.21.15.55:0/2427966231 conn(0x7f6e1806ece0 msgr2=0x7f6e18155270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:30.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 shutdown_connections 2023-10-06T11:16:30.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:30.979+0000 7f6e1759e700 1 -- 172.21.15.55:0/2427966231 wait complete. 2023-10-06T11:16:30.992 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:16:30.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:16:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.117+0000 7f4d59d2f700 1 Processor -- start 2023-10-06T11:16:31.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.117+0000 7f4d59d2f700 1 -- start start 2023-10-06T11:16:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d59d2f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d54153950 0x7f4d5415c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d59d2f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5415ad30 0x7f4d5415b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d59d2f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415c400 con 0x7f4d54153d20 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d59d2f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d54158200 con 0x7f4d54153950 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d59d2f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415b7f0 con 0x7f4d5415ad30 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d537fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d54153950 0x7f4d5415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d52ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d54153d20 0x7f4d541577a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37830/0 (socket says 172.21.15.55:37830) 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d52ffd700 1 -- 172.21.15.55:0/3982075809 learned_addr learned my addr 172.21.15.55:0/3982075809 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.118+0000 7f4d53fff700 1 --2- 172.21.15.55:0/3982075809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5415ad30 0x7f4d5415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d537fe700 1 -- 172.21.15.55:0/3982075809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5415ad30 msgr2=0x7f4d5415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d537fe700 1 --2- 172.21.15.55:0/3982075809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5415ad30 0x7f4d5415b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d537fe700 1 -- 172.21.15.55:0/3982075809 >> v1:172.21.15.55:6789/0 conn(0x7f4d54153d20 legacy=0x7f4d541577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d537fe700 1 -- 172.21.15.55:0/3982075809 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5415bad0 con 0x7f4d54153950 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d527fc700 1 -- 172.21.15.55:0/3982075809 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326116510 0 0) 0x7f4d5415c400 con 0x7f4d54153d20 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d537fe700 1 --2- 172.21.15.55:0/3982075809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d54153950 0x7f4d5415c890 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4d440098d0 tx=0x7f4d44009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e003cd1cb316b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d527fc700 1 -- 172.21.15.55:0/3982075809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44009e70 con 0x7f4d54153950 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d527fc700 1 -- 172.21.15.55:0/3982075809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44005c10 con 0x7f4d54153950 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d527fc700 1 -- 172.21.15.55:0/3982075809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400b650 con 0x7f4d54153950 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 -- 172.21.15.55:0/3982075809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d54153950 msgr2=0x7f4d5415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/3982075809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d54153950 0x7f4d5415c890 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4d440098d0 tx=0x7f4d44009120 comp rx=0 tx=0).stop 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 -- 172.21.15.55:0/3982075809 shutdown_connections 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/3982075809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5415ad30 0x7f4d5415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/3982075809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d54153950 0x7f4d5415c890 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 -- 172.21.15.55:0/3982075809 >> 172.21.15.55:0/3982075809 conn(0x7f4d5406ece0 msgr2=0x7f4d5406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 -- 172.21.15.55:0/3982075809 shutdown_connections 2023-10-06T11:16:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.119+0000 7f4d59d2f700 1 -- 172.21.15.55:0/3982075809 wait complete. 2023-10-06T11:16:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 Processor -- start 2023-10-06T11:16:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 -- start start 2023-10-06T11:16:31.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d54153950 0x7f4d54152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d54153d20 0x7f4d540b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 0x7f4d540b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541573a0 con 0x7f4d5415ad30 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54156820 con 0x7f4d54153950 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d59d2f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54156b00 con 0x7f4d54153d20 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.121+0000 7f4d53fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 0x7f4d540b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:31.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 0x7f4d540b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53244/0 (socket says 172.21.15.55:53244) 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 -- 172.21.15.55:0/1330688286 learned_addr learned my addr 172.21.15.55:0/1330688286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d52ffd700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d54153d20 0x7f4d540b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d537fe700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d54153950 0x7f4d54152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 -- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d54153d20 msgr2=0x7f4d540b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d54153d20 0x7f4d540b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 -- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d54153950 msgr2=0x7f4d54152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d54153950 0x7f4d54152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 -- 172.21.15.55:0/1330688286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440093c0 con 0x7f4d5415ad30 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d53fff700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 0x7f4d540b2240 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00ceb0 tx=0x7f4d4c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00ae40 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c016430 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d54156de0 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0167d0 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.122+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541528c0 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.123+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d54064a90 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.124+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d4c003020 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.124+0000 7f4d3b7fe700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d40066f30 0x7f4d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.124+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4d4c012070 con 0x7f4d5415ad30 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.124+0000 7f4d537fe700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d40066f30 0x7f4d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.125+0000 7f4d537fe700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d40066f30 0x7f4d400693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009160 tx=0x7f4d44016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.129+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d4c056160 con 0x7f4d5415ad30 2023-10-06T11:16:31.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:31.321+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4d5415bdb0 con 0x7f4d5415ad30 2023-10-06T11:16:32.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.199+0000 7f4d3b7fe700 1 -- 172.21.15.55:0/1330688286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d4c055cf0 con 0x7f4d5415ad30 2023-10-06T11:16:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d40066f30 msgr2=0x7f4d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d40066f30 0x7f4d400693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009160 tx=0x7f4d44016000 comp rx=0 tx=0).stop 2023-10-06T11:16:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 msgr2=0x7f4d540b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 0x7f4d540b2240 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00ceb0 tx=0x7f4d4c007870 comp rx=0 tx=0).stop 2023-10-06T11:16:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 shutdown_connections 2023-10-06T11:16:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d40066f30 0x7f4d400693e0 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009160 tx=0x7f4d44016000 comp rx=0 tx=0).stop 2023-10-06T11:16:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5415ad30 0x7f4d540b2240 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d54153950 0x7f4d54152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 --2- 172.21.15.55:0/1330688286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d54153d20 0x7f4d540b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.204+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 >> 172.21.15.55:0/1330688286 conn(0x7f4d5406ece0 msgr2=0x7f4d541531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.205+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 shutdown_connections 2023-10-06T11:16:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.205+0000 7f4d59d2f700 1 -- 172.21.15.55:0/1330688286 wait complete. 2023-10-06T11:16:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-10-06T11:16:32.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:16:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.356+0000 7f282b902700 1 Processor -- start 2023-10-06T11:16:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.356+0000 7f282b902700 1 -- start start 2023-10-06T11:16:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f282b902700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28240b0640 0x7f28240cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f282b902700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28240b0a10 0x7f28240cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f282b902700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240c53c0 con 0x7f28240cc420 2023-10-06T11:16:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f282b902700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240ca790 con 0x7f28240b0640 2023-10-06T11:16:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f282b902700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240ccd00 con 0x7f28240b0a10 2023-10-06T11:16:32.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f282969e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28240b0640 0x7f28240cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f2829e9f700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28240cc420 0x7f28240c3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37836/0 (socket says 172.21.15.55:37836) 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.357+0000 7f2829e9f700 1 -- 172.21.15.55:0/552380991 learned_addr learned my addr 172.21.15.55:0/552380991 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f2828e9d700 1 --2- 172.21.15.55:0/552380991 >> v2:172.21.15.142:3300/0 conn(0x7f28240b0a10 0x7f28240cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282969e700 1 -- 172.21.15.55:0/552380991 >> v2:172.21.15.142:3300/0 conn(0x7f28240b0a10 msgr2=0x7f28240cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282969e700 1 --2- 172.21.15.55:0/552380991 >> v2:172.21.15.142:3300/0 conn(0x7f28240b0a10 0x7f28240cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282969e700 1 -- 172.21.15.55:0/552380991 >> v1:172.21.15.55:6789/0 conn(0x7f28240cc420 legacy=0x7f28240c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f2823fff700 1 -- 172.21.15.55:0/552380991 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769811299 0 0) 0x7f28240c53c0 con 0x7f28240cc420 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282969e700 1 -- 172.21.15.55:0/552380991 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240ccfe0 con 0x7f28240b0640 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282969e700 1 --2- 172.21.15.55:0/552380991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0640 0x7f28240cecd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f282406f440 tx=0x7f281c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567e1b768882f312 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f2823fff700 1 -- 172.21.15.55:0/552380991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c005c10 con 0x7f28240b0640 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f2823fff700 1 -- 172.21.15.55:0/552380991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c005d70 con 0x7f28240b0640 2023-10-06T11:16:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f2823fff700 1 -- 172.21.15.55:0/552380991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c006260 con 0x7f28240b0640 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282b902700 1 -- 172.21.15.55:0/552380991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0640 msgr2=0x7f28240cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282b902700 1 --2- 172.21.15.55:0/552380991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0640 0x7f28240cecd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f282406f440 tx=0x7f281c009120 comp rx=0 tx=0).stop 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282b902700 1 -- 172.21.15.55:0/552380991 shutdown_connections 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282b902700 1 --2- 172.21.15.55:0/552380991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0640 0x7f28240cecd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282b902700 1 --2- 172.21.15.55:0/552380991 >> v2:172.21.15.142:3300/0 conn(0x7f28240b0a10 0x7f28240cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.358+0000 7f282b902700 1 -- 172.21.15.55:0/552380991 >> 172.21.15.55:0/552380991 conn(0x7f2824087fc0 msgr2=0x7f28240ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.359+0000 7f282b902700 1 -- 172.21.15.55:0/552380991 shutdown_connections 2023-10-06T11:16:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.359+0000 7f282b902700 1 -- 172.21.15.55:0/552380991 wait complete. 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 Processor -- start 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 -- start start 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240b0640 0x7f2824156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 0x7f282415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240cc420 0x7f28240c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240b32e0 con 0x7f28240b0a10 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282415a920 con 0x7f28240cc420 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.360+0000 7f282b902700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28240b3000 con 0x7f28240b0640 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 0x7f282415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 0x7f282415adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53262/0 (socket says 172.21.15.55:53262) 2023-10-06T11:16:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 -- 172.21.15.55:0/885087073 learned_addr learned my addr 172.21.15.55:0/885087073 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f282969e700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240b0640 0x7f2824156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 -- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240b0640 msgr2=0x7f2824156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240b0640 0x7f2824156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 -- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240cc420 msgr2=0x7f28240c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2829e9f700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240cc420 0x7f28240c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240cc420 0x7f28240c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 -- 172.21.15.55:0/885087073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0093c0 con 0x7f28240b0a10 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2829e9f700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240cc420 0x7f28240c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f2828e9d700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 0x7f282415adb0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f281800d860 tx=0x7f2818008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818009610 con 0x7f28240b0a10 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818009770 con 0x7f28240b0a10 2023-10-06T11:16:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282415a2d0 con 0x7f28240b0a10 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818009b30 con 0x7f28240b0a10 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.361+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824156580 con 0x7f28240b0a10 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.362+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282415a130 con 0x7f28240b0a10 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.363+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f281801e460 con 0x7f28240b0a10 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.363+0000 7f28217fa700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2810066f30 0x7f28100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.363+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f2818084c10 con 0x7f28240b0a10 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.363+0000 7f282969e700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2810066f30 0x7f28100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.364+0000 7f282969e700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2810066f30 0x7f28100693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f281c009160 tx=0x7f281c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:32.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.368+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f282415a130 con 0x7f28240b0a10 2023-10-06T11:16:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:32.562+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f282415a130 con 0x7f28240b0a10 2023-10-06T11:16:33.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.204+0000 7f28217fa700 1 -- 172.21.15.55:0/885087073 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) v1 ==== 170+0+0 (secure 0 0 0) 0x7f282415a130 con 0x7f28240b0a10 2023-10-06T11:16:33.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.210+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2810066f30 msgr2=0x7f28100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.210+0000 7f282b902700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2810066f30 0x7f28100693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f281c009160 tx=0x7f281c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:33.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.210+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 msgr2=0x7f282415adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.210+0000 7f282b902700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 0x7f282415adb0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f281800d860 tx=0x7f2818008040 comp rx=0 tx=0).stop 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 shutdown_connections 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2810066f30 0x7f28100693e0 secure :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f281c009160 tx=0x7f281c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28240cc420 0x7f28240c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28240b0640 0x7f2824156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 --2- 172.21.15.55:0/885087073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28240b0a10 0x7f282415adb0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 >> 172.21.15.55:0/885087073 conn(0x7f2824087fc0 msgr2=0x7f28240c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 shutdown_connections 2023-10-06T11:16:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.211+0000 7f282b902700 1 -- 172.21.15.55:0/885087073 wait complete. 2023-10-06T11:16:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-10-06T11:16:33.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:16:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.362+0000 7fa7cfb37700 1 Processor -- start 2023-10-06T11:16:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 -- start start 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa7c8159470 0x7fa7c80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7c8159840 0x7fa7c80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c80c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80cbb80 con 0x7fa7c8159840 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80c6f00 con 0x7fa7c8159470 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.363+0000 7fa7cfb37700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80cb530 con 0x7fa7c80c6170 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7c8159840 0x7fa7c80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7c8159840 0x7fa7c80ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53274/0 (socket says 172.21.15.55:53274) 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/2751360352 learned_addr learned my addr 172.21.15.55:0/2751360352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7ce0d4700 1 --2- 172.21.15.55:0/2751360352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c80c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd8d3700 1 --2- 172.21.15.55:0/2751360352 >> v2:172.21.15.142:3300/0 conn(0x7fa7c8159470 0x7fa7c80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/2751360352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 msgr2=0x7fa7c80c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 --2- 172.21.15.55:0/2751360352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c80c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/2751360352 >> v2:172.21.15.142:3300/0 conn(0x7fa7c8159470 msgr2=0x7fa7c80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 --2- 172.21.15.55:0/2751360352 >> v2:172.21.15.142:3300/0 conn(0x7fa7c8159470 0x7fa7c80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/2751360352 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80cb810 con 0x7fa7c8159840 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cd0d2700 1 --2- 172.21.15.55:0/2751360352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159840 0x7fa7c80ceec0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8089d50 tx=0x7fa7bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df39432ad4004a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cc8d1700 1 -- 172.21.15.55:0/2751360352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00b860 con 0x7fa7c8159840 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cc8d1700 1 -- 172.21.15.55:0/2751360352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc00b9c0 con 0x7fa7c8159840 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.364+0000 7fa7cc8d1700 1 -- 172.21.15.55:0/2751360352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00bd60 con 0x7fa7c8159840 2023-10-06T11:16:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 -- 172.21.15.55:0/2751360352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159840 msgr2=0x7fa7c80ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/2751360352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159840 0x7fa7c80ceec0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8089d50 tx=0x7fa7bc009250 comp rx=0 tx=0).stop 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 -- 172.21.15.55:0/2751360352 shutdown_connections 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/2751360352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c80c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/2751360352 >> v2:172.21.15.142:3300/0 conn(0x7fa7c8159470 0x7fa7c80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/2751360352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159840 0x7fa7c80ceec0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 -- 172.21.15.55:0/2751360352 >> 172.21.15.55:0/2751360352 conn(0x7fa7c80996e0 msgr2=0x7fa7c806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 -- 172.21.15.55:0/2751360352 shutdown_connections 2023-10-06T11:16:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.365+0000 7fa7cfb37700 1 -- 172.21.15.55:0/2751360352 wait complete. 2023-10-06T11:16:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.366+0000 7fa7cfb37700 1 Processor -- start 2023-10-06T11:16:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.366+0000 7fa7cfb37700 1 -- start start 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cfb37700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cfb37700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 0x7fa7c80c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cfb37700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8159840 0x7fa7c815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cfb37700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c815dc00 con 0x7fa7c8159470 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cfb37700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c814f0d0 con 0x7fa7c8159840 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cfb37700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8150f00 con 0x7fa7c80c6170 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 0x7fa7c80c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 0x7fa7c80c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53280/0 (socket says 172.21.15.55:53280) 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/1581384170 learned_addr learned my addr 172.21.15.55:0/1581384170 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7ce0d4700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8159840 0x7fa7c815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd8d3700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 msgr2=0x7fa7c814eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c814eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8159840 msgr2=0x7fa7c815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8159840 0x7fa7c815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 -- 172.21.15.55:0/1581384170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0094f0 con 0x7fa7c8159470 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.367+0000 7fa7cd0d2700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 0x7fa7c80c7bc0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc006fd0 tx=0x7fa7bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.368+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011e00 con 0x7fa7c8159470 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.368+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc01a450 con 0x7fa7c8159470 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.368+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc01a810 con 0x7fa7c8159470 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.368+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c8150610 con 0x7fa7c8159470 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.368+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c81508b0 con 0x7fa7c8159470 2023-10-06T11:16:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.369+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c8151090 con 0x7fa7c8159470 2023-10-06T11:16:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.369+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7bc01abc0 con 0x7fa7c8159470 2023-10-06T11:16:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.370+0000 7fa7c5ffb700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa7b4066f30 0x7fa7b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.370+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fa7bc086270 con 0x7fa7c8159470 2023-10-06T11:16:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.370+0000 7fa7cd8d3700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa7b4066f30 0x7fa7b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.371+0000 7fa7cd8d3700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa7b4066f30 0x7fa7b40693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8007680 tx=0x7fa7b80098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.375+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7bc053200 con 0x7fa7c8159470 2023-10-06T11:16:33.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:33.612+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa7c8064a90 con 0x7fa7c8159470 2023-10-06T11:16:34.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.234+0000 7fa7c5ffb700 1 -- 172.21.15.55:0/1581384170 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa7bc056820 con 0x7fa7c8159470 2023-10-06T11:16:34.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.246+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa7b4066f30 msgr2=0x7fa7b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.246+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa7b4066f30 0x7fa7b40693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8007680 tx=0x7fa7b80098d0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.246+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 msgr2=0x7fa7c80c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.246+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 0x7fa7c80c7bc0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc006fd0 tx=0x7fa7bc017000 comp rx=0 tx=0).stop 2023-10-06T11:16:34.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.249+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 shutdown_connections 2023-10-06T11:16:34.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.249+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa7b4066f30 0x7fa7b40693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.249+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8159840 0x7fa7c815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.249+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa7c80c6170 0x7fa7c814eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.249+0000 7fa7cfb37700 1 --2- 172.21.15.55:0/1581384170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7c8159470 0x7fa7c80c7bc0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.249+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 >> 172.21.15.55:0/1581384170 conn(0x7fa7c80996e0 msgr2=0x7fa7c80cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.251+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 shutdown_connections 2023-10-06T11:16:34.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.251+0000 7fa7cfb37700 1 -- 172.21.15.55:0/1581384170 wait complete. 2023-10-06T11:16:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 16 and data pool 17 2023-10-06T11:16:34.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.392+0000 7f12444fb700 1 Processor -- start 2023-10-06T11:16:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.392+0000 7f12444fb700 1 -- start start 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.393+0000 7f12444fb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123c0b25e0 0x7f123c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.393+0000 7f12444fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.393+0000 7f12444fb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0cbfa0 con 0x7f123c0b29b0 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.393+0000 7f12444fb700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0cb390 con 0x7f123c0b25e0 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.393+0000 7f12444fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0cb670 con 0x7f123c159830 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.393+0000 7f1242297700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123c0b25e0 0x7f123c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123c0b25e0 0x7f123c0b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38102/0 (socket says 172.21.15.55:38102) 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 -- 172.21.15.55:0/2307589430 learned_addr learned my addr 172.21.15.55:0/2307589430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242a98700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 -- 172.21.15.55:0/2307589430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 msgr2=0x7f123c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 -- 172.21.15.55:0/2307589430 >> v1:172.21.15.142:6789/0 conn(0x7f123c0b29b0 legacy=0x7f123c159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 -- 172.21.15.55:0/2307589430 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0cb950 con 0x7f123c0b25e0 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242a98700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1242297700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0b0690 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f122c009f70 tx=0x7f122c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61afb5a8a6c168a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1241295700 1 -- 172.21.15.55:0/2307589430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00e070 con 0x7f123c0b25e0 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1241295700 1 -- 172.21.15.55:0/2307589430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00bad0 con 0x7f123c0b25e0 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.394+0000 7f1241295700 1 -- 172.21.15.55:0/2307589430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0092e0 con 0x7f123c0b25e0 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 -- 172.21.15.55:0/2307589430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 msgr2=0x7f123c0b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0b0690 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f122c009f70 tx=0x7f122c009840 comp rx=0 tx=0).stop 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 -- 172.21.15.55:0/2307589430 shutdown_connections 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 --2- 172.21.15.55:0/2307589430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0b0690 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 -- 172.21.15.55:0/2307589430 >> 172.21.15.55:0/2307589430 conn(0x7f123c06ece0 msgr2=0x7f123c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 -- 172.21.15.55:0/2307589430 shutdown_connections 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.395+0000 7f12444fb700 1 -- 172.21.15.55:0/2307589430 wait complete. 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.396+0000 7f12444fb700 1 Processor -- start 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.396+0000 7f12444fb700 1 -- start start 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f123c0b29b0 0x7f123c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c158460 con 0x7f123c0b25e0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1577e0 con 0x7f123c0b29b0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c157ac0 con 0x7f123c159830 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38104/0 (socket says 172.21.15.55:38104) 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 -- 172.21.15.55:0/3127445232 learned_addr learned my addr 172.21.15.55:0/3127445232 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 -- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 msgr2=0x7f123c169c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 -- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f123c0b29b0 msgr2=0x7f123c156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f123c0b29b0 0x7f123c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 -- 172.21.15.55:0/3127445232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c009ae0 con 0x7f123c0b25e0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f1242297700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0d08c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b770 tx=0x7f122c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c008ac0 con 0x7f123c0b25e0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c008c20 con 0x7f123c0b25e0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c157da0 con 0x7f123c0b25e0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.397+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c026460 con 0x7f123c0b25e0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.398+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c157440 con 0x7f123c0b25e0 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.398+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c064a90 con 0x7f123c0b25e0 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.399+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f122c003040 con 0x7f123c0b25e0 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.399+0000 7f123a7fc700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1228066f30 0x7f12280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.399+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f122c086670 con 0x7f123c0b25e0 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.399+0000 7f1241a96700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1228066f30 0x7f12280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.400+0000 7f1241a96700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1228066f30 0x7f12280693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f123c0cd170 tx=0x7f1230007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.403+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f122c053640 con 0x7f123c0b25e0 2023-10-06T11:16:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.598+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f123c0cbc30 con 0x7f123c0b25e0 2023-10-06T11:16:34.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.599+0000 7f123a7fc700 1 -- 172.21.15.55:0/3127445232 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17098 (secure 0 0 0) 0x7f122c056c60 con 0x7f123c0b25e0 2023-10-06T11:16:34.601 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:34.601 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:33.613393+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:31.352151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:32.593083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:34.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1228066f30 msgr2=0x7f12280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1228066f30 0x7f12280693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f123c0cd170 tx=0x7f1230007b40 comp rx=0 tx=0).stop 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 msgr2=0x7f123c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0d08c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b770 tx=0x7f122c018000 comp rx=0 tx=0).stop 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 shutdown_connections 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1228066f30 0x7f12280693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0b25e0 0x7f123c0d08c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f123c159830 0x7f123c169c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 --2- 172.21.15.55:0/3127445232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f123c0b29b0 0x7f123c156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.601+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 >> 172.21.15.55:0/3127445232 conn(0x7f123c06ece0 msgr2=0x7f123c0b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.602+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 shutdown_connections 2023-10-06T11:16:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.602+0000 7f12444fb700 1 -- 172.21.15.55:0/3127445232 wait complete. 2023-10-06T11:16:34.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:34.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.733+0000 7fc30d382700 1 Processor -- start 2023-10-06T11:16:34.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.733+0000 7fc30d382700 1 -- start start 2023-10-06T11:16:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30d382700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc3080b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30d382700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3080b35d0 0x7fc3080cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30d382700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3080cb7a0 con 0x7fc3080cc170 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30d382700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3080b0860 con 0x7fc3080b35d0 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30d382700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080cb150 con 0x7fc308159440 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc3077fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3080b35d0 0x7fc3080cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30cb81700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc3080cc170 0x7fc3080b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48148/0 (socket says 172.21.15.55:48148) 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc30cb81700 1 -- 172.21.15.55:0/573177425 learned_addr learned my addr 172.21.15.55:0/573177425 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc307fff700 1 --2- 172.21.15.55:0/573177425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc3080b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc3077fe700 1 -- 172.21.15.55:0/573177425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 msgr2=0x7fc3080b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc3077fe700 1 --2- 172.21.15.55:0/573177425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc3080b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc3077fe700 1 -- 172.21.15.55:0/573177425 >> v1:172.21.15.55:6789/0 conn(0x7fc3080cc170 legacy=0x7fc3080b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.734+0000 7fc3077fe700 1 -- 172.21.15.55:0/573177425 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080cb430 con 0x7fc3080b35d0 2023-10-06T11:16:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc3077fe700 1 --2- 172.21.15.55:0/573177425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080b35d0 0x7fc3080cbc30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80098e0 tx=0x7fc2f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608d1bf31e191886 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc306ffd700 1 -- 172.21.15.55:0/573177425 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800b640 con 0x7fc3080b35d0 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc306ffd700 1 -- 172.21.15.55:0/573177425 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f800b7a0 con 0x7fc3080b35d0 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc306ffd700 1 -- 172.21.15.55:0/573177425 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800bb40 con 0x7fc3080b35d0 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 -- 172.21.15.55:0/573177425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080b35d0 msgr2=0x7fc3080cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 --2- 172.21.15.55:0/573177425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080b35d0 0x7fc3080cbc30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80098e0 tx=0x7fc2f80091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 -- 172.21.15.55:0/573177425 shutdown_connections 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 --2- 172.21.15.55:0/573177425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc3080b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 --2- 172.21.15.55:0/573177425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080b35d0 0x7fc3080cbc30 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 -- 172.21.15.55:0/573177425 >> 172.21.15.55:0/573177425 conn(0x7fc30806ece0 msgr2=0x7fc30806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 -- 172.21.15.55:0/573177425 shutdown_connections 2023-10-06T11:16:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.735+0000 7fc30d382700 1 -- 172.21.15.55:0/573177425 wait complete. 2023-10-06T11:16:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.736+0000 7fc30d382700 1 Processor -- start 2023-10-06T11:16:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 -- start start 2023-10-06T11:16:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3080b35d0 0x7fc308154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 0x7fc3081558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc308155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30815a6a0 con 0x7fc3080cc170 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc308159a90 con 0x7fc3080b35d0 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.737+0000 7fc30d382700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc308159d70 con 0x7fc308159440 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 0x7fc3081558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 0x7fc3081558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38116/0 (socket says 172.21.15.55:38116) 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 -- 172.21.15.55:0/673386419 learned_addr learned my addr 172.21.15.55:0/673386419 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 -- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 msgr2=0x7fc308155e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc308155e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 -- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3080b35d0 msgr2=0x7fc308154790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:16:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3080b35d0 0x7fc308154790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 -- 172.21.15.55:0/673386419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8009420 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc3077fe700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 0x7fc3081558f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009f80 tx=0x7fc2f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800bb20 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8011420 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30815a050 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8011800 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.738+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc308154cd0 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.739+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30805f230 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.740+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2f8011c30 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.740+0000 7fc2fffff700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc2e8066f30 0x7fc2e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.740+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc2f80862c0 con 0x7fc3080cc170 2023-10-06T11:16:34.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.740+0000 7fc307fff700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc2e8066f30 0x7fc2e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.741+0000 7fc307fff700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc2e8066f30 0x7fc2e80693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009b10 tx=0x7fc2f00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.744+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2f8053290 con 0x7fc3080cc170 2023-10-06T11:16:34.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.943+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc308159810 con 0x7fc3080cc170 2023-10-06T11:16:34.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.943+0000 7fc2fffff700 1 -- 172.21.15.55:0/673386419 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17098 (secure 0 0 0) 0x7fc2f80568b0 con 0x7fc3080cc170 2023-10-06T11:16:34.946 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:34.946 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:33.613393+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:31.352151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:32.593083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:34.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.945+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc2e8066f30 msgr2=0x7fc2e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc2e8066f30 0x7fc2e80693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009b10 tx=0x7fc2f00091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 msgr2=0x7fc3081558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 0x7fc3081558f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009f80 tx=0x7fc2f8017000 comp rx=0 tx=0).stop 2023-10-06T11:16:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 shutdown_connections 2023-10-06T11:16:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc2e8066f30 0x7fc2e80693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc308159440 0x7fc308155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3080b35d0 0x7fc308154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 --2- 172.21.15.55:0/673386419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3080cc170 0x7fc3081558f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 >> 172.21.15.55:0/673386419 conn(0x7fc30806ece0 msgr2=0x7fc308158780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 shutdown_connections 2023-10-06T11:16:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:34.946+0000 7fc30d382700 1 -- 172.21.15.55:0/673386419 wait complete. 2023-10-06T11:16:34.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:16:35.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.081+0000 7faed1ac3700 1 Processor -- start 2023-10-06T11:16:35.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.081+0000 7faed1ac3700 1 -- start start 2023-10-06T11:16:35.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faed1ac3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 0x7faecc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faed1ac3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faecc0cbaa0 0x7faecc0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faed1ac3700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc0cbec0 con 0x7faecc1598a0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faed1ac3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc0cf5d0 con 0x7faecc0cbaa0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faed1ac3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0cf8b0 con 0x7faecc1594d0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faecaffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faecc1598a0 0x7faecc0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48162/0 (socket says 172.21.15.55:48162) 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faecaffd700 1 -- 172.21.15.55:0/1128974846 learned_addr learned my addr 172.21.15.55:0/1128974846 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faecbfff700 1 --2- 172.21.15.55:0/1128974846 >> v2:172.21.15.142:3300/0 conn(0x7faecc0cbaa0 0x7faecc0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faecb7fe700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 0x7faecc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707458602 0 0) 0x7faecc0cbec0 con 0x7faecc1598a0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.082+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb4003570 con 0x7faecc1598a0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3322404377 0 0) 0x7faeb4003570 con 0x7faecc1598a0 2023-10-06T11:16:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 msgr2=0x7faecc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 0x7faecc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 >> v2:172.21.15.142:3300/0 conn(0x7faecc0cbaa0 msgr2=0x7faecc0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 --2- 172.21.15.55:0/1128974846 >> v2:172.21.15.142:3300/0 conn(0x7faecc0cbaa0 0x7faecc0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0cfb90 con 0x7faecc1598a0 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7faec0001470 con 0x7faecc1598a0 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 >> v1:172.21.15.55:6789/0 conn(0x7faecc1598a0 legacy=0x7faecc0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 0x7faeb4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb4003fe0 0x7faeb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4004d50 0x7faeb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0cf5d0 con 0x7faeb4003fe0 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0cf8b0 con 0x7faeb4004d50 2023-10-06T11:16:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb400ba90 con 0x7faecc1594d0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb4003fe0 0x7faeb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecb7fe700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 0x7faeb4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecbfff700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4004d50 0x7faeb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 -- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 msgr2=0x7faeb4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc1594d0 0x7faeb4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 -- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4004d50 msgr2=0x7faeb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4004d50 0x7faeb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 -- 172.21.15.55:0/1128974846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4003570 con 0x7faeb4003fe0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.083+0000 7faecaffd700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb4003fe0 0x7faeb4004810 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faec000c390 tx=0x7faec0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f642ad18cddda2f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000cc00 con 0x7faeb4003fe0 2023-10-06T11:16:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000cd80 con 0x7faeb4003fe0 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faeca7fc700 1 -- 172.21.15.55:0/1128974846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0005b70 con 0x7faeb4003fe0 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faed1ac3700 1 -- 172.21.15.55:0/1128974846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb4003fe0 msgr2=0x7faeb4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faed1ac3700 1 --2- 172.21.15.55:0/1128974846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb4003fe0 0x7faeb4004810 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7faec000c390 tx=0x7faec0001e90 comp rx=0 tx=0).stop 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faecbfff700 1 -- 172.21.15.55:0/1128974846 reap_dead start 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faed1ac3700 1 -- 172.21.15.55:0/1128974846 shutdown_connections 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faed1ac3700 1 -- 172.21.15.55:0/1128974846 >> 172.21.15.55:0/1128974846 conn(0x7faecc089e50 msgr2=0x7faecc099770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faed1ac3700 1 -- 172.21.15.55:0/1128974846 shutdown_connections 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.084+0000 7faed1ac3700 1 -- 172.21.15.55:0/1128974846 wait complete. 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.085+0000 7faed1ac3700 1 Processor -- start 2023-10-06T11:16:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.085+0000 7faed1ac3700 1 -- start start 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faed1ac3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4003fe0 0x7faecc16cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faed1ac3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc0c75c0 0x7faecc169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faed1ac3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 0x7faecc0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faed1ac3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c8680 con 0x7faecc0c7e30 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faed1ac3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c8960 con 0x7faeb4003fe0 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faed1ac3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c8c40 con 0x7faecc0c75c0 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faecbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 0x7faecc0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faecbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 0x7faecc0cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38140/0 (socket says 172.21.15.55:38140) 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faecbfff700 1 -- 172.21.15.55:0/2041848019 learned_addr learned my addr 172.21.15.55:0/2041848019 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faecb7fe700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4003fe0 0x7faecc16cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.086+0000 7faecaffd700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc0c75c0 0x7faecc169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecbfff700 1 -- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc0c75c0 msgr2=0x7faecc169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecbfff700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc0c75c0 0x7faecc169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecbfff700 1 -- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4003fe0 msgr2=0x7faecc16cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecbfff700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4003fe0 0x7faecc16cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecbfff700 1 -- 172.21.15.55:0/2041848019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0b4c30 con 0x7faecc0c7e30 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecb7fe700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4003fe0 0x7faecc16cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecaffd700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc0c75c0 0x7faecc169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faecbfff700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 0x7faecc0cad10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7faecc0cace0 tx=0x7faec400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400e070 con 0x7faecc0c7e30 2023-10-06T11:16:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4011d00 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc0b4f10 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40166c0 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.087+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc0cb250 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.088+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc0b4a90 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.088+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faec4016ab0 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.089+0000 7faeb37fe700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faeb8066f30 0x7faeb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.089+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faec4085490 con 0x7faecc0c7e30 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.089+0000 7faecb7fe700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faeb8066f30 0x7faeb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.089+0000 7faecb7fe700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faeb8066f30 0x7faeb80693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faebc006dc0 tx=0x7faebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.093+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faecc0b4a90 con 0x7faecc0c7e30 2023-10-06T11:16:35.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:35.335+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faecc0b4a90 con 0x7faecc0c7e30 2023-10-06T11:16:36.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.257+0000 7faeb37fe700 1 -- 172.21.15.55:0/2041848019 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7faecc0b4a90 con 0x7faecc0c7e30 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faeb8066f30 msgr2=0x7faeb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faeb8066f30 0x7faeb80693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faebc006dc0 tx=0x7faebc008040 comp rx=0 tx=0).stop 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 msgr2=0x7faecc0cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 0x7faecc0cad10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7faecc0cace0 tx=0x7faec400b040 comp rx=0 tx=0).stop 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 shutdown_connections 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7faeb8066f30 0x7faeb80693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0c7e30 0x7faecc0cad10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb4003fe0 0x7faecc16cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 --2- 172.21.15.55:0/2041848019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faecc0c75c0 0x7faecc169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 >> 172.21.15.55:0/2041848019 conn(0x7faecc089e50 msgr2=0x7faecc14d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 shutdown_connections 2023-10-06T11:16:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.260+0000 7faed1ac3700 1 -- 172.21.15.55:0/2041848019 wait complete. 2023-10-06T11:16:36.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:16:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.402+0000 7f1d98aff700 1 Processor -- start 2023-10-06T11:16:36.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.402+0000 7f1d98aff700 1 -- start start 2023-10-06T11:16:36.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d98aff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d940c3f50 0x7f1d94162240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d98aff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940cadd0 con 0x7f1d940cce20 2023-10-06T11:16:36.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d98aff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d941577d0 con 0x7f1d940b05d0 2023-10-06T11:16:36.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d98aff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940c9ae0 con 0x7f1d940c3f50 2023-10-06T11:16:36.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d93fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d940c3f50 0x7f1d94162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d92ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1d940cce20 0x7f1d940c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48164/0 (socket says 172.21.15.55:48164) 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d92ffd700 1 -- 172.21.15.55:0/4223787075 learned_addr learned my addr 172.21.15.55:0/4223787075 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.403+0000 7f1d93fff700 1 -- 172.21.15.55:0/4223787075 >> v1:172.21.15.142:6789/0 conn(0x7f1d940b05d0 legacy=0x7f1d940cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d93fff700 1 -- 172.21.15.55:0/4223787075 >> v1:172.21.15.55:6789/0 conn(0x7f1d940cce20 legacy=0x7f1d940c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d93fff700 1 -- 172.21.15.55:0/4223787075 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940c9dc0 con 0x7f1d940c3f50 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d927fc700 1 -- 172.21.15.55:0/4223787075 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041792825 0 0) 0x7f1d940cadd0 con 0x7f1d940cce20 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d93fff700 1 --2- 172.21.15.55:0/4223787075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d94162240 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009e60 tx=0x7f1d8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ca6cfca44b6aa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d927fc700 1 -- 172.21.15.55:0/4223787075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00e070 con 0x7f1d940c3f50 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d927fc700 1 -- 172.21.15.55:0/4223787075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c00bc30 con 0x7f1d940c3f50 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d927fc700 1 -- 172.21.15.55:0/4223787075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c012430 con 0x7f1d940c3f50 2023-10-06T11:16:36.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 -- 172.21.15.55:0/4223787075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 msgr2=0x7f1d94162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 --2- 172.21.15.55:0/4223787075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d94162240 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009e60 tx=0x7f1d8c009780 comp rx=0 tx=0).stop 2023-10-06T11:16:36.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 -- 172.21.15.55:0/4223787075 shutdown_connections 2023-10-06T11:16:36.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 --2- 172.21.15.55:0/4223787075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d94162240 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 -- 172.21.15.55:0/4223787075 >> 172.21.15.55:0/4223787075 conn(0x7f1d94096a30 msgr2=0x7f1d94096e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 -- 172.21.15.55:0/4223787075 shutdown_connections 2023-10-06T11:16:36.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.404+0000 7f1d98aff700 1 -- 172.21.15.55:0/4223787075 wait complete. 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 Processor -- start 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 -- start start 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d940b05d0 0x7f1d9416a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d9416c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d940cce20 0x7f1d940c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c8630 con 0x7f1d940c3f50 2023-10-06T11:16:36.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94153870 con 0x7f1d940b05d0 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d98aff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9416ac90 con 0x7f1d940cce20 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.406+0000 7f1d92ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d9416c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d9416c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38160/0 (socket says 172.21.15.55:38160) 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 -- 172.21.15.55:0/1334291965 learned_addr learned my addr 172.21.15.55:0/1334291965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 -- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d940cce20 msgr2=0x7f1d940c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d940cce20 0x7f1d940c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 -- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d940b05d0 msgr2=0x7f1d9416a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d940b05d0 0x7f1d9416a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 -- 172.21.15.55:0/1334291965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009a20 con 0x7f1d940c3f50 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d92ffd700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d9416c260 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c590 tx=0x7f1d88007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880072e0 con 0x7f1d940c3f50 2023-10-06T11:16:36.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88007460 con 0x7f1d940c3f50 2023-10-06T11:16:36.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d940c7d90 con 0x7f1d940c3f50 2023-10-06T11:16:36.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880057f0 con 0x7f1d940c3f50 2023-10-06T11:16:36.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.407+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d940c8350 con 0x7f1d940c3f50 2023-10-06T11:16:36.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.408+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9405f230 con 0x7f1d940c3f50 2023-10-06T11:16:36.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.409+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d88005b60 con 0x7f1d940c3f50 2023-10-06T11:16:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.409+0000 7f1d7b7fe700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1d80066f30 0x7f1d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.409+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1d88083cf0 con 0x7f1d940c3f50 2023-10-06T11:16:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.409+0000 7f1d937fe700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1d80066f30 0x7f1d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.410+0000 7f1d937fe700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1d80066f30 0x7f1d800693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d84001730 tx=0x7f1d84007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.413+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d88088070 con 0x7f1d940c3f50 2023-10-06T11:16:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:36.649+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d940ca0a0 con 0x7f1d940c3f50 2023-10-06T11:16:37.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.263+0000 7f1d7b7fe700 1 -- 172.21.15.55:0/1334291965 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d88017070 con 0x7f1d940c3f50 2023-10-06T11:16:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1d80066f30 msgr2=0x7f1d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1d80066f30 0x7f1d800693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d84001730 tx=0x7f1d84007b40 comp rx=0 tx=0).stop 2023-10-06T11:16:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 msgr2=0x7f1d9416c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d9416c260 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c590 tx=0x7f1d88007e50 comp rx=0 tx=0).stop 2023-10-06T11:16:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 shutdown_connections 2023-10-06T11:16:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1d80066f30 0x7f1d800693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d940cce20 0x7f1d940c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d940b05d0 0x7f1d9416a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 --2- 172.21.15.55:0/1334291965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d940c3f50 0x7f1d9416c260 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 >> 172.21.15.55:0/1334291965 conn(0x7f1d94096a30 msgr2=0x7f1d94151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 shutdown_connections 2023-10-06T11:16:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.266+0000 7f1d98aff700 1 -- 172.21.15.55:0/1334291965 wait complete. 2023-10-06T11:16:37.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.407+0000 7fe198743700 1 Processor -- start 2023-10-06T11:16:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.407+0000 7fe198743700 1 -- start start 2023-10-06T11:16:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.407+0000 7fe198743700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe190159560 0x7fe1900aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.407+0000 7fe198743700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 0x7fe1900aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.407+0000 7fe198743700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900b0c60 con 0x7fe1900b0760 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe198743700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900b0f40 con 0x7fe190159560 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe198743700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900b1220 con 0x7fe1900b49a0 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe196ce0700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe1900b0760 0x7fe1900b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48178/0 (socket says 172.21.15.55:48178) 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe196ce0700 1 -- 172.21.15.55:0/94620197 learned_addr learned my addr 172.21.15.55:0/94620197 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe195cde700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 0x7fe1900aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1964df700 1 --2- 172.21.15.55:0/94620197 >> v2:172.21.15.142:3300/0 conn(0x7fe190159560 0x7fe1900aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094711983 0 0) 0x7fe1900b0c60 con 0x7fe1900b0760 2023-10-06T11:16:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003570 con 0x7fe1900b0760 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428084898 0 0) 0x7fe178003570 con 0x7fe1900b0760 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 msgr2=0x7fe1900aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 0x7fe1900aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 >> v2:172.21.15.142:3300/0 conn(0x7fe190159560 msgr2=0x7fe1900aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 --2- 172.21.15.55:0/94620197 >> v2:172.21.15.142:3300/0 conn(0x7fe190159560 0x7fe1900aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900b1500 con 0x7fe1900b0760 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fe1800017f0 con 0x7fe1900b0760 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 >> v1:172.21.15.55:6789/0 conn(0x7fe1900b0760 legacy=0x7fe1900b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe178003a60 0x7fe178003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 0x7fe178004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe178004d50 0x7fe1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900b0f40 con 0x7fe178003a60 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900b1220 con 0x7fe178004d50 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17800ba60 con 0x7fe1900b49a0 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.408+0000 7fe1964df700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe178003a60 0x7fe178003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe195cde700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 0x7fe178004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe196ce0700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe178004d50 0x7fe1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1964df700 1 -- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 msgr2=0x7fe178004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1964df700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1900b49a0 0x7fe178004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1964df700 1 -- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe178004d50 msgr2=0x7fe1780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1964df700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe178004d50 0x7fe1780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1964df700 1 -- 172.21.15.55:0/94620197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178003570 con 0x7fe178003a60 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1964df700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe178003a60 0x7fe178003e70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe188009bf0 tx=0x7fe188009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2394964851daf09b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188005a00 con 0x7fe178003a60 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188005b60 con 0x7fe178003a60 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.409+0000 7fe1954dd700 1 -- 172.21.15.55:0/94620197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800e6b0 con 0x7fe178003a60 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe198743700 1 -- 172.21.15.55:0/94620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe178003a60 msgr2=0x7fe178003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe198743700 1 --2- 172.21.15.55:0/94620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe178003a60 0x7fe178003e70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe188009bf0 tx=0x7fe188009120 comp rx=0 tx=0).stop 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe196ce0700 1 -- 172.21.15.55:0/94620197 reap_dead start 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe198743700 1 -- 172.21.15.55:0/94620197 shutdown_connections 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe198743700 1 -- 172.21.15.55:0/94620197 >> 172.21.15.55:0/94620197 conn(0x7fe1900997f0 msgr2=0x7fe19006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe198743700 1 -- 172.21.15.55:0/94620197 shutdown_connections 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.410+0000 7fe198743700 1 -- 172.21.15.55:0/94620197 wait complete. 2023-10-06T11:16:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 Processor -- start 2023-10-06T11:16:37.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 -- start start 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe178003a60 0x7fe190154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 0x7fe19009d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe190155140 0x7fe1901555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1901599c0 con 0x7fe19009d440 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190155e70 con 0x7fe190155140 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.411+0000 7fe198743700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190156150 con 0x7fe178003a60 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 0x7fe19009d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 0x7fe19009d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38186/0 (socket says 172.21.15.55:38186) 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 -- 172.21.15.55:0/4142779159 learned_addr learned my addr 172.21.15.55:0/4142779159 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe196ce0700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe190155140 0x7fe1901555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe1964df700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe178003a60 0x7fe190154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 -- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe178003a60 msgr2=0x7fe190154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe178003a60 0x7fe190154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 -- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe190155140 msgr2=0x7fe1901555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe190155140 0x7fe1901555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 -- 172.21.15.55:0/4142779159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190156430 con 0x7fe19009d440 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe1964df700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe178003a60 0x7fe190154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe195cde700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 0x7fe19009d8b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe184011d70 tx=0x7fe1840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400fac0 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400fc20 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190156710 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184014440 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.412+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe190155af0 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.413+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe190064a90 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.414+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe184014830 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.414+0000 7fe18e7fc700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe17c066f30 0x7fe17c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.414+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe184018030 con 0x7fe19009d440 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.414+0000 7fe1964df700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe17c066f30 0x7fe17c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.415+0000 7fe1964df700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe17c066f30 0x7fe17c0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe188009160 tx=0x7fe188019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.418+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1840522b0 con 0x7fe19009d440 2023-10-06T11:16:37.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.655+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1900b17e0 con 0x7fe19009d440 2023-10-06T11:16:37.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.656+0000 7fe18e7fc700 1 -- 172.21.15.55:0/4142779159 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fe1840558d0 con 0x7fe19009d440 2023-10-06T11:16:37.658 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:37.658 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3034002798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3034002798},{"type":"v1","addr":"172.21.15.55:6834","nonce":3034002798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6403,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/526298502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":526298502},{"type":"v1","addr":"172.21.15.55:6835","nonce":526298502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6415,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2651321220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2651321220},{"type":"v1","addr":"172.21.15.142:6837","nonce":2651321220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:37.257164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6418":{"gid":6418,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2387992820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2387992820},{"type":"v1","addr":"172.21.15.142:6836","nonce":2387992820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe17c066f30 msgr2=0x7fe17c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe17c066f30 0x7fe17c0693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe188009160 tx=0x7fe188019000 comp rx=0 tx=0).stop 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 msgr2=0x7fe19009d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 0x7fe19009d8b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe184011d70 tx=0x7fe1840091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 shutdown_connections 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe17c066f30 0x7fe17c0693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe190155140 0x7fe1901555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe178003a60 0x7fe190154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 --2- 172.21.15.55:0/4142779159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19009d440 0x7fe19009d8b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 >> 172.21.15.55:0/4142779159 conn(0x7fe1900997f0 msgr2=0x7fe1900683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 shutdown_connections 2023-10-06T11:16:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.658+0000 7fe198743700 1 -- 172.21.15.55:0/4142779159 wait complete. 2023-10-06T11:16:37.661 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 59 2023-10-06T11:16:37.671 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:37.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.788+0000 7f9861abf700 1 Processor -- start 2023-10-06T11:16:37.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 -- start start 2023-10-06T11:16:37.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f985c0adf20 0x7f985c0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c06e240 0x7f985c06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f985c069520 0x7f985c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c156110 con 0x7f985c0adf20 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c069ee0 con 0x7f985c069520 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f9861abf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c7330 con 0x7f985c06e240 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.789+0000 7f985b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f985c0adf20 0x7f985c0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f985c0adf20 0x7f985c0ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38190/0 (socket says 172.21.15.55:38190) 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 -- 172.21.15.55:0/3144359259 learned_addr learned my addr 172.21.15.55:0/3144359259 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:37.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985bfff700 1 --2- 172.21.15.55:0/3144359259 >> v2:172.21.15.142:3300/0 conn(0x7f985c069520 0x7f985c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985affd700 1 --2- 172.21.15.55:0/3144359259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c06e240 0x7f985c06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 -- 172.21.15.55:0/3144359259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c06e240 msgr2=0x7f985c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 --2- 172.21.15.55:0/3144359259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c06e240 0x7f985c06e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 -- 172.21.15.55:0/3144359259 >> v2:172.21.15.142:3300/0 conn(0x7f985c069520 msgr2=0x7f985c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 --2- 172.21.15.55:0/3144359259 >> v2:172.21.15.142:3300/0 conn(0x7f985c069520 0x7f985c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 -- 172.21.15.55:0/3144359259 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0ac540 con 0x7f985c0adf20 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985b7fe700 1 --2- 172.21.15.55:0/3144359259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c0adf20 0x7f985c0ac000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f985c06a9c0 tx=0x7f984c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e71e0bb92eb8b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985a7fc700 1 -- 172.21.15.55:0/3144359259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00b820 con 0x7f985c0adf20 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985a7fc700 1 -- 172.21.15.55:0/3144359259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c00b980 con 0x7f985c0adf20 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.790+0000 7f985a7fc700 1 -- 172.21.15.55:0/3144359259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00bd20 con 0x7f985c0adf20 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 -- 172.21.15.55:0/3144359259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c0adf20 msgr2=0x7f985c0ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 --2- 172.21.15.55:0/3144359259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c0adf20 0x7f985c0ac000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f985c06a9c0 tx=0x7f984c009250 comp rx=0 tx=0).stop 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 -- 172.21.15.55:0/3144359259 shutdown_connections 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 --2- 172.21.15.55:0/3144359259 >> v2:172.21.15.142:3300/0 conn(0x7f985c069520 0x7f985c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 --2- 172.21.15.55:0/3144359259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c0adf20 0x7f985c0ac000 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 --2- 172.21.15.55:0/3144359259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c06e240 0x7f985c06e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 -- 172.21.15.55:0/3144359259 >> 172.21.15.55:0/3144359259 conn(0x7f985c068080 msgr2=0x7f985c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 -- 172.21.15.55:0/3144359259 shutdown_connections 2023-10-06T11:16:37.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.791+0000 7f9861abf700 1 -- 172.21.15.55:0/3144359259 wait complete. 2023-10-06T11:16:37.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.792+0000 7f9861abf700 1 Processor -- start 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.792+0000 7f9861abf700 1 -- start start 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f9861abf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 0x7f985c16a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f9861abf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c06e240 0x7f985c1674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f9861abf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0adf20 0x7f985c0b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f9861abf700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c4270 con 0x7f985c069520 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f9861abf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c50d0 con 0x7f985c06e240 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f9861abf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c44c0 con 0x7f985c0adf20 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 0x7f985c16a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 0x7f985c16a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38198/0 (socket says 172.21.15.55:38198) 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 -- 172.21.15.55:0/3548076924 learned_addr learned my addr 172.21.15.55:0/3548076924 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985affd700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c06e240 0x7f985c1674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985bfff700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0adf20 0x7f985c0b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 -- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0adf20 msgr2=0x7f985c0b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0adf20 0x7f985c0b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 -- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c06e240 msgr2=0x7f985c1674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c06e240 0x7f985c1674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 -- 172.21.15.55:0/3548076924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c0094f0 con 0x7f985c069520 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985bfff700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0adf20 0x7f985c0b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f985b7fe700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 0x7f985c16a290 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f984c009290 tx=0x7f984c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.793+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c011de0 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.794+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c024440 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.794+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c0c47a0 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.794+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c0247e0 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.794+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0c4d60 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.794+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c064a90 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.795+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f984c01a420 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.795+0000 7f98437fe700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9848066f30 0x7f98480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.795+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f984c0865c0 con 0x7f985c069520 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.795+0000 7f985affd700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9848066f30 0x7f98480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.796+0000 7f985affd700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9848066f30 0x7f98480693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f985c0abaf0 tx=0x7f9850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.800+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f984c053590 con 0x7f985c069520 2023-10-06T11:16:37.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.993+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f985c0c6720 con 0x7f985c069520 2023-10-06T11:16:37.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.994+0000 7f98437fe700 1 -- 172.21.15.55:0/3548076924 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f984c056bb0 con 0x7f985c069520 2023-10-06T11:16:37.996 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:37.996 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:35.224948+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:31.352151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:32.593083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:37.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9848066f30 msgr2=0x7f98480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9848066f30 0x7f98480693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f985c0abaf0 tx=0x7f9850008040 comp rx=0 tx=0).stop 2023-10-06T11:16:37.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 msgr2=0x7f985c16a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 0x7f985c16a290 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f984c009290 tx=0x7f984c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 shutdown_connections 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9848066f30 0x7f98480693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f985c069520 0x7f985c16a290 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0adf20 0x7f985c0b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 --2- 172.21.15.55:0/3548076924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c06e240 0x7f985c1674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 >> 172.21.15.55:0/3548076924 conn(0x7f985c068080 msgr2=0x7f985c0c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 shutdown_connections 2023-10-06T11:16:37.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:37.996+0000 7f9861abf700 1 -- 172.21.15.55:0/3548076924 wait complete. 2023-10-06T11:16:38.010 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:16:38.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:38.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.128+0000 7f87b359e700 1 Processor -- start 2023-10-06T11:16:38.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.128+0000 7f87b359e700 1 -- start start 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b4159440 0x7f87b40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b359e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b40cb7a0 con 0x7f87b40b35d0 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b40b0860 con 0x7f87b40b2100 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b359e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b40cb150 con 0x7f87b4159440 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b259c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b4159440 0x7f87b40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b1d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87b40b35d0 0x7f87b40cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48184/0 (socket says 172.21.15.55:48184) 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.129+0000 7f87b1d9b700 1 -- 172.21.15.55:0/3997523061 learned_addr learned my addr 172.21.15.55:0/3997523061 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b259c700 1 -- 172.21.15.55:0/3997523061 >> v1:172.21.15.142:6789/0 conn(0x7f87b40b2100 legacy=0x7f87b40b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b259c700 1 -- 172.21.15.55:0/3997523061 >> v1:172.21.15.55:6789/0 conn(0x7f87b40b35d0 legacy=0x7f87b40cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b259c700 1 -- 172.21.15.55:0/3997523061 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40cb430 con 0x7f87b4159440 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b159a700 1 -- 172.21.15.55:0/3997523061 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184105281 0 0) 0x7f87b40cb7a0 con 0x7f87b40b35d0 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b259c700 1 --2- 172.21.15.55:0/3997523061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b4159440 0x7f87b40b3090 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f879c0098e0 tx=0x7f879c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e1b060a47f5ba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b159a700 1 -- 172.21.15.55:0/3997523061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c009e80 con 0x7f87b4159440 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b159a700 1 -- 172.21.15.55:0/3997523061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00b860 con 0x7f87b4159440 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.130+0000 7f87b159a700 1 -- 172.21.15.55:0/3997523061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00bbe0 con 0x7f87b4159440 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 -- 172.21.15.55:0/3997523061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b4159440 msgr2=0x7f87b40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 --2- 172.21.15.55:0/3997523061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b4159440 0x7f87b40b3090 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f879c0098e0 tx=0x7f879c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 -- 172.21.15.55:0/3997523061 shutdown_connections 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 --2- 172.21.15.55:0/3997523061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b4159440 0x7f87b40b3090 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 -- 172.21.15.55:0/3997523061 >> 172.21.15.55:0/3997523061 conn(0x7f87b406ece0 msgr2=0x7f87b406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:38.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 -- 172.21.15.55:0/3997523061 shutdown_connections 2023-10-06T11:16:38.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.131+0000 7f87b359e700 1 -- 172.21.15.55:0/3997523061 wait complete. 2023-10-06T11:16:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.132+0000 7f87b359e700 1 Processor -- start 2023-10-06T11:16:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.132+0000 7f87b359e700 1 -- start start 2023-10-06T11:16:38.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87b40b2100 0x7f87b40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 0x7f87b40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87b4159440 0x7f87b416d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40c9370 con 0x7f87b40b35d0 2023-10-06T11:16:38.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b4154a10 con 0x7f87b40b2100 2023-10-06T11:16:38.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b4154cf0 con 0x7f87b4159440 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 0x7f87b40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 0x7f87b40ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38210/0 (socket says 172.21.15.55:38210) 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 -- 172.21.15.55:0/332646589 learned_addr learned my addr 172.21.15.55:0/332646589 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b259c700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87b40b2100 0x7f87b40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b2d9d700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87b4159440 0x7f87b416d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 -- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87b4159440 msgr2=0x7f87b416d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87b4159440 0x7f87b416d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 -- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87b40b2100 msgr2=0x7f87b40cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87b40b2100 0x7f87b40cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 -- 172.21.15.55:0/332646589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009420 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b2d9d700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87b4159440 0x7f87b416d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b1d9b700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 0x7f87b40ccc30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c810 tx=0x7f87a4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4005c00 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4005d60 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b4154fd0 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4007340 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.133+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b4154450 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.134+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b4155470 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.135+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87a401b400 con 0x7f87b40b35d0 2023-10-06T11:16:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.135+0000 7f87aa7fc700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8794066f60 0x7f8794069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.135+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f87a4084260 con 0x7f87b40b35d0 2023-10-06T11:16:38.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.135+0000 7f87b259c700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8794066f60 0x7f8794069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.136+0000 7f87b259c700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8794066f60 0x7f8794069410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f879c0093f0 tx=0x7f879c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.139+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87a40512b0 con 0x7f87b40b35d0 2023-10-06T11:16:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.329+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87b40b5ac0 con 0x7f8794066f60 2023-10-06T11:16:38.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.338+0000 7f87aa7fc700 1 -- 172.21.15.55:0/332646589 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309067 (secure 0 0 0) 0x7f87b40b5ac0 con 0x7f8794066f60 2023-10-06T11:16:38.343 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.341+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8794066f60 msgr2=0x7f8794069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.341+0000 7f87b359e700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8794066f60 0x7f8794069410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f879c0093f0 tx=0x7f879c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.341+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 msgr2=0x7f87b40ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.341+0000 7f87b359e700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 0x7f87b40ccc30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c810 tx=0x7f87a4007d90 comp rx=0 tx=0).stop 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.341+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 shutdown_connections 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8794066f60 0x7f8794069410 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87b4159440 0x7f87b416d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87b40b2100 0x7f87b40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 --2- 172.21.15.55:0/332646589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b40b35d0 0x7f87b40ccc30 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 >> 172.21.15.55:0/332646589 conn(0x7f87b406ece0 msgr2=0x7f87b40cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:38.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 shutdown_connections 2023-10-06T11:16:38.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.342+0000 7f87b359e700 1 -- 172.21.15.55:0/332646589 wait complete. 2023-10-06T11:16:38.347 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:38.355 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T11:16:36.888773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389256,"kb_used_data":10952,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585464,"statfs":{"total":773094113280,"available":770647515136,"internally_reserved":0,"allocated":11214848,"data_stored":5905400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.691048"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.219019+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:11.838005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199831+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:57.843933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200777+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213524+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:17.700582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207782+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:55.397042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210429+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:43.643298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203627+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:05.482312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200673+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213467+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:59.454027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213379+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:39.027148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198587+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210754+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:14.462278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198718+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:11.494531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199339+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206793+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:11.734578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211224+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:25.658893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199708+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:00:30.047202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203540+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200330+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198711+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.201191+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:04.302154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:26.058723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198837+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208250+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:19.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199170+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:57.757671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208201+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:45.935305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211851+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:55.669164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207714+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200675+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:21.773972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203957+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:24.048799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.209372+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:29.307102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.205941+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:00.331729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210506+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:14.789768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209192+0000","last_change":"2023-10-06T11:16:33.209192+0000","last_active":"2023-10-06T11:16:33.209192+0000","last_peered":"2023-10-06T11:16:33.209192+0000","last_clean":"2023-10-06T11:16:33.209192+0000","last_became_active":"2023-10-06T11:16:33.208882+0000","last_became_peered":"2023-10-06T11:16:33.208882+0000","last_unstale":"2023-10-06T11:16:33.209192+0000","last_undegraded":"2023-10-06T11:16:33.209192+0000","last_fullsized":"2023-10-06T11:16:33.209192+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.244456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203596+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209362+0000","last_change":"2023-10-06T11:16:33.209362+0000","last_active":"2023-10-06T11:16:33.209362+0000","last_peered":"2023-10-06T11:16:33.209362+0000","last_clean":"2023-10-06T11:16:33.209362+0000","last_became_active":"2023-10-06T11:16:33.209094+0000","last_became_peered":"2023-10-06T11:16:33.209094+0000","last_unstale":"2023-10-06T11:16:33.209362+0000","last_undegraded":"2023-10-06T11:16:33.209362+0000","last_fullsized":"2023-10-06T11:16:33.209362+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:58.573116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.124517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220109+0000","last_change":"2023-10-06T11:16:33.220109+0000","last_active":"2023-10-06T11:16:33.220109+0000","last_peered":"2023-10-06T11:16:33.220109+0000","last_clean":"2023-10-06T11:16:33.220109+0000","last_became_active":"2023-10-06T11:16:33.219863+0000","last_became_peered":"2023-10-06T11:16:33.219863+0000","last_unstale":"2023-10-06T11:16:33.220109+0000","last_undegraded":"2023-10-06T11:16:33.220109+0000","last_fullsized":"2023-10-06T11:16:33.220109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:10.732532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199388+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220071+0000","last_change":"2023-10-06T11:16:33.220071+0000","last_active":"2023-10-06T11:16:33.220071+0000","last_peered":"2023-10-06T11:16:33.220071+0000","last_clean":"2023-10-06T11:16:33.220071+0000","last_became_active":"2023-10-06T11:16:33.219690+0000","last_became_peered":"2023-10-06T11:16:33.219690+0000","last_unstale":"2023-10-06T11:16:33.220071+0000","last_undegraded":"2023-10-06T11:16:33.220071+0000","last_fullsized":"2023-10-06T11:16:33.220071+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:10.870949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208504+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:51.097081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223884+0000","last_change":"2023-10-06T11:16:33.223884+0000","last_active":"2023-10-06T11:16:33.223884+0000","last_peered":"2023-10-06T11:16:33.223884+0000","last_clean":"2023-10-06T11:16:33.223884+0000","last_became_active":"2023-10-06T11:16:33.223637+0000","last_became_peered":"2023-10-06T11:16:33.223637+0000","last_unstale":"2023-10-06T11:16:33.223884+0000","last_undegraded":"2023-10-06T11:16:33.223884+0000","last_fullsized":"2023-10-06T11:16:33.223884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:33.118292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:31.455801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213285+0000","last_change":"2023-10-06T11:16:33.213285+0000","last_active":"2023-10-06T11:16:33.213285+0000","last_peered":"2023-10-06T11:16:33.213285+0000","last_clean":"2023-10-06T11:16:33.213285+0000","last_became_active":"2023-10-06T11:16:33.213019+0000","last_became_peered":"2023-10-06T11:16:33.213019+0000","last_unstale":"2023-10-06T11:16:33.213285+0000","last_undegraded":"2023-10-06T11:16:33.213285+0000","last_fullsized":"2023-10-06T11:16:33.213285+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:29.411415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208935+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:59.743398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213564+0000","last_change":"2023-10-06T11:16:33.213564+0000","last_active":"2023-10-06T11:16:33.213564+0000","last_peered":"2023-10-06T11:16:33.213564+0000","last_clean":"2023-10-06T11:16:33.213564+0000","last_became_active":"2023-10-06T11:16:33.213277+0000","last_became_peered":"2023-10-06T11:16:33.213277+0000","last_unstale":"2023-10-06T11:16:33.213564+0000","last_undegraded":"2023-10-06T11:16:33.213564+0000","last_fullsized":"2023-10-06T11:16:33.213564+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:22.574901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203149+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:03.107546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217368+0000","last_change":"2023-10-06T11:16:33.217368+0000","last_active":"2023-10-06T11:16:33.217368+0000","last_peered":"2023-10-06T11:16:33.217368+0000","last_clean":"2023-10-06T11:16:33.217368+0000","last_became_active":"2023-10-06T11:16:33.217072+0000","last_became_peered":"2023-10-06T11:16:33.217072+0000","last_unstale":"2023-10-06T11:16:33.217368+0000","last_undegraded":"2023-10-06T11:16:33.217368+0000","last_fullsized":"2023-10-06T11:16:33.217368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:22.680971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207696+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219889+0000","last_change":"2023-10-06T11:16:33.219889+0000","last_active":"2023-10-06T11:16:33.219889+0000","last_peered":"2023-10-06T11:16:33.219889+0000","last_clean":"2023-10-06T11:16:33.219889+0000","last_became_active":"2023-10-06T11:16:33.219585+0000","last_became_peered":"2023-10-06T11:16:33.219585+0000","last_unstale":"2023-10-06T11:16:33.219889+0000","last_undegraded":"2023-10-06T11:16:33.219889+0000","last_fullsized":"2023-10-06T11:16:33.219889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:25.460290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.212265+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.212220+0000","last_change":"2023-10-06T11:16:33.212220+0000","last_active":"2023-10-06T11:16:33.212220+0000","last_peered":"2023-10-06T11:16:33.212220+0000","last_clean":"2023-10-06T11:16:33.212220+0000","last_became_active":"2023-10-06T11:16:33.211932+0000","last_became_peered":"2023-10-06T11:16:33.211932+0000","last_unstale":"2023-10-06T11:16:33.212220+0000","last_undegraded":"2023-10-06T11:16:33.212220+0000","last_fullsized":"2023-10-06T11:16:33.212220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199128+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223822+0000","last_change":"2023-10-06T11:16:33.223822+0000","last_active":"2023-10-06T11:16:33.223822+0000","last_peered":"2023-10-06T11:16:33.223822+0000","last_clean":"2023-10-06T11:16:33.223822+0000","last_became_active":"2023-10-06T11:16:33.223455+0000","last_became_peered":"2023-10-06T11:16:33.223455+0000","last_unstale":"2023-10-06T11:16:33.223822+0000","last_undegraded":"2023-10-06T11:16:33.223822+0000","last_fullsized":"2023-10-06T11:16:33.223822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:10.492484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198901+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:47.057998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.224060+0000","last_change":"2023-10-06T11:16:33.224060+0000","last_active":"2023-10-06T11:16:33.224060+0000","last_peered":"2023-10-06T11:16:33.224060+0000","last_clean":"2023-10-06T11:16:33.224060+0000","last_became_active":"2023-10-06T11:16:33.223797+0000","last_became_peered":"2023-10-06T11:16:33.223797+0000","last_unstale":"2023-10-06T11:16:33.224060+0000","last_undegraded":"2023-10-06T11:16:33.224060+0000","last_fullsized":"2023-10-06T11:16:33.224060+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:26.775059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198552+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:35.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221810+0000","last_change":"2023-10-06T11:16:33.221810+0000","last_active":"2023-10-06T11:16:33.221810+0000","last_peered":"2023-10-06T11:16:33.221810+0000","last_clean":"2023-10-06T11:16:33.221810+0000","last_became_active":"2023-10-06T11:16:33.221549+0000","last_became_peered":"2023-10-06T11:16:33.221549+0000","last_unstale":"2023-10-06T11:16:33.221810+0000","last_undegraded":"2023-10-06T11:16:33.221810+0000","last_fullsized":"2023-10-06T11:16:33.221810+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:27.175374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208605+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:54.763081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220572+0000","last_change":"2023-10-06T11:16:33.220572+0000","last_active":"2023-10-06T11:16:33.220572+0000","last_peered":"2023-10-06T11:16:33.220572+0000","last_clean":"2023-10-06T11:16:33.220572+0000","last_became_active":"2023-10-06T11:16:33.220337+0000","last_became_peered":"2023-10-06T11:16:33.220337+0000","last_unstale":"2023-10-06T11:16:33.220572+0000","last_undegraded":"2023-10-06T11:16:33.220572+0000","last_fullsized":"2023-10-06T11:16:33.220572+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:13.787721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199601+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219845+0000","last_change":"2023-10-06T11:16:33.219845+0000","last_active":"2023-10-06T11:16:33.219845+0000","last_peered":"2023-10-06T11:16:33.219845+0000","last_clean":"2023-10-06T11:16:33.219845+0000","last_became_active":"2023-10-06T11:16:33.219336+0000","last_became_peered":"2023-10-06T11:16:33.219336+0000","last_unstale":"2023-10-06T11:16:33.219845+0000","last_undegraded":"2023-10-06T11:16:33.219845+0000","last_fullsized":"2023-10-06T11:16:33.219845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.506752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207414+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216450+0000","last_change":"2023-10-06T11:16:33.216450+0000","last_active":"2023-10-06T11:16:33.216450+0000","last_peered":"2023-10-06T11:16:33.216450+0000","last_clean":"2023-10-06T11:16:33.216450+0000","last_became_active":"2023-10-06T11:16:33.215830+0000","last_became_peered":"2023-10-06T11:16:33.215830+0000","last_unstale":"2023-10-06T11:16:33.216450+0000","last_undegraded":"2023-10-06T11:16:33.216450+0000","last_fullsized":"2023-10-06T11:16:33.216450+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:13.026976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202956+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220995+0000","last_change":"2023-10-06T11:16:33.220995+0000","last_active":"2023-10-06T11:16:33.220995+0000","last_peered":"2023-10-06T11:16:33.220995+0000","last_clean":"2023-10-06T11:16:33.220995+0000","last_became_active":"2023-10-06T11:16:33.220666+0000","last_became_peered":"2023-10-06T11:16:33.220666+0000","last_unstale":"2023-10-06T11:16:33.220995+0000","last_undegraded":"2023-10-06T11:16:33.220995+0000","last_fullsized":"2023-10-06T11:16:33.220995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:14.808502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208030+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:48.432471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.211898+0000","last_change":"2023-10-06T11:16:33.211898+0000","last_active":"2023-10-06T11:16:33.211898+0000","last_peered":"2023-10-06T11:16:33.211898+0000","last_clean":"2023-10-06T11:16:33.211898+0000","last_became_active":"2023-10-06T11:16:33.211582+0000","last_became_peered":"2023-10-06T11:16:33.211582+0000","last_unstale":"2023-10-06T11:16:33.211898+0000","last_undegraded":"2023-10-06T11:16:33.211898+0000","last_fullsized":"2023-10-06T11:16:33.211898+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:14.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208507+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:57.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218347+0000","last_change":"2023-10-06T11:16:33.218347+0000","last_active":"2023-10-06T11:16:33.218347+0000","last_peered":"2023-10-06T11:16:33.218347+0000","last_clean":"2023-10-06T11:16:33.218347+0000","last_became_active":"2023-10-06T11:16:33.217829+0000","last_became_peered":"2023-10-06T11:16:33.217829+0000","last_unstale":"2023-10-06T11:16:33.218347+0000","last_undegraded":"2023-10-06T11:16:33.218347+0000","last_fullsized":"2023-10-06T11:16:33.218347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:49:48.984656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204562+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218295+0000","last_change":"2023-10-06T11:16:33.218295+0000","last_active":"2023-10-06T11:16:33.218295+0000","last_peered":"2023-10-06T11:16:33.218295+0000","last_clean":"2023-10-06T11:16:33.218295+0000","last_became_active":"2023-10-06T11:16:33.218027+0000","last_became_peered":"2023-10-06T11:16:33.218027+0000","last_unstale":"2023-10-06T11:16:33.218295+0000","last_undegraded":"2023-10-06T11:16:33.218295+0000","last_fullsized":"2023-10-06T11:16:33.218295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:28.052406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199787+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:06.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209049+0000","last_change":"2023-10-06T11:16:33.209049+0000","last_active":"2023-10-06T11:16:33.209049+0000","last_peered":"2023-10-06T11:16:33.209049+0000","last_clean":"2023-10-06T11:16:33.209049+0000","last_became_active":"2023-10-06T11:16:33.208697+0000","last_became_peered":"2023-10-06T11:16:33.208697+0000","last_unstale":"2023-10-06T11:16:33.209049+0000","last_undegraded":"2023-10-06T11:16:33.209049+0000","last_fullsized":"2023-10-06T11:16:33.209049+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.708958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199655+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:59.285038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219734+0000","last_change":"2023-10-06T11:16:33.219734+0000","last_active":"2023-10-06T11:16:33.219734+0000","last_peered":"2023-10-06T11:16:33.219734+0000","last_clean":"2023-10-06T11:16:33.219734+0000","last_became_active":"2023-10-06T11:16:33.219460+0000","last_became_peered":"2023-10-06T11:16:33.219460+0000","last_unstale":"2023-10-06T11:16:33.219734+0000","last_undegraded":"2023-10-06T11:16:33.219734+0000","last_fullsized":"2023-10-06T11:16:33.219734+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:18.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198528+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:15.720942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216523+0000","last_change":"2023-10-06T11:16:33.216523+0000","last_active":"2023-10-06T11:16:33.216523+0000","last_peered":"2023-10-06T11:16:33.216523+0000","last_clean":"2023-10-06T11:16:33.216523+0000","last_became_active":"2023-10-06T11:16:33.216307+0000","last_became_peered":"2023-10-06T11:16:33.216307+0000","last_unstale":"2023-10-06T11:16:33.216523+0000","last_undegraded":"2023-10-06T11:16:33.216523+0000","last_fullsized":"2023-10-06T11:16:33.216523+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:42.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208804+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:43.963003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216619+0000","last_change":"2023-10-06T11:16:33.216619+0000","last_active":"2023-10-06T11:16:33.216619+0000","last_peered":"2023-10-06T11:16:33.216619+0000","last_clean":"2023-10-06T11:16:33.216619+0000","last_became_active":"2023-10-06T11:16:33.216192+0000","last_became_peered":"2023-10-06T11:16:33.216192+0000","last_unstale":"2023-10-06T11:16:33.216619+0000","last_undegraded":"2023-10-06T11:16:33.216619+0000","last_fullsized":"2023-10-06T11:16:33.216619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:06.366888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203139+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213912+0000","last_change":"2023-10-06T11:16:33.213912+0000","last_active":"2023-10-06T11:16:33.213912+0000","last_peered":"2023-10-06T11:16:33.213912+0000","last_clean":"2023-10-06T11:16:33.213912+0000","last_became_active":"2023-10-06T11:16:33.213162+0000","last_became_peered":"2023-10-06T11:16:33.213162+0000","last_unstale":"2023-10-06T11:16:33.213912+0000","last_undegraded":"2023-10-06T11:16:33.213912+0000","last_fullsized":"2023-10-06T11:16:33.213912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:46.055952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203912+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:32.203912+0000","last_peered":"2023-10-06T11:16:32.203912+0000","last_clean":"2023-10-06T11:16:32.203912+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:32.203912+0000","last_undegraded":"2023-10-06T11:16:32.203912+0000","last_fullsized":"2023-10-06T11:16:32.203912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207914+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:04.732227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223967+0000","last_change":"2023-10-06T11:16:33.223967+0000","last_active":"2023-10-06T11:16:33.223967+0000","last_peered":"2023-10-06T11:16:33.223967+0000","last_clean":"2023-10-06T11:16:33.223967+0000","last_became_active":"2023-10-06T11:16:33.223718+0000","last_became_peered":"2023-10-06T11:16:33.223718+0000","last_unstale":"2023-10-06T11:16:33.223967+0000","last_undegraded":"2023-10-06T11:16:33.223967+0000","last_fullsized":"2023-10-06T11:16:33.223967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:07.122471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199277+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:32.199277+0000","last_peered":"2023-10-06T11:16:32.199277+0000","last_clean":"2023-10-06T11:16:32.199277+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:32.199277+0000","last_undegraded":"2023-10-06T11:16:32.199277+0000","last_fullsized":"2023-10-06T11:16:32.199277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206904+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218452+0000","last_change":"2023-10-06T11:16:33.218452+0000","last_active":"2023-10-06T11:16:33.218452+0000","last_peered":"2023-10-06T11:16:33.218452+0000","last_clean":"2023-10-06T11:16:33.218452+0000","last_became_active":"2023-10-06T11:16:33.218174+0000","last_became_peered":"2023-10-06T11:16:33.218174+0000","last_unstale":"2023-10-06T11:16:33.218452+0000","last_undegraded":"2023-10-06T11:16:33.218452+0000","last_fullsized":"2023-10-06T11:16:33.218452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199399+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:32.199399+0000","last_peered":"2023-10-06T11:16:32.199399+0000","last_clean":"2023-10-06T11:16:32.199399+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:32.199399+0000","last_undegraded":"2023-10-06T11:16:32.199399+0000","last_fullsized":"2023-10-06T11:16:32.199399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206766+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217999+0000","last_change":"2023-10-06T11:16:33.217999+0000","last_active":"2023-10-06T11:16:33.217999+0000","last_peered":"2023-10-06T11:16:33.217999+0000","last_clean":"2023-10-06T11:16:33.217999+0000","last_became_active":"2023-10-06T11:16:33.217732+0000","last_became_peered":"2023-10-06T11:16:33.217732+0000","last_unstale":"2023-10-06T11:16:33.217999+0000","last_undegraded":"2023-10-06T11:16:33.217999+0000","last_fullsized":"2023-10-06T11:16:33.217999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:18.572365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.201292+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:32.201292+0000","last_peered":"2023-10-06T11:16:32.201292+0000","last_clean":"2023-10-06T11:16:32.201292+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:32.201292+0000","last_undegraded":"2023-10-06T11:16:32.201292+0000","last_fullsized":"2023-10-06T11:16:32.201292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.205986+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:32.205986+0000","last_peered":"2023-10-06T11:16:32.205986+0000","last_clean":"2023-10-06T11:16:32.205986+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:32.205986+0000","last_undegraded":"2023-10-06T11:16:32.205986+0000","last_fullsized":"2023-10-06T11:16:32.205986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206850+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.215786+0000","last_change":"2023-10-06T11:16:33.215786+0000","last_active":"2023-10-06T11:16:33.215786+0000","last_peered":"2023-10-06T11:16:33.215786+0000","last_clean":"2023-10-06T11:16:33.215786+0000","last_became_active":"2023-10-06T11:16:33.215537+0000","last_became_peered":"2023-10-06T11:16:33.215537+0000","last_unstale":"2023-10-06T11:16:33.215786+0000","last_undegraded":"2023-10-06T11:16:33.215786+0000","last_fullsized":"2023-10-06T11:16:33.215786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:34.426776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206482+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:32.206482+0000","last_peered":"2023-10-06T11:16:32.206482+0000","last_clean":"2023-10-06T11:16:32.206482+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:32.206482+0000","last_undegraded":"2023-10-06T11:16:32.206482+0000","last_fullsized":"2023-10-06T11:16:32.206482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204603+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:05.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223915+0000","last_change":"2023-10-06T11:16:33.223915+0000","last_active":"2023-10-06T11:16:33.223915+0000","last_peered":"2023-10-06T11:16:33.223915+0000","last_clean":"2023-10-06T11:16:33.223915+0000","last_became_active":"2023-10-06T11:16:33.223629+0000","last_became_peered":"2023-10-06T11:16:33.223629+0000","last_unstale":"2023-10-06T11:16:33.223915+0000","last_undegraded":"2023-10-06T11:16:33.223915+0000","last_fullsized":"2023-10-06T11:16:33.223915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:59.329683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206490+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:32.206490+0000","last_peered":"2023-10-06T11:16:32.206490+0000","last_clean":"2023-10-06T11:16:32.206490+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:32.206490+0000","last_undegraded":"2023-10-06T11:16:32.206490+0000","last_fullsized":"2023-10-06T11:16:32.206490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202728+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:15.676191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221210+0000","last_change":"2023-10-06T11:16:33.221210+0000","last_active":"2023-10-06T11:16:33.221210+0000","last_peered":"2023-10-06T11:16:33.221210+0000","last_clean":"2023-10-06T11:16:33.221210+0000","last_became_active":"2023-10-06T11:16:33.220958+0000","last_became_peered":"2023-10-06T11:16:33.220958+0000","last_unstale":"2023-10-06T11:16:33.221210+0000","last_undegraded":"2023-10-06T11:16:33.221210+0000","last_fullsized":"2023-10-06T11:16:33.221210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:43:17.165325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203800+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:32.203800+0000","last_peered":"2023-10-06T11:16:32.203800+0000","last_clean":"2023-10-06T11:16:32.203800+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:32.203800+0000","last_undegraded":"2023-10-06T11:16:32.203800+0000","last_fullsized":"2023-10-06T11:16:32.203800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218458+0000","last_change":"2023-10-06T11:16:33.218458+0000","last_active":"2023-10-06T11:16:33.218458+0000","last_peered":"2023-10-06T11:16:33.218458+0000","last_clean":"2023-10-06T11:16:33.218458+0000","last_became_active":"2023-10-06T11:16:33.218195+0000","last_became_peered":"2023-10-06T11:16:33.218195+0000","last_unstale":"2023-10-06T11:16:33.218458+0000","last_undegraded":"2023-10-06T11:16:33.218458+0000","last_fullsized":"2023-10-06T11:16:33.218458+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:03.300107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206678+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:32.206678+0000","last_peered":"2023-10-06T11:16:32.206678+0000","last_clean":"2023-10-06T11:16:32.206678+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:32.206678+0000","last_undegraded":"2023-10-06T11:16:32.206678+0000","last_fullsized":"2023-10-06T11:16:32.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.432},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.497}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.056,"15min":1.056},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.371},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":1.254},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.298}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":1.319}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60999999999999999,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.434,"15min":0.432},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47199999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":1.056,"15min":1.056},"last":0.255},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.438,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56999999999999995,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.55400000000000005,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65700000000000003,"15min":0.67900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78400000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66500000000000004,"15min":0.68700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.745,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.335,"15min":2.335},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72399999999999998,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.218,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36799999999999999,"15min":0.38},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42899999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.497,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38700000000000001,"15min":0.40100000000000002},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83499999999999996,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.872,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":1.115,"15min":1.115},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80500000000000005,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84299999999999997,"5min":1.276,"15min":1.276},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.996,"15min":0.996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71399999999999997,"5min":1.014,"15min":1.014},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.621},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":1.369,"15min":1.369},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77200000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70599999999999996,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81000000000000005,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":1.355,"15min":1.355},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":1.512,"15min":1.512},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:38.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:38.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.513+0000 7f74f1a54700 1 Processor -- start 2023-10-06T11:16:38.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.513+0000 7f74f1a54700 1 -- start start 2023-10-06T11:16:38.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.514+0000 7f74f1a54700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74ec0b29b0 0x7f74ec159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.514+0000 7f74f1a54700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec0b0da0 con 0x7f74ec159660 2023-10-06T11:16:38.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.514+0000 7f74f1a54700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec0cbfa0 con 0x7f74ec0b25e0 2023-10-06T11:16:38.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.514+0000 7f74f1a54700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec0cb390 con 0x7f74ec0b29b0 2023-10-06T11:16:38.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.514+0000 7f74eb7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74ec159660 0x7f74ec0cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48186/0 (socket says 172.21.15.55:48186) 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.514+0000 7f74eb7fe700 1 -- 172.21.15.55:0/2451801550 learned_addr learned my addr 172.21.15.55:0/2451801550 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74ea7fc700 1 --2- 172.21.15.55:0/2451801550 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0b29b0 0x7f74ec159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152029271 0 0) 0x7f74e4001490 con 0x7f74ec159660 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d8003570 con 0x7f74ec159660 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1043772364 0 0) 0x7f74d8003570 con 0x7f74ec159660 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0b29b0 msgr2=0x7f74ec159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 --2- 172.21.15.55:0/2451801550 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0b29b0 0x7f74ec159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 >> v1:172.21.15.142:6789/0 conn(0x7f74ec0b25e0 legacy=0x7f74ec0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0cb670 con 0x7f74ec159660 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f74e4001980 con 0x7f74ec159660 2023-10-06T11:16:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74ea7fc700 1 --2- 172.21.15.55:0/2451801550 >> v2:172.21.15.142:3300/0 conn(0x7f74ec0b29b0 0x7f74ec159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 >> v1:172.21.15.55:6789/0 conn(0x7f74ec159660 legacy=0x7f74ec0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d8003a60 0x7f74d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74d8004810 0x7f74d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d80051c0 0x7f74d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cb390 con 0x7f74d8003a60 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800c050 con 0x7f74d8004810 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800c210 con 0x7f74d80051c0 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74eaffd700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d8003a60 0x7f74d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74ea7fc700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74d8004810 0x7f74d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.515+0000 7f74eb7fe700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d80051c0 0x7f74d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eaffd700 1 -- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d80051c0 msgr2=0x7f74d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eaffd700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d80051c0 0x7f74d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eaffd700 1 -- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74d8004810 msgr2=0x7f74d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eaffd700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74d8004810 0x7f74d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eaffd700 1 -- 172.21.15.55:0/2451801550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8003570 con 0x7f74d8003a60 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74ea7fc700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74d8004810 0x7f74d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eb7fe700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d80051c0 0x7f74d800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eb7fe700 1 -- 172.21.15.55:0/2451801550 reap_dead start 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74eaffd700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d8003a60 0x7f74d8003e30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0019c0 tx=0x7f74dc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397dcfb37fa7a2a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc001330 con 0x7f74d8003a60 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc00c5d0 con 0x7f74d8003a60 2023-10-06T11:16:38.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74e9ffb700 1 -- 172.21.15.55:0/2451801550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00c970 con 0x7f74d8003a60 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 -- 172.21.15.55:0/2451801550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d8003a60 msgr2=0x7f74d8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d8003a60 0x7f74d8003e30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0019c0 tx=0x7f74dc007d60 comp rx=0 tx=0).stop 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 -- 172.21.15.55:0/2451801550 shutdown_connections 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 --2- 172.21.15.55:0/2451801550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d8003a60 0x7f74d8003e30 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 -- 172.21.15.55:0/2451801550 >> 172.21.15.55:0/2451801550 conn(0x7f74ec06ece0 msgr2=0x7f74ec06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 -- 172.21.15.55:0/2451801550 shutdown_connections 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.516+0000 7f74f1a54700 1 -- 172.21.15.55:0/2451801550 wait complete. 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.518+0000 7f74f1a54700 1 Processor -- start 2023-10-06T11:16:38.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.518+0000 7f74f1a54700 1 -- start start 2023-10-06T11:16:38.524 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-10-06T11:16:38.515+0000 7f98b0144700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.518+0000 7f74f1a54700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d8003a60 0x7f74ec0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0c4680 0x7f74ec0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 0x7f74ec1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0c76e0 con 0x7f74ec0c57b0 2023-10-06T11:16:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0c5cc0 con 0x7f74ec0c4680 2023-10-06T11:16:38.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0c5fa0 con 0x7f74d8003a60 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 0x7f74ec1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 0x7f74ec1545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38236/0 (socket says 172.21.15.55:38236) 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 -- 172.21.15.55:0/1839952428 learned_addr learned my addr 172.21.15.55:0/1839952428 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74ea7fc700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0c4680 0x7f74ec0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 -- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d8003a60 msgr2=0x7f74ec0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d8003a60 0x7f74ec0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 -- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0c4680 msgr2=0x7f74ec0c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0c4680 0x7f74ec0c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 -- 172.21.15.55:0/1839952428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0c6280 con 0x7f74ec0c57b0 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74ea7fc700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0c4680 0x7f74ec0c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:38.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74eb7fe700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 0x7f74ec1545b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f74e4000f80 tx=0x7f74e4001270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4007b60 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400ebc0 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec0c4c40 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4013420 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.519+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec154cb0 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.520+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec0c74d0 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.521+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74e4013810 con 0x7f74ec0c57b0 2023-10-06T11:16:38.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.521+0000 7f74e2ffd700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74cc066f30 0x7f74cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.521+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f74e4084bf0 con 0x7f74ec0c57b0 2023-10-06T11:16:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.521+0000 7f74eaffd700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74cc066f30 0x7f74cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.522+0000 7f74eaffd700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74cc066f30 0x7f74cc0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f74dc000ef0 tx=0x7f74dc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.525+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74e4051bc0 con 0x7f74ec0c57b0 2023-10-06T11:16:38.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.715+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74ec0c74d0 con 0x7f74cc066f30 2023-10-06T11:16:38.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.724+0000 7f74e2ffd700 1 -- 172.21.15.55:0/1839952428 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309067 (secure 0 0 0) 0x7f74ec0c74d0 con 0x7f74cc066f30 2023-10-06T11:16:38.729 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.727+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74cc066f30 msgr2=0x7f74cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.727+0000 7f74f1a54700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74cc066f30 0x7f74cc0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f74dc000ef0 tx=0x7f74dc015000 comp rx=0 tx=0).stop 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.727+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 msgr2=0x7f74ec1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.727+0000 7f74f1a54700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 0x7f74ec1545b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f74e4000f80 tx=0x7f74e4001270 comp rx=0 tx=0).stop 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 shutdown_connections 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f74cc066f30 0x7f74cc0693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec0c57b0 0x7f74ec1545b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74d8003a60 0x7f74ec0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 --2- 172.21.15.55:0/1839952428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0c4680 0x7f74ec0c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 >> 172.21.15.55:0/1839952428 conn(0x7f74ec06ece0 msgr2=0x7f74ec0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 shutdown_connections 2023-10-06T11:16:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.728+0000 7f74f1a54700 1 -- 172.21.15.55:0/1839952428 wait complete. 2023-10-06T11:16:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:38.741 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T11:16:36.888773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389256,"kb_used_data":10952,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585464,"statfs":{"total":773094113280,"available":770647515136,"internally_reserved":0,"allocated":11214848,"data_stored":5905400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.691048"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.219019+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:11.838005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199831+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:57.843933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200777+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213524+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:17.700582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207782+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:55.397042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210429+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:43.643298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203627+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:05.482312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200673+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213467+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:59.454027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213379+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:39.027148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198587+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210754+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:14.462278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198718+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:11.494531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199339+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206793+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:11.734578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211224+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:25.658893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199708+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:00:30.047202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203540+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200330+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198711+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.201191+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:04.302154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:26.058723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198837+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208250+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:19.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199170+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:57.757671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208201+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:45.935305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211851+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:55.669164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207714+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200675+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:21.773972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203957+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:24.048799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.209372+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:29.307102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.205941+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:00.331729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210506+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:14.789768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209192+0000","last_change":"2023-10-06T11:16:33.209192+0000","last_active":"2023-10-06T11:16:33.209192+0000","last_peered":"2023-10-06T11:16:33.209192+0000","last_clean":"2023-10-06T11:16:33.209192+0000","last_became_active":"2023-10-06T11:16:33.208882+0000","last_became_peered":"2023-10-06T11:16:33.208882+0000","last_unstale":"2023-10-06T11:16:33.209192+0000","last_undegraded":"2023-10-06T11:16:33.209192+0000","last_fullsized":"2023-10-06T11:16:33.209192+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.244456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203596+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209362+0000","last_change":"2023-10-06T11:16:33.209362+0000","last_active":"2023-10-06T11:16:33.209362+0000","last_peered":"2023-10-06T11:16:33.209362+0000","last_clean":"2023-10-06T11:16:33.209362+0000","last_became_active":"2023-10-06T11:16:33.209094+0000","last_became_peered":"2023-10-06T11:16:33.209094+0000","last_unstale":"2023-10-06T11:16:33.209362+0000","last_undegraded":"2023-10-06T11:16:33.209362+0000","last_fullsized":"2023-10-06T11:16:33.209362+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:58.573116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.124517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220109+0000","last_change":"2023-10-06T11:16:33.220109+0000","last_active":"2023-10-06T11:16:33.220109+0000","last_peered":"2023-10-06T11:16:33.220109+0000","last_clean":"2023-10-06T11:16:33.220109+0000","last_became_active":"2023-10-06T11:16:33.219863+0000","last_became_peered":"2023-10-06T11:16:33.219863+0000","last_unstale":"2023-10-06T11:16:33.220109+0000","last_undegraded":"2023-10-06T11:16:33.220109+0000","last_fullsized":"2023-10-06T11:16:33.220109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:10.732532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199388+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220071+0000","last_change":"2023-10-06T11:16:33.220071+0000","last_active":"2023-10-06T11:16:33.220071+0000","last_peered":"2023-10-06T11:16:33.220071+0000","last_clean":"2023-10-06T11:16:33.220071+0000","last_became_active":"2023-10-06T11:16:33.219690+0000","last_became_peered":"2023-10-06T11:16:33.219690+0000","last_unstale":"2023-10-06T11:16:33.220071+0000","last_undegraded":"2023-10-06T11:16:33.220071+0000","last_fullsized":"2023-10-06T11:16:33.220071+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:10.870949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208504+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:51.097081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223884+0000","last_change":"2023-10-06T11:16:33.223884+0000","last_active":"2023-10-06T11:16:33.223884+0000","last_peered":"2023-10-06T11:16:33.223884+0000","last_clean":"2023-10-06T11:16:33.223884+0000","last_became_active":"2023-10-06T11:16:33.223637+0000","last_became_peered":"2023-10-06T11:16:33.223637+0000","last_unstale":"2023-10-06T11:16:33.223884+0000","last_undegraded":"2023-10-06T11:16:33.223884+0000","last_fullsized":"2023-10-06T11:16:33.223884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:33.118292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:31.455801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213285+0000","last_change":"2023-10-06T11:16:33.213285+0000","last_active":"2023-10-06T11:16:33.213285+0000","last_peered":"2023-10-06T11:16:33.213285+0000","last_clean":"2023-10-06T11:16:33.213285+0000","last_became_active":"2023-10-06T11:16:33.213019+0000","last_became_peered":"2023-10-06T11:16:33.213019+0000","last_unstale":"2023-10-06T11:16:33.213285+0000","last_undegraded":"2023-10-06T11:16:33.213285+0000","last_fullsized":"2023-10-06T11:16:33.213285+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:29.411415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208935+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:59.743398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213564+0000","last_change":"2023-10-06T11:16:33.213564+0000","last_active":"2023-10-06T11:16:33.213564+0000","last_peered":"2023-10-06T11:16:33.213564+0000","last_clean":"2023-10-06T11:16:33.213564+0000","last_became_active":"2023-10-06T11:16:33.213277+0000","last_became_peered":"2023-10-06T11:16:33.213277+0000","last_unstale":"2023-10-06T11:16:33.213564+0000","last_undegraded":"2023-10-06T11:16:33.213564+0000","last_fullsized":"2023-10-06T11:16:33.213564+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:22.574901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203149+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:03.107546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217368+0000","last_change":"2023-10-06T11:16:33.217368+0000","last_active":"2023-10-06T11:16:33.217368+0000","last_peered":"2023-10-06T11:16:33.217368+0000","last_clean":"2023-10-06T11:16:33.217368+0000","last_became_active":"2023-10-06T11:16:33.217072+0000","last_became_peered":"2023-10-06T11:16:33.217072+0000","last_unstale":"2023-10-06T11:16:33.217368+0000","last_undegraded":"2023-10-06T11:16:33.217368+0000","last_fullsized":"2023-10-06T11:16:33.217368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:22.680971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207696+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219889+0000","last_change":"2023-10-06T11:16:33.219889+0000","last_active":"2023-10-06T11:16:33.219889+0000","last_peered":"2023-10-06T11:16:33.219889+0000","last_clean":"2023-10-06T11:16:33.219889+0000","last_became_active":"2023-10-06T11:16:33.219585+0000","last_became_peered":"2023-10-06T11:16:33.219585+0000","last_unstale":"2023-10-06T11:16:33.219889+0000","last_undegraded":"2023-10-06T11:16:33.219889+0000","last_fullsized":"2023-10-06T11:16:33.219889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:25.460290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.212265+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.212220+0000","last_change":"2023-10-06T11:16:33.212220+0000","last_active":"2023-10-06T11:16:33.212220+0000","last_peered":"2023-10-06T11:16:33.212220+0000","last_clean":"2023-10-06T11:16:33.212220+0000","last_became_active":"2023-10-06T11:16:33.211932+0000","last_became_peered":"2023-10-06T11:16:33.211932+0000","last_unstale":"2023-10-06T11:16:33.212220+0000","last_undegraded":"2023-10-06T11:16:33.212220+0000","last_fullsized":"2023-10-06T11:16:33.212220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199128+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223822+0000","last_change":"2023-10-06T11:16:33.223822+0000","last_active":"2023-10-06T11:16:33.223822+0000","last_peered":"2023-10-06T11:16:33.223822+0000","last_clean":"2023-10-06T11:16:33.223822+0000","last_became_active":"2023-10-06T11:16:33.223455+0000","last_became_peered":"2023-10-06T11:16:33.223455+0000","last_unstale":"2023-10-06T11:16:33.223822+0000","last_undegraded":"2023-10-06T11:16:33.223822+0000","last_fullsized":"2023-10-06T11:16:33.223822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:10.492484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198901+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:47.057998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.224060+0000","last_change":"2023-10-06T11:16:33.224060+0000","last_active":"2023-10-06T11:16:33.224060+0000","last_peered":"2023-10-06T11:16:33.224060+0000","last_clean":"2023-10-06T11:16:33.224060+0000","last_became_active":"2023-10-06T11:16:33.223797+0000","last_became_peered":"2023-10-06T11:16:33.223797+0000","last_unstale":"2023-10-06T11:16:33.224060+0000","last_undegraded":"2023-10-06T11:16:33.224060+0000","last_fullsized":"2023-10-06T11:16:33.224060+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:26.775059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198552+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:35.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221810+0000","last_change":"2023-10-06T11:16:33.221810+0000","last_active":"2023-10-06T11:16:33.221810+0000","last_peered":"2023-10-06T11:16:33.221810+0000","last_clean":"2023-10-06T11:16:33.221810+0000","last_became_active":"2023-10-06T11:16:33.221549+0000","last_became_peered":"2023-10-06T11:16:33.221549+0000","last_unstale":"2023-10-06T11:16:33.221810+0000","last_undegraded":"2023-10-06T11:16:33.221810+0000","last_fullsized":"2023-10-06T11:16:33.221810+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:27.175374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208605+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:54.763081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220572+0000","last_change":"2023-10-06T11:16:33.220572+0000","last_active":"2023-10-06T11:16:33.220572+0000","last_peered":"2023-10-06T11:16:33.220572+0000","last_clean":"2023-10-06T11:16:33.220572+0000","last_became_active":"2023-10-06T11:16:33.220337+0000","last_became_peered":"2023-10-06T11:16:33.220337+0000","last_unstale":"2023-10-06T11:16:33.220572+0000","last_undegraded":"2023-10-06T11:16:33.220572+0000","last_fullsized":"2023-10-06T11:16:33.220572+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:13.787721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199601+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219845+0000","last_change":"2023-10-06T11:16:33.219845+0000","last_active":"2023-10-06T11:16:33.219845+0000","last_peered":"2023-10-06T11:16:33.219845+0000","last_clean":"2023-10-06T11:16:33.219845+0000","last_became_active":"2023-10-06T11:16:33.219336+0000","last_became_peered":"2023-10-06T11:16:33.219336+0000","last_unstale":"2023-10-06T11:16:33.219845+0000","last_undegraded":"2023-10-06T11:16:33.219845+0000","last_fullsized":"2023-10-06T11:16:33.219845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.506752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207414+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216450+0000","last_change":"2023-10-06T11:16:33.216450+0000","last_active":"2023-10-06T11:16:33.216450+0000","last_peered":"2023-10-06T11:16:33.216450+0000","last_clean":"2023-10-06T11:16:33.216450+0000","last_became_active":"2023-10-06T11:16:33.215830+0000","last_became_peered":"2023-10-06T11:16:33.215830+0000","last_unstale":"2023-10-06T11:16:33.216450+0000","last_undegraded":"2023-10-06T11:16:33.216450+0000","last_fullsized":"2023-10-06T11:16:33.216450+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:13.026976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202956+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220995+0000","last_change":"2023-10-06T11:16:33.220995+0000","last_active":"2023-10-06T11:16:33.220995+0000","last_peered":"2023-10-06T11:16:33.220995+0000","last_clean":"2023-10-06T11:16:33.220995+0000","last_became_active":"2023-10-06T11:16:33.220666+0000","last_became_peered":"2023-10-06T11:16:33.220666+0000","last_unstale":"2023-10-06T11:16:33.220995+0000","last_undegraded":"2023-10-06T11:16:33.220995+0000","last_fullsized":"2023-10-06T11:16:33.220995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:14.808502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208030+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:48.432471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.211898+0000","last_change":"2023-10-06T11:16:33.211898+0000","last_active":"2023-10-06T11:16:33.211898+0000","last_peered":"2023-10-06T11:16:33.211898+0000","last_clean":"2023-10-06T11:16:33.211898+0000","last_became_active":"2023-10-06T11:16:33.211582+0000","last_became_peered":"2023-10-06T11:16:33.211582+0000","last_unstale":"2023-10-06T11:16:33.211898+0000","last_undegraded":"2023-10-06T11:16:33.211898+0000","last_fullsized":"2023-10-06T11:16:33.211898+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:14.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208507+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:57.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218347+0000","last_change":"2023-10-06T11:16:33.218347+0000","last_active":"2023-10-06T11:16:33.218347+0000","last_peered":"2023-10-06T11:16:33.218347+0000","last_clean":"2023-10-06T11:16:33.218347+0000","last_became_active":"2023-10-06T11:16:33.217829+0000","last_became_peered":"2023-10-06T11:16:33.217829+0000","last_unstale":"2023-10-06T11:16:33.218347+0000","last_undegraded":"2023-10-06T11:16:33.218347+0000","last_fullsized":"2023-10-06T11:16:33.218347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:49:48.984656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204562+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218295+0000","last_change":"2023-10-06T11:16:33.218295+0000","last_active":"2023-10-06T11:16:33.218295+0000","last_peered":"2023-10-06T11:16:33.218295+0000","last_clean":"2023-10-06T11:16:33.218295+0000","last_became_active":"2023-10-06T11:16:33.218027+0000","last_became_peered":"2023-10-06T11:16:33.218027+0000","last_unstale":"2023-10-06T11:16:33.218295+0000","last_undegraded":"2023-10-06T11:16:33.218295+0000","last_fullsized":"2023-10-06T11:16:33.218295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:28.052406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199787+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:06.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209049+0000","last_change":"2023-10-06T11:16:33.209049+0000","last_active":"2023-10-06T11:16:33.209049+0000","last_peered":"2023-10-06T11:16:33.209049+0000","last_clean":"2023-10-06T11:16:33.209049+0000","last_became_active":"2023-10-06T11:16:33.208697+0000","last_became_peered":"2023-10-06T11:16:33.208697+0000","last_unstale":"2023-10-06T11:16:33.209049+0000","last_undegraded":"2023-10-06T11:16:33.209049+0000","last_fullsized":"2023-10-06T11:16:33.209049+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.708958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199655+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:59.285038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219734+0000","last_change":"2023-10-06T11:16:33.219734+0000","last_active":"2023-10-06T11:16:33.219734+0000","last_peered":"2023-10-06T11:16:33.219734+0000","last_clean":"2023-10-06T11:16:33.219734+0000","last_became_active":"2023-10-06T11:16:33.219460+0000","last_became_peered":"2023-10-06T11:16:33.219460+0000","last_unstale":"2023-10-06T11:16:33.219734+0000","last_undegraded":"2023-10-06T11:16:33.219734+0000","last_fullsized":"2023-10-06T11:16:33.219734+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:18.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198528+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:15.720942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216523+0000","last_change":"2023-10-06T11:16:33.216523+0000","last_active":"2023-10-06T11:16:33.216523+0000","last_peered":"2023-10-06T11:16:33.216523+0000","last_clean":"2023-10-06T11:16:33.216523+0000","last_became_active":"2023-10-06T11:16:33.216307+0000","last_became_peered":"2023-10-06T11:16:33.216307+0000","last_unstale":"2023-10-06T11:16:33.216523+0000","last_undegraded":"2023-10-06T11:16:33.216523+0000","last_fullsized":"2023-10-06T11:16:33.216523+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:42.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208804+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:43.963003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216619+0000","last_change":"2023-10-06T11:16:33.216619+0000","last_active":"2023-10-06T11:16:33.216619+0000","last_peered":"2023-10-06T11:16:33.216619+0000","last_clean":"2023-10-06T11:16:33.216619+0000","last_became_active":"2023-10-06T11:16:33.216192+0000","last_became_peered":"2023-10-06T11:16:33.216192+0000","last_unstale":"2023-10-06T11:16:33.216619+0000","last_undegraded":"2023-10-06T11:16:33.216619+0000","last_fullsized":"2023-10-06T11:16:33.216619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:06.366888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203139+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213912+0000","last_change":"2023-10-06T11:16:33.213912+0000","last_active":"2023-10-06T11:16:33.213912+0000","last_peered":"2023-10-06T11:16:33.213912+0000","last_clean":"2023-10-06T11:16:33.213912+0000","last_became_active":"2023-10-06T11:16:33.213162+0000","last_became_peered":"2023-10-06T11:16:33.213162+0000","last_unstale":"2023-10-06T11:16:33.213912+0000","last_undegraded":"2023-10-06T11:16:33.213912+0000","last_fullsized":"2023-10-06T11:16:33.213912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:46.055952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203912+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:32.203912+0000","last_peered":"2023-10-06T11:16:32.203912+0000","last_clean":"2023-10-06T11:16:32.203912+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:32.203912+0000","last_undegraded":"2023-10-06T11:16:32.203912+0000","last_fullsized":"2023-10-06T11:16:32.203912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207914+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:04.732227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223967+0000","last_change":"2023-10-06T11:16:33.223967+0000","last_active":"2023-10-06T11:16:33.223967+0000","last_peered":"2023-10-06T11:16:33.223967+0000","last_clean":"2023-10-06T11:16:33.223967+0000","last_became_active":"2023-10-06T11:16:33.223718+0000","last_became_peered":"2023-10-06T11:16:33.223718+0000","last_unstale":"2023-10-06T11:16:33.223967+0000","last_undegraded":"2023-10-06T11:16:33.223967+0000","last_fullsized":"2023-10-06T11:16:33.223967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:07.122471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199277+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:32.199277+0000","last_peered":"2023-10-06T11:16:32.199277+0000","last_clean":"2023-10-06T11:16:32.199277+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:32.199277+0000","last_undegraded":"2023-10-06T11:16:32.199277+0000","last_fullsized":"2023-10-06T11:16:32.199277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206904+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218452+0000","last_change":"2023-10-06T11:16:33.218452+0000","last_active":"2023-10-06T11:16:33.218452+0000","last_peered":"2023-10-06T11:16:33.218452+0000","last_clean":"2023-10-06T11:16:33.218452+0000","last_became_active":"2023-10-06T11:16:33.218174+0000","last_became_peered":"2023-10-06T11:16:33.218174+0000","last_unstale":"2023-10-06T11:16:33.218452+0000","last_undegraded":"2023-10-06T11:16:33.218452+0000","last_fullsized":"2023-10-06T11:16:33.218452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199399+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:32.199399+0000","last_peered":"2023-10-06T11:16:32.199399+0000","last_clean":"2023-10-06T11:16:32.199399+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:32.199399+0000","last_undegraded":"2023-10-06T11:16:32.199399+0000","last_fullsized":"2023-10-06T11:16:32.199399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206766+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217999+0000","last_change":"2023-10-06T11:16:33.217999+0000","last_active":"2023-10-06T11:16:33.217999+0000","last_peered":"2023-10-06T11:16:33.217999+0000","last_clean":"2023-10-06T11:16:33.217999+0000","last_became_active":"2023-10-06T11:16:33.217732+0000","last_became_peered":"2023-10-06T11:16:33.217732+0000","last_unstale":"2023-10-06T11:16:33.217999+0000","last_undegraded":"2023-10-06T11:16:33.217999+0000","last_fullsized":"2023-10-06T11:16:33.217999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:18.572365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.201292+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:32.201292+0000","last_peered":"2023-10-06T11:16:32.201292+0000","last_clean":"2023-10-06T11:16:32.201292+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:32.201292+0000","last_undegraded":"2023-10-06T11:16:32.201292+0000","last_fullsized":"2023-10-06T11:16:32.201292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.205986+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:32.205986+0000","last_peered":"2023-10-06T11:16:32.205986+0000","last_clean":"2023-10-06T11:16:32.205986+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:32.205986+0000","last_undegraded":"2023-10-06T11:16:32.205986+0000","last_fullsized":"2023-10-06T11:16:32.205986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206850+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.215786+0000","last_change":"2023-10-06T11:16:33.215786+0000","last_active":"2023-10-06T11:16:33.215786+0000","last_peered":"2023-10-06T11:16:33.215786+0000","last_clean":"2023-10-06T11:16:33.215786+0000","last_became_active":"2023-10-06T11:16:33.215537+0000","last_became_peered":"2023-10-06T11:16:33.215537+0000","last_unstale":"2023-10-06T11:16:33.215786+0000","last_undegraded":"2023-10-06T11:16:33.215786+0000","last_fullsized":"2023-10-06T11:16:33.215786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:34.426776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206482+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:32.206482+0000","last_peered":"2023-10-06T11:16:32.206482+0000","last_clean":"2023-10-06T11:16:32.206482+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:32.206482+0000","last_undegraded":"2023-10-06T11:16:32.206482+0000","last_fullsized":"2023-10-06T11:16:32.206482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204603+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:05.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223915+0000","last_change":"2023-10-06T11:16:33.223915+0000","last_active":"2023-10-06T11:16:33.223915+0000","last_peered":"2023-10-06T11:16:33.223915+0000","last_clean":"2023-10-06T11:16:33.223915+0000","last_became_active":"2023-10-06T11:16:33.223629+0000","last_became_peered":"2023-10-06T11:16:33.223629+0000","last_unstale":"2023-10-06T11:16:33.223915+0000","last_undegraded":"2023-10-06T11:16:33.223915+0000","last_fullsized":"2023-10-06T11:16:33.223915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:59.329683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206490+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:32.206490+0000","last_peered":"2023-10-06T11:16:32.206490+0000","last_clean":"2023-10-06T11:16:32.206490+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:32.206490+0000","last_undegraded":"2023-10-06T11:16:32.206490+0000","last_fullsized":"2023-10-06T11:16:32.206490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202728+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:15.676191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221210+0000","last_change":"2023-10-06T11:16:33.221210+0000","last_active":"2023-10-06T11:16:33.221210+0000","last_peered":"2023-10-06T11:16:33.221210+0000","last_clean":"2023-10-06T11:16:33.221210+0000","last_became_active":"2023-10-06T11:16:33.220958+0000","last_became_peered":"2023-10-06T11:16:33.220958+0000","last_unstale":"2023-10-06T11:16:33.221210+0000","last_undegraded":"2023-10-06T11:16:33.221210+0000","last_fullsized":"2023-10-06T11:16:33.221210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:43:17.165325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203800+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:32.203800+0000","last_peered":"2023-10-06T11:16:32.203800+0000","last_clean":"2023-10-06T11:16:32.203800+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:32.203800+0000","last_undegraded":"2023-10-06T11:16:32.203800+0000","last_fullsized":"2023-10-06T11:16:32.203800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218458+0000","last_change":"2023-10-06T11:16:33.218458+0000","last_active":"2023-10-06T11:16:33.218458+0000","last_peered":"2023-10-06T11:16:33.218458+0000","last_clean":"2023-10-06T11:16:33.218458+0000","last_became_active":"2023-10-06T11:16:33.218195+0000","last_became_peered":"2023-10-06T11:16:33.218195+0000","last_unstale":"2023-10-06T11:16:33.218458+0000","last_undegraded":"2023-10-06T11:16:33.218458+0000","last_fullsized":"2023-10-06T11:16:33.218458+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:03.300107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206678+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:32.206678+0000","last_peered":"2023-10-06T11:16:32.206678+0000","last_clean":"2023-10-06T11:16:32.206678+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:32.206678+0000","last_undegraded":"2023-10-06T11:16:32.206678+0000","last_fullsized":"2023-10-06T11:16:32.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.432},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.497}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.056,"15min":1.056},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.371},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":1.254},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.298}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":1.319}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60999999999999999,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.434,"15min":0.432},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47199999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":1.056,"15min":1.056},"last":0.255},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.438,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56999999999999995,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.55400000000000005,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65700000000000003,"15min":0.67900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78400000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66500000000000004,"15min":0.68700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.745,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.335,"15min":2.335},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72399999999999998,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.218,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36799999999999999,"15min":0.38},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42899999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.497,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38700000000000001,"15min":0.40100000000000002},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83499999999999996,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.872,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":1.115,"15min":1.115},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80500000000000005,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84299999999999997,"5min":1.276,"15min":1.276},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.996,"15min":0.996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71399999999999997,"5min":1.014,"15min":1.014},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.621},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":1.369,"15min":1.369},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77200000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70599999999999996,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81000000000000005,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":1.355,"15min":1.355},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":1.512,"15min":1.512},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:38.748 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:38.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:38.896 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:38.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.902+0000 7fed5da18700 1 Processor -- start 2023-10-06T11:16:38.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.902+0000 7fed5da18700 1 -- start start 2023-10-06T11:16:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed5da18700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed580ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed5da18700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed580b0c60 con 0x7fed58159560 2023-10-06T11:16:38.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed5da18700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed580b0f40 con 0x7fed580b49a0 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed5da18700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed580ab350 con 0x7fed580b0760 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed56ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fed58159560 0x7fed580aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48194/0 (socket says 172.21.15.55:48194) 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed56ffd700 1 -- 172.21.15.55:0/154916598 learned_addr learned my addr 172.21.15.55:0/154916598 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed577fe700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed580ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713583986 0 0) 0x7fed580b0c60 con 0x7fed58159560 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.903+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed40003570 con 0x7fed58159560 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291946772 0 0) 0x7fed580b0f40 con 0x7fed580b49a0 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed580b0c60 con 0x7fed580b49a0 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849662620 0 0) 0x7fed40003570 con 0x7fed58159560 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 msgr2=0x7fed580ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:38.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed580ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 >> v1:172.21.15.142:6789/0 conn(0x7fed580b49a0 legacy=0x7fed580aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580b1220 con 0x7fed58159560 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fed4c0015f0 con 0x7fed58159560 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed577fe700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed580ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 >> v1:172.21.15.55:6789/0 conn(0x7fed58159560 legacy=0x7fed580aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed40003c20 0x7fed40004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580ab350 con 0x7fed40004810 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4000bbb0 con 0x7fed40003c20 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4000bd70 con 0x7fed580b0760 2023-10-06T11:16:38.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed567fc700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed56ffd700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed40003c20 0x7fed40004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed577fe700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed567fc700 1 -- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 msgr2=0x7fed400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed567fc700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580b0760 0x7fed400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed567fc700 1 -- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed40003c20 msgr2=0x7fed40004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed567fc700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed40003c20 0x7fed40004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.904+0000 7fed567fc700 1 -- 172.21.15.55:0/154916598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009a20 con 0x7fed40004810 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed567fc700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed40004c80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fed58088de0 tx=0x7fed48007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebd22956b5f435e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4800c5d0 con 0x7fed40004810 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4800c730 con 0x7fed40004810 2023-10-06T11:16:38.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed55ffb700 1 -- 172.21.15.55:0/154916598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4800cad0 con 0x7fed40004810 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed5da18700 1 -- 172.21.15.55:0/154916598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 msgr2=0x7fed40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed5da18700 1 --2- 172.21.15.55:0/154916598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed40004c80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fed58088de0 tx=0x7fed48007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed577fe700 1 -- 172.21.15.55:0/154916598 reap_dead start 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed5da18700 1 -- 172.21.15.55:0/154916598 shutdown_connections 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed5da18700 1 -- 172.21.15.55:0/154916598 >> 172.21.15.55:0/154916598 conn(0x7fed580997f0 msgr2=0x7fed5806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed5da18700 1 -- 172.21.15.55:0/154916598 shutdown_connections 2023-10-06T11:16:38.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.905+0000 7fed5da18700 1 -- 172.21.15.55:0/154916598 wait complete. 2023-10-06T11:16:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 Processor -- start 2023-10-06T11:16:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 -- start start 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed58157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580ac0e0 0x7fed580acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed580ce840 0x7fed580cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580cf220 con 0x7fed40004810 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5809c330 con 0x7fed580ce840 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed5da18700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5809c4c0 con 0x7fed580ac0e0 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.907+0000 7fed56ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed58157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed58157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38250/0 (socket says 172.21.15.55:38250) 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 -- 172.21.15.55:0/262592702 learned_addr learned my addr 172.21.15.55:0/262592702 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed577fe700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed580ce840 0x7fed580cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed567fc700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580ac0e0 0x7fed580acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 -- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580ac0e0 msgr2=0x7fed580acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580ac0e0 0x7fed580acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 -- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed580ce840 msgr2=0x7fed580cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed580ce840 0x7fed580cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 -- 172.21.15.55:0/262592702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580ad7e0 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed56ffd700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed58157be0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c470 tx=0x7fed4c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c01a070 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c007110 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed580adac0 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0074d0 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.908+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed580ae080 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.909+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed58064a90 con 0x7fed40004810 2023-10-06T11:16:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.910+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed4c005a00 con 0x7fed40004810 2023-10-06T11:16:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.910+0000 7fed3effd700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.910+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fed4c08c7c0 con 0x7fed40004810 2023-10-06T11:16:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.910+0000 7fed567fc700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.911+0000 7fed567fc700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fed48008fd0 tx=0x7fed48015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:38.915+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed4c059790 con 0x7fed40004810 2023-10-06T11:16:39.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.108+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed5809c600 con 0x7fed44066f30 2023-10-06T11:16:39.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.117+0000 7fed3effd700 1 -- 172.21.15.55:0/262592702 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309067 (secure 0 0 0) 0x7fed48023070 con 0x7fed44066f30 2023-10-06T11:16:39.122 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:39.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.120+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed44066f30 msgr2=0x7fed440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:39.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed44066f30 0x7fed440693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fed48008fd0 tx=0x7fed48015000 comp rx=0 tx=0).stop 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 msgr2=0x7fed58157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed58157be0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c470 tx=0x7fed4c009040 comp rx=0 tx=0).stop 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 shutdown_connections 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fed44066f30 0x7fed440693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed40004810 0x7fed58157be0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed580ce840 0x7fed580cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 --2- 172.21.15.55:0/262592702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed580ac0e0 0x7fed580acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 >> 172.21.15.55:0/262592702 conn(0x7fed580997f0 msgr2=0x7fed58069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 shutdown_connections 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.121+0000 7fed5da18700 1 -- 172.21.15.55:0/262592702 wait complete. 2023-10-06T11:16:39.125 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:39.134 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2023-10-06T11:16:38.889204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389256,"kb_used_data":10952,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585464,"statfs":{"total":773094113280,"available":770647515136,"internally_reserved":0,"allocated":11214848,"data_stored":5905400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001280"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.219019+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:11.838005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199831+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:57.843933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200777+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213524+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:17.700582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207782+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:55.397042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210429+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:43.643298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203627+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:05.482312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200673+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213467+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:59.454027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213379+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:39.027148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198587+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210754+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:14.462278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198718+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:11.494531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199339+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206793+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:11.734578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211224+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:25.658893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199708+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:00:30.047202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203540+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200330+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198711+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.201191+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:04.302154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:26.058723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198837+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208250+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:19.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199170+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:57.757671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208201+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:45.935305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211851+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:55.669164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207714+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200675+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:21.773972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203957+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:24.048799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.209372+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:29.307102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.205941+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:00.331729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210506+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:14.789768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209192+0000","last_change":"2023-10-06T11:16:33.209192+0000","last_active":"2023-10-06T11:16:33.209192+0000","last_peered":"2023-10-06T11:16:33.209192+0000","last_clean":"2023-10-06T11:16:33.209192+0000","last_became_active":"2023-10-06T11:16:33.208882+0000","last_became_peered":"2023-10-06T11:16:33.208882+0000","last_unstale":"2023-10-06T11:16:33.209192+0000","last_undegraded":"2023-10-06T11:16:33.209192+0000","last_fullsized":"2023-10-06T11:16:33.209192+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.244456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203596+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209362+0000","last_change":"2023-10-06T11:16:33.209362+0000","last_active":"2023-10-06T11:16:33.209362+0000","last_peered":"2023-10-06T11:16:33.209362+0000","last_clean":"2023-10-06T11:16:33.209362+0000","last_became_active":"2023-10-06T11:16:33.209094+0000","last_became_peered":"2023-10-06T11:16:33.209094+0000","last_unstale":"2023-10-06T11:16:33.209362+0000","last_undegraded":"2023-10-06T11:16:33.209362+0000","last_fullsized":"2023-10-06T11:16:33.209362+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:58.573116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.124517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220109+0000","last_change":"2023-10-06T11:16:33.220109+0000","last_active":"2023-10-06T11:16:33.220109+0000","last_peered":"2023-10-06T11:16:33.220109+0000","last_clean":"2023-10-06T11:16:33.220109+0000","last_became_active":"2023-10-06T11:16:33.219863+0000","last_became_peered":"2023-10-06T11:16:33.219863+0000","last_unstale":"2023-10-06T11:16:33.220109+0000","last_undegraded":"2023-10-06T11:16:33.220109+0000","last_fullsized":"2023-10-06T11:16:33.220109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:10.732532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199388+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220071+0000","last_change":"2023-10-06T11:16:33.220071+0000","last_active":"2023-10-06T11:16:33.220071+0000","last_peered":"2023-10-06T11:16:33.220071+0000","last_clean":"2023-10-06T11:16:33.220071+0000","last_became_active":"2023-10-06T11:16:33.219690+0000","last_became_peered":"2023-10-06T11:16:33.219690+0000","last_unstale":"2023-10-06T11:16:33.220071+0000","last_undegraded":"2023-10-06T11:16:33.220071+0000","last_fullsized":"2023-10-06T11:16:33.220071+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:10.870949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208504+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:51.097081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223884+0000","last_change":"2023-10-06T11:16:33.223884+0000","last_active":"2023-10-06T11:16:33.223884+0000","last_peered":"2023-10-06T11:16:33.223884+0000","last_clean":"2023-10-06T11:16:33.223884+0000","last_became_active":"2023-10-06T11:16:33.223637+0000","last_became_peered":"2023-10-06T11:16:33.223637+0000","last_unstale":"2023-10-06T11:16:33.223884+0000","last_undegraded":"2023-10-06T11:16:33.223884+0000","last_fullsized":"2023-10-06T11:16:33.223884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:33.118292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:31.455801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213285+0000","last_change":"2023-10-06T11:16:33.213285+0000","last_active":"2023-10-06T11:16:33.213285+0000","last_peered":"2023-10-06T11:16:33.213285+0000","last_clean":"2023-10-06T11:16:33.213285+0000","last_became_active":"2023-10-06T11:16:33.213019+0000","last_became_peered":"2023-10-06T11:16:33.213019+0000","last_unstale":"2023-10-06T11:16:33.213285+0000","last_undegraded":"2023-10-06T11:16:33.213285+0000","last_fullsized":"2023-10-06T11:16:33.213285+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:29.411415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208935+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:59.743398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213564+0000","last_change":"2023-10-06T11:16:33.213564+0000","last_active":"2023-10-06T11:16:33.213564+0000","last_peered":"2023-10-06T11:16:33.213564+0000","last_clean":"2023-10-06T11:16:33.213564+0000","last_became_active":"2023-10-06T11:16:33.213277+0000","last_became_peered":"2023-10-06T11:16:33.213277+0000","last_unstale":"2023-10-06T11:16:33.213564+0000","last_undegraded":"2023-10-06T11:16:33.213564+0000","last_fullsized":"2023-10-06T11:16:33.213564+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:22.574901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203149+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:03.107546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217368+0000","last_change":"2023-10-06T11:16:33.217368+0000","last_active":"2023-10-06T11:16:33.217368+0000","last_peered":"2023-10-06T11:16:33.217368+0000","last_clean":"2023-10-06T11:16:33.217368+0000","last_became_active":"2023-10-06T11:16:33.217072+0000","last_became_peered":"2023-10-06T11:16:33.217072+0000","last_unstale":"2023-10-06T11:16:33.217368+0000","last_undegraded":"2023-10-06T11:16:33.217368+0000","last_fullsized":"2023-10-06T11:16:33.217368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:22.680971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207696+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219889+0000","last_change":"2023-10-06T11:16:33.219889+0000","last_active":"2023-10-06T11:16:33.219889+0000","last_peered":"2023-10-06T11:16:33.219889+0000","last_clean":"2023-10-06T11:16:33.219889+0000","last_became_active":"2023-10-06T11:16:33.219585+0000","last_became_peered":"2023-10-06T11:16:33.219585+0000","last_unstale":"2023-10-06T11:16:33.219889+0000","last_undegraded":"2023-10-06T11:16:33.219889+0000","last_fullsized":"2023-10-06T11:16:33.219889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:25.460290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.212265+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.212220+0000","last_change":"2023-10-06T11:16:33.212220+0000","last_active":"2023-10-06T11:16:33.212220+0000","last_peered":"2023-10-06T11:16:33.212220+0000","last_clean":"2023-10-06T11:16:33.212220+0000","last_became_active":"2023-10-06T11:16:33.211932+0000","last_became_peered":"2023-10-06T11:16:33.211932+0000","last_unstale":"2023-10-06T11:16:33.212220+0000","last_undegraded":"2023-10-06T11:16:33.212220+0000","last_fullsized":"2023-10-06T11:16:33.212220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199128+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223822+0000","last_change":"2023-10-06T11:16:33.223822+0000","last_active":"2023-10-06T11:16:33.223822+0000","last_peered":"2023-10-06T11:16:33.223822+0000","last_clean":"2023-10-06T11:16:33.223822+0000","last_became_active":"2023-10-06T11:16:33.223455+0000","last_became_peered":"2023-10-06T11:16:33.223455+0000","last_unstale":"2023-10-06T11:16:33.223822+0000","last_undegraded":"2023-10-06T11:16:33.223822+0000","last_fullsized":"2023-10-06T11:16:33.223822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:10.492484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198901+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:47.057998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.224060+0000","last_change":"2023-10-06T11:16:33.224060+0000","last_active":"2023-10-06T11:16:33.224060+0000","last_peered":"2023-10-06T11:16:33.224060+0000","last_clean":"2023-10-06T11:16:33.224060+0000","last_became_active":"2023-10-06T11:16:33.223797+0000","last_became_peered":"2023-10-06T11:16:33.223797+0000","last_unstale":"2023-10-06T11:16:33.224060+0000","last_undegraded":"2023-10-06T11:16:33.224060+0000","last_fullsized":"2023-10-06T11:16:33.224060+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:26.775059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198552+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:35.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221810+0000","last_change":"2023-10-06T11:16:33.221810+0000","last_active":"2023-10-06T11:16:33.221810+0000","last_peered":"2023-10-06T11:16:33.221810+0000","last_clean":"2023-10-06T11:16:33.221810+0000","last_became_active":"2023-10-06T11:16:33.221549+0000","last_became_peered":"2023-10-06T11:16:33.221549+0000","last_unstale":"2023-10-06T11:16:33.221810+0000","last_undegraded":"2023-10-06T11:16:33.221810+0000","last_fullsized":"2023-10-06T11:16:33.221810+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:27.175374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208605+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:54.763081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220572+0000","last_change":"2023-10-06T11:16:33.220572+0000","last_active":"2023-10-06T11:16:33.220572+0000","last_peered":"2023-10-06T11:16:33.220572+0000","last_clean":"2023-10-06T11:16:33.220572+0000","last_became_active":"2023-10-06T11:16:33.220337+0000","last_became_peered":"2023-10-06T11:16:33.220337+0000","last_unstale":"2023-10-06T11:16:33.220572+0000","last_undegraded":"2023-10-06T11:16:33.220572+0000","last_fullsized":"2023-10-06T11:16:33.220572+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:13.787721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199601+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219845+0000","last_change":"2023-10-06T11:16:33.219845+0000","last_active":"2023-10-06T11:16:33.219845+0000","last_peered":"2023-10-06T11:16:33.219845+0000","last_clean":"2023-10-06T11:16:33.219845+0000","last_became_active":"2023-10-06T11:16:33.219336+0000","last_became_peered":"2023-10-06T11:16:33.219336+0000","last_unstale":"2023-10-06T11:16:33.219845+0000","last_undegraded":"2023-10-06T11:16:33.219845+0000","last_fullsized":"2023-10-06T11:16:33.219845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.506752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207414+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216450+0000","last_change":"2023-10-06T11:16:33.216450+0000","last_active":"2023-10-06T11:16:33.216450+0000","last_peered":"2023-10-06T11:16:33.216450+0000","last_clean":"2023-10-06T11:16:33.216450+0000","last_became_active":"2023-10-06T11:16:33.215830+0000","last_became_peered":"2023-10-06T11:16:33.215830+0000","last_unstale":"2023-10-06T11:16:33.216450+0000","last_undegraded":"2023-10-06T11:16:33.216450+0000","last_fullsized":"2023-10-06T11:16:33.216450+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:13.026976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202956+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220995+0000","last_change":"2023-10-06T11:16:33.220995+0000","last_active":"2023-10-06T11:16:33.220995+0000","last_peered":"2023-10-06T11:16:33.220995+0000","last_clean":"2023-10-06T11:16:33.220995+0000","last_became_active":"2023-10-06T11:16:33.220666+0000","last_became_peered":"2023-10-06T11:16:33.220666+0000","last_unstale":"2023-10-06T11:16:33.220995+0000","last_undegraded":"2023-10-06T11:16:33.220995+0000","last_fullsized":"2023-10-06T11:16:33.220995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:14.808502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208030+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:48.432471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.211898+0000","last_change":"2023-10-06T11:16:33.211898+0000","last_active":"2023-10-06T11:16:33.211898+0000","last_peered":"2023-10-06T11:16:33.211898+0000","last_clean":"2023-10-06T11:16:33.211898+0000","last_became_active":"2023-10-06T11:16:33.211582+0000","last_became_peered":"2023-10-06T11:16:33.211582+0000","last_unstale":"2023-10-06T11:16:33.211898+0000","last_undegraded":"2023-10-06T11:16:33.211898+0000","last_fullsized":"2023-10-06T11:16:33.211898+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:14.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208507+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:57.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218347+0000","last_change":"2023-10-06T11:16:33.218347+0000","last_active":"2023-10-06T11:16:33.218347+0000","last_peered":"2023-10-06T11:16:33.218347+0000","last_clean":"2023-10-06T11:16:33.218347+0000","last_became_active":"2023-10-06T11:16:33.217829+0000","last_became_peered":"2023-10-06T11:16:33.217829+0000","last_unstale":"2023-10-06T11:16:33.218347+0000","last_undegraded":"2023-10-06T11:16:33.218347+0000","last_fullsized":"2023-10-06T11:16:33.218347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:49:48.984656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204562+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218295+0000","last_change":"2023-10-06T11:16:33.218295+0000","last_active":"2023-10-06T11:16:33.218295+0000","last_peered":"2023-10-06T11:16:33.218295+0000","last_clean":"2023-10-06T11:16:33.218295+0000","last_became_active":"2023-10-06T11:16:33.218027+0000","last_became_peered":"2023-10-06T11:16:33.218027+0000","last_unstale":"2023-10-06T11:16:33.218295+0000","last_undegraded":"2023-10-06T11:16:33.218295+0000","last_fullsized":"2023-10-06T11:16:33.218295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:28.052406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199787+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:06.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209049+0000","last_change":"2023-10-06T11:16:33.209049+0000","last_active":"2023-10-06T11:16:33.209049+0000","last_peered":"2023-10-06T11:16:33.209049+0000","last_clean":"2023-10-06T11:16:33.209049+0000","last_became_active":"2023-10-06T11:16:33.208697+0000","last_became_peered":"2023-10-06T11:16:33.208697+0000","last_unstale":"2023-10-06T11:16:33.209049+0000","last_undegraded":"2023-10-06T11:16:33.209049+0000","last_fullsized":"2023-10-06T11:16:33.209049+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.708958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199655+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:59.285038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219734+0000","last_change":"2023-10-06T11:16:33.219734+0000","last_active":"2023-10-06T11:16:33.219734+0000","last_peered":"2023-10-06T11:16:33.219734+0000","last_clean":"2023-10-06T11:16:33.219734+0000","last_became_active":"2023-10-06T11:16:33.219460+0000","last_became_peered":"2023-10-06T11:16:33.219460+0000","last_unstale":"2023-10-06T11:16:33.219734+0000","last_undegraded":"2023-10-06T11:16:33.219734+0000","last_fullsized":"2023-10-06T11:16:33.219734+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:18.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198528+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:15.720942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216523+0000","last_change":"2023-10-06T11:16:33.216523+0000","last_active":"2023-10-06T11:16:33.216523+0000","last_peered":"2023-10-06T11:16:33.216523+0000","last_clean":"2023-10-06T11:16:33.216523+0000","last_became_active":"2023-10-06T11:16:33.216307+0000","last_became_peered":"2023-10-06T11:16:33.216307+0000","last_unstale":"2023-10-06T11:16:33.216523+0000","last_undegraded":"2023-10-06T11:16:33.216523+0000","last_fullsized":"2023-10-06T11:16:33.216523+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:42.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208804+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:43.963003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216619+0000","last_change":"2023-10-06T11:16:33.216619+0000","last_active":"2023-10-06T11:16:33.216619+0000","last_peered":"2023-10-06T11:16:33.216619+0000","last_clean":"2023-10-06T11:16:33.216619+0000","last_became_active":"2023-10-06T11:16:33.216192+0000","last_became_peered":"2023-10-06T11:16:33.216192+0000","last_unstale":"2023-10-06T11:16:33.216619+0000","last_undegraded":"2023-10-06T11:16:33.216619+0000","last_fullsized":"2023-10-06T11:16:33.216619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:06.366888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203139+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213912+0000","last_change":"2023-10-06T11:16:33.213912+0000","last_active":"2023-10-06T11:16:33.213912+0000","last_peered":"2023-10-06T11:16:33.213912+0000","last_clean":"2023-10-06T11:16:33.213912+0000","last_became_active":"2023-10-06T11:16:33.213162+0000","last_became_peered":"2023-10-06T11:16:33.213162+0000","last_unstale":"2023-10-06T11:16:33.213912+0000","last_undegraded":"2023-10-06T11:16:33.213912+0000","last_fullsized":"2023-10-06T11:16:33.213912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:46.055952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203912+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:32.203912+0000","last_peered":"2023-10-06T11:16:32.203912+0000","last_clean":"2023-10-06T11:16:32.203912+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:32.203912+0000","last_undegraded":"2023-10-06T11:16:32.203912+0000","last_fullsized":"2023-10-06T11:16:32.203912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207914+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:04.732227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223967+0000","last_change":"2023-10-06T11:16:33.223967+0000","last_active":"2023-10-06T11:16:33.223967+0000","last_peered":"2023-10-06T11:16:33.223967+0000","last_clean":"2023-10-06T11:16:33.223967+0000","last_became_active":"2023-10-06T11:16:33.223718+0000","last_became_peered":"2023-10-06T11:16:33.223718+0000","last_unstale":"2023-10-06T11:16:33.223967+0000","last_undegraded":"2023-10-06T11:16:33.223967+0000","last_fullsized":"2023-10-06T11:16:33.223967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:07.122471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199277+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:32.199277+0000","last_peered":"2023-10-06T11:16:32.199277+0000","last_clean":"2023-10-06T11:16:32.199277+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:32.199277+0000","last_undegraded":"2023-10-06T11:16:32.199277+0000","last_fullsized":"2023-10-06T11:16:32.199277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206904+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218452+0000","last_change":"2023-10-06T11:16:33.218452+0000","last_active":"2023-10-06T11:16:33.218452+0000","last_peered":"2023-10-06T11:16:33.218452+0000","last_clean":"2023-10-06T11:16:33.218452+0000","last_became_active":"2023-10-06T11:16:33.218174+0000","last_became_peered":"2023-10-06T11:16:33.218174+0000","last_unstale":"2023-10-06T11:16:33.218452+0000","last_undegraded":"2023-10-06T11:16:33.218452+0000","last_fullsized":"2023-10-06T11:16:33.218452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199399+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:32.199399+0000","last_peered":"2023-10-06T11:16:32.199399+0000","last_clean":"2023-10-06T11:16:32.199399+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:32.199399+0000","last_undegraded":"2023-10-06T11:16:32.199399+0000","last_fullsized":"2023-10-06T11:16:32.199399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206766+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217999+0000","last_change":"2023-10-06T11:16:33.217999+0000","last_active":"2023-10-06T11:16:33.217999+0000","last_peered":"2023-10-06T11:16:33.217999+0000","last_clean":"2023-10-06T11:16:33.217999+0000","last_became_active":"2023-10-06T11:16:33.217732+0000","last_became_peered":"2023-10-06T11:16:33.217732+0000","last_unstale":"2023-10-06T11:16:33.217999+0000","last_undegraded":"2023-10-06T11:16:33.217999+0000","last_fullsized":"2023-10-06T11:16:33.217999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:18.572365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.201292+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:32.201292+0000","last_peered":"2023-10-06T11:16:32.201292+0000","last_clean":"2023-10-06T11:16:32.201292+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:32.201292+0000","last_undegraded":"2023-10-06T11:16:32.201292+0000","last_fullsized":"2023-10-06T11:16:32.201292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.205986+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:32.205986+0000","last_peered":"2023-10-06T11:16:32.205986+0000","last_clean":"2023-10-06T11:16:32.205986+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:32.205986+0000","last_undegraded":"2023-10-06T11:16:32.205986+0000","last_fullsized":"2023-10-06T11:16:32.205986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206850+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.215786+0000","last_change":"2023-10-06T11:16:33.215786+0000","last_active":"2023-10-06T11:16:33.215786+0000","last_peered":"2023-10-06T11:16:33.215786+0000","last_clean":"2023-10-06T11:16:33.215786+0000","last_became_active":"2023-10-06T11:16:33.215537+0000","last_became_peered":"2023-10-06T11:16:33.215537+0000","last_unstale":"2023-10-06T11:16:33.215786+0000","last_undegraded":"2023-10-06T11:16:33.215786+0000","last_fullsized":"2023-10-06T11:16:33.215786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:34.426776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206482+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:32.206482+0000","last_peered":"2023-10-06T11:16:32.206482+0000","last_clean":"2023-10-06T11:16:32.206482+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:32.206482+0000","last_undegraded":"2023-10-06T11:16:32.206482+0000","last_fullsized":"2023-10-06T11:16:32.206482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204603+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:05.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223915+0000","last_change":"2023-10-06T11:16:33.223915+0000","last_active":"2023-10-06T11:16:33.223915+0000","last_peered":"2023-10-06T11:16:33.223915+0000","last_clean":"2023-10-06T11:16:33.223915+0000","last_became_active":"2023-10-06T11:16:33.223629+0000","last_became_peered":"2023-10-06T11:16:33.223629+0000","last_unstale":"2023-10-06T11:16:33.223915+0000","last_undegraded":"2023-10-06T11:16:33.223915+0000","last_fullsized":"2023-10-06T11:16:33.223915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:59.329683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206490+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:32.206490+0000","last_peered":"2023-10-06T11:16:32.206490+0000","last_clean":"2023-10-06T11:16:32.206490+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:32.206490+0000","last_undegraded":"2023-10-06T11:16:32.206490+0000","last_fullsized":"2023-10-06T11:16:32.206490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202728+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:15.676191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221210+0000","last_change":"2023-10-06T11:16:33.221210+0000","last_active":"2023-10-06T11:16:33.221210+0000","last_peered":"2023-10-06T11:16:33.221210+0000","last_clean":"2023-10-06T11:16:33.221210+0000","last_became_active":"2023-10-06T11:16:33.220958+0000","last_became_peered":"2023-10-06T11:16:33.220958+0000","last_unstale":"2023-10-06T11:16:33.221210+0000","last_undegraded":"2023-10-06T11:16:33.221210+0000","last_fullsized":"2023-10-06T11:16:33.221210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:43:17.165325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203800+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:32.203800+0000","last_peered":"2023-10-06T11:16:32.203800+0000","last_clean":"2023-10-06T11:16:32.203800+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:32.203800+0000","last_undegraded":"2023-10-06T11:16:32.203800+0000","last_fullsized":"2023-10-06T11:16:32.203800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218458+0000","last_change":"2023-10-06T11:16:33.218458+0000","last_active":"2023-10-06T11:16:33.218458+0000","last_peered":"2023-10-06T11:16:33.218458+0000","last_clean":"2023-10-06T11:16:33.218458+0000","last_became_active":"2023-10-06T11:16:33.218195+0000","last_became_peered":"2023-10-06T11:16:33.218195+0000","last_unstale":"2023-10-06T11:16:33.218458+0000","last_undegraded":"2023-10-06T11:16:33.218458+0000","last_fullsized":"2023-10-06T11:16:33.218458+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:03.300107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206678+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:32.206678+0000","last_peered":"2023-10-06T11:16:32.206678+0000","last_clean":"2023-10-06T11:16:32.206678+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:32.206678+0000","last_undegraded":"2023-10-06T11:16:32.206678+0000","last_fullsized":"2023-10-06T11:16:32.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.432},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.497}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.056,"15min":1.056},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.371},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":1.254},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.298}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":1.319}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60999999999999999,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.434,"15min":0.432},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47199999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":1.056,"15min":1.056},"last":0.255},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.438,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56999999999999995,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.55400000000000005,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65700000000000003,"15min":0.67900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78400000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66500000000000004,"15min":0.68700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.745,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.335,"15min":2.335},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72399999999999998,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.218,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36799999999999999,"15min":0.38},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42899999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.497,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38700000000000001,"15min":0.40100000000000002},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83499999999999996,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.872,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":1.115,"15min":1.115},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80500000000000005,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84299999999999997,"5min":1.276,"15min":1.276},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.996,"15min":0.996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71399999999999997,"5min":1.014,"15min":1.014},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.621},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":1.369,"15min":1.369},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77200000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70599999999999996,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81000000000000005,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":1.355,"15min":1.355},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":1.512,"15min":1.512},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.219019+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:31:11.838005+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199831+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:43:57.843933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.200777+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-10-06T11:16:39.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.213524+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:46:17.700582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-10-06T11:16:39.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207782+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:35:55.397042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:39.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-10-06T11:16:39.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.210429+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:30:43.643298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-10-06T11:16:39.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.203627+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:14:05.482312+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:39.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-10-06T11:16:39.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.200673+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.213467+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:56:59.454027+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.213379+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:30:39.027148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198587+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.210754+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:44:14.462278+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-10-06T11:16:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198718+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:36:11.494531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-10-06T11:16:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199339+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-10-06T11:16:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.206793+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:45:11.734578+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.211224+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:25:25.658893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199708+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:00:30.047202+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.203540+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.200330+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-10-06T11:16:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198711+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.201191+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:10:04.302154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207762+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:42:26.058723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198837+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208250+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:22:19.851554+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199170+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:02:57.757671+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208201+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:00:45.935305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.211851+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:18:55.669164+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207714+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-10-06T11:16:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.200675+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:46:21.773972+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.203957+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:12:24.048799+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.209372+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:37:29.307102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.205941+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:41:00.331729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.210506+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:50:14.789768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.203596+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.210762+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:23:08.124517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199388+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-10-06T11:16:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208504+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:09:51.097081+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-10-06T11:16:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.200238+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:16:31.455801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-10-06T11:16:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208935+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:42:59.743398+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.203149+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:15:03.107546+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207696+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.212265+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199128+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-10-06T11:16:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198901+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:49:47.057998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198552+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:18:35.428822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208605+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:14:54.763081+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199601+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-10-06T11:16:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207414+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.202956+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208030+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:39:48.432471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208507+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:58:57.767656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.204562+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199787+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:48:06.987894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.199655+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:03:59.285038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-10-06T11:16:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.198528+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:40:15.720942+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.208804+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:35:43.963003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.203139+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207914+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:55:04.732227+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-10-06T11:16:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.206904+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.206766+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.206850+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.204603+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:29:05.363544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-10-06T11:16:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.202728+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:51:15.676191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:16:39.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-10-06T11:16:39.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:33.192781+0000', 'last_change': '2023-10-06T11:16:33.207238+0000', 'last_active': '2023-10-06T11:16:33.192781+0000', 'last_peered': '2023-10-06T11:16:33.192781+0000', 'last_clean': '2023-10-06T11:16:33.192781+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:33.192781+0000', 'last_undegraded': '2023-10-06T11:16:33.192781+0000', 'last_fullsized': '2023-10-06T11:16:33.192781+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:33.192781+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:16:39.631 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:16:39.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.755+0000 7fd948aab700 1 Processor -- start 2023-10-06T11:16:39.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.755+0000 7fd948aab700 1 -- start start 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd948aab700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9440ad210 0x7fd9440cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd948aab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94415db10 0x7fd9440ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd948aab700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440ca600 con 0x7fd9440ad5e0 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd948aab700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9440cecf0 con 0x7fd9440ad210 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd948aab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440cefd0 con 0x7fd94415db10 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94259c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9440ad210 0x7fd9440cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd941d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9440ad5e0 0x7fd94415d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48210/0 (socket says 172.21.15.55:48210) 2023-10-06T11:16:39.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd941d9b700 1 -- 172.21.15.55:0/1237507150 learned_addr learned my addr 172.21.15.55:0/1237507150 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd942d9d700 1 --2- 172.21.15.55:0/1237507150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94415db10 0x7fd9440ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94259c700 1 -- 172.21.15.55:0/1237507150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94415db10 msgr2=0x7fd9440ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94259c700 1 --2- 172.21.15.55:0/1237507150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94415db10 0x7fd9440ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94259c700 1 -- 172.21.15.55:0/1237507150 >> v1:172.21.15.55:6789/0 conn(0x7fd9440ad5e0 legacy=0x7fd94415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94259c700 1 -- 172.21.15.55:0/1237507150 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440cca90 con 0x7fd9440ad210 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94159a700 1 -- 172.21.15.55:0/1237507150 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341152473 0 0) 0x7fd9440ca600 con 0x7fd9440ad5e0 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.756+0000 7fd94259c700 1 --2- 172.21.15.55:0/1237507150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad210 0x7fd9440cd290 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009eb0 tx=0x7fd93c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff82f72a605a0a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd94159a700 1 -- 172.21.15.55:0/1237507150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c00e070 con 0x7fd9440ad210 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd94159a700 1 -- 172.21.15.55:0/1237507150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c00bc30 con 0x7fd9440ad210 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd94159a700 1 -- 172.21.15.55:0/1237507150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c012430 con 0x7fd9440ad210 2023-10-06T11:16:39.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 -- 172.21.15.55:0/1237507150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad210 msgr2=0x7fd9440cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 --2- 172.21.15.55:0/1237507150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad210 0x7fd9440cd290 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009eb0 tx=0x7fd93c009780 comp rx=0 tx=0).stop 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 -- 172.21.15.55:0/1237507150 shutdown_connections 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 --2- 172.21.15.55:0/1237507150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94415db10 0x7fd9440ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 --2- 172.21.15.55:0/1237507150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad210 0x7fd9440cd290 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 -- 172.21.15.55:0/1237507150 >> 172.21.15.55:0/1237507150 conn(0x7fd944067d90 msgr2=0x7fd9440ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 -- 172.21.15.55:0/1237507150 shutdown_connections 2023-10-06T11:16:39.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.757+0000 7fd948aab700 1 -- 172.21.15.55:0/1237507150 wait complete. 2023-10-06T11:16:39.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.758+0000 7fd948aab700 1 Processor -- start 2023-10-06T11:16:39.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.758+0000 7fd948aab700 1 -- start start 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd948aab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9440ad210 0x7fd94416d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd948aab700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 0x7fd9440c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd948aab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94415db10 0x7fd9440b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd948aab700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440c6600 con 0x7fd9440ad5e0 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd948aab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440b4080 con 0x7fd94415db10 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd948aab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440c73c0 con 0x7fd9440ad210 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 0x7fd9440c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 0x7fd9440c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38274/0 (socket says 172.21.15.55:38274) 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 -- 172.21.15.55:0/1132993795 learned_addr learned my addr 172.21.15.55:0/1132993795 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd94259c700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9440ad210 0x7fd94416d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:39.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd942d9d700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94415db10 0x7fd9440b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 -- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9440ad210 msgr2=0x7fd94416d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9440ad210 0x7fd94416d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 -- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94415db10 msgr2=0x7fd9440b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94415db10 0x7fd9440b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.759+0000 7fd941d9b700 1 -- 172.21.15.55:0/1132993795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c009a20 con 0x7fd9440ad5e0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.760+0000 7fd941d9b700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 0x7fd9440c60c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c840 tx=0x7fd92c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.760+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c005c00 con 0x7fd9440ad5e0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.760+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c005d60 con 0x7fd9440ad5e0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.760+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0072e0 con 0x7fd9440ad5e0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.760+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94416dd10 con 0x7fd9440ad5e0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.760+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94416e2d0 con 0x7fd9440ad5e0 2023-10-06T11:16:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.761+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944064a90 con 0x7fd9440ad5e0 2023-10-06T11:16:39.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.761+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd92c007690 con 0x7fd9440ad5e0 2023-10-06T11:16:39.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.762+0000 7fd93a7fc700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd924066f30 0x7fd9240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:39.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.762+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd92c083b90 con 0x7fd9440ad5e0 2023-10-06T11:16:39.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.762+0000 7fd94259c700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd924066f30 0x7fd9240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:39.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.763+0000 7fd94259c700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd924066f30 0x7fd9240693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009eb0 tx=0x7fd93c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:39.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:39.766+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd92c04b5a0 con 0x7fd9440ad5e0 2023-10-06T11:16:40.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.041+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9440ccd70 con 0x7fd9440ad5e0 2023-10-06T11:16:40.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.041+0000 7fd93a7fc700 1 -- 172.21.15.55:0/1132993795 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1457 (secure 0 0 0) 0x7fd92c0175d0 con 0x7fd9440ad5e0 2023-10-06T11:16:40.046 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:40.047 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":232,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":103,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590778,"num_in_osds":8,"osd_in_since":1696590769,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2446598144,"bytes_avail":770647515136,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":59,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":6418}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T11:16:22.885761+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd924066f30 msgr2=0x7fd9240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd924066f30 0x7fd9240693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009eb0 tx=0x7fd93c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 msgr2=0x7fd9440c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 0x7fd9440c60c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c840 tx=0x7fd92c007db0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 shutdown_connections 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd924066f30 0x7fd9240693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94415db10 0x7fd9440b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9440ad210 0x7fd94416d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 --2- 172.21.15.55:0/1132993795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9440ad5e0 0x7fd9440c60c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 >> 172.21.15.55:0/1132993795 conn(0x7fd944067d90 msgr2=0x7fd94406c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 shutdown_connections 2023-10-06T11:16:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.043+0000 7fd948aab700 1 -- 172.21.15.55:0/1132993795 wait complete. 2023-10-06T11:16:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:16:40.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.175+0000 7fb17d077700 1 Processor -- start 2023-10-06T11:16:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.175+0000 7fb17d077700 1 -- start start 2023-10-06T11:16:40.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb17d077700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1780ac000 0x7fb178069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb17d077700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb178069ec0 con 0x7fb1780adf20 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb17d077700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780c7330 con 0x7fb178069a60 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb17d077700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb178156110 con 0x7fb1780ac000 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb176d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb1780adf20 0x7fb17806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48224/0 (socket says 172.21.15.55:48224) 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb176d9d700 1 -- 172.21.15.55:0/2189422647 learned_addr learned my addr 172.21.15.55:0/2189422647 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335473449 0 0) 0x7fb170001110 con 0x7fb1780adf20 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb17659c700 1 --2- 172.21.15.55:0/2189422647 >> v2:172.21.15.142:3300/0 conn(0x7fb1780ac000 0x7fb178069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.176+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb164003570 con 0x7fb1780adf20 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663504128 0 0) 0x7fb164003570 con 0x7fb1780adf20 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 >> v2:172.21.15.142:3300/0 conn(0x7fb1780ac000 msgr2=0x7fb178069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:40.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 --2- 172.21.15.55:0/2189422647 >> v2:172.21.15.142:3300/0 conn(0x7fb1780ac000 0x7fb178069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 >> v1:172.21.15.142:6789/0 conn(0x7fb178069a60 legacy=0x7fb1780c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780c6720 con 0x7fb1780adf20 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fb170001600 con 0x7fb1780adf20 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 >> v1:172.21.15.55:6789/0 conn(0x7fb1780adf20 legacy=0x7fb17806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb164003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178156110 con 0x7fb164003a60 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c0d0 con 0x7fb1640051c0 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c290 con 0x7fb164004810 2023-10-06T11:16:40.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb164003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb17759e700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb17659c700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 -- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb164004810 msgr2=0x7fb164004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 -- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1640051c0 msgr2=0x7fb16400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 -- 172.21.15.55:0/2189422647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164003570 con 0x7fb164003a60 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb17759e700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb17759e700 1 -- 172.21.15.55:0/2189422647 reap_dead start 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb164003e70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb17000d6d0 tx=0x7fb170007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634eb869fd213ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:40.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170005920 con 0x7fb164003a60 2023-10-06T11:16:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170005aa0 con 0x7fb164003a60 2023-10-06T11:16:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.177+0000 7fb175d9b700 1 -- 172.21.15.55:0/2189422647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170005e60 con 0x7fb164003a60 2023-10-06T11:16:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 -- 172.21.15.55:0/2189422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 msgr2=0x7fb164003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb164003e70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb17000d6d0 tx=0x7fb170007ae0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 -- 172.21.15.55:0/2189422647 shutdown_connections 2023-10-06T11:16:40.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 --2- 172.21.15.55:0/2189422647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb164003e70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 -- 172.21.15.55:0/2189422647 >> 172.21.15.55:0/2189422647 conn(0x7fb178068080 msgr2=0x7fb1780cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:40.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 -- 172.21.15.55:0/2189422647 shutdown_connections 2023-10-06T11:16:40.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.178+0000 7fb17d077700 1 -- 172.21.15.55:0/2189422647 wait complete. 2023-10-06T11:16:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.179+0000 7fb17d077700 1 Processor -- start 2023-10-06T11:16:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.179+0000 7fb17d077700 1 -- start start 2023-10-06T11:16:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17d077700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb17815e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17d077700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1780c4b90 0x7fb17816d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17d077700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb17815b710 0x7fb17815bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17d077700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17815ad40 con 0x7fb164003a60 2023-10-06T11:16:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17d077700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178155ac0 con 0x7fb1780c4b90 2023-10-06T11:16:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17d077700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17815c0b0 con 0x7fb17815b710 2023-10-06T11:16:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb17815e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb17815e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38296/0 (socket says 172.21.15.55:38296) 2023-10-06T11:16:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 -- 172.21.15.55:0/2354343998 learned_addr learned my addr 172.21.15.55:0/2354343998 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17759e700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb17815b710 0x7fb17815bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb17659c700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1780c4b90 0x7fb17816d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 -- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb17815b710 msgr2=0x7fb17815bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb17815b710 0x7fb17815bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 -- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1780c4b90 msgr2=0x7fb17816d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1780c4b90 0x7fb17816d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.180+0000 7fb176d9d700 1 -- 172.21.15.55:0/2354343998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17815e940 con 0x7fb164003a60 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.181+0000 7fb176d9d700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb17815e400 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb170007f00 tx=0x7fb170018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.181+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700072e0 con 0x7fb164003a60 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.181+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170007480 con 0x7fb164003a60 2023-10-06T11:16:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.181+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780c5110 con 0x7fb164003a60 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.181+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170025470 con 0x7fb164003a60 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.181+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780c56d0 con 0x7fb164003a60 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.182+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb178064a90 con 0x7fb164003a60 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.182+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb170022070 con 0x7fb164003a60 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.183+0000 7fb16effd700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb158066f30 0x7fb1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.183+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb170086160 con 0x7fb164003a60 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.183+0000 7fb17659c700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb158066f30 0x7fb1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.184+0000 7fb17659c700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb158066f30 0x7fb1580693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb160009e00 tx=0x7fb160008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.187+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1700532a0 con 0x7fb164003a60 2023-10-06T11:16:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.376+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb178069ec0 con 0x7fb158066f30 2023-10-06T11:16:40.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.385+0000 7fb16effd700 1 -- 172.21.15.55:0/2354343998 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309067 (secure 0 0 0) 0x7fb178069ec0 con 0x7fb158066f30 2023-10-06T11:16:40.390 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.388+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb158066f30 msgr2=0x7fb1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.388+0000 7fb17d077700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb158066f30 0x7fb1580693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb160009e00 tx=0x7fb160008040 comp rx=0 tx=0).stop 2023-10-06T11:16:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.388+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 msgr2=0x7fb17815e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.388+0000 7fb17d077700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb17815e400 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb170007f00 tx=0x7fb170018000 comp rx=0 tx=0).stop 2023-10-06T11:16:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 shutdown_connections 2023-10-06T11:16:40.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb158066f30 0x7fb1580693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb164003a60 0x7fb17815e400 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb17815b710 0x7fb17815bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 --2- 172.21.15.55:0/2354343998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1780c4b90 0x7fb17816d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 >> 172.21.15.55:0/2354343998 conn(0x7fb178068080 msgr2=0x7fb1780ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 shutdown_connections 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:40.389+0000 7fb17d077700 1 -- 172.21.15.55:0/2354343998 wait complete. 2023-10-06T11:16:40.394 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:40.402 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2023-10-06T11:16:38.889204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389256,"kb_used_data":10952,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585464,"statfs":{"total":773094113280,"available":770647515136,"internally_reserved":0,"allocated":11214848,"data_stored":5905400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001280"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.219019+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:11.838005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199831+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:57.843933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200777+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213524+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:46:17.700582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207782+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:55.397042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210429+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:43.643298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203627+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:05.482312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200673+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213467+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:59.454027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.213379+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:39.027148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198587+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210754+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:14.462278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198718+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:11.494531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199339+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206793+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:11.734578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211224+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:25.658893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199708+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:00:30.047202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203540+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200330+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198711+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.201191+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:04.302154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:26.058723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198837+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208250+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:19.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199170+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:57.757671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208201+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:45.935305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.211851+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:55.669164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207714+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200675+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:21.773972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203957+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:24.048799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.209372+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:29.307102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.205941+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:41:00.331729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210506+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:14.789768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209192+0000","last_change":"2023-10-06T11:16:33.209192+0000","last_active":"2023-10-06T11:16:33.209192+0000","last_peered":"2023-10-06T11:16:33.209192+0000","last_clean":"2023-10-06T11:16:33.209192+0000","last_became_active":"2023-10-06T11:16:33.208882+0000","last_became_peered":"2023-10-06T11:16:33.208882+0000","last_unstale":"2023-10-06T11:16:33.209192+0000","last_undegraded":"2023-10-06T11:16:33.209192+0000","last_fullsized":"2023-10-06T11:16:33.209192+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.244456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203596+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209362+0000","last_change":"2023-10-06T11:16:33.209362+0000","last_active":"2023-10-06T11:16:33.209362+0000","last_peered":"2023-10-06T11:16:33.209362+0000","last_clean":"2023-10-06T11:16:33.209362+0000","last_became_active":"2023-10-06T11:16:33.209094+0000","last_became_peered":"2023-10-06T11:16:33.209094+0000","last_unstale":"2023-10-06T11:16:33.209362+0000","last_undegraded":"2023-10-06T11:16:33.209362+0000","last_fullsized":"2023-10-06T11:16:33.209362+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:58.573116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.210762+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:08.124517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220109+0000","last_change":"2023-10-06T11:16:33.220109+0000","last_active":"2023-10-06T11:16:33.220109+0000","last_peered":"2023-10-06T11:16:33.220109+0000","last_clean":"2023-10-06T11:16:33.220109+0000","last_became_active":"2023-10-06T11:16:33.219863+0000","last_became_peered":"2023-10-06T11:16:33.219863+0000","last_unstale":"2023-10-06T11:16:33.220109+0000","last_undegraded":"2023-10-06T11:16:33.220109+0000","last_fullsized":"2023-10-06T11:16:33.220109+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:10.732532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199388+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:29.054452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220071+0000","last_change":"2023-10-06T11:16:33.220071+0000","last_active":"2023-10-06T11:16:33.220071+0000","last_peered":"2023-10-06T11:16:33.220071+0000","last_clean":"2023-10-06T11:16:33.220071+0000","last_became_active":"2023-10-06T11:16:33.219690+0000","last_became_peered":"2023-10-06T11:16:33.219690+0000","last_unstale":"2023-10-06T11:16:33.220071+0000","last_undegraded":"2023-10-06T11:16:33.220071+0000","last_fullsized":"2023-10-06T11:16:33.220071+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:10.870949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208504+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:51.097081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223884+0000","last_change":"2023-10-06T11:16:33.223884+0000","last_active":"2023-10-06T11:16:33.223884+0000","last_peered":"2023-10-06T11:16:33.223884+0000","last_clean":"2023-10-06T11:16:33.223884+0000","last_became_active":"2023-10-06T11:16:33.223637+0000","last_became_peered":"2023-10-06T11:16:33.223637+0000","last_unstale":"2023-10-06T11:16:33.223884+0000","last_undegraded":"2023-10-06T11:16:33.223884+0000","last_fullsized":"2023-10-06T11:16:33.223884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:33.118292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.200238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:31.455801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213285+0000","last_change":"2023-10-06T11:16:33.213285+0000","last_active":"2023-10-06T11:16:33.213285+0000","last_peered":"2023-10-06T11:16:33.213285+0000","last_clean":"2023-10-06T11:16:33.213285+0000","last_became_active":"2023-10-06T11:16:33.213019+0000","last_became_peered":"2023-10-06T11:16:33.213019+0000","last_unstale":"2023-10-06T11:16:33.213285+0000","last_undegraded":"2023-10-06T11:16:33.213285+0000","last_fullsized":"2023-10-06T11:16:33.213285+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:29.411415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208935+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:59.743398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213564+0000","last_change":"2023-10-06T11:16:33.213564+0000","last_active":"2023-10-06T11:16:33.213564+0000","last_peered":"2023-10-06T11:16:33.213564+0000","last_clean":"2023-10-06T11:16:33.213564+0000","last_became_active":"2023-10-06T11:16:33.213277+0000","last_became_peered":"2023-10-06T11:16:33.213277+0000","last_unstale":"2023-10-06T11:16:33.213564+0000","last_undegraded":"2023-10-06T11:16:33.213564+0000","last_fullsized":"2023-10-06T11:16:33.213564+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:22.574901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203149+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:03.107546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217368+0000","last_change":"2023-10-06T11:16:33.217368+0000","last_active":"2023-10-06T11:16:33.217368+0000","last_peered":"2023-10-06T11:16:33.217368+0000","last_clean":"2023-10-06T11:16:33.217368+0000","last_became_active":"2023-10-06T11:16:33.217072+0000","last_became_peered":"2023-10-06T11:16:33.217072+0000","last_unstale":"2023-10-06T11:16:33.217368+0000","last_undegraded":"2023-10-06T11:16:33.217368+0000","last_fullsized":"2023-10-06T11:16:33.217368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:22.680971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207696+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219889+0000","last_change":"2023-10-06T11:16:33.219889+0000","last_active":"2023-10-06T11:16:33.219889+0000","last_peered":"2023-10-06T11:16:33.219889+0000","last_clean":"2023-10-06T11:16:33.219889+0000","last_became_active":"2023-10-06T11:16:33.219585+0000","last_became_peered":"2023-10-06T11:16:33.219585+0000","last_unstale":"2023-10-06T11:16:33.219889+0000","last_undegraded":"2023-10-06T11:16:33.219889+0000","last_fullsized":"2023-10-06T11:16:33.219889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:25.460290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.212265+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:34.705021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.212220+0000","last_change":"2023-10-06T11:16:33.212220+0000","last_active":"2023-10-06T11:16:33.212220+0000","last_peered":"2023-10-06T11:16:33.212220+0000","last_clean":"2023-10-06T11:16:33.212220+0000","last_became_active":"2023-10-06T11:16:33.211932+0000","last_became_peered":"2023-10-06T11:16:33.211932+0000","last_unstale":"2023-10-06T11:16:33.212220+0000","last_undegraded":"2023-10-06T11:16:33.212220+0000","last_fullsized":"2023-10-06T11:16:33.212220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199128+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223822+0000","last_change":"2023-10-06T11:16:33.223822+0000","last_active":"2023-10-06T11:16:33.223822+0000","last_peered":"2023-10-06T11:16:33.223822+0000","last_clean":"2023-10-06T11:16:33.223822+0000","last_became_active":"2023-10-06T11:16:33.223455+0000","last_became_peered":"2023-10-06T11:16:33.223455+0000","last_unstale":"2023-10-06T11:16:33.223822+0000","last_undegraded":"2023-10-06T11:16:33.223822+0000","last_fullsized":"2023-10-06T11:16:33.223822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:10.492484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198901+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:47.057998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.224060+0000","last_change":"2023-10-06T11:16:33.224060+0000","last_active":"2023-10-06T11:16:33.224060+0000","last_peered":"2023-10-06T11:16:33.224060+0000","last_clean":"2023-10-06T11:16:33.224060+0000","last_became_active":"2023-10-06T11:16:33.223797+0000","last_became_peered":"2023-10-06T11:16:33.223797+0000","last_unstale":"2023-10-06T11:16:33.224060+0000","last_undegraded":"2023-10-06T11:16:33.224060+0000","last_fullsized":"2023-10-06T11:16:33.224060+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:26.775059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198552+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:35.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221810+0000","last_change":"2023-10-06T11:16:33.221810+0000","last_active":"2023-10-06T11:16:33.221810+0000","last_peered":"2023-10-06T11:16:33.221810+0000","last_clean":"2023-10-06T11:16:33.221810+0000","last_became_active":"2023-10-06T11:16:33.221549+0000","last_became_peered":"2023-10-06T11:16:33.221549+0000","last_unstale":"2023-10-06T11:16:33.221810+0000","last_undegraded":"2023-10-06T11:16:33.221810+0000","last_fullsized":"2023-10-06T11:16:33.221810+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:27.175374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208605+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:54.763081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220572+0000","last_change":"2023-10-06T11:16:33.220572+0000","last_active":"2023-10-06T11:16:33.220572+0000","last_peered":"2023-10-06T11:16:33.220572+0000","last_clean":"2023-10-06T11:16:33.220572+0000","last_became_active":"2023-10-06T11:16:33.220337+0000","last_became_peered":"2023-10-06T11:16:33.220337+0000","last_unstale":"2023-10-06T11:16:33.220572+0000","last_undegraded":"2023-10-06T11:16:33.220572+0000","last_fullsized":"2023-10-06T11:16:33.220572+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:13.787721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199601+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:14:09.093676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219845+0000","last_change":"2023-10-06T11:16:33.219845+0000","last_active":"2023-10-06T11:16:33.219845+0000","last_peered":"2023-10-06T11:16:33.219845+0000","last_clean":"2023-10-06T11:16:33.219845+0000","last_became_active":"2023-10-06T11:16:33.219336+0000","last_became_peered":"2023-10-06T11:16:33.219336+0000","last_unstale":"2023-10-06T11:16:33.219845+0000","last_undegraded":"2023-10-06T11:16:33.219845+0000","last_fullsized":"2023-10-06T11:16:33.219845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.506752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207414+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216450+0000","last_change":"2023-10-06T11:16:33.216450+0000","last_active":"2023-10-06T11:16:33.216450+0000","last_peered":"2023-10-06T11:16:33.216450+0000","last_clean":"2023-10-06T11:16:33.216450+0000","last_became_active":"2023-10-06T11:16:33.215830+0000","last_became_peered":"2023-10-06T11:16:33.215830+0000","last_unstale":"2023-10-06T11:16:33.216450+0000","last_undegraded":"2023-10-06T11:16:33.216450+0000","last_fullsized":"2023-10-06T11:16:33.216450+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:13.026976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202956+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:30.413462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.220995+0000","last_change":"2023-10-06T11:16:33.220995+0000","last_active":"2023-10-06T11:16:33.220995+0000","last_peered":"2023-10-06T11:16:33.220995+0000","last_clean":"2023-10-06T11:16:33.220995+0000","last_became_active":"2023-10-06T11:16:33.220666+0000","last_became_peered":"2023-10-06T11:16:33.220666+0000","last_unstale":"2023-10-06T11:16:33.220995+0000","last_undegraded":"2023-10-06T11:16:33.220995+0000","last_fullsized":"2023-10-06T11:16:33.220995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:14.808502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208030+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:48.432471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.211898+0000","last_change":"2023-10-06T11:16:33.211898+0000","last_active":"2023-10-06T11:16:33.211898+0000","last_peered":"2023-10-06T11:16:33.211898+0000","last_clean":"2023-10-06T11:16:33.211898+0000","last_became_active":"2023-10-06T11:16:33.211582+0000","last_became_peered":"2023-10-06T11:16:33.211582+0000","last_unstale":"2023-10-06T11:16:33.211898+0000","last_undegraded":"2023-10-06T11:16:33.211898+0000","last_fullsized":"2023-10-06T11:16:33.211898+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:14.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208507+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:57.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218347+0000","last_change":"2023-10-06T11:16:33.218347+0000","last_active":"2023-10-06T11:16:33.218347+0000","last_peered":"2023-10-06T11:16:33.218347+0000","last_clean":"2023-10-06T11:16:33.218347+0000","last_became_active":"2023-10-06T11:16:33.217829+0000","last_became_peered":"2023-10-06T11:16:33.217829+0000","last_unstale":"2023-10-06T11:16:33.218347+0000","last_undegraded":"2023-10-06T11:16:33.218347+0000","last_fullsized":"2023-10-06T11:16:33.218347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:49:48.984656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204562+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218295+0000","last_change":"2023-10-06T11:16:33.218295+0000","last_active":"2023-10-06T11:16:33.218295+0000","last_peered":"2023-10-06T11:16:33.218295+0000","last_clean":"2023-10-06T11:16:33.218295+0000","last_became_active":"2023-10-06T11:16:33.218027+0000","last_became_peered":"2023-10-06T11:16:33.218027+0000","last_unstale":"2023-10-06T11:16:33.218295+0000","last_undegraded":"2023-10-06T11:16:33.218295+0000","last_fullsized":"2023-10-06T11:16:33.218295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:28.052406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199787+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:06.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.209049+0000","last_change":"2023-10-06T11:16:33.209049+0000","last_active":"2023-10-06T11:16:33.209049+0000","last_peered":"2023-10-06T11:16:33.209049+0000","last_clean":"2023-10-06T11:16:33.209049+0000","last_became_active":"2023-10-06T11:16:33.208697+0000","last_became_peered":"2023-10-06T11:16:33.208697+0000","last_unstale":"2023-10-06T11:16:33.209049+0000","last_undegraded":"2023-10-06T11:16:33.209049+0000","last_fullsized":"2023-10-06T11:16:33.209049+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.708958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.199655+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:59.285038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.219734+0000","last_change":"2023-10-06T11:16:33.219734+0000","last_active":"2023-10-06T11:16:33.219734+0000","last_peered":"2023-10-06T11:16:33.219734+0000","last_clean":"2023-10-06T11:16:33.219734+0000","last_became_active":"2023-10-06T11:16:33.219460+0000","last_became_peered":"2023-10-06T11:16:33.219460+0000","last_unstale":"2023-10-06T11:16:33.219734+0000","last_undegraded":"2023-10-06T11:16:33.219734+0000","last_fullsized":"2023-10-06T11:16:33.219734+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:18.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.198528+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:15.720942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216523+0000","last_change":"2023-10-06T11:16:33.216523+0000","last_active":"2023-10-06T11:16:33.216523+0000","last_peered":"2023-10-06T11:16:33.216523+0000","last_clean":"2023-10-06T11:16:33.216523+0000","last_became_active":"2023-10-06T11:16:33.216307+0000","last_became_peered":"2023-10-06T11:16:33.216307+0000","last_unstale":"2023-10-06T11:16:33.216523+0000","last_undegraded":"2023-10-06T11:16:33.216523+0000","last_fullsized":"2023-10-06T11:16:33.216523+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:42.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.208804+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:43.963003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.216619+0000","last_change":"2023-10-06T11:16:33.216619+0000","last_active":"2023-10-06T11:16:33.216619+0000","last_peered":"2023-10-06T11:16:33.216619+0000","last_clean":"2023-10-06T11:16:33.216619+0000","last_became_active":"2023-10-06T11:16:33.216192+0000","last_became_peered":"2023-10-06T11:16:33.216192+0000","last_unstale":"2023-10-06T11:16:33.216619+0000","last_undegraded":"2023-10-06T11:16:33.216619+0000","last_fullsized":"2023-10-06T11:16:33.216619+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:06.366888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.203139+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:15.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.213912+0000","last_change":"2023-10-06T11:16:33.213912+0000","last_active":"2023-10-06T11:16:33.213912+0000","last_peered":"2023-10-06T11:16:33.213912+0000","last_clean":"2023-10-06T11:16:33.213912+0000","last_became_active":"2023-10-06T11:16:33.213162+0000","last_became_peered":"2023-10-06T11:16:33.213162+0000","last_unstale":"2023-10-06T11:16:33.213912+0000","last_undegraded":"2023-10-06T11:16:33.213912+0000","last_fullsized":"2023-10-06T11:16:33.213912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:46.055952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203912+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:32.203912+0000","last_peered":"2023-10-06T11:16:32.203912+0000","last_clean":"2023-10-06T11:16:32.203912+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:32.203912+0000","last_undegraded":"2023-10-06T11:16:32.203912+0000","last_fullsized":"2023-10-06T11:16:32.203912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207914+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:04.732227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223967+0000","last_change":"2023-10-06T11:16:33.223967+0000","last_active":"2023-10-06T11:16:33.223967+0000","last_peered":"2023-10-06T11:16:33.223967+0000","last_clean":"2023-10-06T11:16:33.223967+0000","last_became_active":"2023-10-06T11:16:33.223718+0000","last_became_peered":"2023-10-06T11:16:33.223718+0000","last_unstale":"2023-10-06T11:16:33.223967+0000","last_undegraded":"2023-10-06T11:16:33.223967+0000","last_fullsized":"2023-10-06T11:16:33.223967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:07.122471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199277+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:32.199277+0000","last_peered":"2023-10-06T11:16:32.199277+0000","last_clean":"2023-10-06T11:16:32.199277+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:32.199277+0000","last_undegraded":"2023-10-06T11:16:32.199277+0000","last_fullsized":"2023-10-06T11:16:32.199277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206904+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218452+0000","last_change":"2023-10-06T11:16:33.218452+0000","last_active":"2023-10-06T11:16:33.218452+0000","last_peered":"2023-10-06T11:16:33.218452+0000","last_clean":"2023-10-06T11:16:33.218452+0000","last_became_active":"2023-10-06T11:16:33.218174+0000","last_became_peered":"2023-10-06T11:16:33.218174+0000","last_unstale":"2023-10-06T11:16:33.218452+0000","last_undegraded":"2023-10-06T11:16:33.218452+0000","last_fullsized":"2023-10-06T11:16:33.218452+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.199399+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:32.199399+0000","last_peered":"2023-10-06T11:16:32.199399+0000","last_clean":"2023-10-06T11:16:32.199399+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:32.199399+0000","last_undegraded":"2023-10-06T11:16:32.199399+0000","last_fullsized":"2023-10-06T11:16:32.199399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206766+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:09:42.949497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.217999+0000","last_change":"2023-10-06T11:16:33.217999+0000","last_active":"2023-10-06T11:16:33.217999+0000","last_peered":"2023-10-06T11:16:33.217999+0000","last_clean":"2023-10-06T11:16:33.217999+0000","last_became_active":"2023-10-06T11:16:33.217732+0000","last_became_peered":"2023-10-06T11:16:33.217732+0000","last_unstale":"2023-10-06T11:16:33.217999+0000","last_undegraded":"2023-10-06T11:16:33.217999+0000","last_fullsized":"2023-10-06T11:16:33.217999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:18.572365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.201292+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:32.201292+0000","last_peered":"2023-10-06T11:16:32.201292+0000","last_clean":"2023-10-06T11:16:32.201292+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:32.201292+0000","last_undegraded":"2023-10-06T11:16:32.201292+0000","last_fullsized":"2023-10-06T11:16:32.201292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.205986+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:32.205986+0000","last_peered":"2023-10-06T11:16:32.205986+0000","last_clean":"2023-10-06T11:16:32.205986+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:32.205986+0000","last_undegraded":"2023-10-06T11:16:32.205986+0000","last_fullsized":"2023-10-06T11:16:32.205986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.206850+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.215786+0000","last_change":"2023-10-06T11:16:33.215786+0000","last_active":"2023-10-06T11:16:33.215786+0000","last_peered":"2023-10-06T11:16:33.215786+0000","last_clean":"2023-10-06T11:16:33.215786+0000","last_became_active":"2023-10-06T11:16:33.215537+0000","last_became_peered":"2023-10-06T11:16:33.215537+0000","last_unstale":"2023-10-06T11:16:33.215786+0000","last_undegraded":"2023-10-06T11:16:33.215786+0000","last_fullsized":"2023-10-06T11:16:33.215786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:34.426776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206482+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:32.206482+0000","last_peered":"2023-10-06T11:16:32.206482+0000","last_clean":"2023-10-06T11:16:32.206482+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:32.206482+0000","last_undegraded":"2023-10-06T11:16:32.206482+0000","last_fullsized":"2023-10-06T11:16:32.206482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.204603+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:05.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.223915+0000","last_change":"2023-10-06T11:16:33.223915+0000","last_active":"2023-10-06T11:16:33.223915+0000","last_peered":"2023-10-06T11:16:33.223915+0000","last_clean":"2023-10-06T11:16:33.223915+0000","last_became_active":"2023-10-06T11:16:33.223629+0000","last_became_peered":"2023-10-06T11:16:33.223629+0000","last_unstale":"2023-10-06T11:16:33.223915+0000","last_undegraded":"2023-10-06T11:16:33.223915+0000","last_fullsized":"2023-10-06T11:16:33.223915+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:59.329683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206490+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:32.206490+0000","last_peered":"2023-10-06T11:16:32.206490+0000","last_clean":"2023-10-06T11:16:32.206490+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:32.206490+0000","last_undegraded":"2023-10-06T11:16:32.206490+0000","last_fullsized":"2023-10-06T11:16:32.206490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.202728+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:15.676191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.221210+0000","last_change":"2023-10-06T11:16:33.221210+0000","last_active":"2023-10-06T11:16:33.221210+0000","last_peered":"2023-10-06T11:16:33.221210+0000","last_clean":"2023-10-06T11:16:33.221210+0000","last_became_active":"2023-10-06T11:16:33.220958+0000","last_became_peered":"2023-10-06T11:16:33.220958+0000","last_unstale":"2023-10-06T11:16:33.221210+0000","last_undegraded":"2023-10-06T11:16:33.221210+0000","last_fullsized":"2023-10-06T11:16:33.221210+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:43:17.165325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.203800+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:32.203800+0000","last_peered":"2023-10-06T11:16:32.203800+0000","last_clean":"2023-10-06T11:16:32.203800+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:32.203800+0000","last_undegraded":"2023-10-06T11:16:32.203800+0000","last_fullsized":"2023-10-06T11:16:32.203800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:33.192781+0000","last_change":"2023-10-06T11:16:33.207238+0000","last_active":"2023-10-06T11:16:33.192781+0000","last_peered":"2023-10-06T11:16:33.192781+0000","last_clean":"2023-10-06T11:16:33.192781+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:33.192781+0000","last_undegraded":"2023-10-06T11:16:33.192781+0000","last_fullsized":"2023-10-06T11:16:33.192781+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-06T11:16:33.218458+0000","last_change":"2023-10-06T11:16:33.218458+0000","last_active":"2023-10-06T11:16:33.218458+0000","last_peered":"2023-10-06T11:16:33.218458+0000","last_clean":"2023-10-06T11:16:33.218458+0000","last_became_active":"2023-10-06T11:16:33.218195+0000","last_became_peered":"2023-10-06T11:16:33.218195+0000","last_unstale":"2023-10-06T11:16:33.218458+0000","last_undegraded":"2023-10-06T11:16:33.218458+0000","last_fullsized":"2023-10-06T11:16:33.218458+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:03.300107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:16:32.206678+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:32.206678+0000","last_peered":"2023-10-06T11:16:32.206678+0000","last_clean":"2023-10-06T11:16:32.206678+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:32.206678+0000","last_undegraded":"2023-10-06T11:16:32.206678+0000","last_fullsized":"2023-10-06T11:16:32.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.432},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.497}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.056,"15min":1.056},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.371},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":1.254},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":1.298}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":1.319}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299092,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072748,"statfs":{"total":96636764160,"available":96330493952,"internally_reserved":0,"allocated":1847296,"data_stored":1180951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60999999999999999,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.434,"15min":0.432},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47199999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":1.056,"15min":1.056},"last":0.255},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.438,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56999999999999995,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.55400000000000005,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65700000000000003,"15min":0.67900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78400000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66500000000000004,"15min":0.68700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.745,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.335,"15min":2.335},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72399999999999998,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.218,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36799999999999999,"15min":0.38},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42899999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.497,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38700000000000001,"15min":0.40100000000000002},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83499999999999996,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.872,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":1.115,"15min":1.115},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80500000000000005,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84299999999999997,"5min":1.276,"15min":1.276},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.996,"15min":0.996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71399999999999997,"5min":1.014,"15min":1.014},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":590583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.621},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":1.369,"15min":1.369},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77200000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70599999999999996,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81000000000000005,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":1.355,"15min":1.355},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":1.512,"15min":1.512},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:43.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.540+0000 7ffb81169700 1 Processor -- start 2023-10-06T11:16:43.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.540+0000 7ffb81169700 1 -- start start 2023-10-06T11:16:43.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb81169700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb7c159560 0x7ffb7c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb81169700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb7c0b49a0 0x7ffb7c0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb81169700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb81169700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b0c60 con 0x7ffb7c159560 2023-10-06T11:16:43.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb81169700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b0f40 con 0x7ffb7c0b49a0 2023-10-06T11:16:43.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb81169700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b1220 con 0x7ffb7c0b0760 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb7ad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb7c159560 0x7ffb7c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb7ad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb7c159560 0x7ffb7c0aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38304/0 (socket says 172.21.15.55:38304) 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb7ad9d700 1 -- 172.21.15.55:0/995236841 learned_addr learned my addr 172.21.15.55:0/995236841 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb7b59e700 1 --2- 172.21.15.55:0/995236841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.541+0000 7ffb7a59c700 1 --2- 172.21.15.55:0/995236841 >> v2:172.21.15.142:3300/0 conn(0x7ffb7c0b49a0 0x7ffb7c0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb7ad9d700 1 -- 172.21.15.55:0/995236841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 msgr2=0x7ffb7c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/995236841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb7ad9d700 1 -- 172.21.15.55:0/995236841 >> v2:172.21.15.142:3300/0 conn(0x7ffb7c0b49a0 msgr2=0x7ffb7c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/995236841 >> v2:172.21.15.142:3300/0 conn(0x7ffb7c0b49a0 0x7ffb7c0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb7ad9d700 1 -- 172.21.15.55:0/995236841 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0b1500 con 0x7ffb7c159560 2023-10-06T11:16:43.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/995236841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c0aa530 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009990 tx=0x7ffb6c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c171e377326879a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb79d9b700 1 -- 172.21.15.55:0/995236841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005c10 con 0x7ffb7c159560 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb79d9b700 1 -- 172.21.15.55:0/995236841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c005d70 con 0x7ffb7c159560 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb79d9b700 1 -- 172.21.15.55:0/995236841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c006260 con 0x7ffb7c159560 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 -- 172.21.15.55:0/995236841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 msgr2=0x7ffb7c0aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 --2- 172.21.15.55:0/995236841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c0aa530 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009990 tx=0x7ffb6c009220 comp rx=0 tx=0).stop 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 -- 172.21.15.55:0/995236841 shutdown_connections 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 --2- 172.21.15.55:0/995236841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 --2- 172.21.15.55:0/995236841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c0aa530 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 --2- 172.21.15.55:0/995236841 >> v2:172.21.15.142:3300/0 conn(0x7ffb7c0b49a0 0x7ffb7c0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 -- 172.21.15.55:0/995236841 >> 172.21.15.55:0/995236841 conn(0x7ffb7c0997f0 msgr2=0x7ffb7c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:43.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.542+0000 7ffb81169700 1 -- 172.21.15.55:0/995236841 shutdown_connections 2023-10-06T11:16:43.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.543+0000 7ffb81169700 1 -- 172.21.15.55:0/995236841 wait complete. 2023-10-06T11:16:43.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.544+0000 7ffb81169700 1 Processor -- start 2023-10-06T11:16:43.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.544+0000 7ffb81169700 1 -- start start 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7c0b49a0 0x7ffb7c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c14cf30 con 0x7ffb7c159560 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c154ae0 con 0x7ffb7c0b49a0 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c152d70 con 0x7ffb7c0b0760 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c1545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38320/0 (socket says 172.21.15.55:38320) 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 -- 172.21.15.55:0/2029575748 learned_addr learned my addr 172.21.15.55:0/2029575748 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7a59c700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7c0b49a0 0x7ffb7c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 -- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 msgr2=0x7ffb7c151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 -- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7c0b49a0 msgr2=0x7ffb7c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7c0b49a0 0x7ffb7c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 -- 172.21.15.55:0/2029575748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c009480 con 0x7ffb7c159560 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7a59c700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7c0b49a0 0x7ffb7c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb7b59e700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c1545a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009f20 tx=0x7ffb7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400cd10 con 0x7ffb7c159560 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7400f040 con 0x7ffb7c159560 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c152160 con 0x7ffb7c159560 2023-10-06T11:16:43.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.545+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740146d0 con 0x7ffb7c159560 2023-10-06T11:16:43.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.546+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c152720 con 0x7ffb7c159560 2023-10-06T11:16:43.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.546+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c152ee0 con 0x7ffb7c159560 2023-10-06T11:16:43.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.547+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb74014a80 con 0x7ffb7c159560 2023-10-06T11:16:43.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.547+0000 7ffb72ffd700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb5c066f30 0x7ffb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.548+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffb74085650 con 0x7ffb7c159560 2023-10-06T11:16:43.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.548+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb5c066f30 0x7ffb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.548+0000 7ffb7ad9d700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb5c066f30 0x7ffb5c0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009260 tx=0x7ffb6c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:43.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.552+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb74052580 con 0x7ffb7c159560 2023-10-06T11:16:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.740+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb7c064b00 con 0x7ffb5c066f30 2023-10-06T11:16:43.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.749+0000 7ffb72ffd700 1 -- 172.21.15.55:0/2029575748 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312137 (secure 0 0 0) 0x7ffb7c064b00 con 0x7ffb5c066f30 2023-10-06T11:16:43.754 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb5c066f30 msgr2=0x7ffb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb5c066f30 0x7ffb5c0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009260 tx=0x7ffb6c016000 comp rx=0 tx=0).stop 2023-10-06T11:16:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 msgr2=0x7ffb7c1545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c1545a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009f20 tx=0x7ffb7400b040 comp rx=0 tx=0).stop 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 shutdown_connections 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb5c066f30 0x7ffb5c0693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb7c159560 0x7ffb7c1545a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7c0b0760 0x7ffb7c151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 --2- 172.21.15.55:0/2029575748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7c0b49a0 0x7ffb7c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 >> 172.21.15.55:0/2029575748 conn(0x7ffb7c0997f0 msgr2=0x7ffb7c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 shutdown_connections 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.752+0000 7ffb81169700 1 -- 172.21.15.55:0/2029575748 wait complete. 2023-10-06T11:16:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:16:43.766 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2023-10-06T11:16:42.890380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389512,"kb_used_data":11208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752585208,"statfs":{"total":773094113280,"available":770647252992,"internally_reserved":0,"allocated":11476992,"data_stored":6025188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.664312"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255142+0000","last_change":"2023-10-06T11:16:34.244836+0000","last_active":"2023-10-06T11:16:34.255142+0000","last_peered":"2023-10-06T11:16:34.255142+0000","last_clean":"2023-10-06T11:16:34.255142+0000","last_became_active":"2023-10-06T11:16:34.244505+0000","last_became_peered":"2023-10-06T11:16:34.244505+0000","last_unstale":"2023-10-06T11:16:34.255142+0000","last_undegraded":"2023-10-06T11:16:34.255142+0000","last_fullsized":"2023-10-06T11:16:34.255142+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:40.546723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255555+0000","last_change":"2023-10-06T11:16:34.253555+0000","last_active":"2023-10-06T11:16:34.255555+0000","last_peered":"2023-10-06T11:16:34.255555+0000","last_clean":"2023-10-06T11:16:34.255555+0000","last_became_active":"2023-10-06T11:16:34.253308+0000","last_became_peered":"2023-10-06T11:16:34.253308+0000","last_unstale":"2023-10-06T11:16:34.255555+0000","last_undegraded":"2023-10-06T11:16:34.255555+0000","last_fullsized":"2023-10-06T11:16:34.255555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:59.743398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256012+0000","last_change":"2023-10-06T11:16:34.254317+0000","last_active":"2023-10-06T11:16:34.256012+0000","last_peered":"2023-10-06T11:16:34.256012+0000","last_clean":"2023-10-06T11:16:34.256012+0000","last_became_active":"2023-10-06T11:16:34.254024+0000","last_became_peered":"2023-10-06T11:16:34.254024+0000","last_unstale":"2023-10-06T11:16:34.256012+0000","last_undegraded":"2023-10-06T11:16:34.256012+0000","last_fullsized":"2023-10-06T11:16:34.256012+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255896+0000","last_change":"2023-10-06T11:16:34.246060+0000","last_active":"2023-10-06T11:16:34.255896+0000","last_peered":"2023-10-06T11:16:34.255896+0000","last_clean":"2023-10-06T11:16:34.255896+0000","last_became_active":"2023-10-06T11:16:34.245220+0000","last_became_peered":"2023-10-06T11:16:34.245220+0000","last_unstale":"2023-10-06T11:16:34.255896+0000","last_undegraded":"2023-10-06T11:16:34.255896+0000","last_fullsized":"2023-10-06T11:16:34.255896+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:24.462760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.261853+0000","last_change":"2023-10-06T11:16:34.259613+0000","last_active":"2023-10-06T11:16:34.261853+0000","last_peered":"2023-10-06T11:16:34.261853+0000","last_clean":"2023-10-06T11:16:34.261853+0000","last_became_active":"2023-10-06T11:16:34.259235+0000","last_became_peered":"2023-10-06T11:16:34.259235+0000","last_unstale":"2023-10-06T11:16:34.261853+0000","last_undegraded":"2023-10-06T11:16:34.261853+0000","last_fullsized":"2023-10-06T11:16:34.261853+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:11.023778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.252672+0000","last_change":"2023-10-06T11:16:34.251141+0000","last_active":"2023-10-06T11:16:34.252672+0000","last_peered":"2023-10-06T11:16:34.252672+0000","last_clean":"2023-10-06T11:16:34.252672+0000","last_became_active":"2023-10-06T11:16:34.250803+0000","last_became_peered":"2023-10-06T11:16:34.250803+0000","last_unstale":"2023-10-06T11:16:34.252672+0000","last_undegraded":"2023-10-06T11:16:34.252672+0000","last_fullsized":"2023-10-06T11:16:34.252672+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:11.023778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.248902+0000","last_change":"2023-10-06T11:16:34.243625+0000","last_active":"2023-10-06T11:16:34.248902+0000","last_peered":"2023-10-06T11:16:34.248902+0000","last_clean":"2023-10-06T11:16:34.248902+0000","last_became_active":"2023-10-06T11:16:34.243361+0000","last_became_peered":"2023-10-06T11:16:34.243361+0000","last_unstale":"2023-10-06T11:16:34.248902+0000","last_undegraded":"2023-10-06T11:16:34.248902+0000","last_fullsized":"2023-10-06T11:16:34.248902+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:15.720942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254497+0000","last_change":"2023-10-06T11:16:34.252729+0000","last_active":"2023-10-06T11:16:34.254497+0000","last_peered":"2023-10-06T11:16:34.254497+0000","last_clean":"2023-10-06T11:16:34.254497+0000","last_became_active":"2023-10-06T11:16:34.252447+0000","last_became_peered":"2023-10-06T11:16:34.252447+0000","last_unstale":"2023-10-06T11:16:34.254497+0000","last_undegraded":"2023-10-06T11:16:34.254497+0000","last_fullsized":"2023-10-06T11:16:34.254497+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256373+0000","last_change":"2023-10-06T11:16:34.253370+0000","last_active":"2023-10-06T11:16:34.256373+0000","last_peered":"2023-10-06T11:16:34.256373+0000","last_clean":"2023-10-06T11:16:34.256373+0000","last_became_active":"2023-10-06T11:16:34.253121+0000","last_became_peered":"2023-10-06T11:16:34.253121+0000","last_unstale":"2023-10-06T11:16:34.256373+0000","last_undegraded":"2023-10-06T11:16:34.256373+0000","last_fullsized":"2023-10-06T11:16:34.256373+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:46.014159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256949+0000","last_change":"2023-10-06T11:16:34.249046+0000","last_active":"2023-10-06T11:16:34.256949+0000","last_peered":"2023-10-06T11:16:34.256949+0000","last_clean":"2023-10-06T11:16:34.256949+0000","last_became_active":"2023-10-06T11:16:34.248776+0000","last_became_peered":"2023-10-06T11:16:34.248776+0000","last_unstale":"2023-10-06T11:16:34.256949+0000","last_undegraded":"2023-10-06T11:16:34.256949+0000","last_fullsized":"2023-10-06T11:16:34.256949+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.898444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.249688+0000","last_change":"2023-10-06T11:16:34.242905+0000","last_active":"2023-10-06T11:16:34.249688+0000","last_peered":"2023-10-06T11:16:34.249688+0000","last_clean":"2023-10-06T11:16:34.249688+0000","last_became_active":"2023-10-06T11:16:34.242605+0000","last_became_peered":"2023-10-06T11:16:34.242605+0000","last_unstale":"2023-10-06T11:16:34.249688+0000","last_undegraded":"2023-10-06T11:16:34.249688+0000","last_fullsized":"2023-10-06T11:16:34.249688+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:14.029022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255145+0000","last_change":"2023-10-06T11:16:34.244962+0000","last_active":"2023-10-06T11:16:34.255145+0000","last_peered":"2023-10-06T11:16:34.255145+0000","last_clean":"2023-10-06T11:16:34.255145+0000","last_became_active":"2023-10-06T11:16:34.244546+0000","last_became_peered":"2023-10-06T11:16:34.244546+0000","last_unstale":"2023-10-06T11:16:34.255145+0000","last_undegraded":"2023-10-06T11:16:34.255145+0000","last_fullsized":"2023-10-06T11:16:34.255145+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:53:15.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256054+0000","last_change":"2023-10-06T11:16:34.254635+0000","last_active":"2023-10-06T11:16:34.256054+0000","last_peered":"2023-10-06T11:16:34.256054+0000","last_clean":"2023-10-06T11:16:34.256054+0000","last_became_active":"2023-10-06T11:16:34.254260+0000","last_became_peered":"2023-10-06T11:16:34.254260+0000","last_unstale":"2023-10-06T11:16:34.256054+0000","last_undegraded":"2023-10-06T11:16:34.256054+0000","last_fullsized":"2023-10-06T11:16:34.256054+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:26.058723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.252881+0000","last_change":"2023-10-06T11:16:34.247315+0000","last_active":"2023-10-06T11:16:34.252881+0000","last_peered":"2023-10-06T11:16:34.252881+0000","last_clean":"2023-10-06T11:16:34.252881+0000","last_became_active":"2023-10-06T11:16:34.247032+0000","last_became_peered":"2023-10-06T11:16:34.247032+0000","last_unstale":"2023-10-06T11:16:34.252881+0000","last_undegraded":"2023-10-06T11:16:34.252881+0000","last_fullsized":"2023-10-06T11:16:34.252881+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254301+0000","last_change":"2023-10-06T11:16:34.251728+0000","last_active":"2023-10-06T11:16:34.254301+0000","last_peered":"2023-10-06T11:16:34.254301+0000","last_clean":"2023-10-06T11:16:34.254301+0000","last_became_active":"2023-10-06T11:16:34.251459+0000","last_became_peered":"2023-10-06T11:16:34.251459+0000","last_unstale":"2023-10-06T11:16:34.254301+0000","last_undegraded":"2023-10-06T11:16:34.254301+0000","last_fullsized":"2023-10-06T11:16:34.254301+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.711005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256255+0000","last_change":"2023-10-06T11:16:34.248280+0000","last_active":"2023-10-06T11:16:34.256255+0000","last_peered":"2023-10-06T11:16:34.256255+0000","last_clean":"2023-10-06T11:16:34.256255+0000","last_became_active":"2023-10-06T11:16:34.248004+0000","last_became_peered":"2023-10-06T11:16:34.248004+0000","last_unstale":"2023-10-06T11:16:34.256255+0000","last_undegraded":"2023-10-06T11:16:34.256255+0000","last_fullsized":"2023-10-06T11:16:34.256255+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:24.105158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.249795+0000","last_change":"2023-10-06T11:16:34.243533+0000","last_active":"2023-10-06T11:16:34.249795+0000","last_peered":"2023-10-06T11:16:34.249795+0000","last_clean":"2023-10-06T11:16:34.249795+0000","last_became_active":"2023-10-06T11:16:34.243081+0000","last_became_peered":"2023-10-06T11:16:34.243081+0000","last_unstale":"2023-10-06T11:16:34.249795+0000","last_undegraded":"2023-10-06T11:16:34.249795+0000","last_fullsized":"2023-10-06T11:16:34.249795+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:59.583913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250068+0000","last_change":"2023-10-06T11:16:34.245407+0000","last_active":"2023-10-06T11:16:34.250068+0000","last_peered":"2023-10-06T11:16:34.250068+0000","last_clean":"2023-10-06T11:16:34.250068+0000","last_became_active":"2023-10-06T11:16:34.244542+0000","last_became_peered":"2023-10-06T11:16:34.244542+0000","last_unstale":"2023-10-06T11:16:34.250068+0000","last_undegraded":"2023-10-06T11:16:34.250068+0000","last_fullsized":"2023-10-06T11:16:34.250068+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:24.546464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254412+0000","last_change":"2023-10-06T11:16:34.250782+0000","last_active":"2023-10-06T11:16:34.254412+0000","last_peered":"2023-10-06T11:16:34.254412+0000","last_clean":"2023-10-06T11:16:34.254412+0000","last_became_active":"2023-10-06T11:16:34.250389+0000","last_became_peered":"2023-10-06T11:16:34.250389+0000","last_unstale":"2023-10-06T11:16:34.254412+0000","last_undegraded":"2023-10-06T11:16:34.254412+0000","last_fullsized":"2023-10-06T11:16:34.254412+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:19.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250562+0000","last_change":"2023-10-06T11:16:34.248646+0000","last_active":"2023-10-06T11:16:34.250562+0000","last_peered":"2023-10-06T11:16:34.250562+0000","last_clean":"2023-10-06T11:16:34.250562+0000","last_became_active":"2023-10-06T11:16:34.248354+0000","last_became_peered":"2023-10-06T11:16:34.248354+0000","last_unstale":"2023-10-06T11:16:34.250562+0000","last_undegraded":"2023-10-06T11:16:34.250562+0000","last_fullsized":"2023-10-06T11:16:34.250562+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:24.226295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254546+0000","last_change":"2023-10-06T11:16:34.252717+0000","last_active":"2023-10-06T11:16:34.254546+0000","last_peered":"2023-10-06T11:16:34.254546+0000","last_clean":"2023-10-06T11:16:34.254546+0000","last_became_active":"2023-10-06T11:16:34.252397+0000","last_became_peered":"2023-10-06T11:16:34.252397+0000","last_unstale":"2023-10-06T11:16:34.254546+0000","last_undegraded":"2023-10-06T11:16:34.254546+0000","last_fullsized":"2023-10-06T11:16:34.254546+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:43:18.167371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.260000+0000","last_change":"2023-10-06T11:16:34.251157+0000","last_active":"2023-10-06T11:16:34.260000+0000","last_peered":"2023-10-06T11:16:34.260000+0000","last_clean":"2023-10-06T11:16:34.260000+0000","last_became_active":"2023-10-06T11:16:34.250668+0000","last_became_peered":"2023-10-06T11:16:34.250668+0000","last_unstale":"2023-10-06T11:16:34.260000+0000","last_undegraded":"2023-10-06T11:16:34.260000+0000","last_fullsized":"2023-10-06T11:16:34.260000+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250557+0000","last_change":"2023-10-06T11:16:34.248636+0000","last_active":"2023-10-06T11:16:34.250557+0000","last_peered":"2023-10-06T11:16:34.250557+0000","last_clean":"2023-10-06T11:16:34.250557+0000","last_became_active":"2023-10-06T11:16:34.248351+0000","last_became_peered":"2023-10-06T11:16:34.248351+0000","last_unstale":"2023-10-06T11:16:34.250557+0000","last_undegraded":"2023-10-06T11:16:34.250557+0000","last_fullsized":"2023-10-06T11:16:34.250557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:29.067184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.260544+0000","last_change":"2023-10-06T11:16:34.256757+0000","last_active":"2023-10-06T11:16:34.260544+0000","last_peered":"2023-10-06T11:16:34.260544+0000","last_clean":"2023-10-06T11:16:34.260544+0000","last_became_active":"2023-10-06T11:16:34.256477+0000","last_became_peered":"2023-10-06T11:16:34.256477+0000","last_unstale":"2023-10-06T11:16:34.260544+0000","last_undegraded":"2023-10-06T11:16:34.260544+0000","last_fullsized":"2023-10-06T11:16:34.260544+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:06.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.249774+0000","last_change":"2023-10-06T11:16:34.243335+0000","last_active":"2023-10-06T11:16:34.249774+0000","last_peered":"2023-10-06T11:16:34.249774+0000","last_clean":"2023-10-06T11:16:34.249774+0000","last_became_active":"2023-10-06T11:16:34.242729+0000","last_became_peered":"2023-10-06T11:16:34.242729+0000","last_unstale":"2023-10-06T11:16:34.249774+0000","last_undegraded":"2023-10-06T11:16:34.249774+0000","last_fullsized":"2023-10-06T11:16:34.249774+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:49:49.986702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254908+0000","last_change":"2023-10-06T11:16:34.238926+0000","last_active":"2023-10-06T11:16:34.254908+0000","last_peered":"2023-10-06T11:16:34.254908+0000","last_clean":"2023-10-06T11:16:34.254908+0000","last_became_active":"2023-10-06T11:16:34.238648+0000","last_became_peered":"2023-10-06T11:16:34.238648+0000","last_unstale":"2023-10-06T11:16:34.254908+0000","last_undegraded":"2023-10-06T11:16:34.254908+0000","last_fullsized":"2023-10-06T11:16:34.254908+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:41.421874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.259341+0000","last_change":"2023-10-06T11:16:34.256170+0000","last_active":"2023-10-06T11:16:34.259341+0000","last_peered":"2023-10-06T11:16:34.259341+0000","last_clean":"2023-10-06T11:16:34.259341+0000","last_became_active":"2023-10-06T11:16:34.255890+0000","last_became_peered":"2023-10-06T11:16:34.255890+0000","last_unstale":"2023-10-06T11:16:34.259341+0000","last_undegraded":"2023-10-06T11:16:34.259341+0000","last_fullsized":"2023-10-06T11:16:34.259341+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:55.397042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.262562+0000","last_change":"2023-10-06T11:16:34.260640+0000","last_active":"2023-10-06T11:16:34.262562+0000","last_peered":"2023-10-06T11:16:34.262562+0000","last_clean":"2023-10-06T11:16:34.262562+0000","last_became_active":"2023-10-06T11:16:34.260393+0000","last_became_peered":"2023-10-06T11:16:34.260393+0000","last_unstale":"2023-10-06T11:16:34.262562+0000","last_undegraded":"2023-10-06T11:16:34.262562+0000","last_fullsized":"2023-10-06T11:16:34.262562+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:59.285038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250598+0000","last_change":"2023-10-06T11:16:34.249255+0000","last_active":"2023-10-06T11:16:34.250598+0000","last_peered":"2023-10-06T11:16:34.250598+0000","last_clean":"2023-10-06T11:16:34.250598+0000","last_became_active":"2023-10-06T11:16:34.248701+0000","last_became_peered":"2023-10-06T11:16:34.248701+0000","last_unstale":"2023-10-06T11:16:34.250598+0000","last_undegraded":"2023-10-06T11:16:34.250598+0000","last_fullsized":"2023-10-06T11:16:34.250598+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:26.462336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255849+0000","last_change":"2023-10-06T11:16:34.252636+0000","last_active":"2023-10-06T11:16:34.255849+0000","last_peered":"2023-10-06T11:16:34.255849+0000","last_clean":"2023-10-06T11:16:34.255849+0000","last_became_active":"2023-10-06T11:16:34.252362+0000","last_became_peered":"2023-10-06T11:16:34.252362+0000","last_unstale":"2023-10-06T11:16:34.255849+0000","last_undegraded":"2023-10-06T11:16:34.255849+0000","last_fullsized":"2023-10-06T11:16:34.255849+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:24.919572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255075+0000","last_change":"2023-10-06T11:16:34.241589+0000","last_active":"2023-10-06T11:16:34.255075+0000","last_peered":"2023-10-06T11:16:34.255075+0000","last_clean":"2023-10-06T11:16:34.255075+0000","last_became_active":"2023-10-06T11:16:34.241332+0000","last_became_peered":"2023-10-06T11:16:34.241332+0000","last_unstale":"2023-10-06T11:16:34.255075+0000","last_undegraded":"2023-10-06T11:16:34.255075+0000","last_fullsized":"2023-10-06T11:16:34.255075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:55.430853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.262021+0000","last_change":"2023-10-06T11:16:34.259298+0000","last_active":"2023-10-06T11:16:34.262021+0000","last_peered":"2023-10-06T11:16:34.262021+0000","last_clean":"2023-10-06T11:16:34.262021+0000","last_became_active":"2023-10-06T11:16:34.259022+0000","last_became_peered":"2023-10-06T11:16:34.259022+0000","last_unstale":"2023-10-06T11:16:34.262021+0000","last_undegraded":"2023-10-06T11:16:34.262021+0000","last_fullsized":"2023-10-06T11:16:34.262021+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:27.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256818+0000","last_change":"2023-10-06T11:16:34.254066+0000","last_active":"2023-10-06T11:16:34.256818+0000","last_peered":"2023-10-06T11:16:34.256818+0000","last_clean":"2023-10-06T11:16:34.256818+0000","last_became_active":"2023-10-06T11:16:34.253813+0000","last_became_peered":"2023-10-06T11:16:34.253813+0000","last_unstale":"2023-10-06T11:16:34.256818+0000","last_undegraded":"2023-10-06T11:16:34.256818+0000","last_fullsized":"2023-10-06T11:16:34.256818+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:34.120338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"102'4","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.246814+0000","last_change":"2023-10-06T11:16:33.209192+0000","last_active":"2023-10-06T11:16:34.246814+0000","last_peered":"2023-10-06T11:16:34.246814+0000","last_clean":"2023-10-06T11:16:34.246814+0000","last_became_active":"2023-10-06T11:16:33.208882+0000","last_became_peered":"2023-10-06T11:16:33.208882+0000","last_unstale":"2023-10-06T11:16:34.246814+0000","last_undegraded":"2023-10-06T11:16:34.246814+0000","last_fullsized":"2023-10-06T11:16:34.246814+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.244456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254085+0000","last_change":"2023-10-06T11:16:34.251698+0000","last_active":"2023-10-06T11:16:34.254085+0000","last_peered":"2023-10-06T11:16:34.254085+0000","last_clean":"2023-10-06T11:16:34.254085+0000","last_became_active":"2023-10-06T11:16:34.251443+0000","last_became_peered":"2023-10-06T11:16:34.251443+0000","last_unstale":"2023-10-06T11:16:34.254085+0000","last_undegraded":"2023-10-06T11:16:34.254085+0000","last_fullsized":"2023-10-06T11:16:34.254085+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:35:42.527966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.251181+0000","last_change":"2023-10-06T11:16:33.209362+0000","last_active":"2023-10-06T11:16:34.251181+0000","last_peered":"2023-10-06T11:16:34.251181+0000","last_clean":"2023-10-06T11:16:34.251181+0000","last_became_active":"2023-10-06T11:16:33.209094+0000","last_became_peered":"2023-10-06T11:16:33.209094+0000","last_unstale":"2023-10-06T11:16:34.251181+0000","last_undegraded":"2023-10-06T11:16:34.251181+0000","last_fullsized":"2023-10-06T11:16:34.251181+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:58.573116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.263694+0000","last_change":"2023-10-06T11:16:34.260900+0000","last_active":"2023-10-06T11:16:34.263694+0000","last_peered":"2023-10-06T11:16:34.263694+0000","last_clean":"2023-10-06T11:16:34.263694+0000","last_became_active":"2023-10-06T11:16:34.260664+0000","last_became_peered":"2023-10-06T11:16:34.260664+0000","last_unstale":"2023-10-06T11:16:34.263694+0000","last_undegraded":"2023-10-06T11:16:34.263694+0000","last_fullsized":"2023-10-06T11:16:34.263694+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:19.574411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.251180+0000","last_change":"2023-10-06T11:16:33.220109+0000","last_active":"2023-10-06T11:16:34.251180+0000","last_peered":"2023-10-06T11:16:34.251180+0000","last_clean":"2023-10-06T11:16:34.251180+0000","last_became_active":"2023-10-06T11:16:33.219863+0000","last_became_peered":"2023-10-06T11:16:33.219863+0000","last_unstale":"2023-10-06T11:16:34.251180+0000","last_undegraded":"2023-10-06T11:16:34.251180+0000","last_fullsized":"2023-10-06T11:16:34.251180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:10.732532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254436+0000","last_change":"2023-10-06T11:16:34.250881+0000","last_active":"2023-10-06T11:16:34.254436+0000","last_peered":"2023-10-06T11:16:34.254436+0000","last_clean":"2023-10-06T11:16:34.254436+0000","last_became_active":"2023-10-06T11:16:34.250529+0000","last_became_peered":"2023-10-06T11:16:34.250529+0000","last_unstale":"2023-10-06T11:16:34.254436+0000","last_undegraded":"2023-10-06T11:16:34.254436+0000","last_fullsized":"2023-10-06T11:16:34.254436+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:55:04.732227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250993+0000","last_change":"2023-10-06T11:16:33.220071+0000","last_active":"2023-10-06T11:16:34.250993+0000","last_peered":"2023-10-06T11:16:34.250993+0000","last_clean":"2023-10-06T11:16:34.250993+0000","last_became_active":"2023-10-06T11:16:33.219690+0000","last_became_peered":"2023-10-06T11:16:33.219690+0000","last_unstale":"2023-10-06T11:16:34.250993+0000","last_undegraded":"2023-10-06T11:16:34.250993+0000","last_fullsized":"2023-10-06T11:16:34.250993+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:10:10.870949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255824+0000","last_change":"2023-10-06T11:16:34.252694+0000","last_active":"2023-10-06T11:16:34.255824+0000","last_peered":"2023-10-06T11:16:34.255824+0000","last_clean":"2023-10-06T11:16:34.255824+0000","last_became_active":"2023-10-06T11:16:34.252416+0000","last_became_peered":"2023-10-06T11:16:34.252416+0000","last_unstale":"2023-10-06T11:16:34.255824+0000","last_undegraded":"2023-10-06T11:16:34.255824+0000","last_fullsized":"2023-10-06T11:16:34.255824+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:55.572133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.239000+0000","last_change":"2023-10-06T11:16:33.223884+0000","last_active":"2023-10-06T11:16:34.239000+0000","last_peered":"2023-10-06T11:16:34.239000+0000","last_clean":"2023-10-06T11:16:34.239000+0000","last_became_active":"2023-10-06T11:16:33.223637+0000","last_became_peered":"2023-10-06T11:16:33.223637+0000","last_unstale":"2023-10-06T11:16:34.239000+0000","last_undegraded":"2023-10-06T11:16:34.239000+0000","last_fullsized":"2023-10-06T11:16:34.239000+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:33.118292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255748+0000","last_change":"2023-10-06T11:16:34.253746+0000","last_active":"2023-10-06T11:16:34.255748+0000","last_peered":"2023-10-06T11:16:34.255748+0000","last_clean":"2023-10-06T11:16:34.255748+0000","last_became_active":"2023-10-06T11:16:34.253482+0000","last_became_peered":"2023-10-06T11:16:34.253482+0000","last_unstale":"2023-10-06T11:16:34.255748+0000","last_undegraded":"2023-10-06T11:16:34.255748+0000","last_fullsized":"2023-10-06T11:16:34.255748+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:48.432471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.259920+0000","last_change":"2023-10-06T11:16:33.213285+0000","last_active":"2023-10-06T11:16:34.259920+0000","last_peered":"2023-10-06T11:16:34.259920+0000","last_clean":"2023-10-06T11:16:34.259920+0000","last_became_active":"2023-10-06T11:16:33.213019+0000","last_became_peered":"2023-10-06T11:16:33.213019+0000","last_unstale":"2023-10-06T11:16:34.259920+0000","last_undegraded":"2023-10-06T11:16:34.259920+0000","last_fullsized":"2023-10-06T11:16:34.259920+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:29.411415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256858+0000","last_change":"2023-10-06T11:16:34.255000+0000","last_active":"2023-10-06T11:16:34.256858+0000","last_peered":"2023-10-06T11:16:34.256858+0000","last_clean":"2023-10-06T11:16:34.256858+0000","last_became_active":"2023-10-06T11:16:34.254725+0000","last_became_peered":"2023-10-06T11:16:34.254725+0000","last_unstale":"2023-10-06T11:16:34.256858+0000","last_undegraded":"2023-10-06T11:16:34.256858+0000","last_fullsized":"2023-10-06T11:16:34.256858+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:35.881588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.230423+0000","last_change":"2023-10-06T11:16:33.213564+0000","last_active":"2023-10-06T11:16:34.230423+0000","last_peered":"2023-10-06T11:16:34.230423+0000","last_clean":"2023-10-06T11:16:34.230423+0000","last_became_active":"2023-10-06T11:16:33.213277+0000","last_became_peered":"2023-10-06T11:16:33.213277+0000","last_unstale":"2023-10-06T11:16:34.230423+0000","last_undegraded":"2023-10-06T11:16:34.230423+0000","last_fullsized":"2023-10-06T11:16:34.230423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:22.574901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.248884+0000","last_change":"2023-10-06T11:16:34.243524+0000","last_active":"2023-10-06T11:16:34.248884+0000","last_peered":"2023-10-06T11:16:34.248884+0000","last_clean":"2023-10-06T11:16:34.248884+0000","last_became_active":"2023-10-06T11:16:34.243050+0000","last_became_peered":"2023-10-06T11:16:34.243050+0000","last_unstale":"2023-10-06T11:16:34.248884+0000","last_undegraded":"2023-10-06T11:16:34.248884+0000","last_fullsized":"2023-10-06T11:16:34.248884+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:01:30.804164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.231722+0000","last_change":"2023-10-06T11:16:33.217368+0000","last_active":"2023-10-06T11:16:34.231722+0000","last_peered":"2023-10-06T11:16:34.231722+0000","last_clean":"2023-10-06T11:16:34.231722+0000","last_became_active":"2023-10-06T11:16:33.217072+0000","last_became_peered":"2023-10-06T11:16:33.217072+0000","last_unstale":"2023-10-06T11:16:34.231722+0000","last_undegraded":"2023-10-06T11:16:34.231722+0000","last_fullsized":"2023-10-06T11:16:34.231722+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:22.680971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.264540+0000","last_change":"2023-10-06T11:16:34.262899+0000","last_active":"2023-10-06T11:16:34.264540+0000","last_peered":"2023-10-06T11:16:34.264540+0000","last_clean":"2023-10-06T11:16:34.264540+0000","last_became_active":"2023-10-06T11:16:34.262660+0000","last_became_peered":"2023-10-06T11:16:34.262660+0000","last_unstale":"2023-10-06T11:16:34.264540+0000","last_undegraded":"2023-10-06T11:16:34.264540+0000","last_fullsized":"2023-10-06T11:16:34.264540+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.711005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.247745+0000","last_change":"2023-10-06T11:16:33.219889+0000","last_active":"2023-10-06T11:16:34.247745+0000","last_peered":"2023-10-06T11:16:34.247745+0000","last_clean":"2023-10-06T11:16:34.247745+0000","last_became_active":"2023-10-06T11:16:33.219585+0000","last_became_peered":"2023-10-06T11:16:33.219585+0000","last_unstale":"2023-10-06T11:16:34.247745+0000","last_undegraded":"2023-10-06T11:16:34.247745+0000","last_fullsized":"2023-10-06T11:16:34.247745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:25.460290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.260086+0000","last_change":"2023-10-06T11:16:34.258436+0000","last_active":"2023-10-06T11:16:34.260086+0000","last_peered":"2023-10-06T11:16:34.260086+0000","last_clean":"2023-10-06T11:16:34.260086+0000","last_became_active":"2023-10-06T11:16:34.258162+0000","last_became_peered":"2023-10-06T11:16:34.258162+0000","last_unstale":"2023-10-06T11:16:34.260086+0000","last_undegraded":"2023-10-06T11:16:34.260086+0000","last_fullsized":"2023-10-06T11:16:34.260086+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:03.246502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.251156+0000","last_change":"2023-10-06T11:16:33.212220+0000","last_active":"2023-10-06T11:16:34.251156+0000","last_peered":"2023-10-06T11:16:34.251156+0000","last_clean":"2023-10-06T11:16:34.251156+0000","last_became_active":"2023-10-06T11:16:33.211932+0000","last_became_peered":"2023-10-06T11:16:33.211932+0000","last_unstale":"2023-10-06T11:16:34.251156+0000","last_undegraded":"2023-10-06T11:16:34.251156+0000","last_fullsized":"2023-10-06T11:16:34.251156+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256479+0000","last_change":"2023-10-06T11:16:34.255872+0000","last_active":"2023-10-06T11:16:34.256479+0000","last_peered":"2023-10-06T11:16:34.256479+0000","last_clean":"2023-10-06T11:16:34.256479+0000","last_became_active":"2023-10-06T11:16:34.255590+0000","last_became_peered":"2023-10-06T11:16:34.255590+0000","last_unstale":"2023-10-06T11:16:34.256479+0000","last_undegraded":"2023-10-06T11:16:34.256479+0000","last_fullsized":"2023-10-06T11:16:34.256479+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.247831+0000","last_change":"2023-10-06T11:16:33.223822+0000","last_active":"2023-10-06T11:16:34.247831+0000","last_peered":"2023-10-06T11:16:34.247831+0000","last_clean":"2023-10-06T11:16:34.247831+0000","last_became_active":"2023-10-06T11:16:33.223455+0000","last_became_peered":"2023-10-06T11:16:33.223455+0000","last_unstale":"2023-10-06T11:16:34.247831+0000","last_undegraded":"2023-10-06T11:16:34.247831+0000","last_fullsized":"2023-10-06T11:16:34.247831+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:10.492484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254453+0000","last_change":"2023-10-06T11:16:34.250960+0000","last_active":"2023-10-06T11:16:34.254453+0000","last_peered":"2023-10-06T11:16:34.254453+0000","last_clean":"2023-10-06T11:16:34.254453+0000","last_became_active":"2023-10-06T11:16:34.250622+0000","last_became_peered":"2023-10-06T11:16:34.250622+0000","last_unstale":"2023-10-06T11:16:34.254453+0000","last_undegraded":"2023-10-06T11:16:34.254453+0000","last_fullsized":"2023-10-06T11:16:34.254453+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:59.316552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.229387+0000","last_change":"2023-10-06T11:16:33.224060+0000","last_active":"2023-10-06T11:16:34.229387+0000","last_peered":"2023-10-06T11:16:34.229387+0000","last_clean":"2023-10-06T11:16:34.229387+0000","last_became_active":"2023-10-06T11:16:33.223797+0000","last_became_peered":"2023-10-06T11:16:33.223797+0000","last_unstale":"2023-10-06T11:16:34.229387+0000","last_undegraded":"2023-10-06T11:16:34.229387+0000","last_fullsized":"2023-10-06T11:16:34.229387+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:26.775059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255308+0000","last_change":"2023-10-06T11:16:34.253589+0000","last_active":"2023-10-06T11:16:34.255308+0000","last_peered":"2023-10-06T11:16:34.255308+0000","last_clean":"2023-10-06T11:16:34.255308+0000","last_became_active":"2023-10-06T11:16:34.253395+0000","last_became_peered":"2023-10-06T11:16:34.253395+0000","last_unstale":"2023-10-06T11:16:34.255308+0000","last_undegraded":"2023-10-06T11:16:34.255308+0000","last_fullsized":"2023-10-06T11:16:34.255308+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.253709+0000","last_change":"2023-10-06T11:16:33.221810+0000","last_active":"2023-10-06T11:16:34.253709+0000","last_peered":"2023-10-06T11:16:34.253709+0000","last_clean":"2023-10-06T11:16:34.253709+0000","last_became_active":"2023-10-06T11:16:33.221549+0000","last_became_peered":"2023-10-06T11:16:33.221549+0000","last_unstale":"2023-10-06T11:16:34.253709+0000","last_undegraded":"2023-10-06T11:16:34.253709+0000","last_fullsized":"2023-10-06T11:16:34.253709+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:27.175374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255777+0000","last_change":"2023-10-06T11:16:34.253032+0000","last_active":"2023-10-06T11:16:34.255777+0000","last_peered":"2023-10-06T11:16:34.255777+0000","last_clean":"2023-10-06T11:16:34.255777+0000","last_became_active":"2023-10-06T11:16:34.252740+0000","last_became_peered":"2023-10-06T11:16:34.252740+0000","last_unstale":"2023-10-06T11:16:34.255777+0000","last_undegraded":"2023-10-06T11:16:34.255777+0000","last_fullsized":"2023-10-06T11:16:34.255777+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:28:34.347190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.236880+0000","last_change":"2023-10-06T11:16:33.220572+0000","last_active":"2023-10-06T11:16:34.236880+0000","last_peered":"2023-10-06T11:16:34.236880+0000","last_clean":"2023-10-06T11:16:34.236880+0000","last_became_active":"2023-10-06T11:16:33.220337+0000","last_became_peered":"2023-10-06T11:16:33.220337+0000","last_unstale":"2023-10-06T11:16:34.236880+0000","last_undegraded":"2023-10-06T11:16:34.236880+0000","last_fullsized":"2023-10-06T11:16:34.236880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:13.787721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254433+0000","last_change":"2023-10-06T11:16:34.251870+0000","last_active":"2023-10-06T11:16:34.254433+0000","last_peered":"2023-10-06T11:16:34.254433+0000","last_clean":"2023-10-06T11:16:34.254433+0000","last_became_active":"2023-10-06T11:16:34.251508+0000","last_became_peered":"2023-10-06T11:16:34.251508+0000","last_unstale":"2023-10-06T11:16:34.254433+0000","last_undegraded":"2023-10-06T11:16:34.254433+0000","last_fullsized":"2023-10-06T11:16:34.254433+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:23.576947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.243414+0000","last_change":"2023-10-06T11:16:33.219845+0000","last_active":"2023-10-06T11:16:34.243414+0000","last_peered":"2023-10-06T11:16:34.243414+0000","last_clean":"2023-10-06T11:16:34.243414+0000","last_became_active":"2023-10-06T11:16:33.219336+0000","last_became_peered":"2023-10-06T11:16:33.219336+0000","last_unstale":"2023-10-06T11:16:34.243414+0000","last_undegraded":"2023-10-06T11:16:34.243414+0000","last_fullsized":"2023-10-06T11:16:34.243414+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.506752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.262604+0000","last_change":"2023-10-06T11:16:34.261271+0000","last_active":"2023-10-06T11:16:34.262604+0000","last_peered":"2023-10-06T11:16:34.262604+0000","last_clean":"2023-10-06T11:16:34.262604+0000","last_became_active":"2023-10-06T11:16:34.260985+0000","last_became_peered":"2023-10-06T11:16:34.260985+0000","last_unstale":"2023-10-06T11:16:34.262604+0000","last_undegraded":"2023-10-06T11:16:34.262604+0000","last_fullsized":"2023-10-06T11:16:34.262604+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:00:30.047202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.233578+0000","last_change":"2023-10-06T11:16:33.216450+0000","last_active":"2023-10-06T11:16:34.233578+0000","last_peered":"2023-10-06T11:16:34.233578+0000","last_clean":"2023-10-06T11:16:34.233578+0000","last_became_active":"2023-10-06T11:16:33.215830+0000","last_became_peered":"2023-10-06T11:16:33.215830+0000","last_unstale":"2023-10-06T11:16:34.233578+0000","last_undegraded":"2023-10-06T11:16:34.233578+0000","last_fullsized":"2023-10-06T11:16:34.233578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:13.026976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250154+0000","last_change":"2023-10-06T11:16:34.245950+0000","last_active":"2023-10-06T11:16:34.250154+0000","last_peered":"2023-10-06T11:16:34.250154+0000","last_clean":"2023-10-06T11:16:34.250154+0000","last_became_active":"2023-10-06T11:16:34.245680+0000","last_became_peered":"2023-10-06T11:16:34.245680+0000","last_unstale":"2023-10-06T11:16:34.250154+0000","last_undegraded":"2023-10-06T11:16:34.250154+0000","last_fullsized":"2023-10-06T11:16:34.250154+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:07.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.260562+0000","last_change":"2023-10-06T11:16:33.220995+0000","last_active":"2023-10-06T11:16:34.260562+0000","last_peered":"2023-10-06T11:16:34.260562+0000","last_clean":"2023-10-06T11:16:34.260562+0000","last_became_active":"2023-10-06T11:16:33.220666+0000","last_became_peered":"2023-10-06T11:16:33.220666+0000","last_unstale":"2023-10-06T11:16:34.260562+0000","last_undegraded":"2023-10-06T11:16:34.260562+0000","last_fullsized":"2023-10-06T11:16:34.260562+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:14.808502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.256319+0000","last_change":"2023-10-06T11:16:34.252122+0000","last_active":"2023-10-06T11:16:34.256319+0000","last_peered":"2023-10-06T11:16:34.256319+0000","last_clean":"2023-10-06T11:16:34.256319+0000","last_became_active":"2023-10-06T11:16:34.248965+0000","last_became_peered":"2023-10-06T11:16:34.248965+0000","last_unstale":"2023-10-06T11:16:34.256319+0000","last_undegraded":"2023-10-06T11:16:34.256319+0000","last_fullsized":"2023-10-06T11:16:34.256319+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:08.408228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"103'1","reported_seq":11,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-06T11:16:35.434401+0000","last_change":"2023-10-06T11:16:33.211898+0000","last_active":"2023-10-06T11:16:35.434401+0000","last_peered":"2023-10-06T11:16:35.434401+0000","last_clean":"2023-10-06T11:16:35.434401+0000","last_became_active":"2023-10-06T11:16:33.211582+0000","last_became_peered":"2023-10-06T11:16:33.211582+0000","last_unstale":"2023-10-06T11:16:35.434401+0000","last_undegraded":"2023-10-06T11:16:35.434401+0000","last_fullsized":"2023-10-06T11:16:35.434401+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:14.718896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255995+0000","last_change":"2023-10-06T11:16:34.254438+0000","last_active":"2023-10-06T11:16:34.255995+0000","last_peered":"2023-10-06T11:16:34.255995+0000","last_clean":"2023-10-06T11:16:34.255995+0000","last_became_active":"2023-10-06T11:16:34.254099+0000","last_became_peered":"2023-10-06T11:16:34.254099+0000","last_unstale":"2023-10-06T11:16:34.255995+0000","last_undegraded":"2023-10-06T11:16:34.255995+0000","last_fullsized":"2023-10-06T11:16:34.255995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:46:15.963622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.232623+0000","last_change":"2023-10-06T11:16:33.218347+0000","last_active":"2023-10-06T11:16:34.232623+0000","last_peered":"2023-10-06T11:16:34.232623+0000","last_clean":"2023-10-06T11:16:34.232623+0000","last_became_active":"2023-10-06T11:16:33.217829+0000","last_became_peered":"2023-10-06T11:16:33.217829+0000","last_unstale":"2023-10-06T11:16:34.232623+0000","last_undegraded":"2023-10-06T11:16:34.232623+0000","last_fullsized":"2023-10-06T11:16:34.232623+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:49:48.984656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250284+0000","last_change":"2023-10-06T11:16:34.246065+0000","last_active":"2023-10-06T11:16:34.250284+0000","last_peered":"2023-10-06T11:16:34.250284+0000","last_clean":"2023-10-06T11:16:34.250284+0000","last_became_active":"2023-10-06T11:16:34.245796+0000","last_became_peered":"2023-10-06T11:16:34.245796+0000","last_unstale":"2023-10-06T11:16:34.250284+0000","last_undegraded":"2023-10-06T11:16:34.250284+0000","last_fullsized":"2023-10-06T11:16:34.250284+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:30:42.020577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.248663+0000","last_change":"2023-10-06T11:16:33.218295+0000","last_active":"2023-10-06T11:16:34.248663+0000","last_peered":"2023-10-06T11:16:34.248663+0000","last_clean":"2023-10-06T11:16:34.248663+0000","last_became_active":"2023-10-06T11:16:33.218027+0000","last_became_peered":"2023-10-06T11:16:33.218027+0000","last_unstale":"2023-10-06T11:16:34.248663+0000","last_undegraded":"2023-10-06T11:16:34.248663+0000","last_fullsized":"2023-10-06T11:16:34.248663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:28.052406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.234151+0000","last_change":"2023-10-06T11:16:34.232708+0000","last_active":"2023-10-06T11:16:34.234151+0000","last_peered":"2023-10-06T11:16:34.234151+0000","last_clean":"2023-10-06T11:16:34.234151+0000","last_became_active":"2023-10-06T11:16:34.232459+0000","last_became_peered":"2023-10-06T11:16:34.232459+0000","last_unstale":"2023-10-06T11:16:34.234151+0000","last_undegraded":"2023-10-06T11:16:34.234151+0000","last_fullsized":"2023-10-06T11:16:34.234151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:23.683017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.229525+0000","last_change":"2023-10-06T11:16:33.209049+0000","last_active":"2023-10-06T11:16:34.229525+0000","last_peered":"2023-10-06T11:16:34.229525+0000","last_clean":"2023-10-06T11:16:34.229525+0000","last_became_active":"2023-10-06T11:16:33.208697+0000","last_became_peered":"2023-10-06T11:16:33.208697+0000","last_unstale":"2023-10-06T11:16:34.229525+0000","last_undegraded":"2023-10-06T11:16:34.229525+0000","last_fullsized":"2023-10-06T11:16:34.229525+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.708958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.247756+0000","last_change":"2023-10-06T11:16:34.240212+0000","last_active":"2023-10-06T11:16:34.247756+0000","last_peered":"2023-10-06T11:16:34.247756+0000","last_clean":"2023-10-06T11:16:34.247756+0000","last_became_active":"2023-10-06T11:16:34.239998+0000","last_became_peered":"2023-10-06T11:16:34.239998+0000","last_unstale":"2023-10-06T11:16:34.247756+0000","last_undegraded":"2023-10-06T11:16:34.247756+0000","last_fullsized":"2023-10-06T11:16:34.247756+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:07.368934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.230316+0000","last_change":"2023-10-06T11:16:33.219734+0000","last_active":"2023-10-06T11:16:34.230316+0000","last_peered":"2023-10-06T11:16:34.230316+0000","last_clean":"2023-10-06T11:16:34.230316+0000","last_became_active":"2023-10-06T11:16:33.219460+0000","last_became_peered":"2023-10-06T11:16:33.219460+0000","last_unstale":"2023-10-06T11:16:34.230316+0000","last_undegraded":"2023-10-06T11:16:34.230316+0000","last_fullsized":"2023-10-06T11:16:34.230316+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:18.849508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254393+0000","last_change":"2023-10-06T11:16:34.251276+0000","last_active":"2023-10-06T11:16:34.254393+0000","last_peered":"2023-10-06T11:16:34.254393+0000","last_clean":"2023-10-06T11:16:34.254393+0000","last_became_active":"2023-10-06T11:16:34.250051+0000","last_became_peered":"2023-10-06T11:16:34.250051+0000","last_unstale":"2023-10-06T11:16:34.254393+0000","last_undegraded":"2023-10-06T11:16:34.254393+0000","last_fullsized":"2023-10-06T11:16:34.254393+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:24.504505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.237004+0000","last_change":"2023-10-06T11:16:33.216523+0000","last_active":"2023-10-06T11:16:34.237004+0000","last_peered":"2023-10-06T11:16:34.237004+0000","last_clean":"2023-10-06T11:16:34.237004+0000","last_became_active":"2023-10-06T11:16:33.216307+0000","last_became_peered":"2023-10-06T11:16:33.216307+0000","last_unstale":"2023-10-06T11:16:34.237004+0000","last_undegraded":"2023-10-06T11:16:34.237004+0000","last_fullsized":"2023-10-06T11:16:34.237004+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:42.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.257118+0000","last_change":"2023-10-06T11:16:34.253145+0000","last_active":"2023-10-06T11:16:34.257118+0000","last_peered":"2023-10-06T11:16:34.257118+0000","last_clean":"2023-10-06T11:16:34.257118+0000","last_became_active":"2023-10-06T11:16:34.252869+0000","last_became_peered":"2023-10-06T11:16:34.252869+0000","last_unstale":"2023-10-06T11:16:34.257118+0000","last_undegraded":"2023-10-06T11:16:34.257118+0000","last_fullsized":"2023-10-06T11:16:34.257118+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:51.608325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.232410+0000","last_change":"2023-10-06T11:16:33.216619+0000","last_active":"2023-10-06T11:16:34.232410+0000","last_peered":"2023-10-06T11:16:34.232410+0000","last_clean":"2023-10-06T11:16:34.232410+0000","last_became_active":"2023-10-06T11:16:33.216192+0000","last_became_peered":"2023-10-06T11:16:33.216192+0000","last_unstale":"2023-10-06T11:16:34.232410+0000","last_undegraded":"2023-10-06T11:16:34.232410+0000","last_fullsized":"2023-10-06T11:16:34.232410+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:06.366888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250196+0000","last_change":"2023-10-06T11:16:34.245830+0000","last_active":"2023-10-06T11:16:34.250196+0000","last_peered":"2023-10-06T11:16:34.250196+0000","last_clean":"2023-10-06T11:16:34.250196+0000","last_became_active":"2023-10-06T11:16:34.245494+0000","last_became_peered":"2023-10-06T11:16:34.245494+0000","last_unstale":"2023-10-06T11:16:34.250196+0000","last_undegraded":"2023-10-06T11:16:34.250196+0000","last_fullsized":"2023-10-06T11:16:34.250196+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:19.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.242164+0000","last_change":"2023-10-06T11:16:33.213912+0000","last_active":"2023-10-06T11:16:34.242164+0000","last_peered":"2023-10-06T11:16:34.242164+0000","last_clean":"2023-10-06T11:16:34.242164+0000","last_became_active":"2023-10-06T11:16:33.213162+0000","last_became_peered":"2023-10-06T11:16:33.213162+0000","last_unstale":"2023-10-06T11:16:34.242164+0000","last_undegraded":"2023-10-06T11:16:34.242164+0000","last_fullsized":"2023-10-06T11:16:34.242164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:46.055952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.244821+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:16:34.244821+0000","last_peered":"2023-10-06T11:16:34.244821+0000","last_clean":"2023-10-06T11:16:34.244821+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:16:34.244821+0000","last_undegraded":"2023-10-06T11:16:34.244821+0000","last_fullsized":"2023-10-06T11:16:34.244821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.261366+0000","last_change":"2023-10-06T11:16:34.257514+0000","last_active":"2023-10-06T11:16:34.261366+0000","last_peered":"2023-10-06T11:16:34.261366+0000","last_clean":"2023-10-06T11:16:34.261366+0000","last_became_active":"2023-10-06T11:16:34.252173+0000","last_became_peered":"2023-10-06T11:16:34.252173+0000","last_unstale":"2023-10-06T11:16:34.261366+0000","last_undegraded":"2023-10-06T11:16:34.261366+0000","last_fullsized":"2023-10-06T11:16:34.261366+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:29.370273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"102'8","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.258605+0000","last_change":"2023-10-06T11:16:33.223967+0000","last_active":"2023-10-06T11:16:34.258605+0000","last_peered":"2023-10-06T11:16:34.258605+0000","last_clean":"2023-10-06T11:16:34.258605+0000","last_became_active":"2023-10-06T11:16:33.223718+0000","last_became_peered":"2023-10-06T11:16:33.223718+0000","last_unstale":"2023-10-06T11:16:34.258605+0000","last_undegraded":"2023-10-06T11:16:34.258605+0000","last_fullsized":"2023-10-06T11:16:34.258605+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:23:07.122471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.230364+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:16:34.230364+0000","last_peered":"2023-10-06T11:16:34.230364+0000","last_clean":"2023-10-06T11:16:34.230364+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:16:34.230364+0000","last_undegraded":"2023-10-06T11:16:34.230364+0000","last_fullsized":"2023-10-06T11:16:34.230364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.262012+0000","last_change":"2023-10-06T11:16:34.259825+0000","last_active":"2023-10-06T11:16:34.262012+0000","last_peered":"2023-10-06T11:16:34.262012+0000","last_clean":"2023-10-06T11:16:34.262012+0000","last_became_active":"2023-10-06T11:16:34.257983+0000","last_became_peered":"2023-10-06T11:16:34.257983+0000","last_unstale":"2023-10-06T11:16:34.262012+0000","last_undegraded":"2023-10-06T11:16:34.262012+0000","last_fullsized":"2023-10-06T11:16:34.262012+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:23.576947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.257299+0000","last_change":"2023-10-06T11:16:33.218452+0000","last_active":"2023-10-06T11:16:34.257299+0000","last_peered":"2023-10-06T11:16:34.257299+0000","last_clean":"2023-10-06T11:16:34.257299+0000","last_became_active":"2023-10-06T11:16:33.218174+0000","last_became_peered":"2023-10-06T11:16:33.218174+0000","last_unstale":"2023-10-06T11:16:34.257299+0000","last_undegraded":"2023-10-06T11:16:34.257299+0000","last_fullsized":"2023-10-06T11:16:34.257299+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:14.187169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.237081+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:16:34.237081+0000","last_peered":"2023-10-06T11:16:34.237081+0000","last_clean":"2023-10-06T11:16:34.237081+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:16:34.237081+0000","last_undegraded":"2023-10-06T11:16:34.237081+0000","last_fullsized":"2023-10-06T11:16:34.237081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.260524+0000","last_change":"2023-10-06T11:16:34.256736+0000","last_active":"2023-10-06T11:16:34.260524+0000","last_peered":"2023-10-06T11:16:34.260524+0000","last_clean":"2023-10-06T11:16:34.260524+0000","last_became_active":"2023-10-06T11:16:34.256431+0000","last_became_peered":"2023-10-06T11:16:34.256431+0000","last_unstale":"2023-10-06T11:16:34.260524+0000","last_undegraded":"2023-10-06T11:16:34.260524+0000","last_fullsized":"2023-10-06T11:16:34.260524+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:06.233184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.230327+0000","last_change":"2023-10-06T11:16:33.217999+0000","last_active":"2023-10-06T11:16:34.230327+0000","last_peered":"2023-10-06T11:16:34.230327+0000","last_clean":"2023-10-06T11:16:34.230327+0000","last_became_active":"2023-10-06T11:16:33.217732+0000","last_became_peered":"2023-10-06T11:16:33.217732+0000","last_unstale":"2023-10-06T11:16:34.230327+0000","last_undegraded":"2023-10-06T11:16:34.230327+0000","last_fullsized":"2023-10-06T11:16:34.230327+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:18.572365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.229615+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:16:34.229615+0000","last_peered":"2023-10-06T11:16:34.229615+0000","last_clean":"2023-10-06T11:16:34.229615+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:16:34.229615+0000","last_undegraded":"2023-10-06T11:16:34.229615+0000","last_fullsized":"2023-10-06T11:16:34.229615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.239338+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:16:34.239338+0000","last_peered":"2023-10-06T11:16:34.239338+0000","last_clean":"2023-10-06T11:16:34.239338+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:16:34.239338+0000","last_undegraded":"2023-10-06T11:16:34.239338+0000","last_fullsized":"2023-10-06T11:16:34.239338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.262297+0000","last_change":"2023-10-06T11:16:34.256636+0000","last_active":"2023-10-06T11:16:34.262297+0000","last_peered":"2023-10-06T11:16:34.262297+0000","last_clean":"2023-10-06T11:16:34.262297+0000","last_became_active":"2023-10-06T11:16:34.256338+0000","last_became_peered":"2023-10-06T11:16:34.256338+0000","last_unstale":"2023-10-06T11:16:34.262297+0000","last_undegraded":"2023-10-06T11:16:34.262297+0000","last_fullsized":"2023-10-06T11:16:34.262297+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:48:59.316552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.238780+0000","last_change":"2023-10-06T11:16:33.215786+0000","last_active":"2023-10-06T11:16:34.238780+0000","last_peered":"2023-10-06T11:16:34.238780+0000","last_clean":"2023-10-06T11:16:34.238780+0000","last_became_active":"2023-10-06T11:16:33.215537+0000","last_became_peered":"2023-10-06T11:16:33.215537+0000","last_unstale":"2023-10-06T11:16:34.238780+0000","last_undegraded":"2023-10-06T11:16:34.238780+0000","last_fullsized":"2023-10-06T11:16:34.238780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:34.426776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.239241+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:16:34.239241+0000","last_peered":"2023-10-06T11:16:34.239241+0000","last_clean":"2023-10-06T11:16:34.239241+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:16:34.239241+0000","last_undegraded":"2023-10-06T11:16:34.239241+0000","last_fullsized":"2023-10-06T11:16:34.239241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.255396+0000","last_change":"2023-10-06T11:16:34.249354+0000","last_active":"2023-10-06T11:16:34.255396+0000","last_peered":"2023-10-06T11:16:34.255396+0000","last_clean":"2023-10-06T11:16:34.255396+0000","last_became_active":"2023-10-06T11:16:34.249116+0000","last_became_peered":"2023-10-06T11:16:34.249116+0000","last_unstale":"2023-10-06T11:16:34.255396+0000","last_undegraded":"2023-10-06T11:16:34.255396+0000","last_fullsized":"2023-10-06T11:16:34.255396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:59.575163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.236980+0000","last_change":"2023-10-06T11:16:33.223915+0000","last_active":"2023-10-06T11:16:34.236980+0000","last_peered":"2023-10-06T11:16:34.236980+0000","last_clean":"2023-10-06T11:16:34.236980+0000","last_became_active":"2023-10-06T11:16:33.223629+0000","last_became_peered":"2023-10-06T11:16:33.223629+0000","last_unstale":"2023-10-06T11:16:34.236980+0000","last_undegraded":"2023-10-06T11:16:34.236980+0000","last_fullsized":"2023-10-06T11:16:34.236980+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:59.329683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.244933+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:16:34.244933+0000","last_peered":"2023-10-06T11:16:34.244933+0000","last_clean":"2023-10-06T11:16:34.244933+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:16:34.244933+0000","last_undegraded":"2023-10-06T11:16:34.244933+0000","last_fullsized":"2023-10-06T11:16:34.244933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.250629+0000","last_change":"2023-10-06T11:16:34.247666+0000","last_active":"2023-10-06T11:16:34.250629+0000","last_peered":"2023-10-06T11:16:34.250629+0000","last_clean":"2023-10-06T11:16:34.250629+0000","last_became_active":"2023-10-06T11:16:34.247375+0000","last_became_peered":"2023-10-06T11:16:34.247375+0000","last_unstale":"2023-10-06T11:16:34.250629+0000","last_undegraded":"2023-10-06T11:16:34.250629+0000","last_fullsized":"2023-10-06T11:16:34.250629+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:35.428822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"102'6","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.265113+0000","last_change":"2023-10-06T11:16:33.221210+0000","last_active":"2023-10-06T11:16:34.265113+0000","last_peered":"2023-10-06T11:16:34.265113+0000","last_clean":"2023-10-06T11:16:34.265113+0000","last_became_active":"2023-10-06T11:16:33.220958+0000","last_became_peered":"2023-10-06T11:16:33.220958+0000","last_unstale":"2023-10-06T11:16:34.265113+0000","last_undegraded":"2023-10-06T11:16:34.265113+0000","last_fullsized":"2023-10-06T11:16:34.265113+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:43:17.165325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.244556+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:16:34.244556+0000","last_peered":"2023-10-06T11:16:34.244556+0000","last_clean":"2023-10-06T11:16:34.244556+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:16:34.244556+0000","last_undegraded":"2023-10-06T11:16:34.244556+0000","last_fullsized":"2023-10-06T11:16:34.244556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.261730+0000","last_change":"2023-10-06T11:16:34.258524+0000","last_active":"2023-10-06T11:16:34.261730+0000","last_peered":"2023-10-06T11:16:34.261730+0000","last_clean":"2023-10-06T11:16:34.261730+0000","last_became_active":"2023-10-06T11:16:34.255829+0000","last_became_peered":"2023-10-06T11:16:34.255829+0000","last_unstale":"2023-10-06T11:16:34.261730+0000","last_undegraded":"2023-10-06T11:16:34.261730+0000","last_fullsized":"2023-10-06T11:16:34.261730+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:33.192781+0000","last_clean_scrub_stamp":"2023-10-06T11:16:33.192781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:57.757671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"102'3","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.254341+0000","last_change":"2023-10-06T11:16:33.218458+0000","last_active":"2023-10-06T11:16:34.254341+0000","last_peered":"2023-10-06T11:16:34.254341+0000","last_clean":"2023-10-06T11:16:34.254341+0000","last_became_active":"2023-10-06T11:16:33.218195+0000","last_became_peered":"2023-10-06T11:16:33.218195+0000","last_unstale":"2023-10-06T11:16:34.254341+0000","last_undegraded":"2023-10-06T11:16:34.254341+0000","last_fullsized":"2023-10-06T11:16:34.254341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:32.190734+0000","last_clean_scrub_stamp":"2023-10-06T11:16:32.190734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:03.300107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-06T11:16:34.238949+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:16:34.238949+0000","last_peered":"2023-10-06T11:16:34.238949+0000","last_clean":"2023-10-06T11:16:34.238949+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:16:34.238949+0000","last_undegraded":"2023-10-06T11:16:34.238949+0000","last_fullsized":"2023-10-06T11:16:34.238949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299124,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072716,"statfs":{"total":96636764160,"available":96330461184,"internally_reserved":0,"allocated":1880064,"data_stored":1195936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.504,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70299999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":1.325,"15min":1.325},"last":0.40999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77800000000000002,"5min":1.395,"15min":1.395},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":1.369,"15min":1.369},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.91400000000000003,"15min":1.0760000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.60499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.438},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71799999999999997,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.503},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74099999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67100000000000004,"5min":0.872,"15min":0.872},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298540,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073300,"statfs":{"total":96636764160,"available":96331059200,"internally_reserved":0,"allocated":1282048,"data_stored":605050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.441},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.74299999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.056,"15min":1.056},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.751,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.749,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298544,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073296,"statfs":{"total":96636764160,"available":96331055104,"internally_reserved":0,"allocated":1286144,"data_stored":605104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.39500000000000002,"15min":0.42699999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.52300000000000002,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.255},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.40500000000000003,"15min":0.42099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46600000000000003,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.39200000000000002,"15min":0.41099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.41699999999999998,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.45800000000000002,"15min":0.49199999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.29599999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.47699999999999998,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.495,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.44800000000000001,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77900000000000003,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.77900000000000003,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67800000000000005,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77600000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79500000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.69899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.754,"5min":1.508,"15min":1.508},"last":0.435}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":1196996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33600000000000002},"min":{"1min":0.24299999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.49199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60399999999999998,"5min":0.626,"15min":0.626},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.438},{"interface":"front","average":{"1min":0.377,"5min":0.41899999999999998,"15min":0.434},"min":{"1min":0.28299999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.52000000000000002,"5min":0.626,"15min":0.626},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40600000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83599999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.747},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298536,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073304,"statfs":{"total":96636764160,"available":96331063296,"internally_reserved":0,"allocated":1277952,"data_stored":604980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60999999999999999,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.434,"15min":0.432},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47199999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.376,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":1.056,"15min":1.056},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.438,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56999999999999995,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.55400000000000005,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.65700000000000003,"15min":0.67900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65700000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78400000000000003,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66500000000000004,"15min":0.68700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.745,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":2.335,"15min":2.335},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69499999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72399999999999998,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.496},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.67800000000000005,"15min":0.69799999999999995},"min":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.79600000000000004,"5min":1.161,"15min":1.161},"last":0.56200000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":606586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.35699999999999998,"15min":0.373},"min":{"1min":0.218,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.379},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36799999999999999,"15min":0.38},"min":{"1min":0.24099999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.42899999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.497,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38700000000000001,"15min":0.40100000000000002},"min":{"1min":0.28799999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52800000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64500000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83499999999999996,"5min":0.997,"15min":0.997},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83199999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.497}]},{"osd":5,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.755,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.872,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":1.115,"15min":1.115},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80500000000000005,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84299999999999997,"5min":1.276,"15min":1.276},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79500000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.745}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298536,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073304,"statfs":{"total":96636764160,"available":96331063296,"internally_reserved":0,"allocated":1277952,"data_stored":604980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73599999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.996,"15min":0.996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.624},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.69899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.71399999999999997,"5min":1.014,"15min":1.014},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.626},"min":{"1min":0.38200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.51700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298544,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073296,"statfs":{"total":96636764160,"available":96331055104,"internally_reserved":0,"allocated":1286144,"data_stored":605556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.64300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80000000000000004,"5min":1.369,"15min":1.369},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77200000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70599999999999996,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81000000000000005,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.502}]},{"osd":3,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":1.355,"15min":1.355},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76300000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.53000000000000003},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":1.512,"15min":1.512},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78900000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:43.773 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:16:43.774 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:16:43.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.931+0000 7f4d7632e700 1 Processor -- start 2023-10-06T11:16:43.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.931+0000 7f4d7632e700 1 -- start start 2023-10-06T11:16:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d7632e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d700cf090 0x7f4d700c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d7632e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700cbb80 con 0x7f4d70159840 2023-10-06T11:16:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d7632e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700c6f00 con 0x7f4d70159470 2023-10-06T11:16:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d7632e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700cb530 con 0x7f4d700cf090 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d70159840 0x7f4d700c6170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48234/0 (socket says 172.21.15.55:48234) 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6f7fe700 1 -- 172.21.15.55:0/3956117758 learned_addr learned my addr 172.21.15.55:0/3956117758 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d748cb700 1 --2- 172.21.15.55:0/3956117758 >> v2:172.21.15.142:3300/0 conn(0x7f4d700cf090 0x7f4d700c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894684092 0 0) 0x7f4d700cbb80 con 0x7f4d70159840 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c003570 con 0x7f4d70159840 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3122619762 0 0) 0x7f4d5c003570 con 0x7f4d70159840 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 >> v2:172.21.15.142:3300/0 conn(0x7f4d700cf090 msgr2=0x7f4d700c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 --2- 172.21.15.55:0/3956117758 >> v2:172.21.15.142:3300/0 conn(0x7f4d700cf090 0x7f4d700c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 >> v1:172.21.15.142:6789/0 conn(0x7f4d70159470 legacy=0x7f4d700ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700cb810 con 0x7f4d70159840 2023-10-06T11:16:43.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.932+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f4d58001470 con 0x7f4d70159840 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 >> v1:172.21.15.55:6789/0 conn(0x7f4d70159840 legacy=0x7f4d700c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d5c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d5c004810 0x7f4d5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5c005210 0x7f4d5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700cb530 con 0x7f4d5c003ab0 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c00c130 con 0x7f4d5c004810 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c00c2f0 con 0x7f4d5c005210 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d5c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6f7fe700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d5c004810 0x7f4d5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d748cb700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5c005210 0x7f4d5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 -- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5c005210 msgr2=0x7f4d5c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5c005210 0x7f4d5c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 -- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d5c004810 msgr2=0x7f4d5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d5c004810 0x7f4d5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 -- 172.21.15.55:0/3956117758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c003570 con 0x7f4d5c003ab0 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d748cb700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d5c005210 0x7f4d5c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d748cb700 1 -- 172.21.15.55:0/3956117758 reap_dead start 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d5c003ec0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f4d600018d0 tx=0x7f4d60007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8238ddfb3e09ecac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60001290 con 0x7f4d5c003ab0 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60012420 con 0x7f4d5c003ab0 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.933+0000 7f4d6effd700 1 -- 172.21.15.55:0/3956117758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600127e0 con 0x7f4d5c003ab0 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 -- 172.21.15.55:0/3956117758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 msgr2=0x7f4d5c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d5c003ec0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f4d600018d0 tx=0x7f4d60007d80 comp rx=0 tx=0).stop 2023-10-06T11:16:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 -- 172.21.15.55:0/3956117758 shutdown_connections 2023-10-06T11:16:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 --2- 172.21.15.55:0/3956117758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d5c003ec0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 -- 172.21.15.55:0/3956117758 >> 172.21.15.55:0/3956117758 conn(0x7f4d700996e0 msgr2=0x7f4d7006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 -- 172.21.15.55:0/3956117758 shutdown_connections 2023-10-06T11:16:43.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.934+0000 7f4d7632e700 1 -- 172.21.15.55:0/3956117758 wait complete. 2023-10-06T11:16:43.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.935+0000 7f4d7632e700 1 Processor -- start 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.935+0000 7f4d7632e700 1 -- start start 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d7632e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d70153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d7632e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015bf70 0x7f4d70155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d7632e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d701561d0 0x7f4d700c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d7632e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7015ac80 con 0x7f4d5c003ab0 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d7632e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7015bae0 con 0x7f4d7015bf70 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d7632e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7009e0b0 con 0x7f4d701561d0 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d70153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d70153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38330/0 (socket says 172.21.15.55:38330) 2023-10-06T11:16:43.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 -- 172.21.15.55:0/532718487 learned_addr learned my addr 172.21.15.55:0/532718487 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:43.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6f7fe700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015bf70 0x7f4d70155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d748cb700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d701561d0 0x7f4d700c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 -- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d701561d0 msgr2=0x7f4d700c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d701561d0 0x7f4d700c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 -- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015bf70 msgr2=0x7f4d70155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015bf70 0x7f4d70155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.936+0000 7f4d6ffff700 1 -- 172.21.15.55:0/532718487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7015aed0 con 0x7f4d5c003ab0 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.937+0000 7f4d6ffff700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d70153070 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000e10 tx=0x7f4d60015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.937+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6001e610 con 0x7f4d5c003ab0 2023-10-06T11:16:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.937+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6001e770 con 0x7f4d5c003ab0 2023-10-06T11:16:43.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.937+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7015b1b0 con 0x7f4d5c003ab0 2023-10-06T11:16:43.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.937+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6001eb30 con 0x7f4d5c003ab0 2023-10-06T11:16:43.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.937+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7015b770 con 0x7f4d5c003ab0 2023-10-06T11:16:43.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.938+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7015bdc0 con 0x7f4d5c003ab0 2023-10-06T11:16:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.938+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d60019030 con 0x7f4d5c003ab0 2023-10-06T11:16:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.939+0000 7f4d67fff700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d50066f60 0x7f4d50069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.939+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4d60085a40 con 0x7f4d5c003ab0 2023-10-06T11:16:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.939+0000 7f4d6f7fe700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d50066f60 0x7f4d50069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.939+0000 7f4d6f7fe700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d50066f60 0x7f4d50069410 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4d700ca510 tx=0x7f4d58001d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:43.943+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d60087e60 con 0x7f4d5c003ab0 2023-10-06T11:16:44.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.216+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4d70064a90 con 0x7f4d5c003ab0 2023-10-06T11:16:44.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.220+0000 7f4d67fff700 1 -- 172.21.15.55:0/532718487 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4d600170e0 con 0x7f4d5c003ab0 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.221+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d50066f60 msgr2=0x7f4d50069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.221+0000 7f4d7632e700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d50066f60 0x7f4d50069410 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4d700ca510 tx=0x7f4d58001d80 comp rx=0 tx=0).stop 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.221+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 msgr2=0x7f4d70153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.221+0000 7f4d7632e700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d70153070 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000e10 tx=0x7f4d60015000 comp rx=0 tx=0).stop 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 shutdown_connections 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4d50066f60 0x7f4d50069410 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d5c003ab0 0x7f4d70153070 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d701561d0 0x7f4d700c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 --2- 172.21.15.55:0/532718487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015bf70 0x7f4d70155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 >> 172.21.15.55:0/532718487 conn(0x7f4d700996e0 msgr2=0x7f4d70154130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:44.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 shutdown_connections 2023-10-06T11:16:44.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.222+0000 7f4d7632e700 1 -- 172.21.15.55:0/532718487 wait complete. 2023-10-06T11:16:44.225 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-10-06T11:16:44.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:44.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.353+0000 7f5902474700 1 Processor -- start 2023-10-06T11:16:44.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.353+0000 7f5902474700 1 -- start start 2023-10-06T11:16:44.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5902474700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58fc0cbc30 0x7f58fc0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5902474700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0cb7a0 con 0x7f58fc0b2100 2023-10-06T11:16:44.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5902474700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0b0860 con 0x7f58fc159440 2023-10-06T11:16:44.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5902474700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0cb150 con 0x7f58fc0cbc30 2023-10-06T11:16:44.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5901c73700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58fc0b2100 0x7f58fc0b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53802/0 (socket says 172.21.15.55:53802) 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5901c73700 1 -- 172.21.15.55:0/3154634253 learned_addr learned my addr 172.21.15.55:0/3154634253 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f5900c71700 1 --2- 172.21.15.55:0/3154634253 >> v2:172.21.15.142:3300/0 conn(0x7f58fc0cbc30 0x7f58fc0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.354+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458198634 0 0) 0x7f58fc0cb7a0 con 0x7f58fc0b2100 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e4003570 con 0x7f58fc0b2100 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2809010530 0 0) 0x7f58e4003570 con 0x7f58fc0b2100 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 >> v2:172.21.15.142:3300/0 conn(0x7f58fc0cbc30 msgr2=0x7f58fc0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 --2- 172.21.15.55:0/3154634253 >> v2:172.21.15.142:3300/0 conn(0x7f58fc0cbc30 0x7f58fc0cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 >> v1:172.21.15.142:6789/0 conn(0x7f58fc159440 legacy=0x7f58fc0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0cb430 con 0x7f58fc0b2100 2023-10-06T11:16:44.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f58ec0017f0 con 0x7f58fc0b2100 2023-10-06T11:16:44.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 >> v1:172.21.15.55:6789/0 conn(0x7f58fc0b2100 legacy=0x7f58fc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e4003a60 0x7f58e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e4004810 0x7f58e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e40051c0 0x7f58e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0cb150 con 0x7f58e40051c0 2023-10-06T11:16:44.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e400c0d0 con 0x7f58e4003a60 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e400c290 con 0x7f58e4004810 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e40051c0 0x7f58e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901472700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e4003a60 0x7f58e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5900c71700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e4004810 0x7f58e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 -- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e4004810 msgr2=0x7f58e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e4004810 0x7f58e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 -- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e4003a60 msgr2=0x7f58e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e4003a60 0x7f58e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 -- 172.21.15.55:0/3154634253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4003570 con 0x7f58e40051c0 2023-10-06T11:16:44.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.355+0000 7f5901c73700 1 -- 172.21.15.55:0/3154634253 reap_dead start 2023-10-06T11:16:44.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5901c73700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e40051c0 0x7f58e400ba60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00a930 tx=0x7f58ec0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcddec03a7f01aac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:44.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0070d0 con 0x7f58e40051c0 2023-10-06T11:16:44.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec007230 con 0x7f58e40051c0 2023-10-06T11:16:44.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f58fbfff700 1 -- 172.21.15.55:0/3154634253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0075d0 con 0x7f58e40051c0 2023-10-06T11:16:44.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 -- 172.21.15.55:0/3154634253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e40051c0 msgr2=0x7f58e400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e40051c0 0x7f58e400ba60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00a930 tx=0x7f58ec0021d0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 -- 172.21.15.55:0/3154634253 shutdown_connections 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 --2- 172.21.15.55:0/3154634253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e40051c0 0x7f58e400ba60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 -- 172.21.15.55:0/3154634253 >> 172.21.15.55:0/3154634253 conn(0x7f58fc06ece0 msgr2=0x7f58fc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 -- 172.21.15.55:0/3154634253 shutdown_connections 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.356+0000 7f5902474700 1 -- 172.21.15.55:0/3154634253 wait complete. 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.357+0000 7f5902474700 1 Processor -- start 2023-10-06T11:16:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.357+0000 7f5902474700 1 -- start start 2023-10-06T11:16:44.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5902474700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e40051c0 0x7f58fc15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5902474700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 0x7f58fc153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5902474700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b49a0 0x7f58fc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5902474700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0b5350 con 0x7f58fc0c5070 2023-10-06T11:16:44.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5902474700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0c6380 con 0x7f58fc0b49a0 2023-10-06T11:16:44.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5902474700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0c54e0 con 0x7f58e40051c0 2023-10-06T11:16:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5900c71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 0x7f58fc153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5900c71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 0x7f58fc153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56322/0 (socket says 172.21.15.55:56322) 2023-10-06T11:16:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.358+0000 7f5900c71700 1 -- 172.21.15.55:0/1263414636 learned_addr learned my addr 172.21.15.55:0/1263414636 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5901472700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e40051c0 0x7f58fc15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5900c71700 1 -- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e40051c0 msgr2=0x7f58fc15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5901c73700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b49a0 0x7f58fc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5900c71700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e40051c0 0x7f58fc15af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5900c71700 1 -- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b49a0 msgr2=0x7f58fc0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5900c71700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b49a0 0x7f58fc0b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5900c71700 1 -- 172.21.15.55:0/1263414636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0c6810 con 0x7f58fc0c5070 2023-10-06T11:16:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5901c73700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b49a0 0x7f58fc0b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5901472700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e40051c0 0x7f58fc15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5900c71700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 0x7f58fc153c60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f58f0006ac0 tx=0x7f58f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000fa10 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000fb70 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc0c5770 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0014440 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.359+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc0c5d30 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.360+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc0c64f0 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.361+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58f00147f0 con 0x7f58fc0c5070 2023-10-06T11:16:44.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.361+0000 7f58f97fa700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58e8066f30 0x7f58e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:44.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.361+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f58f0018030 con 0x7f58fc0c5070 2023-10-06T11:16:44.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.361+0000 7f5901472700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58e8066f30 0x7f58e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:44.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.362+0000 7f5901472700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58e8066f30 0x7f58e80693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f58f4000c00 tx=0x7f58f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:44.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.365+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58f00521f0 con 0x7f58fc0c5070 2023-10-06T11:16:44.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.607+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58fc05f230 con 0x7f58fc0c5070 2023-10-06T11:16:44.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.607+0000 7f58f97fa700 1 -- 172.21.15.55:0/1263414636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f58f0055810 con 0x7f58fc0c5070 2023-10-06T11:16:44.609 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:44.609 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3034002798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3034002798},{"type":"v1","addr":"172.21.15.55:6834","nonce":3034002798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6403,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/526298502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":526298502},{"type":"v1","addr":"172.21.15.55:6835","nonce":526298502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6415,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2651321220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2651321220},{"type":"v1","addr":"172.21.15.142:6837","nonce":2651321220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:37.257164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6418":{"gid":6418,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6836/2387992820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2387992820},{"type":"v1","addr":"172.21.15.142:6836","nonce":2387992820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58e8066f30 msgr2=0x7f58e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58e8066f30 0x7f58e80693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f58f4000c00 tx=0x7f58f4009040 comp rx=0 tx=0).stop 2023-10-06T11:16:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 msgr2=0x7f58fc153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 0x7f58fc153c60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f58f0006ac0 tx=0x7f58f00091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 shutdown_connections 2023-10-06T11:16:44.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58e8066f30 0x7f58e80693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc0b49a0 0x7f58fc0b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e40051c0 0x7f58fc15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 --2- 172.21.15.55:0/1263414636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58fc0c5070 0x7f58fc153c60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 >> 172.21.15.55:0/1263414636 conn(0x7f58fc06ece0 msgr2=0x7f58fc158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 shutdown_connections 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:44.609+0000 7f5902474700 1 -- 172.21.15.55:0/1263414636 wait complete. 2023-10-06T11:16:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 59 2023-10-06T11:16:45.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:33.613713+0000', 'modified': '2023-10-06T11:16:37.257164+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6418}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6418': {'gid': 6418, 'name': 'd', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6836/2387992820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2387992820}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2387992820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:45.025 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:16:45.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T11:16:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.146+0000 7f6a9b59e700 1 Processor -- start 2023-10-06T11:16:45.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.146+0000 7f6a9b59e700 1 -- start start 2023-10-06T11:16:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a9b59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a9c159440 0x7f6a9c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a9b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 0x7f6a9c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a9b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0cb7a0 con 0x7f6a9c0cc170 2023-10-06T11:16:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a9b59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0b0860 con 0x7f6a9c159440 2023-10-06T11:16:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a9b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cb150 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a99d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 0x7f6a9c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a9a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a9c159440 0x7f6a9c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a99d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 0x7f6a9c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:59326/0 (socket says 172.21.15.55:59326) 2023-10-06T11:16:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a99d9b700 1 -- 172.21.15.55:0/2789439325 learned_addr learned my addr 172.21.15.55:0/2789439325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a99d9b700 1 -- 172.21.15.55:0/2789439325 >> v2:172.21.15.142:3300/0 conn(0x7f6a9c159440 msgr2=0x7f6a9c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/2789439325 >> v2:172.21.15.142:3300/0 conn(0x7f6a9c159440 0x7f6a9c0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.147+0000 7f6a99d9b700 1 -- 172.21.15.55:0/2789439325 >> v1:172.21.15.142:6789/0 conn(0x7f6a9c0cc170 legacy=0x7f6a9c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a99d9b700 1 -- 172.21.15.55:0/2789439325 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0cb430 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/2789439325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 0x7f6a9c0cbc30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a900099b0 tx=0x7f6a90009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=622eda955b671b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9959a700 1 -- 172.21.15.55:0/2789439325 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90009ea0 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9959a700 1 -- 172.21.15.55:0/2789439325 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9000b860 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9959a700 1 -- 172.21.15.55:0/2789439325 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000bc00 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2789439325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 msgr2=0x7f6a9c0cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2789439325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 0x7f6a9c0cbc30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a900099b0 tx=0x7f6a90009250 comp rx=0 tx=0).stop 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2789439325 shutdown_connections 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.148+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2789439325 >> v2:172.21.15.142:3300/0 conn(0x7f6a9c159440 0x7f6a9c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.149+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2789439325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0b35d0 0x7f6a9c0cbc30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.149+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2789439325 >> 172.21.15.55:0/2789439325 conn(0x7f6a9c06ece0 msgr2=0x7f6a9c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.149+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2789439325 shutdown_connections 2023-10-06T11:16:45.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.149+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2789439325 wait complete. 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 Processor -- start 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 -- start start 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 0x7f6a9c1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0cc170 0x7f6a9c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9c159440 0x7f6a9c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c154f00 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c77e0 con 0x7f6a9c159440 2023-10-06T11:16:45.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c15f590 con 0x7f6a9c0cc170 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 0x7f6a9c1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 0x7f6a9c1549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56324/0 (socket says 172.21.15.55:56324) 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.150+0000 7f6a9a59c700 1 -- 172.21.15.55:0/2400043825 learned_addr learned my addr 172.21.15.55:0/2400043825 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0cc170 0x7f6a9c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9c159440 0x7f6a9c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9a59c700 1 -- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0cc170 msgr2=0x7f6a9c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0cc170 0x7f6a9c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9a59c700 1 -- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9c159440 msgr2=0x7f6a9c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9c159440 0x7f6a9c157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9a59c700 1 -- 172.21.15.55:0/2400043825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900094f0 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0cc170 0x7f6a9c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:45.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 0x7f6a9c1549c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00e930 tx=0x7f6a8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a8a7fc700 1 -- 172.21.15.55:0/2400043825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c009510 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a8a7fc700 1 -- 172.21.15.55:0/2400043825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00c850 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c15f870 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a8a7fc700 1 -- 172.21.15.55:0/2400043825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00cc10 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.151+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c159a90 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.153+0000 7f6a8a7fc700 1 -- 172.21.15.55:0/2400043825 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a8c013470 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.153+0000 7f6a8a7fc700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a7c066f30 0x7f6a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.153+0000 7f6a8a7fc700 1 -- 172.21.15.55:0/2400043825 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a8c0848f0 con 0x7f6a9c0b35d0 2023-10-06T11:16:45.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.153+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a7c066f30 0x7f6a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.154+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a7c066f30 0x7f6a7c0693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6a900099b0 tx=0x7f6a90017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.155+0000 7f6aa9cf9b80 1 Processor -- start 2023-10-06T11:16:45.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.155+0000 7f6aa9cf9b80 1 -- start start 2023-10-06T11:16:45.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a933950 0x55da1a933d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a95c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a92f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a8b3c80 con 0x55da1a95ce60 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a88aa70 con 0x55da1a97dbc0 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1a888270 con 0x55da1a933950 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a92f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a92f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56332/0 (socket says 172.21.15.55:56332) 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 -- 172.21.15.55:0/1639466850 learned_addr learned my addr 172.21.15.55:0/1639466850 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a933950 0x55da1a933d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a95c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 -- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a933950 msgr2=0x55da1a933d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a933950 0x55da1a933d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 -- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 msgr2=0x55da1a95c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a95c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 -- 172.21.15.55:0/1639466850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da1a71e270 con 0x55da1a95ce60 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a95c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.156+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a92f990 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6a94001c90 tx=0x7f6a94009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdd79da0360774f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6a7b7fe700 1 -- 172.21.15.55:0/1639466850 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400b070 con 0x55da1a95ce60 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6a7b7fe700 1 -- 172.21.15.55:0/1639466850 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400d890 con 0x55da1a95ce60 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6a7b7fe700 1 -- 172.21.15.55:0/1639466850 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400dc30 con 0x55da1a95ce60 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1639466850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 msgr2=0x55da1a92f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a92f990 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6a94001c90 tx=0x7f6a94009040 comp rx=0 tx=0).stop 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1639466850 shutdown_connections 2023-10-06T11:16:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a92f990 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a933950 0x55da1a933d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1639466850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a95c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1639466850 >> 172.21.15.55:0/1639466850 conn(0x55da1a935270 msgr2=0x55da1a935640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1639466850 shutdown_connections 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.157+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1639466850 wait complete. 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.158+0000 7f6aa9cf9b80 1 -- start start 2023-10-06T11:16:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.158+0000 7f6aa9cf9b80 1 Processor -- start 2023-10-06T11:16:45.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a933950 0x55da1a98a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a975880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a971ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a884060 con 0x55da1a95ce60 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a82f890 con 0x55da1a933950 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1a84aea0 con 0x55da1a97dbc0 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6aa9cf9b80 10 client.0 _ll_register_callbacks cb 0x55da1a720f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a975880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a975880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56336/0 (socket says 172.21.15.55:56336) 2023-10-06T11:16:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 -- 172.21.15.55:0/1335473517 learned_addr learned my addr 172.21.15.55:0/1335473517 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a971ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a933950 0x55da1a98a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 -- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 msgr2=0x55da1a971ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a971ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 -- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a933950 msgr2=0x55da1a98a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a933950 0x55da1a98a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.159+0000 7f6a99d9b700 1 -- 172.21.15.55:0/1335473517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c0cb7a0 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a975880 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6a900090b0 tx=0x7f6a9001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cc4b2bcf87b03a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1335473517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9001ce50 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1335473517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a9001a640 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da1a928690 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1335473517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a9001aa10 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 10 client.7074 fetch_fsmap learned FSMap version 59 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x55da1a6c0fe0 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1335473517 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da1a928690 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1335473517 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 59) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6a9001ab70 con 0x55da1a95ce60 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 10 client.7074 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T11:16:45.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 10 client.7074 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 20 client.7074 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a98d760 0x55da1a98db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 4 client.7074 mds_command: new command op to 6418 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.160+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 --> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da1a9055c0 con 0x55da1a98d760 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.161+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a98d760 0x55da1a98db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.161+0000 7f6a78ff9700 10 client.7074 ms_handle_connect on v2:172.21.15.142:6834/2387992820 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.161+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a98d760 0x55da1a98db30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e47b146a870a22c9 server_cookie=1dc8386b10bfb1c7 in_seq=0 out_seq=0 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1335473517 <== mds.0 v2:172.21.15.142:6834/2387992820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55da1a9055c0 con 0x55da1a98d760 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6a78ff9700 10 client.7074 handle_command_reply: tid=0 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 client.7074 shutdown 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 msgr2=0x55da1a975880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a975880 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6a900090b0 tx=0x7f6a9001e040 comp rx=0 tx=0).stop 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 shutdown_connections 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a98d760 0x55da1a98db30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a971ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a933950 0x55da1a98a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1335473517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a95ce60 0x55da1a975880 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6a78ff9700 0 client.7074 ms_handle_reset on v2:172.21.15.142:6834/2387992820 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 >> 172.21.15.55:0/1335473517 conn(0x55da1a935270 msgr2=0x55da1a934250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 shutdown_connections 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1335473517 wait complete. 2023-10-06T11:16:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.162+0000 7f6aa9cf9b80 20 client.7074 trim_cache size 0 max 16384 2023-10-06T11:16:45.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.179+0000 7f6aa9cf9b80 1 Processor -- start 2023-10-06T11:16:45.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.179+0000 7f6aa9cf9b80 1 -- start start 2023-10-06T11:16:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a975830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a706e30 con 0x55da1a933950 2023-10-06T11:16:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a9308d0 con 0x55da1a95ce60 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1a92c550 con 0x55da1a97dbc0 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a975830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a975830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56352/0 (socket says 172.21.15.55:56352) 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1110774483 learned_addr learned my addr 172.21.15.55:0/1110774483 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 msgr2=0x55da1a92a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a95ce60 msgr2=0x55da1a92a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1110774483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da1a9790a0 con 0x55da1a933950 2023-10-06T11:16:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a975830 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c019000 tx=0x7f6a8c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc36803ecb641d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a7bfff700 1 -- 172.21.15.55:0/1110774483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c082c80 con 0x55da1a933950 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a7bfff700 1 -- 172.21.15.55:0/1110774483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c0536c0 con 0x55da1a933950 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.180+0000 7f6a7bfff700 1 -- 172.21.15.55:0/1110774483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0557e0 con 0x55da1a933950 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1110774483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 msgr2=0x55da1a975830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a975830 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c019000 tx=0x7f6a8c015040 comp rx=0 tx=0).stop 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1110774483 shutdown_connections 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a975830 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1110774483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1110774483 >> 172.21.15.55:0/1110774483 conn(0x55da1a935270 msgr2=0x55da1a931710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1110774483 shutdown_connections 2023-10-06T11:16:45.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.181+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1110774483 wait complete. 2023-10-06T11:16:45.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 -- start start 2023-10-06T11:16:45.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 Processor -- start 2023-10-06T11:16:45.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a9dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a9e06c0 con 0x55da1a933950 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1a930410 con 0x55da1a97dbc0 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.182+0000 7f6aa9cf9b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da1a959ac0 con 0x55da1a95ce60 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6aa9cf9b80 10 client.0 _ll_register_callbacks cb 0x55da1a720f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a9dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a9dcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56358/0 (socket says 172.21.15.55:56358) 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1072103509 learned_addr learned my addr 172.21.15.55:0/1072103509 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9ad9d700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a95ce60 msgr2=0x55da1a92a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 msgr2=0x55da1a92a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 -- 172.21.15.55:0/1072103509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c159a90 con 0x55da1a933950 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a9a59c700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a9dcd40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c055e30 tx=0x7f6a8c058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329542a680412ed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1072103509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c053920 con 0x55da1a933950 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1072103509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a8c054a70 con 0x55da1a933950 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a9400d890 con 0x55da1a933950 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1072103509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a8c05c090 con 0x55da1a933950 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6aa9cf9b80 10 client.7080 fetch_fsmap learned FSMap version 59 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.183+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x55da1a94d790 con 0x55da1a933950 2023-10-06T11:16:45.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1072103509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400d890 con 0x55da1a933950 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1072103509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 59) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6a8c07e070 con 0x55da1a933950 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 10 client.7080 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 10 client.7080 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 20 client.7080 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a9df730 0x55da1a9dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 4 client.7080 mds_command: new command op to 6418 tid=0[{"prefix": "status"}] 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 --> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55da1a826e00 con 0x55da1a9df730 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a9df730 0x55da1a9dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a78ff9700 10 client.7080 ms_handle_connect on v2:172.21.15.142:6834/2387992820 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a99d9b700 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a9df730 0x55da1a9dfb00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=382b8aad848d9b91 server_cookie=70554a521db12d2c in_seq=0 out_seq=0 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a78ff9700 1 -- 172.21.15.55:0/1072103509 <== mds.0 v2:172.21.15.142:6834/2387992820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55da1a826e00 con 0x55da1a9df730 2023-10-06T11:16:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6a78ff9700 10 client.7080 handle_command_reply: tid=0 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.184+0000 7f6aa9cf9b80 1 client.7080 shutdown 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 msgr2=0x55da1a9dcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a9dcd40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c055e30 tx=0x7f6a8c058000 comp rx=0 tx=0).stop 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 shutdown_connections 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:6834/2387992820,v1:172.21.15.142:6836/2387992820] conn(0x55da1a9df730 0x55da1a9dfb00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da1a933950 0x55da1a9dcd40 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da1a97dbc0 0x55da1a92a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a78ff9700 0 client.7080 ms_handle_reset on v2:172.21.15.142:6834/2387992820 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 --2- 172.21.15.55:0/1072103509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da1a95ce60 0x55da1a92a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 >> 172.21.15.55:0/1072103509 conn(0x55da1a935270 msgr2=0x55da1a931710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 shutdown_connections 2023-10-06T11:16:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 1 -- 172.21.15.55:0/1072103509 wait complete. 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6aa9cf9b80 20 client.7080 trim_cache size 0 max 16384 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6418, 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:16:45.195 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.960799468999999, 2023-10-06T11:16:45.196 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 59, 2023-10-06T11:16:45.196 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 103, 2023-10-06T11:16:45.196 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 103, 2023-10-06T11:16:45.196 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 17.048206883999999 2023-10-06T11:16:45.196 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a7c066f30 msgr2=0x7f6a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a7c066f30 0x7f6a7c0693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6a900099b0 tx=0x7f6a90017000 comp rx=0 tx=0).stop 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 msgr2=0x7f6a9c1549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 0x7f6a9c1549c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00e930 tx=0x7f6a8c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 shutdown_connections 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a7c066f30 0x7f6a7c0693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a9c0b35d0 0x7f6a9c1549c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9c159440 0x7f6a9c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 --2- 172.21.15.55:0/2400043825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9c0cc170 0x7f6a9c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 >> 172.21.15.55:0/2400043825 conn(0x7f6a9c06ece0 msgr2=0x7f6a9c0cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 shutdown_connections 2023-10-06T11:16:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.185+0000 7f6a9b59e700 1 -- 172.21.15.55:0/2400043825 wait complete. 2023-10-06T11:16:45.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.317+0000 7fdc6f622700 1 Processor -- start 2023-10-06T11:16:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.318+0000 7fdc6f622700 1 -- start start 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.318+0000 7fdc6f622700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc680ad210 0x7fdc680cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.318+0000 7fdc6f622700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680cecf0 con 0x7fdc680ad5e0 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.318+0000 7fdc6f622700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680cefd0 con 0x7fdc6815db10 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.318+0000 7fdc6f622700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc680cca90 con 0x7fdc680ad210 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6d3be700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc680ad210 0x7fdc680cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6cbbd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc680ad5e0 0x7fdc6815d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53814/0 (socket says 172.21.15.55:53814) 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6cbbd700 1 -- 172.21.15.55:0/4150287862 learned_addr learned my addr 172.21.15.55:0/4150287862 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6d3be700 1 -- 172.21.15.55:0/4150287862 >> v1:172.21.15.142:6789/0 conn(0x7fdc6815db10 legacy=0x7fdc680ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6d3be700 1 -- 172.21.15.55:0/4150287862 >> v1:172.21.15.55:6789/0 conn(0x7fdc680ad5e0 legacy=0x7fdc6815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc67fff700 1 -- 172.21.15.55:0/4150287862 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792588806 0 0) 0x7fdc680cecf0 con 0x7fdc680ad5e0 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6d3be700 1 -- 172.21.15.55:0/4150287862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680ccd70 con 0x7fdc680ad210 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc6d3be700 1 --2- 172.21.15.55:0/4150287862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680ad210 0x7fdc680cd290 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009eb0 tx=0x7fdc58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc632de9b543a4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc67fff700 1 -- 172.21.15.55:0/4150287862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800e070 con 0x7fdc680ad210 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc67fff700 1 -- 172.21.15.55:0/4150287862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800bc30 con 0x7fdc680ad210 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.319+0000 7fdc67fff700 1 -- 172.21.15.55:0/4150287862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58012430 con 0x7fdc680ad210 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 -- 172.21.15.55:0/4150287862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680ad210 msgr2=0x7fdc680cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 --2- 172.21.15.55:0/4150287862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680ad210 0x7fdc680cd290 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009eb0 tx=0x7fdc58009780 comp rx=0 tx=0).stop 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 -- 172.21.15.55:0/4150287862 shutdown_connections 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 --2- 172.21.15.55:0/4150287862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc680ad210 0x7fdc680cd290 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 -- 172.21.15.55:0/4150287862 >> 172.21.15.55:0/4150287862 conn(0x7fdc68067d90 msgr2=0x7fdc680ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 -- 172.21.15.55:0/4150287862 shutdown_connections 2023-10-06T11:16:45.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.320+0000 7fdc6f622700 1 -- 172.21.15.55:0/4150287862 wait complete. 2023-10-06T11:16:45.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.321+0000 7fdc6f622700 1 Processor -- start 2023-10-06T11:16:45.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.321+0000 7fdc6f622700 1 -- start start 2023-10-06T11:16:45.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6f622700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc680ad210 0x7fdc680c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6f622700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc680ad5e0 0x7fdc6806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6f622700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 0x7fdc680c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6f622700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680c1ec0 con 0x7fdc6815db10 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6f622700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680c57c0 con 0x7fdc680ad210 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6f622700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6806bf40 con 0x7fdc680ad5e0 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 0x7fdc680c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 0x7fdc680c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56364/0 (socket says 172.21.15.55:56364) 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 -- 172.21.15.55:0/217715627 learned_addr learned my addr 172.21.15.55:0/217715627 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6d3be700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc680ad210 0x7fdc680c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6cbbd700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc680ad5e0 0x7fdc6806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 -- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc680ad5e0 msgr2=0x7fdc6806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc680ad5e0 0x7fdc6806ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 -- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc680ad210 msgr2=0x7fdc680c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc680ad210 0x7fdc680c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.322+0000 7fdc6dbbf700 1 -- 172.21.15.55:0/217715627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58009a20 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.323+0000 7fdc6dbbf700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 0x7fdc680c9070 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000c440 tx=0x7fdc60007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.323+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60012420 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.323+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600125a0 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.323+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc680b3670 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.323+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60012960 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.323+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc680b3c30 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.324+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc680c2030 con 0x7fdc6815db10 2023-10-06T11:16:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.324+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc6001b3b0 con 0x7fdc6815db10 2023-10-06T11:16:45.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.324+0000 7fdc657fa700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc54066f30 0x7fdc540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:45.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.325+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdc60083d30 con 0x7fdc6815db10 2023-10-06T11:16:45.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.325+0000 7fdc6d3be700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc54066f30 0x7fdc540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:45.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.325+0000 7fdc6d3be700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc54066f30 0x7fdc540693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009eb0 tx=0x7fdc58017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.329+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc60050d00 con 0x7fdc6815db10 2023-10-06T11:16:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.571+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc68064a90 con 0x7fdc6815db10 2023-10-06T11:16:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.571+0000 7fdc657fa700 1 -- 172.21.15.55:0/217715627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc60017070 con 0x7fdc6815db10 2023-10-06T11:16:45.574 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc54066f30 msgr2=0x7fdc540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc54066f30 0x7fdc540693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009eb0 tx=0x7fdc58017000 comp rx=0 tx=0).stop 2023-10-06T11:16:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 msgr2=0x7fdc680c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 0x7fdc680c9070 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000c440 tx=0x7fdc60007ec0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 shutdown_connections 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fdc54066f30 0x7fdc540693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc6815db10 0x7fdc680c9070 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc680ad210 0x7fdc680c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 --2- 172.21.15.55:0/217715627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc680ad5e0 0x7fdc6806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 >> 172.21.15.55:0/217715627 conn(0x7fdc68067d90 msgr2=0x7fdc6815b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 shutdown_connections 2023-10-06T11:16:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:45.573+0000 7fdc6f622700 1 -- 172.21.15.55:0/217715627 wait complete. 2023-10-06T11:16:45.588 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:16:45.588 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:45.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:16:45.588 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:16:45.589 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:45.589 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:16:45.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:16:45.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:45.589 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:45.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:45.589 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:16:45.605 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:45.605 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:45.605 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:45.605 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.605 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:45.605 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42287sec preferred_lft 42287sec 2023-10-06T11:16:45.606 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:16:45.607 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:45.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:45.609 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:45.669 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:16:45.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:45.671 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:16:45.727 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:16:45.727 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:45.727 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:16:45.727 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:16:45.727 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:45.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:45.728 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:16:45.728 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:16:45.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:16:45.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:16:45.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:16:45.728 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:16:45.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:45.830 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:16:45.844 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:16:45.845 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:16:45.845 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:45.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:45.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:16:45.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:45.910 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:45.965 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:45.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:45.966 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:46.020 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:16:46.020 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:46.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:46.101 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:46.759 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:46.761 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:46.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:46.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:46.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:46.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:46.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:46.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:46.763 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:46.763 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:46.763 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:16:46.763 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:16:46.763 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:16:46.763 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:16:46.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:46.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:46.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:46.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.995+0000 7ffb7f71b700 1 Processor -- start 2023-10-06T11:16:46.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.995+0000 7ffb7f71b700 1 -- start start 2023-10-06T11:16:47.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7f71b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 0x7ffb780691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7f71b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb780696e0 0x7ffb78159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7f71b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb78068d10 con 0x7ffb7815a010 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7f71b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb78154020 con 0x7ffb780696e0 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7f71b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7815a450 con 0x7ffb780cb5f0 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7dcb8700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffb7815a010 0x7ffb780ca670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53826/0 (socket says 172.21.15.55:53826) 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.996+0000 7ffb7dcb8700 1 -- 172.21.15.55:0/2089927536 learned_addr learned my addr 172.21.15.55:0/2089927536 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7d4b7700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 0x7ffb780691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/2089927536 >> v2:172.21.15.142:3300/0 conn(0x7ffb780696e0 0x7ffb78159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067346495 0 0) 0x7ffb78068d10 con 0x7ffb7815a010 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb60003570 con 0x7ffb7815a010 2023-10-06T11:16:47.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733908737 0 0) 0x7ffb60003570 con 0x7ffb7815a010 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 msgr2=0x7ffb780691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 0x7ffb780691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 >> v2:172.21.15.142:3300/0 conn(0x7ffb780696e0 msgr2=0x7ffb78159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 --2- 172.21.15.55:0/2089927536 >> v2:172.21.15.142:3300/0 conn(0x7ffb780696e0 0x7ffb78159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7815a670 con 0x7ffb7815a010 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7ffb70001470 con 0x7ffb7815a010 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 >> v1:172.21.15.55:6789/0 conn(0x7ffb7815a010 legacy=0x7ffb780ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:47.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 0x7ffb60003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb60003fe0 0x7ffb60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb60004d50 0x7ffb600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78154020 con 0x7ffb60003fe0 2023-10-06T11:16:47.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7815a450 con 0x7ffb60004d50 2023-10-06T11:16:47.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6000ba90 con 0x7ffb780cb5f0 2023-10-06T11:16:47.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb60003fe0 0x7ffb60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7d4b7700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 0x7ffb60003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7dcb8700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb60004d50 0x7ffb600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 msgr2=0x7ffb60003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb780cb5f0 0x7ffb60003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb60004d50 msgr2=0x7ffb600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb60004d50 0x7ffb600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/2089927536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60003570 con 0x7ffb60003fe0 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.997+0000 7ffb7dcb8700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb60004d50 0x7ffb600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb60003fe0 0x7ffb60004810 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009c00 tx=0x7ffb6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ba7a531c83e8ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00e6b0 con 0x7ffb60003fe0 2023-10-06T11:16:47.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00e810 con 0x7ffb60003fe0 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb77fff700 1 -- 172.21.15.55:0/2089927536 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00ebd0 con 0x7ffb60003fe0 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7f71b700 1 -- 172.21.15.55:0/2089927536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb60003fe0 msgr2=0x7ffb60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/2089927536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb60003fe0 0x7ffb60004810 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009c00 tx=0x7ffb6c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7dcb8700 1 -- 172.21.15.55:0/2089927536 reap_dead start 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7f71b700 1 -- 172.21.15.55:0/2089927536 shutdown_connections 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7f71b700 1 -- 172.21.15.55:0/2089927536 >> 172.21.15.55:0/2089927536 conn(0x7ffb780707d0 msgr2=0x7ffb78070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7f71b700 1 -- 172.21.15.55:0/2089927536 shutdown_connections 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:46.998+0000 7ffb7f71b700 1 -- 172.21.15.55:0/2089927536 wait complete. 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 Processor -- start 2023-10-06T11:16:47.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 -- start start 2023-10-06T11:16:47.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb60003fe0 0x7ffb780b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 0x7ffb78156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb780c7e80 0x7ffb78154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78156530 con 0x7ffb780b3760 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780b32d0 con 0x7ffb780c7e80 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.000+0000 7ffb7f71b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781574f0 con 0x7ffb60003fe0 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 0x7ffb78156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 0x7ffb78156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56384/0 (socket says 172.21.15.55:56384) 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/3586125836 learned_addr learned my addr 172.21.15.55:0/3586125836 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7d4b7700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb60003fe0 0x7ffb780b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7dcb8700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb780c7e80 0x7ffb78154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb60003fe0 msgr2=0x7ffb780b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb60003fe0 0x7ffb780b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb780c7e80 msgr2=0x7ffb78154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb780c7e80 0x7ffb78154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 -- 172.21.15.55:0/3586125836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780b26c0 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7d4b7700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb60003fe0 0x7ffb780b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7ccb6700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 0x7ffb78156fb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00e4b0 tx=0x7ffb6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c022070 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00e980 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb780b29a0 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c027470 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.001+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb780b2f60 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.002+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb780b3480 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.003+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb6c027860 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.003+0000 7ffb757fa700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb64066f30 0x7ffb640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.003+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffb6c086270 con 0x7ffb780b3760 2023-10-06T11:16:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.003+0000 7ffb7d4b7700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb64066f30 0x7ffb640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:47.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.004+0000 7ffb7d4b7700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb64066f30 0x7ffb640693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fd0 tx=0x7ffb6800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:47.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.007+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb780b3480 con 0x7ffb780b3760 2023-10-06T11:16:47.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.247+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb780b3480 con 0x7ffb780b3760 2023-10-06T11:16:47.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.248+0000 7ffb757fa700 1 -- 172.21.15.55:0/3586125836 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb780b3480 con 0x7ffb780b3760 2023-10-06T11:16:47.251 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb64066f30 msgr2=0x7ffb640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb64066f30 0x7ffb640693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fd0 tx=0x7ffb6800b040 comp rx=0 tx=0).stop 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 msgr2=0x7ffb78156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 0x7ffb78156fb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00e4b0 tx=0x7ffb6c01a000 comp rx=0 tx=0).stop 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 shutdown_connections 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ffb64066f30 0x7ffb640693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb780c7e80 0x7ffb78154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb60003fe0 0x7ffb780b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 --2- 172.21.15.55:0/3586125836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b3760 0x7ffb78156fb0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 >> 172.21.15.55:0/3586125836 conn(0x7ffb780707d0 msgr2=0x7ffb780cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 shutdown_connections 2023-10-06T11:16:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:47.250+0000 7ffb7f71b700 1 -- 172.21.15.55:0/3586125836 wait complete. 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:16:47.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:16:47.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:47.266 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:47.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.266 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:47.285 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42288sec preferred_lft 42288sec 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:16:47.286 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:47.287 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:16:47.288 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:16:47.288 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:47.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.288 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:47.353 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:16:47.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.354 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:16:47.413 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:16:47.413 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:47.413 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:16:47.414 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:16:47.414 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:47.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.414 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:16:47.414 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:16:47.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:16:47.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:16:47.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:16:47.415 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:16:47.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.520 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:16:47.535 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:16:47.535 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:16:47.536 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:47.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:16:47.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:47.601 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:47.656 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:47.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:47.657 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:47.711 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:16:47.711 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:47.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:47.791 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:47.792 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:47.811 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:47.811 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:47.811 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:47.811 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:47.811 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:47.833 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:16:47.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:16:47.834 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:16:47.835 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:16:47.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:47.899 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:16:47.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:47.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:47.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:16:47.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:47.942 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:16:47.999 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:16:47.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:47.999 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:48.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:16:48.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:48.037 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:16:48.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:16:48.095 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.145 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2023-10-06T11:16:48.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2023-10-06T11:16:48.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2023-10-06T11:16:48.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2023-10-06T11:16:48.150 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.151 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2023-10-06T11:16:48.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.153 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2023-10-06T11:16:48.154 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2023-10-06T11:16:48.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-10-06T11:16:48.156 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-10-06T11:16:48.157 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-10-06T11:16:48.157 INFO:teuthology.orchestra.run.smithi055.stdout: mds_sessionmap_keys_per_op = 1 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.176 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.177 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-10-06T11:16:48.178 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-10-06T11:16:48.179 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.180 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-10-06T11:16:48.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-10-06T11:16:48.182 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:16:48.183 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-10-06T11:16:48.184 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:16:48.185 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:16:48.186 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-10-06T11:16:48.187 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-10-06T11:16:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: mds_sessionmap_keys_per_op = 1 2023-10-06T11:16:48.189 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:16:48.190 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:48.190 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:16:48.190 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:48.190 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:16:48.191 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:48.191 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:16:48.191 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:48.207 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:16:48.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-10-06T11:16:48.208 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:16:48.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-10-06T11:16:48.240 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:16:48.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-10-06T11:16:48.240 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:16:48.241 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-10-06T11:16:48.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.374+0000 7f17eb468700 1 Processor -- start 2023-10-06T11:16:48.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.374+0000 7fa63d35a700 1 Processor -- start 2023-10-06T11:16:48.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.374+0000 7fa63d35a700 1 -- start start 2023-10-06T11:16:48.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.374+0000 7f17eb468700 1 -- start start 2023-10-06T11:16:48.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa63d35a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa638143160 0x7fa6380ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa63d35a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa638143530 0x7fa6380b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa63d35a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6380cfc60 con 0x7fa6380cd500 2023-10-06T11:16:48.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa63d35a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6380d00f0 con 0x7fa638143530 2023-10-06T11:16:48.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa63d35a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6380b2e50 con 0x7fa638143160 2023-10-06T11:16:48.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17eb468700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17e4157130 0x7f17e406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17eb468700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e40cb960 con 0x7f17e4068cc0 2023-10-06T11:16:48.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17eb468700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e40a98c0 con 0x7f17e4159bb0 2023-10-06T11:16:48.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17eb468700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e40a9ba0 con 0x7f17e4157130 2023-10-06T11:16:48.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa6367fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa638143530 0x7fa6380b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa6377fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa6380cd500 0x7fa63815d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53830/0 (socket says 172.21.15.55:53830) 2023-10-06T11:16:48.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa6377fe700 1 -- 172.21.15.55:0/3184781661 learned_addr learned my addr 172.21.15.55:0/3184781661 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:48.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7fa636ffd700 1 --2- 172.21.15.55:0/3184781661 >> v2:172.21.15.142:3300/0 conn(0x7fa638143160 0x7fa6380ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17e9a05700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f17e4068cc0 0x7f17e40aa030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53846/0 (socket says 172.21.15.55:53846) 2023-10-06T11:16:48.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17e9a05700 1 -- 172.21.15.55:0/3007166908 learned_addr learned my addr 172.21.15.55:0/3007166908 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:48.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.375+0000 7f17e9204700 1 --2- 172.21.15.55:0/3007166908 >> v2:172.21.15.142:3300/0 conn(0x7f17e4157130 0x7f17e406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa6367fc700 1 -- 172.21.15.55:0/3184781661 >> v2:172.21.15.142:3300/0 conn(0x7fa638143160 msgr2=0x7fa6380ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:48.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa6367fc700 1 --2- 172.21.15.55:0/3184781661 >> v2:172.21.15.142:3300/0 conn(0x7fa638143160 0x7fa6380ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa6367fc700 1 -- 172.21.15.55:0/3184781661 >> v1:172.21.15.55:6789/0 conn(0x7fa6380cd500 legacy=0x7fa63815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa6367fc700 1 -- 172.21.15.55:0/3184781661 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6380cf050 con 0x7fa638143530 2023-10-06T11:16:48.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104756191 0 0) 0x7f17dc001490 con 0x7f17e4068cc0 2023-10-06T11:16:48.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d0003570 con 0x7f17e4068cc0 2023-10-06T11:16:48.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa6367fc700 1 --2- 172.21.15.55:0/3184781661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143530 0x7fa6380b16d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa638063e10 tx=0x7fa62c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3761e7b31bde4ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799663023 0 0) 0x7f17e40a98c0 con 0x7f17e4159bb0 2023-10-06T11:16:48.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17dc001490 con 0x7f17e4159bb0 2023-10-06T11:16:48.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848129803 0 0) 0x7f17d0003570 con 0x7f17e4068cc0 2023-10-06T11:16:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 >> v2:172.21.15.142:3300/0 conn(0x7f17e4157130 msgr2=0x7f17e406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 --2- 172.21.15.55:0/3007166908 >> v2:172.21.15.142:3300/0 conn(0x7f17e4157130 0x7f17e406ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 >> v1:172.21.15.142:6789/0 conn(0x7f17e4159bb0 legacy=0x7f17e40685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e415a420 con 0x7f17e4068cc0 2023-10-06T11:16:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f17dc001980 con 0x7f17e4068cc0 2023-10-06T11:16:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa635ffb700 1 -- 172.21.15.55:0/3184781661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00b6b0 con 0x7fa638143530 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 >> v1:172.21.15.55:6789/0 conn(0x7f17e4068cc0 legacy=0x7f17e40aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17d0003c40 0x7f17d0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0004810 0x7f17d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d0005210 0x7f17d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40a9ba0 con 0x7f17d0004810 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d000c1b0 con 0x7f17d0005210 2023-10-06T11:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d000c370 con 0x7f17d0003c40 2023-10-06T11:16:48.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa635ffb700 1 -- 172.21.15.55:0/3184781661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c00b810 con 0x7fa638143530 2023-10-06T11:16:48.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7fa635ffb700 1 -- 172.21.15.55:0/3184781661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00bbb0 con 0x7fa638143530 2023-10-06T11:16:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17e9204700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17d0003c40 0x7f17d0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17e9a05700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d0005210 0x7f17d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.376+0000 7f17e8a03700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0004810 0x7f17d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 -- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17d0003c40 msgr2=0x7f17d0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17d0003c40 0x7f17d0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 -- 172.21.15.55:0/3007166908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0004810 msgr2=0x7f17d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0004810 0x7f17d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 -- 172.21.15.55:0/3007166908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0003570 con 0x7f17d0005210 2023-10-06T11:16:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 -- 172.21.15.55:0/3007166908 reap_dead start 2023-10-06T11:16:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17e9a05700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d0005210 0x7f17d000ba60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f17dc002250 tx=0x7f17dc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa437bd8bfe451eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 -- 172.21.15.55:0/3184781661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143530 msgr2=0x7fa6380b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 --2- 172.21.15.55:0/3184781661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143530 0x7fa6380b16d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa638063e10 tx=0x7fa62c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 -- 172.21.15.55:0/3184781661 shutdown_connections 2023-10-06T11:16:48.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 --2- 172.21.15.55:0/3184781661 >> v2:172.21.15.142:3300/0 conn(0x7fa638143160 0x7fa6380ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 --2- 172.21.15.55:0/3184781661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143530 0x7fa6380b16d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 -- 172.21.15.55:0/3184781661 >> 172.21.15.55:0/3184781661 conn(0x7fa6380d1010 msgr2=0x7fa6380affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:48.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0070f0 con 0x7f17d0005210 2023-10-06T11:16:48.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 -- 172.21.15.55:0/3184781661 shutdown_connections 2023-10-06T11:16:48.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7fa63d35a700 1 -- 172.21.15.55:0/3184781661 wait complete. 2023-10-06T11:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc007250 con 0x7f17d0005210 2023-10-06T11:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.377+0000 7f17dbfff700 1 -- 172.21.15.55:0/3007166908 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc007610 con 0x7f17d0005210 2023-10-06T11:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 -- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d0005210 msgr2=0x7f17d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d0005210 0x7f17d000ba60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f17dc002250 tx=0x7f17dc00a060 comp rx=0 tx=0).stop 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 -- 172.21.15.55:0/3007166908 shutdown_connections 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 --2- 172.21.15.55:0/3007166908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17d0005210 0x7f17d000ba60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 -- 172.21.15.55:0/3007166908 >> 172.21.15.55:0/3007166908 conn(0x7f17e40c9f00 msgr2=0x7f17e406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 -- 172.21.15.55:0/3007166908 shutdown_connections 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.378+0000 7f17eb468700 1 -- 172.21.15.55:0/3007166908 wait complete. 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 Processor -- start 2023-10-06T11:16:48.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 -- start start 2023-10-06T11:16:48.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7f17eb468700 1 Processor -- start 2023-10-06T11:16:48.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380cd500 0x7fa638136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 0x7fa63815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa638143530 0x7fa638137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63815ba50 con 0x7fa638143160 2023-10-06T11:16:48.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63815ad50 con 0x7fa6380cd500 2023-10-06T11:16:48.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa63d35a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63815bca0 con 0x7fa638143530 2023-10-06T11:16:48.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7f17eb468700 1 -- start start 2023-10-06T11:16:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa6367fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 0x7fa63815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa636ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380cd500 0x7fa638136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.379+0000 7fa6367fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 0x7fa63815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56394/0 (socket says 172.21.15.55:56394) 2023-10-06T11:16:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa6367fc700 1 -- 172.21.15.55:0/1651585744 learned_addr learned my addr 172.21.15.55:0/1651585744 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa6377fe700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa638143530 0x7fa638137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa636ffd700 1 -- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa638143530 msgr2=0x7fa638137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa636ffd700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa638143530 0x7fa638137990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa636ffd700 1 -- 172.21.15.55:0/1651585744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 msgr2=0x7fa63815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa636ffd700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 0x7fa63815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa636ffd700 1 -- 172.21.15.55:0/1651585744 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c009420 con 0x7fa6380cd500 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa6377fe700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa638143530 0x7fa638137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa6367fc700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 0x7fa63815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa636ffd700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380cd500 0x7fa638136ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa62800d890 tx=0x7fa628008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280125f0 con 0x7fa6380cd500 2023-10-06T11:16:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa628012770 con 0x7fa6380cd500 2023-10-06T11:16:48.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63815bf80 con 0x7fa6380cd500 2023-10-06T11:16:48.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628012b30 con 0x7fa6380cd500 2023-10-06T11:16:48.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa638136ff0 con 0x7fa6380cd500 2023-10-06T11:16:48.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7f17eb468700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0005210 0x7f17e414fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7f17eb468700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17e415bee0 0x7f17e415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7f17eb468700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e40c5130 0x7f17e40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7f17eb468700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e415c890 con 0x7f17d0005210 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7f17eb468700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40c6b70 con 0x7f17e40c5130 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.380+0000 7f17eb468700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40c5f60 con 0x7f17e415bee0 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e9204700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0005210 0x7f17e414fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e9204700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0005210 0x7f17e414fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56398/0 (socket says 172.21.15.55:56398) 2023-10-06T11:16:48.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e9204700 1 -- 172.21.15.55:0/2318212924 learned_addr learned my addr 172.21.15.55:0/2318212924 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e9a05700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e40c5130 0x7f17e40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17e415bee0 0x7f17e415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 -- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e40c5130 msgr2=0x7f17e40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e40c5130 0x7f17e40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 -- 172.21.15.55:0/2318212924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0005210 msgr2=0x7f17e414fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0005210 0x7f17e414fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 -- 172.21.15.55:0/2318212924 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40c6240 con 0x7f17e415bee0 2023-10-06T11:16:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17e8a03700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17e415bee0 0x7f17e415c350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f17d4002ab0 tx=0x7f17d4007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4006a30 con 0x7f17e415bee0 2023-10-06T11:16:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4006b90 con 0x7f17e415bee0 2023-10-06T11:16:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.381+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e40c6520 con 0x7f17e415bee0 2023-10-06T11:16:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.382+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e4150150 con 0x7f17e415bee0 2023-10-06T11:16:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.382+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4007050 con 0x7f17e415bee0 2023-10-06T11:16:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.382+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa628013480 con 0x7fa6380cd500 2023-10-06T11:16:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.382+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63804c380 con 0x7fa6380cd500 2023-10-06T11:16:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.383+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c40052b0 con 0x7f17e415bee0 2023-10-06T11:16:48.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.383+0000 7fa61effd700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa624066f30 0x7fa6240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.383+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa628084af0 con 0x7fa6380cd500 2023-10-06T11:16:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.383+0000 7fa6367fc700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa624066f30 0x7fa6240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.383+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17d40073c0 con 0x7f17e415bee0 2023-10-06T11:16:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.383+0000 7f17d97fa700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17c8066fb0 0x7f17c8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.384+0000 7fa6367fc700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa624066f30 0x7fa6240693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa63815d1e0 tx=0x7fa62c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.384+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f17d4084a40 con 0x7f17e415bee0 2023-10-06T11:16:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.384+0000 7f17e9204700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17c8066fb0 0x7f17c8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.384+0000 7f17e9204700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17c8066fb0 0x7f17c8069460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009170 tx=0x7f17e00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.387+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa628055550 con 0x7fa6380cd500 2023-10-06T11:16:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.388+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17d4051970 con 0x7f17e415bee0 2023-10-06T11:16:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.395+0000 7f5b98d18700 1 Processor -- start 2023-10-06T11:16:48.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.395+0000 7eff0a9b9700 1 Processor -- start 2023-10-06T11:16:48.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.396+0000 7f5b98d18700 1 -- start start 2023-10-06T11:16:48.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.396+0000 7eff0a9b9700 1 -- start start 2023-10-06T11:16:48.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff0a9b9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff0415d900 0x7eff040cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff0a9b9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff040b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff0a9b9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040b1190 con 0x7eff041593b0 2023-10-06T11:16:48.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff0a9b9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040d0400 con 0x7eff0415d900 2023-10-06T11:16:48.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff0a9b9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040b6550 con 0x7eff04159780 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b98d18700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940b0710 0x7f5b940cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b98d18700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b9406e590 0x7f5b9406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b98d18700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940a98c0 con 0x7f5b940cc4e0 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b98d18700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b94159b70 con 0x7f5b9406e590 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b98d18700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9406ef50 con 0x7f5b940b0710 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff037fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff0415d900 0x7eff040cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff03fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7eff041593b0 0x7eff0415d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53858/0 (socket says 172.21.15.55:53858) 2023-10-06T11:16:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff03fff700 1 -- 172.21.15.55:0/3815552963 learned_addr learned my addr 172.21.15.55:0/3815552963 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7eff08f56700 1 --2- 172.21.15.55:0/3815552963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff040b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b9259c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5b940cc4e0 0x7f5b940b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:55154/0 (socket says 172.21.15.55:55154) 2023-10-06T11:16:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b92d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5b9406e590 0x7f5b9406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b91d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940b0710 0x7f5b940cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.397+0000 7f5b9259c700 1 -- 172.21.15.55:0/1424860575 learned_addr learned my addr 172.21.15.55:0/1424860575 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b9159a700 1 -- 172.21.15.55:0/1424860575 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027868565 0 0) 0x7f5b940a98c0 con 0x7f5b940cc4e0 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b9159a700 1 -- 172.21.15.55:0/1424860575 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b7c003570 con 0x7f5b940cc4e0 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b92d9d700 1 -- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940b0710 msgr2=0x7f5b940cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b92d9d700 1 --2- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940b0710 0x7f5b940cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b92d9d700 1 -- 172.21.15.55:0/1424860575 >> v1:172.21.15.142:6789/0 conn(0x7f5b940cc4e0 legacy=0x7f5b940b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff08f56700 1 -- 172.21.15.55:0/3815552963 >> v2:172.21.15.55:3300/0 conn(0x7eff0415d900 msgr2=0x7eff040cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:48.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff08f56700 1 --2- 172.21.15.55:0/3815552963 >> v2:172.21.15.55:3300/0 conn(0x7eff0415d900 0x7eff040cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff08f56700 1 -- 172.21.15.55:0/3815552963 >> v1:172.21.15.55:6789/0 conn(0x7eff041593b0 legacy=0x7eff0415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b92d9d700 1 -- 172.21.15.55:0/1424860575 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940b0be0 con 0x7f5b9406e590 2023-10-06T11:16:48.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff08f56700 1 -- 172.21.15.55:0/3815552963 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040cfb60 con 0x7eff04159780 2023-10-06T11:16:48.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b92d9d700 1 --2- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406e590 0x7f5b9406ea10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009e90 tx=0x7f5b8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1a7718c098439e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff08f56700 1 --2- 172.21.15.55:0/3815552963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff040b6010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efefc009e60 tx=0x7efefc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da39882085664b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b9159a700 1 -- 172.21.15.55:0/1424860575 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00e070 con 0x7f5b9406e590 2023-10-06T11:16:48.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b9159a700 1 -- 172.21.15.55:0/1424860575 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c00bb40 con 0x7f5b9406e590 2023-10-06T11:16:48.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7f5b9159a700 1 -- 172.21.15.55:0/1424860575 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c012430 con 0x7f5b9406e590 2023-10-06T11:16:48.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff02ffd700 1 -- 172.21.15.55:0/3815552963 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00e070 con 0x7eff04159780 2023-10-06T11:16:48.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff02ffd700 1 -- 172.21.15.55:0/3815552963 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00bb60 con 0x7eff04159780 2023-10-06T11:16:48.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.398+0000 7eff02ffd700 1 -- 172.21.15.55:0/3815552963 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc012430 con 0x7eff04159780 2023-10-06T11:16:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 -- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406e590 msgr2=0x7f5b9406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 --2- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406e590 0x7f5b9406ea10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009e90 tx=0x7f5b8c009780 comp rx=0 tx=0).stop 2023-10-06T11:16:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3815552963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 msgr2=0x7eff040b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3815552963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff040b6010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efefc009e60 tx=0x7efefc009780 comp rx=0 tx=0).stop 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3815552963 shutdown_connections 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3815552963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff040b6010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3815552963 >> v2:172.21.15.55:3300/0 conn(0x7eff0415d900 0x7eff040cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3815552963 >> 172.21.15.55:0/3815552963 conn(0x7eff040d05c0 msgr2=0x7eff040d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3815552963 shutdown_connections 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 -- 172.21.15.55:0/1424860575 shutdown_connections 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 --2- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406e590 0x7f5b9406ea10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 --2- 172.21.15.55:0/1424860575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940b0710 0x7f5b940cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3815552963 wait complete. 2023-10-06T11:16:48.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 -- 172.21.15.55:0/1424860575 >> 172.21.15.55:0/1424860575 conn(0x7f5b9406bb70 msgr2=0x7f5b940aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:48.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 -- 172.21.15.55:0/1424860575 shutdown_connections 2023-10-06T11:16:48.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.399+0000 7f5b98d18700 1 -- 172.21.15.55:0/1424860575 wait complete. 2023-10-06T11:16:48.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.400+0000 7f5b98d18700 1 Processor -- start 2023-10-06T11:16:48.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.400+0000 7eff0a9b9700 1 Processor -- start 2023-10-06T11:16:48.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.400+0000 7f5b98d18700 1 -- start start 2023-10-06T11:16:48.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.400+0000 7eff0a9b9700 1 -- start start 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b98d18700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9406e590 0x7f5b941518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b98d18700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b940b0710 0x7f5b94153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b98d18700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940cc4e0 0x7f5b94141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b98d18700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b941537e0 con 0x7f5b9406e590 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b98d18700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94151fa0 con 0x7f5b940b0710 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b98d18700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94152280 con 0x7f5b940cc4e0 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9406e590 0x7f5b941518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9406e590 0x7f5b941518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56420/0 (socket says 172.21.15.55:56420) 2023-10-06T11:16:48.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b9259c700 1 -- 172.21.15.55:0/3364329611 learned_addr learned my addr 172.21.15.55:0/3364329611 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:48.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b91d9b700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b940b0710 0x7f5b94153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b92d9d700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940cc4e0 0x7f5b94141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff0a9b9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff041593b0 0x7eff0415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff0a9b9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff04156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff0a9b9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff0415d900 0x7eff041440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff0a9b9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff041445e0 con 0x7eff041593b0 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff0a9b9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04156120 con 0x7eff0415d900 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff0a9b9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff04159e90 con 0x7eff04159780 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff03fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff041593b0 0x7eff0415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff037fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff04156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff03fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff041593b0 0x7eff0415c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56428/0 (socket says 172.21.15.55:56428) 2023-10-06T11:16:48.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7eff03fff700 1 -- 172.21.15.55:0/3491269096 learned_addr learned my addr 172.21.15.55:0/3491269096 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:48.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b91d9b700 1 -- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940cc4e0 msgr2=0x7f5b94141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b91d9b700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940cc4e0 0x7f5b94141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b91d9b700 1 -- 172.21.15.55:0/3364329611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9406e590 msgr2=0x7f5b941518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b91d9b700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9406e590 0x7f5b941518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.401+0000 7f5b91d9b700 1 -- 172.21.15.55:0/3364329611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c009a20 con 0x7f5b940b0710 2023-10-06T11:16:48.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff08f56700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff0415d900 0x7eff041440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff037fe700 1 -- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff0415d900 msgr2=0x7eff041440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff037fe700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff0415d900 0x7eff041440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff037fe700 1 -- 172.21.15.55:0/3491269096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff041593b0 msgr2=0x7eff0415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:48.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff037fe700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff041593b0 0x7eff0415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:48.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff037fe700 1 -- 172.21.15.55:0/3491269096 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc009a20 con 0x7eff04159780 2023-10-06T11:16:48.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7f5b91d9b700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b940b0710 0x7f5b94153060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800ea20 tx=0x7f5b880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff08f56700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff0415d900 0x7eff041440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:48.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800ee60 con 0x7f5b940b0710 2023-10-06T11:16:48.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8800c7f0 con 0x7f5b940b0710 2023-10-06T11:16:48.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800cb90 con 0x7f5b940b0710 2023-10-06T11:16:48.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7eff037fe700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff04156d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff0415dd00 tx=0x7efef80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b94152560 con 0x7f5b940b0710 2023-10-06T11:16:48.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b94142030 con 0x7f5b940b0710 2023-10-06T11:16:48.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8013680 con 0x7eff04159780 2023-10-06T11:16:48.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef80137e0 con 0x7eff04159780 2023-10-06T11:16:48.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.402+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8013b80 con 0x7eff04159780 2023-10-06T11:16:48.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.403+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff041557f0 con 0x7eff04159780 2023-10-06T11:16:48.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.403+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff04155db0 con 0x7eff04159780 2023-10-06T11:16:48.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.403+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9404c380 con 0x7f5b940b0710 2023-10-06T11:16:48.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.403+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b88013470 con 0x7f5b940b0710 2023-10-06T11:16:48.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.404+0000 7f5b827fc700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.404+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5b880848f0 con 0x7f5b940b0710 2023-10-06T11:16:48.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.404+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0404c380 con 0x7eff04159780 2023-10-06T11:16:48.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.404+0000 7f5b9259c700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.404+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efef80123d0 con 0x7eff04159780 2023-10-06T11:16:48.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.404+0000 7f5b9259c700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b74066f30 0x7f5b740693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5b84001ad0 tx=0x7f5b84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.405+0000 7efeebfff700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:48.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.405+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efef8084870 con 0x7eff04159780 2023-10-06T11:16:48.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.405+0000 7eff03fff700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:48.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.405+0000 7eff03fff700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efef4007130 tx=0x7efef4007f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:48.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.408+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b88055350 con 0x7f5b940b0710 2023-10-06T11:16:48.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.409+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efef8051840 con 0x7eff04159780 2023-10-06T11:16:48.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.686+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7eff04156260 con 0x7eff04159780 2023-10-06T11:16:48.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.691+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f5b9406f3e0 con 0x7f5b940b0710 2023-10-06T11:16:48.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.717+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fa63815c5d0 con 0x7fa6380cd500 2023-10-06T11:16:48.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:48.719+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7f17c4005560 con 0x7f17e415bee0 2023-10-06T11:16:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.069+0000 7efeebfff700 1 -- 172.21.15.55:0/3491269096 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6400 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7efef8054e60 con 0x7eff04159780 2023-10-06T11:16:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efef0066f30 msgr2=0x7efef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efef4007130 tx=0x7efef4007f70 comp rx=0 tx=0).stop 2023-10-06T11:16:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 msgr2=0x7eff04156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff04156d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff0415dd00 tx=0x7efef80091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 shutdown_connections 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff041593b0 0x7eff0415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff0415d900 0x7eff041440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 --2- 172.21.15.55:0/3491269096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff04159780 0x7eff04156d30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 >> 172.21.15.55:0/3491269096 conn(0x7eff040d05c0 msgr2=0x7eff041503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 shutdown_connections 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.071+0000 7eff0a9b9700 1 -- 172.21.15.55:0/3491269096 wait complete. 2023-10-06T11:16:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:failed mds gid 6400 2023-10-06T11:16:49.088 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:16:49.085+0000 7fc5df229700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:16:49.089 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:16:49.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:16:49.092 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:16:49.092 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:49.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.098+0000 7f5b827fc700 1 -- 172.21.15.55:0/3364329611 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6415 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7f5b88054ee0 con 0x7f5b940b0710 2023-10-06T11:16:49.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.098+0000 7fa61effd700 1 -- 172.21.15.55:0/1651585744 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6403 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7fa6280550e0 con 0x7fa6380cd500 2023-10-06T11:16:49.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.098+0000 7f17d97fa700 1 -- 172.21.15.55:0/2318212924 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6418 v61) v1 ==== 95+0+0 (secure 0 0 0) 0x7f17d4054f90 con 0x7f17e415bee0 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa624066f30 msgr2=0x7fa6240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa624066f30 0x7fa6240693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa63815d1e0 tx=0x7fa62c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380cd500 msgr2=0x7fa638136ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380cd500 0x7fa638136ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa62800d890 tx=0x7fa628008040 comp rx=0 tx=0).stop 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 shutdown_connections 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa624066f30 0x7fa6240693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa638143530 0x7fa638137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6380cd500 0x7fa638136ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 --2- 172.21.15.55:0/1651585744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa638143160 0x7fa63815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 >> 172.21.15.55:0/1651585744 conn(0x7fa6380d1010 msgr2=0x7fa6380b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 shutdown_connections 2023-10-06T11:16:49.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.101+0000 7fa63d35a700 1 -- 172.21.15.55:0/1651585744 wait complete. 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b74066f30 msgr2=0x7f5b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b74066f30 0x7f5b740693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5b84001ad0 tx=0x7f5b84009040 comp rx=0 tx=0).stop 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b940b0710 msgr2=0x7f5b94153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b940b0710 0x7f5b94153060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800ea20 tx=0x7f5b880091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 shutdown_connections 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b9406e590 0x7f5b941518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940cc4e0 0x7f5b94141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 --2- 172.21.15.55:0/3364329611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b940b0710 0x7f5b94153060 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 >> 172.21.15.55:0/3364329611 conn(0x7f5b9406bb70 msgr2=0x7f5b94158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:49.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 shutdown_connections 2023-10-06T11:16:49.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f5b98d18700 1 -- 172.21.15.55:0/3364329611 wait complete. 2023-10-06T11:16:49.107 INFO:teuthology.orchestra.run.smithi055.stderr:failed mds gid 6403 2023-10-06T11:16:49.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17c8066fb0 msgr2=0x7f17c8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17c8066fb0 0x7f17c8069460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009170 tx=0x7f17e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17e415bee0 msgr2=0x7f17e415c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17e415bee0 0x7f17e415c350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f17d4002ab0 tx=0x7f17d4007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:49.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 shutdown_connections 2023-10-06T11:16:49.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f17c8066fb0 0x7f17c8069460 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17d0005210 0x7f17e414fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e40c5130 0x7f17e40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 --2- 172.21.15.55:0/2318212924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17e415bee0 0x7f17e415c350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 >> 172.21.15.55:0/2318212924 conn(0x7f17e40c9f00 msgr2=0x7f17e40ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.102+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 shutdown_connections 2023-10-06T11:16:49.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.103+0000 7f17eb468700 1 -- 172.21.15.55:0/2318212924 wait complete. 2023-10-06T11:16:49.110 INFO:teuthology.orchestra.run.smithi055.stderr:failed mds gid 6415 2023-10-06T11:16:49.110 INFO:teuthology.orchestra.run.smithi055.stderr:failed mds gid 6418 2023-10-06T11:16:49.121 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:16:49.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:16:49.125 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:16:49.126 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:49.127 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:16:49.128 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:16:49.128 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:16:49.129 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:16:49.130 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:16:49.130 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:49.169 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:16:49.170 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:49.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:49.172 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:16:49.198 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-10-06T11:16:49.203 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-10-06T11:16:49.247 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:16:49.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.291+0000 7fe139b1a700 1 Processor -- start 2023-10-06T11:16:49.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.291+0000 7fe139b1a700 1 -- start start 2023-10-06T11:16:49.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139b1a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe1340c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:49.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139b1a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe134068cc0 0x7fe13406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:49.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139b1a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13406aa40 con 0x7fe13406e6c0 2023-10-06T11:16:49.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139b1a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1340ca770 con 0x7fe134068cc0 2023-10-06T11:16:49.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139b1a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1340c7450 con 0x7fe1341596d0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe134068cc0 0x7fe13406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe134068cc0 0x7fe13406aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56466/0 (socket says 172.21.15.55:56466) 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 -- 172.21.15.55:0/2420666105 learned_addr learned my addr 172.21.15.55:0/2420666105 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe138b18700 1 --2- 172.21.15.55:0/2420666105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe1340c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 -- 172.21.15.55:0/2420666105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 msgr2=0x7fe1340c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 --2- 172.21.15.55:0/2420666105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe1340c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 -- 172.21.15.55:0/2420666105 >> v1:172.21.15.142:6789/0 conn(0x7fe13406e6c0 legacy=0x7fe1340685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.292+0000 7fe139319700 1 -- 172.21.15.55:0/2420666105 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340cb020 con 0x7fe134068cc0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139319700 1 --2- 172.21.15.55:0/2420666105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe13406aed0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe1240099b0 tx=0x7fe124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485584aa2b9ca7ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe1337fe700 1 -- 172.21.15.55:0/2420666105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400b860 con 0x7fe134068cc0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe1337fe700 1 -- 172.21.15.55:0/2420666105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400b9c0 con 0x7fe134068cc0 2023-10-06T11:16:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe1337fe700 1 -- 172.21.15.55:0/2420666105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400bd60 con 0x7fe134068cc0 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 -- 172.21.15.55:0/2420666105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 msgr2=0x7fe13406aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 --2- 172.21.15.55:0/2420666105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe13406aed0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe1240099b0 tx=0x7fe124009250 comp rx=0 tx=0).stop 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 -- 172.21.15.55:0/2420666105 shutdown_connections 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 --2- 172.21.15.55:0/2420666105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe13406aed0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 --2- 172.21.15.55:0/2420666105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe1340c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 -- 172.21.15.55:0/2420666105 >> 172.21.15.55:0/2420666105 conn(0x7fe1340c9db0 msgr2=0x7fe13406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 -- 172.21.15.55:0/2420666105 shutdown_connections 2023-10-06T11:16:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.293+0000 7fe139b1a700 1 -- 172.21.15.55:0/2420666105 wait complete. 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.295+0000 7fe139b1a700 1 Processor -- start 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.295+0000 7fe139b1a700 1 -- start start 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.295+0000 7fe139b1a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe1340c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe13406e6c0 0x7fe13414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe134159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13415af00 con 0x7fe134068cc0 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13414bc30 con 0x7fe13406e6c0 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe134159fe0 con 0x7fe1341596d0 2023-10-06T11:16:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe1340c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe1340c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56476/0 (socket says 172.21.15.55:56476) 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 -- 172.21.15.55:0/3149536868 learned_addr learned my addr 172.21.15.55:0/3149536868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139319700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe134159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe133fff700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe13406e6c0 0x7fe13414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 -- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 msgr2=0x7fe134159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe134159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 -- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe13406e6c0 msgr2=0x7fe13414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe13406e6c0 0x7fe13414b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 -- 172.21.15.55:0/3149536868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240094f0 con 0x7fe134068cc0 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe138b18700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe1340c6740 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00e190 tx=0x7fe12c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00ecd0 con 0x7fe134068cc0 2023-10-06T11:16:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00ee30 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c014670 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13415a2b0 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.296+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13415a870 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.297+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13406cc20 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.298+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe12c014a20 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.298+0000 7fe130ff9700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe120066f60 0x7fe120069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.298+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe12c084e60 con 0x7fe134068cc0 2023-10-06T11:16:49.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.298+0000 7fe133fff700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe120066f60 0x7fe120069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:49.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.299+0000 7fe133fff700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe120066f60 0x7fe120069410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe13416d2e0 tx=0x7fe128007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.303+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe12c051de0 con 0x7fe134068cc0 2023-10-06T11:16:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.541+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe13406a4b0 con 0x7fe134068cc0 2023-10-06T11:16:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.542+0000 7fe130ff9700 1 -- 172.21.15.55:0/3149536868 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1565 (secure 0 0 0) 0x7fe12c009a60 con 0x7fe134068cc0 2023-10-06T11:16:49.544 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:49.544 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:49.087402+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe120066f60 msgr2=0x7fe120069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe120066f60 0x7fe120069410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe13416d2e0 tx=0x7fe128007ec0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 msgr2=0x7fe1340c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe1340c6740 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00e190 tx=0x7fe12c009920 comp rx=0 tx=0).stop 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 shutdown_connections 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe120066f60 0x7fe120069410 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe134068cc0 0x7fe1340c6740 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1341596d0 0x7fe134159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 --2- 172.21.15.55:0/3149536868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe13406e6c0 0x7fe13414b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.543+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 >> 172.21.15.55:0/3149536868 conn(0x7fe1340c9db0 msgr2=0x7fe1341574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.544+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 shutdown_connections 2023-10-06T11:16:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:49.544+0000 7fe139b1a700 1 -- 172.21.15.55:0/3149536868 wait complete. 2023-10-06T11:16:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 61 2023-10-06T11:16:49.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:33.613713+0000', 'modified': '2023-10-06T11:16:49.087402+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:49.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2023-10-06T11:16:50.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:51.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.094+0000 7feb1f861700 1 Processor -- start 2023-10-06T11:16:51.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.094+0000 7feb1f861700 1 -- start start 2023-10-06T11:16:51.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1f861700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb180cc650 0x7feb18159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:51.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1f861700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180c45f0 con 0x7feb18153dd0 2023-10-06T11:16:51.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1f861700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180c39e0 con 0x7feb180c3110 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1f861700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb180c3cc0 con 0x7feb180cc650 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1cdfc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb180cc650 0x7feb18159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1d5fd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb18153dd0 0x7feb180cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53874/0 (socket says 172.21.15.55:53874) 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.095+0000 7feb1d5fd700 1 -- 172.21.15.55:0/3631083029 learned_addr learned my addr 172.21.15.55:0/3631083029 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.096+0000 7feb1cdfc700 1 -- 172.21.15.55:0/3631083029 >> v1:172.21.15.142:6789/0 conn(0x7feb180c3110 legacy=0x7feb18068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.096+0000 7feb1cdfc700 1 -- 172.21.15.55:0/3631083029 >> v1:172.21.15.55:6789/0 conn(0x7feb18153dd0 legacy=0x7feb180cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.096+0000 7feb17fff700 1 -- 172.21.15.55:0/3631083029 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900631556 0 0) 0x7feb180c45f0 con 0x7feb18153dd0 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.096+0000 7feb1cdfc700 1 -- 172.21.15.55:0/3631083029 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180c3fa0 con 0x7feb180cc650 2023-10-06T11:16:51.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.096+0000 7feb1cdfc700 1 --2- 172.21.15.55:0/3631083029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb18159d80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0098e0 tx=0x7feb0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571c5bb6b12287da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:51.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.098+0000 7feb17fff700 1 -- 172.21.15.55:0/3631083029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c009e80 con 0x7feb180cc650 2023-10-06T11:16:51.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.098+0000 7feb17fff700 1 -- 172.21.15.55:0/3631083029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00b860 con 0x7feb180cc650 2023-10-06T11:16:51.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.098+0000 7feb17fff700 1 -- 172.21.15.55:0/3631083029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00bbe0 con 0x7feb180cc650 2023-10-06T11:16:51.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 -- 172.21.15.55:0/3631083029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 msgr2=0x7feb18159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 --2- 172.21.15.55:0/3631083029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb18159d80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0098e0 tx=0x7feb0c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 -- 172.21.15.55:0/3631083029 shutdown_connections 2023-10-06T11:16:51.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 --2- 172.21.15.55:0/3631083029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb18159d80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 -- 172.21.15.55:0/3631083029 >> 172.21.15.55:0/3631083029 conn(0x7feb180cade0 msgr2=0x7feb180cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:51.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 -- 172.21.15.55:0/3631083029 shutdown_connections 2023-10-06T11:16:51.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.099+0000 7feb1f861700 1 -- 172.21.15.55:0/3631083029 wait complete. 2023-10-06T11:16:51.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.100+0000 7feb1f861700 1 Processor -- start 2023-10-06T11:16:51.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.100+0000 7feb1f861700 1 -- start start 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1f861700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb180c3110 0x7feb1814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1f861700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb1815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1f861700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb18153dd0 0x7feb18155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1f861700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18169c60 con 0x7feb180cc650 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1f861700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18155750 con 0x7feb180c3110 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1f861700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1815b310 con 0x7feb18153dd0 2023-10-06T11:16:51.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1cdfc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb1815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1cdfc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb1815d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56504/0 (socket says 172.21.15.55:56504) 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1cdfc700 1 -- 172.21.15.55:0/1537169250 learned_addr learned my addr 172.21.15.55:0/1537169250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1d5fd700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb180c3110 0x7feb1814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.101+0000 7feb1ddfe700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb18153dd0 0x7feb18155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1cdfc700 1 -- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb18153dd0 msgr2=0x7feb18155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1cdfc700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb18153dd0 0x7feb18155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1cdfc700 1 -- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb180c3110 msgr2=0x7feb1814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1cdfc700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb180c3110 0x7feb1814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1cdfc700 1 -- 172.21.15.55:0/1537169250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c009420 con 0x7feb180cc650 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1cdfc700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb1815d650 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7feb18064950 tx=0x7feb0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c01f070 con 0x7feb180cc650 2023-10-06T11:16:51.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c000c90 con 0x7feb180cc650 2023-10-06T11:16:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1814baa0 con 0x7feb180cc650 2023-10-06T11:16:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00bbe0 con 0x7feb180cc650 2023-10-06T11:16:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.102+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb18155470 con 0x7feb180cc650 2023-10-06T11:16:51.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.103+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1804c380 con 0x7feb180cc650 2023-10-06T11:16:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.104+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb0c011860 con 0x7feb180cc650 2023-10-06T11:16:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.104+0000 7feb157fa700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb04066f30 0x7feb040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.104+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7feb0c085bc0 con 0x7feb180cc650 2023-10-06T11:16:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.104+0000 7feb1d5fd700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb04066f30 0x7feb040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:51.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.105+0000 7feb1d5fd700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb04066f30 0x7feb040693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7feb08000f80 tx=0x7feb08001950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:51.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.109+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb0c052b40 con 0x7feb180cc650 2023-10-06T11:16:51.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.345+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb1815b450 con 0x7feb180cc650 2023-10-06T11:16:51.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.346+0000 7feb157fa700 1 -- 172.21.15.55:0/1537169250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4607 (secure 0 0 0) 0x7feb0c028090 con 0x7feb180cc650 2023-10-06T11:16:51.348 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:51.349 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7128,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:51.097382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb04066f30 msgr2=0x7feb040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb04066f30 0x7feb040693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7feb08000f80 tx=0x7feb08001950 comp rx=0 tx=0).stop 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 msgr2=0x7feb1815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb1815d650 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7feb18064950 tx=0x7feb0c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 shutdown_connections 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7feb04066f30 0x7feb040693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb18153dd0 0x7feb18155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb180c3110 0x7feb1814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 --2- 172.21.15.55:0/1537169250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb180cc650 0x7feb1815d650 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 >> 172.21.15.55:0/1537169250 conn(0x7feb180cade0 msgr2=0x7feb181590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 shutdown_connections 2023-10-06T11:16:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:51.348+0000 7feb1f861700 1 -- 172.21.15.55:0/1537169250 wait complete. 2023-10-06T11:16:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 64 2023-10-06T11:16:51.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:33.613713+0000', 'modified': '2023-10-06T11:16:51.097382+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7149': {'gid': 7149, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.55:6835/2083914208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 2083914208}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 2083914208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:51.765 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7149:up:reconnect 2023-10-06T11:16:52.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:52.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.895+0000 7f9696b5b700 1 Processor -- start 2023-10-06T11:16:52.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.895+0000 7f9696b5b700 1 -- start start 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9696b5b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 0x7f96900b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9696b5b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900b3a60 con 0x7f9690159760 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9696b5b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900af770 con 0x7f96900b3ef0 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9696b5b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900afd20 con 0x7f969015ab50 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9695b59700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9690159760 0x7f96900af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53882/0 (socket says 172.21.15.55:53882) 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9695b59700 1 -- 172.21.15.55:0/2494747037 learned_addr learned my addr 172.21.15.55:0/2494747037 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9695358700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 0x7f96900b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758752337 0 0) 0x7f96900b3a60 con 0x7f9690159760 2023-10-06T11:16:52.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9678003570 con 0x7f9690159760 2023-10-06T11:16:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343617956 0 0) 0x7f96900af770 con 0x7f96900b3ef0 2023-10-06T11:16:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96900b3a60 con 0x7f96900b3ef0 2023-10-06T11:16:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4221680311 0 0) 0x7f9678003570 con 0x7f9690159760 2023-10-06T11:16:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 msgr2=0x7f96900b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 0x7f96900b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:52.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 >> v1:172.21.15.142:6789/0 conn(0x7f96900b3ef0 legacy=0x7f96900b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.896+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900afa40 con 0x7f9690159760 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f96800017f0 con 0x7f9690159760 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 >> v1:172.21.15.55:6789/0 conn(0x7f9690159760 legacy=0x7f96900af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9678003c20 0x7f9678004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 0x7f9678004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9678004d50 0x7f96780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900afd20 con 0x7f9678004d50 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967800bb40 con 0x7f9678003c20 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967800bd00 con 0x7f969015ab50 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9678004d50 0x7f96780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9695b59700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9678003c20 0x7f9678004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9695358700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 0x7f9678004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 -- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 msgr2=0x7f9678004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f969015ab50 0x7f9678004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 -- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9678003c20 msgr2=0x7f9678004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9678003c20 0x7f9678004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 -- 172.21.15.55:0/2494747037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9678003570 con 0x7f9678004d50 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f969635a700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9678004d50 0x7f96780051c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f96880019e0 tx=0x7f9688007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6bbaa157a809c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800c5d0 con 0x7f9678004d50 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800c730 con 0x7f9678004d50 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.897+0000 7f9694b57700 1 -- 172.21.15.55:0/2494747037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800cad0 con 0x7f9678004d50 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f9696b5b700 1 -- 172.21.15.55:0/2494747037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9678004d50 msgr2=0x7f96780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2494747037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9678004d50 0x7f96780051c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f96880019e0 tx=0x7f9688007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:52.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f969635a700 1 -- 172.21.15.55:0/2494747037 reap_dead start 2023-10-06T11:16:52.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f9696b5b700 1 -- 172.21.15.55:0/2494747037 shutdown_connections 2023-10-06T11:16:52.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f9696b5b700 1 -- 172.21.15.55:0/2494747037 >> 172.21.15.55:0/2494747037 conn(0x7f96900d0f20 msgr2=0x7f96900afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:52.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f9696b5b700 1 -- 172.21.15.55:0/2494747037 shutdown_connections 2023-10-06T11:16:52.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.898+0000 7f9696b5b700 1 -- 172.21.15.55:0/2494747037 wait complete. 2023-10-06T11:16:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.899+0000 7f9696b5b700 1 Processor -- start 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.899+0000 7f9696b5b700 1 -- start start 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9696b5b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 0x7f96900a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9696b5b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96901582e0 0x7f96900b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9696b5b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96900b1520 0x7f96901560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9696b5b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900a8d60 con 0x7f9690169790 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9696b5b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b19a0 con 0x7f96901582e0 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9696b5b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900a8150 con 0x7f96900b1520 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 0x7f96900a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 0x7f96900a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56518/0 (socket says 172.21.15.55:56518) 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 -- 172.21.15.55:0/2906425087 learned_addr learned my addr 172.21.15.55:0/2906425087 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695358700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96901582e0 0x7f96900b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f969635a700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96900b1520 0x7f96901560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 -- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96900b1520 msgr2=0x7f96901560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96900b1520 0x7f96901560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 -- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96901582e0 msgr2=0x7f96900b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96901582e0 0x7f96900b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 -- 172.21.15.55:0/2906425087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900a8430 con 0x7f9690169790 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695358700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96901582e0 0x7f96900b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.900+0000 7f9695b59700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 0x7f96900a77e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9680007c90 tx=0x7f9680002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.901+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96800133f0 con 0x7f9690169790 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.901+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680013550 con 0x7f9690169790 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.901+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900a8710 con 0x7f9690169790 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.901+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680013910 con 0x7f9690169790 2023-10-06T11:16:52.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.901+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96900a7d20 con 0x7f9690169790 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.902+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9690088e20 con 0x7f9690169790 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.902+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9680013c80 con 0x7f9690169790 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.903+0000 7f968dffb700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f967c066f30 0x7f967c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.903+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f96800858d0 con 0x7f9690169790 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.903+0000 7f9695358700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f967c066f30 0x7f967c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.903+0000 7f9695358700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f967c066f30 0x7f967c0693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f969016d2f0 tx=0x7f9684008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:52.907+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9680052850 con 0x7f9690169790 2023-10-06T11:16:53.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.151+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96900b3410 con 0x7f9690169790 2023-10-06T11:16:53.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.151+0000 7f968dffb700 1 -- 172.21.15.55:0/2906425087 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f9680055e70 con 0x7f9690169790 2023-10-06T11:16:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:53.154 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7128,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:53.107107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f967c066f30 msgr2=0x7f967c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f967c066f30 0x7f967c0693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f969016d2f0 tx=0x7f9684008040 comp rx=0 tx=0).stop 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 msgr2=0x7f96900a77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 0x7f96900a77e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9680007c90 tx=0x7f9680002170 comp rx=0 tx=0).stop 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 shutdown_connections 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f967c066f30 0x7f967c0693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9690169790 0x7f96900a77e0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96900b1520 0x7f96901560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 --2- 172.21.15.55:0/2906425087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96901582e0 0x7f96900b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 >> 172.21.15.55:0/2906425087 conn(0x7f96900d0f20 msgr2=0x7f96900cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 shutdown_connections 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.154+0000 7f9696b5b700 1 -- 172.21.15.55:0/2906425087 wait complete. 2023-10-06T11:16:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-10-06T11:16:53.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:33.613713+0000', 'modified': '2023-10-06T11:16:53.107107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7149': {'gid': 7149, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6835/2083914208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 2083914208}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 2083914208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:53.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:16:53.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:16:53.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.696+0000 7fbfc163c700 1 Processor -- start 2023-10-06T11:16:53.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.696+0000 7fbfc163c700 1 -- start start 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc163c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfbc159770 0x7fbfbc067970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc163c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0c8840 con 0x7fbfbc1593a0 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc163c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0c7c30 con 0x7fbfbc0c76c0 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc163c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc06e780 con 0x7fbfbc159770 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc0e3b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfbc159770 0x7fbfbc067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfbbfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbfbc1593a0 0x7fbfbc0aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53888/0 (socket says 172.21.15.55:53888) 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfbbfff700 1 -- 172.21.15.55:0/2037265842 learned_addr learned my addr 172.21.15.55:0/2037265842 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/2037265842 >> v1:172.21.15.142:6789/0 conn(0x7fbfbc0c76c0 legacy=0x7fbfbc06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/2037265842 >> v1:172.21.15.55:6789/0 conn(0x7fbfbc1593a0 legacy=0x7fbfbc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/2037265842 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0c7f10 con 0x7fbfbc159770 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.697+0000 7fbfbaffd700 1 -- 172.21.15.55:0/2037265842 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287026383 0 0) 0x7fbfbc0c8840 con 0x7fbfbc1593a0 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/2037265842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc159770 0x7fbfbc067970 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009e60 tx=0x7fbfb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2e52a9c3b36053 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfbaffd700 1 -- 172.21.15.55:0/2037265842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400e070 con 0x7fbfbc159770 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfbaffd700 1 -- 172.21.15.55:0/2037265842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb400bbf0 con 0x7fbfbc159770 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfbaffd700 1 -- 172.21.15.55:0/2037265842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4012430 con 0x7fbfbc159770 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 -- 172.21.15.55:0/2037265842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc159770 msgr2=0x7fbfbc067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 --2- 172.21.15.55:0/2037265842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc159770 0x7fbfbc067970 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009e60 tx=0x7fbfb4009780 comp rx=0 tx=0).stop 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 -- 172.21.15.55:0/2037265842 shutdown_connections 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 --2- 172.21.15.55:0/2037265842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc159770 0x7fbfbc067970 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 -- 172.21.15.55:0/2037265842 >> 172.21.15.55:0/2037265842 conn(0x7fbfbc0cdbb0 msgr2=0x7fbfbc0c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 -- 172.21.15.55:0/2037265842 shutdown_connections 2023-10-06T11:16:53.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.698+0000 7fbfc163c700 1 -- 172.21.15.55:0/2037265842 wait complete. 2023-10-06T11:16:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.699+0000 7fbfc163c700 1 Processor -- start 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 -- start start 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfbc0c76c0 0x7fbfbc0c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 0x7fbfbc154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfbc159770 0x7fbfbc15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc157660 con 0x7fbfbc1593a0 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15d550 con 0x7fbfbc0c76c0 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfc163c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15d830 con 0x7fbfbc159770 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.700+0000 7fbfbb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 0x7fbfbc154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 0x7fbfbc154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56532/0 (socket says 172.21.15.55:56532) 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3071191558 learned_addr learned my addr 172.21.15.55:0/3071191558 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfbc0c76c0 0x7fbfbc0c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfbc159770 0x7fbfbc15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfbc159770 msgr2=0x7fbfbc15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfbc159770 0x7fbfbc15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfbc0c76c0 msgr2=0x7fbfbc0c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfbc0c76c0 0x7fbfbc0c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3071191558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4009a20 con 0x7fbfbc1593a0 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfbc0c76c0 0x7fbfbc0c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfbc159770 0x7fbfbc15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 0x7fbfbc154740 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c5d0 tx=0x7fbfac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfb3fff700 1 -- 172.21.15.55:0/3071191558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac011590 con 0x7fbfbc1593a0 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfb3fff700 1 -- 172.21.15.55:0/3071191558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac011710 con 0x7fbfbc1593a0 2023-10-06T11:16:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc15db10 con 0x7fbfbc1593a0 2023-10-06T11:16:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfb3fff700 1 -- 172.21.15.55:0/3071191558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac011ad0 con 0x7fbfbc1593a0 2023-10-06T11:16:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.701+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc154c80 con 0x7fbfbc1593a0 2023-10-06T11:16:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.703+0000 7fbfb3fff700 1 -- 172.21.15.55:0/3071191558 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfac01c460 con 0x7fbfbc1593a0 2023-10-06T11:16:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.703+0000 7fbfb3fff700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbf9c066f30 0x7fbf9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.703+0000 7fbfb3fff700 1 -- 172.21.15.55:0/3071191558 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbfac084620 con 0x7fbfbc1593a0 2023-10-06T11:16:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.703+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbf9c066f30 0x7fbf9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.704+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbf9c066f30 0x7fbf9c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4007fd0 tx=0x7fbfa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.705+0000 7fbfcbb96b80 1 Processor -- start 2023-10-06T11:16:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.705+0000 7fbfcbb96b80 1 -- start start 2023-10-06T11:16:53.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 0x55d1d759dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75e7bc0 0x55d1d75c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75c6e60 0x55d1d7599990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d751dc80 con 0x55d1d759d950 2023-10-06T11:16:53.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d74f4a70 con 0x55d1d75e7bc0 2023-10-06T11:16:53.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1d74f2270 con 0x55d1d75c6e60 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 0x55d1d759dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 0x55d1d759dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56546/0 (socket says 172.21.15.55:56546) 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 -- 172.21.15.55:0/3629175982 learned_addr learned my addr 172.21.15.55:0/3629175982 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75e7bc0 0x55d1d75c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75c6e60 0x55d1d7599990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 -- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75c6e60 msgr2=0x55d1d7599990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75c6e60 0x55d1d7599990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 -- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75e7bc0 msgr2=0x55d1d75c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75e7bc0 0x55d1d75c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 -- 172.21.15.55:0/3629175982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1d7388270 con 0x55d1d759d950 2023-10-06T11:16:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75c6e60 0x55d1d7599990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75e7bc0 0x55d1d75c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 0x55d1d759dd20 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005dd0 tx=0x7fbfa4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e04c31e5d39c53b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.706+0000 7fbfb17fa700 1 -- 172.21.15.55:0/3629175982 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400d870 con 0x55d1d759d950 2023-10-06T11:16:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfb17fa700 1 -- 172.21.15.55:0/3629175982 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa400d9d0 con 0x55d1d759d950 2023-10-06T11:16:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfb17fa700 1 -- 172.21.15.55:0/3629175982 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400dd50 con 0x55d1d759d950 2023-10-06T11:16:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3629175982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 msgr2=0x55d1d759dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 0x55d1d759dd20 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005dd0 tx=0x7fbfa4012000 comp rx=0 tx=0).stop 2023-10-06T11:16:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3629175982 shutdown_connections 2023-10-06T11:16:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d759d950 0x55d1d759dd20 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75c6e60 0x55d1d7599990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3629175982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75e7bc0 0x55d1d75c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3629175982 >> 172.21.15.55:0/3629175982 conn(0x55d1d759f270 msgr2=0x55d1d759f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3629175982 shutdown_connections 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.707+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3629175982 wait complete. 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.708+0000 7fbfcbb96b80 1 -- start start 2023-10-06T11:16:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.708+0000 7fbfcbb96b80 1 Processor -- start 2023-10-06T11:16:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d75e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75946e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d74ee060 con 0x55d1d75c6e60 2023-10-06T11:16:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d7499890 con 0x55d1d759d950 2023-10-06T11:16:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1d74b4ea0 con 0x55d1d75e7bc0 2023-10-06T11:16:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 10 client.0 _ll_register_callbacks cb 0x55d1d738af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75941a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56550/0 (socket says 172.21.15.55:56550) 2023-10-06T11:16:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3037475313 learned_addr learned my addr 172.21.15.55:0/3037475313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 msgr2=0x55d1d75946e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d75e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 msgr2=0x55d1d75e19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d75e19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3037475313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa4005960 con 0x55d1d75c6e60 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75941a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00a040 tx=0x7fbfac084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fcd80c09a7f0fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbf9a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3037475313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac058530 con 0x55d1d75c6e60 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3037475313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbfac05c200 con 0x55d1d75c6e60 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.709+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1d7592690 con 0x55d1d75c6e60 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3037475313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfac0556d0 con 0x55d1d75c6e60 2023-10-06T11:16:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 10 client.7185 fetch_fsmap learned FSMap version 66 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55d1d732afe0 con 0x55d1d75c6e60 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3037475313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1d7592690 con 0x55d1d75c6e60 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3037475313 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbfac054750 con 0x55d1d75c6e60 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 10 client.7185 fetch_fsmap finished waiting for FSMap version 66 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 10 client.7185 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 20 client.7185 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75dd7f0 0x55d1d75ddbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 4 client.7185 mds_command: new command op to 7149 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 --> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1d756f5c0 con 0x55d1d75dd7f0 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75dd7f0 0x55d1d75ddbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75dd7f0 0x55d1d75ddbc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f83a096373b3a0c server_cookie=567d378a139f0b34 in_seq=0 out_seq=0 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.710+0000 7fbf9a7fc700 10 client.7185 ms_handle_connect on v2:172.21.15.55:6834/2083914208 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3037475313 <== mds.0 v2:172.21.15.55:6834/2083914208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d1d756f5c0 con 0x55d1d75dd7f0 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbf9a7fc700 10 client.7185 handle_command_reply: tid=0 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 client.7185 shutdown 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 msgr2=0x55d1d75941a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75941a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00a040 tx=0x7fbfac084040 comp rx=0 tx=0).stop 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 shutdown_connections 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75dd7f0 0x55d1d75ddbc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d75e19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbf9a7fc700 0 client.7185 ms_handle_reset on v2:172.21.15.55:6834/2083914208 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3037475313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75941a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 >> 172.21.15.55:0/3037475313 conn(0x55d1d759f270 msgr2=0x55d1d75c3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 shutdown_connections 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3037475313 wait complete. 2023-10-06T11:16:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.711+0000 7fbfcbb96b80 20 client.7185 trim_cache size 0 max 16384 2023-10-06T11:16:53.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.728+0000 7fbfcbb96b80 1 Processor -- start 2023-10-06T11:16:53.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.728+0000 7fbfcbb96b80 1 -- start start 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d759d950 0x55d1d75cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75c6e60 0x55d1d75ddbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 0x55d1d75de100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d7370e30 con 0x55d1d75e7bc0 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d759cbb0 con 0x55d1d75c6e60 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1d7599c90 con 0x55d1d759d950 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 0x55d1d75de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 0x55d1d75de100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56560/0 (socket says 172.21.15.55:56560) 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/964519195 learned_addr learned my addr 172.21.15.55:0/964519195 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75c6e60 0x55d1d75ddbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d759d950 0x55d1d75cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d759d950 msgr2=0x55d1d75cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d759d950 0x55d1d75cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75c6e60 msgr2=0x55d1d75ddbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75c6e60 0x55d1d75ddbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfc0e3b700 1 -- 172.21.15.55:0/964519195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1d74bc780 con 0x55d1d75e7bc0 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.729+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75c6e60 0x55d1d75ddbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:53.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 0x55d1d75de100 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40094d0 tx=0x7fbfb4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e94beccd4a36576 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfb1ffb700 1 -- 172.21.15.55:0/964519195 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40127a0 con 0x55d1d75e7bc0 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfb1ffb700 1 -- 172.21.15.55:0/964519195 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4012900 con 0x55d1d75e7bc0 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfb1ffb700 1 -- 172.21.15.55:0/964519195 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4012cc0 con 0x55d1d75e7bc0 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/964519195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 msgr2=0x55d1d75de100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 0x55d1d75de100 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40094d0 tx=0x7fbfb4018000 comp rx=0 tx=0).stop 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/964519195 shutdown_connections 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75e7bc0 0x55d1d75de100 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d759d950 0x55d1d75cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/964519195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d75c6e60 0x55d1d75ddbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/964519195 >> 172.21.15.55:0/964519195 conn(0x55d1d759f270 msgr2=0x55d1d759a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/964519195 shutdown_connections 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.730+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/964519195 wait complete. 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.731+0000 7fbfcbb96b80 1 -- start start 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.731+0000 7fbfcbb96b80 1 Processor -- start 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d76477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75e1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d764b180 con 0x55d1d75c6e60 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d75fd520 con 0x55d1d759d950 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1d75fd6c0 con 0x55d1d75e7bc0 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 10 client.0 _ll_register_callbacks cb 0x55d1d738af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75fcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56576/0 (socket says 172.21.15.55:56576) 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3270176445 learned_addr learned my addr 172.21.15.55:0/3270176445 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d76477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfc0e3b700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 msgr2=0x55d1d75e1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75e1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 msgr2=0x55d1d76477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d76477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 -- 172.21.15.55:0/3270176445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc0c7f10 con 0x55d1d75c6e60 2023-10-06T11:16:53.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfbb7fe700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75fcfe0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fbfac007fd0 tx=0x7fbfac06c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d71562761ddc97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbf9a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:53.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3270176445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0556d0 con 0x55d1d75c6e60 2023-10-06T11:16:53.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3270176445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbfac05c200 con 0x55d1d75c6e60 2023-10-06T11:16:53.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbfa400d9d0 con 0x55d1d75c6e60 2023-10-06T11:16:53.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3270176445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfac00e040 con 0x55d1d75c6e60 2023-10-06T11:16:53.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 10 client.7191 fetch_fsmap learned FSMap version 66 2023-10-06T11:16:53.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.732+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55d1d74a3470 con 0x55d1d75c6e60 2023-10-06T11:16:53.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3270176445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa400d9d0 con 0x55d1d75c6e60 2023-10-06T11:16:53.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3270176445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbfac054750 con 0x55d1d75c6e60 2023-10-06T11:16:53.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 10 client.7191 fetch_fsmap finished waiting for FSMap version 66 2023-10-06T11:16:53.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 10 client.7191 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:16:53.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 20 client.7191 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:53.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75e1d00 0x55d1d75c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 4 client.7191 mds_command: new command op to 7149 tid=0[{"prefix": "status"}] 2023-10-06T11:16:53.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 --> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1d7490e00 con 0x55d1d75e1d00 2023-10-06T11:16:53.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75e1d00 0x55d1d75c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbf9a7fc700 10 client.7191 ms_handle_connect on v2:172.21.15.55:6834/2083914208 2023-10-06T11:16:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfbbfff700 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75e1d00 0x55d1d75c1a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aac5424c4e0533e server_cookie=27e42b24ca08d244 in_seq=0 out_seq=0 2023-10-06T11:16:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbf9a7fc700 1 -- 172.21.15.55:0/3270176445 <== mds.0 v2:172.21.15.55:6834/2083914208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d1d7490e00 con 0x55d1d75e1d00 2023-10-06T11:16:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbf9a7fc700 10 client.7191 handle_command_reply: tid=0 2023-10-06T11:16:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 1 client.7191 shutdown 2023-10-06T11:16:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 msgr2=0x55d1d75fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.733+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75fcfe0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fbfac007fd0 tx=0x7fbfac06c000 comp rx=0 tx=0).stop 2023-10-06T11:16:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 shutdown_connections 2023-10-06T11:16:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55d1d75e1d00 0x55d1d75c1a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1d75e7bc0 0x55d1d75e1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1d759d950 0x55d1d76477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 --2- 172.21.15.55:0/3270176445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d1d75c6e60 0x55d1d75fcfe0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbf9a7fc700 0 client.7191 ms_handle_reset on v2:172.21.15.55:6834/2083914208 2023-10-06T11:16:53.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 >> 172.21.15.55:0/3270176445 conn(0x55d1d759f270 msgr2=0x55d1d75dc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 shutdown_connections 2023-10-06T11:16:53.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 1 -- 172.21.15.55:0/3270176445 wait complete. 2023-10-06T11:16:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfcbb96b80 20 client.7191 trim_cache size 0 max 16384 2023-10-06T11:16:53.748 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:16:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:16:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:16:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7149, 2023-10-06T11:16:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:16:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:16:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:16:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 3.6349399579999999, 2023-10-06T11:16:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 66, 2023-10-06T11:16:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 107, 2023-10-06T11:16:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 107, 2023-10-06T11:16:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 4.4860066549999997 2023-10-06T11:16:53.750 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:16:53.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbf9c066f30 msgr2=0x7fbf9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbf9c066f30 0x7fbf9c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4007fd0 tx=0x7fbfa4009040 comp rx=0 tx=0).stop 2023-10-06T11:16:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 msgr2=0x7fbfbc154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 0x7fbfbc154740 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c5d0 tx=0x7fbfac007f60 comp rx=0 tx=0).stop 2023-10-06T11:16:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 shutdown_connections 2023-10-06T11:16:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbf9c066f30 0x7fbf9c0693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfbc159770 0x7fbfbc15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfbc0c76c0 0x7fbfbc0c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 --2- 172.21.15.55:0/3071191558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfbc1593a0 0x7fbfbc154740 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 >> 172.21.15.55:0/3071191558 conn(0x7fbfbc0cdbb0 msgr2=0x7fbfbc0676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 shutdown_connections 2023-10-06T11:16:53.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.734+0000 7fbfc163c700 1 -- 172.21.15.55:0/3071191558 wait complete. 2023-10-06T11:16:53.755 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:53.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.872+0000 7fd16a63f700 1 Processor -- start 2023-10-06T11:16:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.872+0000 7fd16a63f700 1 -- start start 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd16a63f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1640cb0c0 0x7fd1640cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd16a63f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd164158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd16a63f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1640ccc10 con 0x7fd1640ceb40 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd16a63f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1640cb630 con 0x7fd1640cb0c0 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd16a63f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640cb910 con 0x7fd1640cef10 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1640cb0c0 0x7fd1640cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1640cb0c0 0x7fd1640cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56580/0 (socket says 172.21.15.55:56580) 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 -- 172.21.15.55:0/4079208092 learned_addr learned my addr 172.21.15.55:0/4079208092 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd163fff700 1 --1- 172.21.15.55:0/4079208092 >> v1:172.21.15.55:6789/0 conn(0x7fd1640ceb40 0x7fd1640c6670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53894/0 (socket says 172.21.15.55:53894) 2023-10-06T11:16:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd168bdc700 1 --2- 172.21.15.55:0/4079208092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd164158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 -- 172.21.15.55:0/4079208092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 msgr2=0x7fd164158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 --2- 172.21.15.55:0/4079208092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd164158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 -- 172.21.15.55:0/4079208092 >> v1:172.21.15.55:6789/0 conn(0x7fd1640ceb40 legacy=0x7fd1640c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 -- 172.21.15.55:0/4079208092 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640cbbf0 con 0x7fd1640cb0c0 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd162ffd700 1 -- 172.21.15.55:0/4079208092 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480998981 0 0) 0x7fd1640ccc10 con 0x7fd1640ceb40 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd1637fe700 1 --2- 172.21.15.55:0/4079208092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640cb0c0 0x7fd1640cc6d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd1580099e0 tx=0x7fd158009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a08b0fb196179 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd162ffd700 1 -- 172.21.15.55:0/4079208092 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800b820 con 0x7fd1640cb0c0 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd162ffd700 1 -- 172.21.15.55:0/4079208092 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15800b980 con 0x7fd1640cb0c0 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.873+0000 7fd162ffd700 1 -- 172.21.15.55:0/4079208092 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800bd20 con 0x7fd1640cb0c0 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 -- 172.21.15.55:0/4079208092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640cb0c0 msgr2=0x7fd1640cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 --2- 172.21.15.55:0/4079208092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640cb0c0 0x7fd1640cc6d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd1580099e0 tx=0x7fd158009250 comp rx=0 tx=0).stop 2023-10-06T11:16:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 -- 172.21.15.55:0/4079208092 shutdown_connections 2023-10-06T11:16:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 --2- 172.21.15.55:0/4079208092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd164158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 --2- 172.21.15.55:0/4079208092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640cb0c0 0x7fd1640cc6d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 -- 172.21.15.55:0/4079208092 >> 172.21.15.55:0/4079208092 conn(0x7fd1640d0550 msgr2=0x7fd1640d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 -- 172.21.15.55:0/4079208092 shutdown_connections 2023-10-06T11:16:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.874+0000 7fd16a63f700 1 -- 172.21.15.55:0/4079208092 wait complete. 2023-10-06T11:16:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.875+0000 7fd16a63f700 1 Processor -- start 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.875+0000 7fd16a63f700 1 -- start start 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd16a63f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1640cb0c0 0x7fd16414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd16a63f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 0x7fd1640b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd16a63f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd1640d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd16a63f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640b35f0 con 0x7fd1640ceb40 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd16a63f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd164150030 con 0x7fd1640cb0c0 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd16a63f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16414ef90 con 0x7fd1640cef10 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 0x7fd1640b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 0x7fd1640b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56590/0 (socket says 172.21.15.55:56590) 2023-10-06T11:16:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 -- 172.21.15.55:0/739997531 learned_addr learned my addr 172.21.15.55:0/739997531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd168bdc700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd1640d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd163fff700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1640cb0c0 0x7fd16414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 -- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 msgr2=0x7fd1640d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd1640d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 -- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1640cb0c0 msgr2=0x7fd16414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1640cb0c0 0x7fd16414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.876+0000 7fd1637fe700 1 -- 172.21.15.55:0/739997531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580094f0 con 0x7fd1640ceb40 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.877+0000 7fd1637fe700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 0x7fd1640b41d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd158006fd0 tx=0x7fd158017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.877+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15801f070 con 0x7fd1640ceb40 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.877+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd158002f70 con 0x7fd1640ceb40 2023-10-06T11:16:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.877+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16414f270 con 0x7fd1640ceb40 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.877+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800b820 con 0x7fd1640ceb40 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.877+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16414f830 con 0x7fd1640ceb40 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.878+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16404c380 con 0x7fd1640ceb40 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.878+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd158023070 con 0x7fd1640ceb40 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.879+0000 7fd14bfff700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd150066f30 0x7fd1500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.879+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd158085bc0 con 0x7fd1640ceb40 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.879+0000 7fd163fff700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd150066f30 0x7fd1500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.879+0000 7fd163fff700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd150066f30 0x7fd1500693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd154007fd0 tx=0x7fd154007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:53.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:53.883+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd158052bc0 con 0x7fd1640ceb40 2023-10-06T11:16:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.120+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1640cbed0 con 0x7fd1640ceb40 2023-10-06T11:16:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.120+0000 7fd14bfff700 1 -- 172.21.15.55:0/739997531 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd15802a070 con 0x7fd1640ceb40 2023-10-06T11:16:54.122 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd150066f30 msgr2=0x7fd1500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd150066f30 0x7fd1500693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd154007fd0 tx=0x7fd154007d50 comp rx=0 tx=0).stop 2023-10-06T11:16:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 msgr2=0x7fd1640b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 0x7fd1640b41d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd158006fd0 tx=0x7fd158017000 comp rx=0 tx=0).stop 2023-10-06T11:16:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 shutdown_connections 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd150066f30 0x7fd1500693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1640cef10 0x7fd1640d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1640cb0c0 0x7fd16414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 --2- 172.21.15.55:0/739997531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1640ceb40 0x7fd1640b41d0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.122+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 >> 172.21.15.55:0/739997531 conn(0x7fd1640d0550 msgr2=0x7fd1640ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.123+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 shutdown_connections 2023-10-06T11:16:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.123+0000 7fd16a63f700 1 -- 172.21.15.55:0/739997531 wait complete. 2023-10-06T11:16:54.136 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:16:54.136 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:54.136 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-10-06T11:16:54.136 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:16:54.136 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:54.137 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:16:54.137 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:16:54.137 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:54.137 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:54.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.137 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-10-06T11:16:54.153 INFO:teuthology.orchestra.run.smithi055.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42279sec preferred_lft 42279sec 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-10-06T11:16:54.154 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::647e:7ff:fe4e:d600/64 scope link 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1a:ea:9d:4c:b0:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::18ea:9dff:fe4c:b047/64 scope link 2023-10-06T11:16:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.156 INFO:teuthology.orchestra.run.smithi055.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 96:3f:16:4b:28:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:16:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::943f:16ff:fe4b:2896/64 scope link 2023-10-06T11:16:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:54.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.156 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:54.217 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-10-06T11:16:54.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.219 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-10-06T11:16:54.276 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-10-06T11:16:54.276 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:54.276 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T11:16:54.276 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T11:16:54.276 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:54.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.277 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-10-06T11:16:54.277 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-10-06T11:16:54.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T11:16:54.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T11:16:54.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T11:16:54.277 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-10-06T11:16:54.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.379 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:16:54.393 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:16:54.394 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:16:54.394 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:54.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-10-06T11:16:54.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:54.459 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:54.515 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:54.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:54.515 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:54.570 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T11:16:54.570 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:54.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:54.651 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:54.651 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:54.670 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:54.671 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:54.671 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:54.692 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:54.692 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:54.692 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:54.692 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:16:54.693 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:16:54.694 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:16:54.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:54.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:54.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.916+0000 7efc9f73b700 1 Processor -- start 2023-10-06T11:16:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.916+0000 7efc9f73b700 1 -- start start 2023-10-06T11:16:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9f73b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc98159590 0x7efc98068360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9f73b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc9806e5e0 0x7efc9806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9f73b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc980acb10 con 0x7efc9806ef90 2023-10-06T11:16:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9f73b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980c84b0 con 0x7efc98159590 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9f73b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9806f3d0 con 0x7efc9806e5e0 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9d4d7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efc98159590 0x7efc98068360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9dcd8700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efc9806ef90 0x7efc9815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60070/0 (socket says 172.21.15.55:60070) 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.917+0000 7efc9dcd8700 1 -- 172.21.15.55:0/1917665623 learned_addr learned my addr 172.21.15.55:0/1917665623 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9d4d7700 1 -- 172.21.15.55:0/1917665623 >> v2:172.21.15.142:3300/0 conn(0x7efc9806e5e0 msgr2=0x7efc9806ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9ccd6700 1 --2- 172.21.15.55:0/1917665623 >> v2:172.21.15.142:3300/0 conn(0x7efc9806e5e0 0x7efc9806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9d4d7700 1 --2- 172.21.15.55:0/1917665623 >> v2:172.21.15.142:3300/0 conn(0x7efc9806e5e0 0x7efc9806ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9d4d7700 1 -- 172.21.15.55:0/1917665623 >> v1:172.21.15.55:6789/0 conn(0x7efc9806ef90 legacy=0x7efc9815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc97fff700 1 -- 172.21.15.55:0/1917665623 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323012476 0 0) 0x7efc980acb10 con 0x7efc9806ef90 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9d4d7700 1 -- 172.21.15.55:0/1917665623 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc980c78a0 con 0x7efc98159590 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9ccd6700 1 --2- 172.21.15.55:0/1917665623 >> v2:172.21.15.142:3300/0 conn(0x7efc9806e5e0 0x7efc9806ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc9d4d7700 1 --2- 172.21.15.55:0/1917665623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc98068360 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7efc9815d1c0 tx=0x7efc900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9898e9905bf5553 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc97fff700 1 -- 172.21.15.55:0/1917665623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000b6b0 con 0x7efc98159590 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc97fff700 1 -- 172.21.15.55:0/1917665623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000b810 con 0x7efc98159590 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.918+0000 7efc97fff700 1 -- 172.21.15.55:0/1917665623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000bbb0 con 0x7efc98159590 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 -- 172.21.15.55:0/1917665623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 msgr2=0x7efc98068360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 --2- 172.21.15.55:0/1917665623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc98068360 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7efc9815d1c0 tx=0x7efc900091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 -- 172.21.15.55:0/1917665623 shutdown_connections 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 --2- 172.21.15.55:0/1917665623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc98068360 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 --2- 172.21.15.55:0/1917665623 >> v2:172.21.15.142:3300/0 conn(0x7efc9806e5e0 0x7efc9806ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 -- 172.21.15.55:0/1917665623 >> 172.21.15.55:0/1917665623 conn(0x7efc9806a530 msgr2=0x7efc9806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 -- 172.21.15.55:0/1917665623 shutdown_connections 2023-10-06T11:16:54.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.919+0000 7efc9f73b700 1 -- 172.21.15.55:0/1917665623 wait complete. 2023-10-06T11:16:54.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.920+0000 7efc9f73b700 1 Processor -- start 2023-10-06T11:16:54.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.920+0000 7efc9f73b700 1 -- start start 2023-10-06T11:16:54.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc9806e5e0 0x7efc98156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:54.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc9806ef90 0x7efc980ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc980ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980aa6e0 con 0x7efc98159590 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980a9e40 con 0x7efc9806ef90 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc980aa120 con 0x7efc9806e5e0 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc980ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc980ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44882/0 (socket says 172.21.15.55:44882) 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 -- 172.21.15.55:0/753293490 learned_addr learned my addr 172.21.15.55:0/753293490 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9ccd6700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc9806ef90 0x7efc980ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9d4d7700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc9806e5e0 0x7efc98156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 -- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc9806e5e0 msgr2=0x7efc98156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:54.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc9806e5e0 0x7efc98156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 -- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc9806ef90 msgr2=0x7efc980ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc9806ef90 0x7efc980ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 -- 172.21.15.55:0/753293490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009420 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9dcd8700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc980ae060 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efc8800cc90 tx=0x7efc88001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800cea0 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8800ab70 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc980aa400 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.921+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880070f0 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.922+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc980abe10 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.922+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980b0990 con 0x7efc98159590 2023-10-06T11:16:54.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.923+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc880074a0 con 0x7efc98159590 2023-10-06T11:16:54.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.923+0000 7efc957fa700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efc84066f30 0x7efc840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:54.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.923+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6464+0+0 (secure 0 0 0) 0x7efc88084d20 con 0x7efc98159590 2023-10-06T11:16:54.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.923+0000 7efc9d4d7700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efc84066f30 0x7efc840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:54.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.924+0000 7efc9d4d7700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efc84066f30 0x7efc840693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efc900093f0 tx=0x7efc90017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:54.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:54.927+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc980b0990 con 0x7efc98159590 2023-10-06T11:16:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.174+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc980b0990 con 0x7efc98159590 2023-10-06T11:16:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.174+0000 7efc957fa700 1 -- 172.21.15.55:0/753293490 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc980b0990 con 0x7efc98159590 2023-10-06T11:16:55.176 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:55.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efc84066f30 msgr2=0x7efc840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:55.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efc84066f30 0x7efc840693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efc900093f0 tx=0x7efc90017000 comp rx=0 tx=0).stop 2023-10-06T11:16:55.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 msgr2=0x7efc980ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:55.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc980ae060 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efc8800cc90 tx=0x7efc88001a80 comp rx=0 tx=0).stop 2023-10-06T11:16:55.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 shutdown_connections 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7efc84066f30 0x7efc840693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc98159590 0x7efc980ae060 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc9806e5e0 0x7efc98156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 --2- 172.21.15.55:0/753293490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc9806ef90 0x7efc980ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 >> 172.21.15.55:0/753293490 conn(0x7efc9806a530 msgr2=0x7efc980acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 shutdown_connections 2023-10-06T11:16:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:55.176+0000 7efc9f73b700 1 -- 172.21.15.55:0/753293490 wait complete. 2023-10-06T11:16:55.190 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T11:16:55.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:55.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-10-06T11:16:55.191 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:16:55.191 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:55.191 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T11:16:55.191 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T11:16:55.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:55.192 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:55.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.192 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-10-06T11:16:55.211 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::6cc3:ceff:fe65:a354/64 scope link 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 76:d2:fe:0e:b9:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::74d2:feff:fe0e:b9c9/64 scope link 2023-10-06T11:16:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.215 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 26:c8:ee:fc:b9:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:16:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::24c8:eeff:fefc:b9cc/64 scope link 2023-10-06T11:16:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:55.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.216 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:55.278 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-10-06T11:16:55.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.281 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-10-06T11:16:55.338 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-10-06T11:16:55.338 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:55.338 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:16:55.339 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:16:55.339 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:55.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.339 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-10-06T11:16:55.339 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-10-06T11:16:55.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:16:55.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:16:55.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:16:55.340 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-10-06T11:16:55.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.443 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:16:55.458 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:16:55.458 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:16:55.458 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:55.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-10-06T11:16:55.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:55.523 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:55.577 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:16:55.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:55.578 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:55.632 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T11:16:55.632 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:55.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:55.712 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:55.712 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:55.730 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:55.730 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:55.753 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@2bd5b0c1-a996-4dae-ab19-fd6663182240.cephfs=/ 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T11:16:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790" 2023-10-06T11:16:55.755 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2023-10-06T11:16:55.755 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=2bd5b0c1-a996-4dae-ab19-fd6663182240" will pass to kernel 2023-10-06T11:16:55.755 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T11:16:55.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:55.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:16:55.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-06T11:16:55.968 INFO:teuthology.orchestra.run.smithi055.stdout:[{"id":6622,"entity":{"name":{"type":"client","num":6622},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":921785645}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":0.21099599299999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99952647057182276,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6622 v1:192.168.0.1:0/921785645","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x0000000000007bff"},"metric_spec":{"metric_flags":{"feature_bits":"0x00000000000003ff"}},"entity_id":"1","hostname":"smithi142","kernel_version":"4.18.0-425.3.1.el8.x86_64","root":"/"}},{"id":7203,"entity":{"name":{"type":"client","num":7203},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":2743705528}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1.2729758259999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99707694447036732,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7203 v1:192.168.0.1:0/2743705528","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x0000000000007bff"},"metric_spec":{"metric_flags":{"feature_bits":"0x00000000000003ff"}},"entity_id":"0","hostname":"smithi055","kernel_version":"4.18.0-425.3.1.el8.x86_64","root":"/"}}] 2023-10-06T11:16:55.969 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "entity_id": "1", "hostname": "smithi142", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 921785645, "type": "v1" }, "name": { "num": 6622, "type": "client" } }, "id": 6622, "inst": "client.6622 v1:192.168.0.1:0/921785645", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9995264705718228 }, "state": "open", "uptime": 0.210995993 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "entity_id": "0", "hostname": "smithi055", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2743705528, "type": "v1" }, "name": { "num": 7203, "type": "client" } }, "id": 7203, "inst": "client.7203 v1:192.168.0.1:0/2743705528", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9970769444703673 }, "state": "open", "uptime": 1.272975826 } ] 2023-10-06T11:16:55.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T11:16:56.100 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-10-06T11:16:56.098+0000 7ffa31220700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:56.131 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2023-10-06T11:16:56.131 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:16:56.132 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2023-10-06T11:16:56.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.165+0000 7fb1c7e46240 1 -- start start 2023-10-06T11:16:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.165+0000 7fb1c7e46240 1 Processor -- start 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.165+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564847532400 0x564847524580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.165+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 0x564847524b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.165+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847532c00 0x564847525080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.165+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648467acdc0 con 0x564847532800 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648467adcc0 con 0x564847532c00 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648467adb80 con 0x564847532400 2023-10-06T11:16:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 0x564847524b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 0x564847524b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44904/0 (socket says 172.21.15.55:44904) 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c1b15700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847532c00 0x564847525080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 -- 172.21.15.55:0/2185218606 learned_addr learned my addr 172.21.15.55:0/2185218606 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c1314700 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564847532400 0x564847524580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 -- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564847532400 msgr2=0x564847524580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564847532400 0x564847524580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 -- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847532c00 msgr2=0x564847525080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847532c00 0x564847525080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 -- 172.21.15.55:0/2185218606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564846790340 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 0x564847524b00 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x5648474f9dd0 tx=0x5648474f6d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01d36c17b79ec56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1beb0f700 1 -- 172.21.15.55:0/2185218606 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5648467a5600 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1beb0f700 1 -- 172.21.15.55:0/2185218606 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5648467c2600 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1beb0f700 1 -- 172.21.15.55:0/2185218606 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5648467a51e0 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564846790000 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x564846790ea0 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1c7e46240 4 waiting for MDS map... 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.166+0000 7fb1beb0f700 1 -- 172.21.15.55:0/2185218606 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x5648467b0c40 con 0x564847532800 2023-10-06T11:16:56.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.167+0000 7fb1beb0f700 1 -- 172.21.15.55:0/2185218606 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x56484754c600 con 0x564847532800 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.167+0000 7fb1c7e46240 4 Got MDS map 66 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.167+0000 7fb1c7e46240 10 main: main 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.167+0000 7fb1c7e46240 4 main: connecting to RADOS... 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.167+0000 7fb1c7e46240 1 Processor -- start 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.167+0000 7fb1c7e46240 1 -- start start 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 0x564847525600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533c00 0x564847525b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648467ac3c0 con 0x564847533800 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648467adcc0 con 0x564847533c00 2023-10-06T11:16:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648467ac000 con 0x5648475da000 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 0x564847525600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 0x564847525600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44906/0 (socket says 172.21.15.55:44906) 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 -- 172.21.15.55:0/1706727661 learned_addr learned my addr 172.21.15.55:0/1706727661 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1314700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533c00 0x564847525b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 -- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 msgr2=0x564847526100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 -- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533c00 msgr2=0x564847525b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533c00 0x564847525b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 -- 172.21.15.55:0/1706727661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564846791860 con 0x564847533800 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1314700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533c00 0x564847525b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.168+0000 7fb1c1b15700 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 0x564847525600 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5648475592f0 tx=0x56484757ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c5f124499dcc80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1bcb0b700 1 -- 172.21.15.55:0/1706727661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5648467a5600 con 0x564847533800 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1bcb0b700 1 -- 172.21.15.55:0/1706727661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5648467c2300 con 0x564847533800 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1bcb0b700 1 -- 172.21.15.55:0/1706727661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5648467a51e0 con 0x564847533800 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 -- 172.21.15.55:0/1706727661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 msgr2=0x564847525600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 0x564847525600 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5648475592f0 tx=0x56484757ec00 comp rx=0 tx=0).stop 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 -- 172.21.15.55:0/1706727661 shutdown_connections 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533800 0x564847525600 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/1706727661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533c00 0x564847525b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 -- 172.21.15.55:0/1706727661 >> 172.21.15.55:0/1706727661 conn(0x564847533000 msgr2=0x56484685d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 -- 172.21.15.55:0/1706727661 shutdown_connections 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.169+0000 7fb1c7e46240 1 -- 172.21.15.55:0/1706727661 wait complete. 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 Processor -- start 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 -- start start 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533c00 0x564847526c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533800 0x564847526680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648467ad180 con 0x564847533c00 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648467ad040 con 0x564847533800 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c7e46240 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648467acf00 con 0x5648475da000 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c1b15700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533c00 0x564847526c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c1b15700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533c00 0x564847526c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44916/0 (socket says 172.21.15.55:44916) 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c1b15700 1 -- 172.21.15.55:0/4079882197 learned_addr learned my addr 172.21.15.55:0/4079882197 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.170+0000 7fb1c1314700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533800 0x564847526680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c1b15700 1 -- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 msgr2=0x564847526100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c1b15700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648475da000 0x564847526100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c1b15700 1 -- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533800 msgr2=0x564847526680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c1b15700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847533800 0x564847526680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c1b15700 1 -- 172.21.15.55:0/4079882197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648467909c0 con 0x564847533c00 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c1b15700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533c00 0x564847526c00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x564847559fb0 tx=0x56484757ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1bb308700 1 -- 172.21.15.55:0/4079882197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5648467a4dc0 con 0x564847533c00 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1bb308700 1 -- 172.21.15.55:0/4079882197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5648467c2c00 con 0x564847533c00 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564846790ea0 con 0x564847533c00 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1bb308700 1 -- 172.21.15.55:0/4079882197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5648467a5600 con 0x564847533c00 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564846790340 con 0x564847533c00 2023-10-06T11:16:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.171+0000 7fb1c7e46240 4 main: resolving pool 16 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.172+0000 7fb1bb308700 1 -- 172.21.15.55:0/4079882197 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x5648474e3080 con 0x564847533c00 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1bb308700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x5648475f4400 0x564847527700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1bb308700 1 -- 172.21.15.55:0/4079882197 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x5648467b0a80 con 0x564847533c00 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c7e46240 4 main: creating IoCtx.. 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x5648475da400 0x564847525b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- osd_op(unknown.0.0:1 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x5648475da800 con 0x5648475da400 2023-10-06T11:16:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c1314700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x5648475f4400 0x564847527700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x5648475da400 0x564847525b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c0b13700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x5648475da400 0x564847525b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c1314700 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x5648475f4400 0x564847527700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5648474f8420 tx=0x564847530300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c0b13700 1 -- 172.21.15.55:0/4079882197 <== osd.1 v2:172.21.15.55:6800/90686 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x564847542fc0 con 0x5648475da400 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.173+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- osd_op(unknown.0.0:2 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x5648475dac00 con 0x5648475da400 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c0b13700 1 -- 172.21.15.55:0/4079882197 <== osd.1 v2:172.21.15.55:6800/90686 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=479b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+479 (crc 0 0 0) 0x564847542fc0 con 0x5648475da400 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- osd_op(unknown.0.0:3 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x5648475db000 con 0x5648475da400 2023-10-06T11:16:56.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c0b13700 1 -- 172.21.15.55:0/4079882197 <== osd.1 v2:172.21.15.55:6800/90686 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x564847542fc0 con 0x5648475da400 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: "0": { 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: "data": { 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: "sessions": [ 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7203, 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": { 2023-10-06T11:16:56.186 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 7203 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2743705528 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "open", 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "num_leases": 0, 2023-10-06T11:16:56.187 INFO:teuthology.orchestra.run.smithi055.stdout: "num_caps": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "request_load_avg": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "requests_in_flight": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "num_completed_requests": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "num_completed_flushes": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "reconnecting": false, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "recall_caps": { 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 60 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "release_caps": { 2023-10-06T11:16:56.188 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 60 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "recall_caps_throttle": { 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 1.5 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "recall_caps_throttle2o": { 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 0.5 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "session_cache_liveness": { 2023-10-06T11:16:56.189 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 300 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "cap_acquisition": { 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 30 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "last_trim_completed_requests_tid": 0, 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "last_trim_completed_flushes_tid": 0, 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "delegated_inos": [], 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": "client.7203 v1:192.168.0.1:0/2743705528", 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "completed_requests": [], 2023-10-06T11:16:56.190 INFO:teuthology.orchestra.run.smithi055.stdout: "prealloc_inos": [], 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "client_metadata": { 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "client_features": { 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "feature_bits": "0x0000000000007bff" 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "metric_spec": { 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "metric_flags": { 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "feature_bits": "0x00000000000003ff" 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2023-10-06T11:16:56.191 INFO:teuthology.orchestra.run.smithi055.stdout: "kernel_version": "4.18.0-425.3.1.el8.x86_64", 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6622, 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": { 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 6622 2023-10-06T11:16:56.192 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 921785645 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "open", 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "num_leases": 0, 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "num_caps": 0, 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "request_load_avg": 0, 2023-10-06T11:16:56.193 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 0, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "requests_in_flight": 0, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "num_completed_requests": 0, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "num_completed_flushes": 0, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "reconnecting": false, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "recall_caps": { 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 60 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "release_caps": { 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 60 2023-10-06T11:16:56.194 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "recall_caps_throttle": { 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 1.5 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "recall_caps_throttle2o": { 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 0.5 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "session_cache_liveness": { 2023-10-06T11:16:56.195 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 300 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "cap_acquisition": { 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "value": 0, 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "halflife": 30 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "last_trim_completed_requests_tid": 0, 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "last_trim_completed_flushes_tid": 0, 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "delegated_inos": [], 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": "client.6622 v1:192.168.0.1:0/921785645", 2023-10-06T11:16:56.196 INFO:teuthology.orchestra.run.smithi055.stdout: "completed_requests": [], 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "prealloc_inos": [], 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "client_metadata": { 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "client_features": { 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "feature_bits": "0x0000000000007bff" 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "metric_spec": { 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "metric_flags": { 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "feature_bits": "0x00000000000003ff" 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "1", 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi142", 2023-10-06T11:16:56.197 INFO:teuthology.orchestra.run.smithi055.stdout: "kernel_version": "4.18.0-425.3.1.el8.x86_64", 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: "result": 0 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:16:56.198 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x5648475da400 msgr2=0x564847525b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x5648475da400 0x564847525b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x5648475f4400 msgr2=0x564847527700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x5648475f4400 0x564847527700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5648474f8420 tx=0x564847530300 comp rx=0 tx=0).stop 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533c00 msgr2=0x564847526c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/4079882197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847533c00 0x564847526c00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x564847559fb0 tx=0x56484757ecc0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c1314700 1 -- 172.21.15.55:0/4079882197 reap_dead start 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 shutdown_connections 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 >> 172.21.15.55:0/4079882197 conn(0x564847533000 msgr2=0x56484685d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 shutdown_connections 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/4079882197 wait complete. 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 msgr2=0x564847524b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.174+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 0x564847524b00 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x5648474f9dd0 tx=0x5648474f6d80 comp rx=0 tx=0).stop 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 shutdown_connections 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564847532c00 0x564847525080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564847532400 0x564847524580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 --2- 172.21.15.55:0/2185218606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564847532800 0x564847524b00 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 >> 172.21.15.55:0/2185218606 conn(0x564847532000 msgr2=0x56484685d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 shutdown_connections 2023-10-06T11:16:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.175+0000 7fb1c7e46240 1 -- 172.21.15.55:0/2185218606 wait complete. 2023-10-06T11:16:56.202 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.070556, result: { "0": { "data": { "sessions": [ { "id": 7203, "entity": { "name": { "type": "client", "num": 7203 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 2743705528 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7203 v1:192.168.0.1:0/2743705528", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "0", "hostname": "smithi055", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } }, { "id": 6622, "entity": { "name": { "type": "client", "num": 6622 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 921785645 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6622 v1:192.168.0.1:0/921785645", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "1", "hostname": "smithi142", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } } ] }, "result": 0 } } 2023-10-06T11:16:56.203 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 7203, "entity": { "name": { "type": "client", "num": 7203 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 2743705528 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7203 v1:192.168.0.1:0/2743705528", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "0", "hostname": "smithi055", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } }, { "id": 6622, "entity": { "name": { "type": "client", "num": 6622 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 921785645 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.6622 v1:192.168.0.1:0/921785645", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000007bff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x00000000000003ff" } }, "entity_id": "1", "hostname": "smithi142", "kernel_version": "4.18.0-425.3.1.el8.x86_64", "root": "/" } } ] }, "result": 0 } } 2023-10-06T11:16:56.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:56.204 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2023-10-06T11:16:56.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:56.268 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2023-10-06T11:16:56.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:56.325 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2023-10-06T11:16:56.355 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-10-06T11:16:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.486+0000 7f69e9511700 1 Processor -- start 2023-10-06T11:16:56.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.486+0000 7f69e9511700 1 -- start start 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e9511700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69e4068540 0x7f69e4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e9511700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e40c6550 con 0x7f69e4155a20 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e9511700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e40c70d0 con 0x7f69e4155df0 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e9511700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e40abbe0 con 0x7f69e4068540 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e37fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f69e4068540 0x7f69e4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e2ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69e4155a20 0x7f69e406ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60072/0 (socket says 172.21.15.55:60072) 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e2ffd700 1 -- 172.21.15.55:0/3581639346 learned_addr learned my addr 172.21.15.55:0/3581639346 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e37fe700 1 -- 172.21.15.55:0/3581639346 >> v1:172.21.15.142:6789/0 conn(0x7f69e4155df0 legacy=0x7f69e4067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e37fe700 1 -- 172.21.15.55:0/3581639346 >> v1:172.21.15.55:6789/0 conn(0x7f69e4155a20 legacy=0x7f69e406ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e37fe700 1 -- 172.21.15.55:0/3581639346 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40c67a0 con 0x7f69e4068540 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.487+0000 7f69e37fe700 1 --2- 172.21.15.55:0/3581639346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4068540 0x7f69e4160af0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009e60 tx=0x7f69d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f0f32bd018947c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e1ffb700 1 -- 172.21.15.55:0/3581639346 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400e070 con 0x7f69e4068540 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e1ffb700 1 -- 172.21.15.55:0/3581639346 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400bc30 con 0x7f69e4068540 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e1ffb700 1 -- 172.21.15.55:0/3581639346 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4012430 con 0x7f69e4068540 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 -- 172.21.15.55:0/3581639346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4068540 msgr2=0x7f69e4160af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 --2- 172.21.15.55:0/3581639346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4068540 0x7f69e4160af0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009e60 tx=0x7f69d4009780 comp rx=0 tx=0).stop 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 -- 172.21.15.55:0/3581639346 shutdown_connections 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 --2- 172.21.15.55:0/3581639346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4068540 0x7f69e4160af0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 -- 172.21.15.55:0/3581639346 >> 172.21.15.55:0/3581639346 conn(0x7f69e40c8a20 msgr2=0x7f69e40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:56.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 -- 172.21.15.55:0/3581639346 shutdown_connections 2023-10-06T11:16:56.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.488+0000 7f69e9511700 1 -- 172.21.15.55:0/3581639346 wait complete. 2023-10-06T11:16:56.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.489+0000 7f69e9511700 1 Processor -- start 2023-10-06T11:16:56.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.489+0000 7f69e9511700 1 -- start start 2023-10-06T11:16:56.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e9511700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e4068540 0x7f69e4151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e9511700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e4155a20 0x7f69e4153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e9511700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 0x7f69e4157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e9511700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4157300 con 0x7f69e4155df0 2023-10-06T11:16:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e9511700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41566f0 con 0x7f69e4068540 2023-10-06T11:16:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e9511700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41569d0 con 0x7f69e4155a20 2023-10-06T11:16:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 0x7f69e4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 0x7f69e4157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44936/0 (socket says 172.21.15.55:44936) 2023-10-06T11:16:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e37fe700 1 -- 172.21.15.55:0/3670220384 learned_addr learned my addr 172.21.15.55:0/3670220384 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e4068540 0x7f69e4151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e27fc700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e4155a20 0x7f69e4153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e37fe700 1 -- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e4155a20 msgr2=0x7f69e4153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e37fe700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e4155a20 0x7f69e4153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.490+0000 7f69e37fe700 1 -- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e4068540 msgr2=0x7f69e4151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69e37fe700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e4068540 0x7f69e4151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69e37fe700 1 -- 172.21.15.55:0/3670220384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4009a20 con 0x7f69e4155df0 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69e27fc700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e4155a20 0x7f69e4153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:56.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69e37fe700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 0x7f69e4157790 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f69d40097c0 tx=0x7f69d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d401e630 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d401e790 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d401eb50 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4156cb0 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.491+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4151790 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.492+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e406c370 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.492+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69d4024070 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.493+0000 7f69daffd700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69c4066f30 0x7f69c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.493+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f69d4087070 con 0x7f69e4155df0 2023-10-06T11:16:56.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.493+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69c4066f30 0x7f69c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:56.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.493+0000 7f69e2ffd700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69c4066f30 0x7f69c40693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007130 tx=0x7f69dc007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:56.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.497+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69d4053fb0 con 0x7f69e4155df0 2023-10-06T11:16:56.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:56.737+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f69e40c6a80 con 0x7f69e4155df0 2023-10-06T11:16:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.053+0000 7f69daffd700 1 -- 172.21.15.55:0/3670220384 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v67) v1 ==== 105+0+0 (secure 0 0 0) 0x7f69d402f350 con 0x7f69e4155df0 2023-10-06T11:16:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69c4066f30 msgr2=0x7f69c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69c4066f30 0x7f69c40693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007130 tx=0x7f69dc007eb0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 msgr2=0x7f69e4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 0x7f69e4157790 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f69d40097c0 tx=0x7f69d4019000 comp rx=0 tx=0).stop 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 shutdown_connections 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f69c4066f30 0x7f69c40693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69e4155df0 0x7f69e4157790 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69e4068540 0x7f69e4151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 --2- 172.21.15.55:0/3670220384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69e4155a20 0x7f69e4153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 >> 172.21.15.55:0/3670220384 conn(0x7f69e40c8a20 msgr2=0x7f69e40cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.056+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 shutdown_connections 2023-10-06T11:16:57.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.057+0000 7f69e9511700 1 -- 172.21.15.55:0/3670220384 wait complete. 2023-10-06T11:16:57.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.197+0000 7fba11e57700 1 Processor -- start 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.197+0000 7fba11e57700 1 -- start start 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba11e57700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba0c0cb0c0 0x7fba0c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba11e57700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c0ccc10 con 0x7fba0c0cef10 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba11e57700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c0cb630 con 0x7fba0c0ceb40 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba11e57700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c0cb910 con 0x7fba0c0cb0c0 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba0affd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba0c0cb0c0 0x7fba0c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba0bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fba0c0cef10 0x7fba0c158fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60074/0 (socket says 172.21.15.55:60074) 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.198+0000 7fba0bfff700 1 -- 172.21.15.55:0/3873619626 learned_addr learned my addr 172.21.15.55:0/3873619626 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0affd700 1 -- 172.21.15.55:0/3873619626 >> v1:172.21.15.142:6789/0 conn(0x7fba0c0ceb40 legacy=0x7fba0c0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0affd700 1 -- 172.21.15.55:0/3873619626 >> v1:172.21.15.55:6789/0 conn(0x7fba0c0cef10 legacy=0x7fba0c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0a7fc700 1 -- 172.21.15.55:0/3873619626 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103384879 0 0) 0x7fba0c0ccc10 con 0x7fba0c0cef10 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0affd700 1 -- 172.21.15.55:0/3873619626 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0cbbf0 con 0x7fba0c0cb0c0 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0affd700 1 --2- 172.21.15.55:0/3873619626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c0cc6d0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fba00009910 tx=0x7fba000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1b02514ffec19e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0a7fc700 1 -- 172.21.15.55:0/3873619626 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000b820 con 0x7fba0c0cb0c0 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0a7fc700 1 -- 172.21.15.55:0/3873619626 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000b980 con 0x7fba0c0cb0c0 2023-10-06T11:16:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba0a7fc700 1 -- 172.21.15.55:0/3873619626 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000bd20 con 0x7fba0c0cb0c0 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba11e57700 1 -- 172.21.15.55:0/3873619626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0cb0c0 msgr2=0x7fba0c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba11e57700 1 --2- 172.21.15.55:0/3873619626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c0cc6d0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fba00009910 tx=0x7fba000091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba11e57700 1 -- 172.21.15.55:0/3873619626 shutdown_connections 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba11e57700 1 --2- 172.21.15.55:0/3873619626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c0cc6d0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.199+0000 7fba11e57700 1 -- 172.21.15.55:0/3873619626 >> 172.21.15.55:0/3873619626 conn(0x7fba0c0d0550 msgr2=0x7fba0c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.200+0000 7fba11e57700 1 -- 172.21.15.55:0/3873619626 shutdown_connections 2023-10-06T11:16:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.200+0000 7fba11e57700 1 -- 172.21.15.55:0/3873619626 wait complete. 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 Processor -- start 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 -- start start 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c13bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 0x7fba0c0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c0cef10 0x7fba0c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0c8b60 con 0x7fba0c0ceb40 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0c7f90 con 0x7fba0c0cb0c0 2023-10-06T11:16:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.201+0000 7fba11e57700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0c8230 con 0x7fba0c0cef10 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 0x7fba0c0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 0x7fba0c0b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44956/0 (socket says 172.21.15.55:44956) 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 -- 172.21.15.55:0/2690959289 learned_addr learned my addr 172.21.15.55:0/2690959289 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0b7fe700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c13bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 -- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c0cef10 msgr2=0x7fba0c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c0cef10 0x7fba0c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 -- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c0cb0c0 msgr2=0x7fba0c13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c13bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 -- 172.21.15.55:0/2690959289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba00009420 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba0affd700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 0x7fba0c0b32f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fba00013000 tx=0x7fba00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00024440 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000245c0 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00024980 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c0c8510 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.202+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c0b60b0 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.203+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c0c8cd0 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.204+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba0001a420 con 0x7fba0c0ceb40 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.204+0000 7fb9f37fe700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.204+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fba00086720 con 0x7fba0c0ceb40 2023-10-06T11:16:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.204+0000 7fba0b7fe700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.205+0000 7fba0b7fe700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f8066f30 0x7fb9f80693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc001760 tx=0x7fb9fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.208+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba00053660 con 0x7fba0c0ceb40 2023-10-06T11:16:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.446+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba0c04c380 con 0x7fba0c0ceb40 2023-10-06T11:16:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.447+0000 7fb9f37fe700 1 -- 172.21.15.55:0/2690959289 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4620 (secure 0 0 0) 0x7fba00056c80 con 0x7fba0c0ceb40 2023-10-06T11:16:57.449 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:57.449 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:57.050939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7149,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":67,"state":"up:creating","state_seq":1,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f8066f30 msgr2=0x7fb9f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f8066f30 0x7fb9f80693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc001760 tx=0x7fb9fc009040 comp rx=0 tx=0).stop 2023-10-06T11:16:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 msgr2=0x7fba0c0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 0x7fba0c0b32f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fba00013000 tx=0x7fba00017000 comp rx=0 tx=0).stop 2023-10-06T11:16:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 shutdown_connections 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba0c0cef10 0x7fba0c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c0cb0c0 0x7fba0c13bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 --2- 172.21.15.55:0/2690959289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0ceb40 0x7fba0c0b32f0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 >> 172.21.15.55:0/2690959289 conn(0x7fba0c0d0550 msgr2=0x7fba0c067ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 shutdown_connections 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:57.449+0000 7fba11e57700 1 -- 172.21.15.55:0/2690959289 wait complete. 2023-10-06T11:16:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 67 2023-10-06T11:16:57.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:33.613713+0000', 'modified': '2023-10-06T11:16:57.050939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7149, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 67, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.55:6833/2516972275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 2516972275}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 2516972275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7149': {'gid': 7149, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6835/2083914208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 2083914208}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 2083914208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:57.865 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7128:up:creating 2023-10-06T11:16:58.866 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.996+0000 7f6ec759e700 1 Processor -- start 2023-10-06T11:16:58.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.996+0000 7f6ec759e700 1 -- start start 2023-10-06T11:16:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ec815ab50 0x7f6ec80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec80b3ef0 0x7f6ec80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec759e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80b3a60 con 0x7f6ec8159760 2023-10-06T11:16:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80afd20 con 0x7f6ec815ab50 2023-10-06T11:16:59.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80af770 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec659c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6ec8159760 0x7f6ec80af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60082/0 (socket says 172.21.15.55:60082) 2023-10-06T11:16:59.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec659c700 1 -- 172.21.15.55:0/349186793 learned_addr learned my addr 172.21.15.55:0/349186793 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:16:59.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/349186793 >> v2:172.21.15.142:3300/0 conn(0x7f6ec815ab50 0x7f6ec80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.997+0000 7f6ec6d9d700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec80b3ef0 0x7f6ec80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec559a700 1 -- 172.21.15.55:0/349186793 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114222280 0 0) 0x7f6ec80b3a60 con 0x7f6ec8159760 2023-10-06T11:16:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec559a700 1 -- 172.21.15.55:0/349186793 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb4003570 con 0x7f6ec8159760 2023-10-06T11:16:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec5d9b700 1 -- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec80b3ef0 msgr2=0x7f6ec80b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec559a700 1 -- 172.21.15.55:0/349186793 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3829805659 0 0) 0x7f6eb4003570 con 0x7f6ec8159760 2023-10-06T11:16:59.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec80b3ef0 0x7f6ec80b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec5d9b700 1 -- 172.21.15.55:0/349186793 >> v1:172.21.15.55:6789/0 conn(0x7f6ec8159760 legacy=0x7f6ec80af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec5d9b700 1 -- 172.21.15.55:0/349186793 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80afa40 con 0x7f6ec815ab50 2023-10-06T11:16:59.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec6d9d700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec80b3ef0 0x7f6ec80b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:59.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec80b15d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00098e0 tx=0x7f6eb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd3360c7fb7597d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec559a700 1 -- 172.21.15.55:0/349186793 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8001470 con 0x7f6ec815ab50 2023-10-06T11:16:59.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec559a700 1 -- 172.21.15.55:0/349186793 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0011420 con 0x7f6ec815ab50 2023-10-06T11:16:59.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.998+0000 7f6ec559a700 1 -- 172.21.15.55:0/349186793 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00117a0 con 0x7f6ec815ab50 2023-10-06T11:16:59.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 -- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 msgr2=0x7f6ec80b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec80b15d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00098e0 tx=0x7f6eb00091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 -- 172.21.15.55:0/349186793 shutdown_connections 2023-10-06T11:16:59.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec80b3ef0 0x7f6ec80b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 --2- 172.21.15.55:0/349186793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec80b15d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 -- 172.21.15.55:0/349186793 >> 172.21.15.55:0/349186793 conn(0x7f6ec80d0f20 msgr2=0x7f6ec80afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 -- 172.21.15.55:0/349186793 shutdown_connections 2023-10-06T11:16:59.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:58.999+0000 7f6ec759e700 1 -- 172.21.15.55:0/349186793 wait complete. 2023-10-06T11:16:59.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.000+0000 7f6ec759e700 1 Processor -- start 2023-10-06T11:16:59.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.000+0000 7f6ec759e700 1 -- start start 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 0x7f6ec8156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec8159760 0x7f6ec8152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec759e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81580f0 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8157280 con 0x7f6ec815ab50 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81532f0 con 0x7f6ec8159760 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 0x7f6ec8156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 0x7f6ec8156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44972/0 (socket says 172.21.15.55:44972) 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 -- 172.21.15.55:0/1545768898 learned_addr learned my addr 172.21.15.55:0/1545768898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec8159760 0x7f6ec8152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec6d9d700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 -- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec8159760 msgr2=0x7f6ec8152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec8159760 0x7f6ec8152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 -- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 msgr2=0x7f6ec8158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec8158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 -- 172.21.15.55:0/1545768898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0009a20 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec8159760 0x7f6ec8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.001+0000 7f6ec659c700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 0x7f6ec8156d40 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8001660 tx=0x7f6eb8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.002+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8001d10 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.002+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8007360 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.002+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb0009420 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.002+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8004830 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.002+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8157560 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.003+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec81583d0 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.003+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eb8004c20 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.004+0000 7f6ebe7fc700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6ea8066f30 0x7f6ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.004+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f6eb8084010 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.004+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6ea8066f30 0x7f6ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.004+0000 7f6ec5d9b700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6ea8066f30 0x7f6ea80693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00091e0 tx=0x7f6eb0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.008+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eb8051090 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.250+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ec8088e50 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.251+0000 7f6ebe7fc700 1 -- 172.21.15.55:0/1545768898 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f6eb8018090 con 0x7f6ec80b3ef0 2023-10-06T11:16:59.253 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:16:59.253 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:16:58.057831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7149,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6ea8066f30 msgr2=0x7f6ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6ea8066f30 0x7f6ea80693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00091e0 tx=0x7f6eb0016000 comp rx=0 tx=0).stop 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 msgr2=0x7f6ec8156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 0x7f6ec8156d40 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8001660 tx=0x7f6eb8001a80 comp rx=0 tx=0).stop 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 shutdown_connections 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6ea8066f30 0x7f6ea80693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec80b3ef0 0x7f6ec8156d40 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec815ab50 0x7f6ec8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 --2- 172.21.15.55:0/1545768898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ec8159760 0x7f6ec8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 >> 172.21.15.55:0/1545768898 conn(0x7f6ec80d0f20 msgr2=0x7f6ec80b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 shutdown_connections 2023-10-06T11:16:59.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.253+0000 7f6ec759e700 1 -- 172.21.15.55:0/1545768898 wait complete. 2023-10-06T11:16:59.256 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 68 2023-10-06T11:16:59.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:33.613713+0000', 'modified': '2023-10-06T11:16:58.057831+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7149, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6833/2516972275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 2516972275}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 2516972275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7149': {'gid': 7149, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6835/2083914208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 2083914208}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 2083914208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:59.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-10-06T11:16:59.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:16:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.790+0000 7fe7f60d6700 1 Processor -- start 2023-10-06T11:16:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.790+0000 7fe7f60d6700 1 -- start start 2023-10-06T11:16:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7f60d6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe7f01593b0 0x7fe7f00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7f60d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7f0159780 0x7fe7f00b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7f60d6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f00b1190 con 0x7fe7f015d1f0 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7f60d6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00d0400 con 0x7fe7f01593b0 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7f60d6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00b6550 con 0x7fe7f0159780 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7ef7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe7f01593b0 0x7fe7f00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7ef7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe7f01593b0 0x7fe7f00cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44974/0 (socket says 172.21.15.55:44974) 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.791+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/3989456561 learned_addr learned my addr 172.21.15.55:0/3989456561 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/3989456561 >> v2:172.21.15.142:3300/0 conn(0x7fe7f0159780 0x7fe7f00b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/3989456561 >> v2:172.21.15.142:3300/0 conn(0x7fe7f0159780 msgr2=0x7fe7f00b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/3989456561 >> v2:172.21.15.142:3300/0 conn(0x7fe7f0159780 0x7fe7f00b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/3989456561 >> v1:172.21.15.142:6789/0 conn(0x7fe7f015d1f0 legacy=0x7fe7f00cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/3989456561 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00cfb60 con 0x7fe7f01593b0 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/3989456561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f01593b0 0x7fe7f00cf520 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00d16a0 tx=0x7fe7e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b48f22f570a20f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ee7fc700 1 -- 172.21.15.55:0/3989456561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000b820 con 0x7fe7f01593b0 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ee7fc700 1 -- 172.21.15.55:0/3989456561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e000b980 con 0x7fe7f01593b0 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.792+0000 7fe7ee7fc700 1 -- 172.21.15.55:0/3989456561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000bd40 con 0x7fe7f01593b0 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 -- 172.21.15.55:0/3989456561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f01593b0 msgr2=0x7fe7f00cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/3989456561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f01593b0 0x7fe7f00cf520 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00d16a0 tx=0x7fe7e0009250 comp rx=0 tx=0).stop 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 -- 172.21.15.55:0/3989456561 shutdown_connections 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/3989456561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f01593b0 0x7fe7f00cf520 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/3989456561 >> v2:172.21.15.142:3300/0 conn(0x7fe7f0159780 0x7fe7f00b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 -- 172.21.15.55:0/3989456561 >> 172.21.15.55:0/3989456561 conn(0x7fe7f00d05c0 msgr2=0x7fe7f00d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 -- 172.21.15.55:0/3989456561 shutdown_connections 2023-10-06T11:16:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.793+0000 7fe7f60d6700 1 -- 172.21.15.55:0/3989456561 wait complete. 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.794+0000 7fe7f60d6700 1 Processor -- start 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.794+0000 7fe7f60d6700 1 -- start start 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7f01593b0 0x7fe7f0154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 0x7fe7f0154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f015d1f0 0x7fe7f0153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c53d0 con 0x7fe7f0159780 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0155db0 con 0x7fe7f015d1f0 2023-10-06T11:16:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0156620 con 0x7fe7f01593b0 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 0x7fe7f0154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 0x7fe7f0154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44978/0 (socket says 172.21.15.55:44978) 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 -- 172.21.15.55:0/1768268954 learned_addr learned my addr 172.21.15.55:0/1768268954 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7f01593b0 0x7fe7f0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7effff700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f015d1f0 0x7fe7f0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 -- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7f01593b0 msgr2=0x7fe7f0154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7f01593b0 0x7fe7f0154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 -- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f015d1f0 msgr2=0x7fe7f0153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f015d1f0 0x7fe7f0153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 -- 172.21.15.55:0/1768268954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00094f0 con 0x7fe7f0159780 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 0x7fe7f0154b50 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400d890 tx=0x7fe7e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7d77fe700 1 -- 172.21.15.55:0/1768268954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400b600 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7d77fe700 1 -- 172.21.15.55:0/1768268954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e400b760 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7d77fe700 1 -- 172.21.15.55:0/1768268954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400bae0 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f01551a0 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.795+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0155760 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.797+0000 7fe7d77fe700 1 -- 172.21.15.55:0/1768268954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7e401e460 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.797+0000 7fe7d77fe700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7dc066f30 0x7fe7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.798+0000 7fe7d77fe700 1 -- 172.21.15.55:0/1768268954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe7e4084f20 con 0x7fe7f0159780 2023-10-06T11:16:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.798+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7dc066f30 0x7fe7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.798+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7dc066f30 0x7fe7dc0693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00d16a0 tx=0x7fe7e0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.799+0000 7fe7ff3ceb80 1 Processor -- start 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.799+0000 7fe7ff3ceb80 1 -- start start 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391298ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564391218c80 con 0x56439129b9a0 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643911efa70 con 0x564391299bd0 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643911ed270 con 0x5643912dfa90 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44984/0 (socket says 172.21.15.55:44984) 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7eeffd700 1 -- 172.21.15.55:0/3946531492 learned_addr learned my addr 172.21.15.55:0/3946531492 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7effff700 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391298ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.800+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7eeffd700 1 -- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 msgr2=0x5643912dfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912dfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7eeffd700 1 -- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 msgr2=0x564391298ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391298ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7eeffd700 1 -- 172.21.15.55:0/3946531492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564391083270 con 0x56439129b9a0 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912dfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4083110 tx=0x7fe7e4083070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78348fafa4ba5c6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7d4ff9700 1 -- 172.21.15.55:0/3946531492 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e405cac0 con 0x56439129b9a0 2023-10-06T11:16:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7d4ff9700 1 -- 172.21.15.55:0/3946531492 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e406d070 con 0x56439129b9a0 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7d4ff9700 1 -- 172.21.15.55:0/3946531492 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4053c60 con 0x56439129b9a0 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/3946531492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 msgr2=0x564391298580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.801+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4083110 tx=0x7fe7e4083070 comp rx=0 tx=0).stop 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/3946531492 shutdown_connections 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391298ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912dfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/3946531492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/3946531492 >> 172.21.15.55:0/3946531492 conn(0x56439129a070 msgr2=0x56439129a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/3946531492 shutdown_connections 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/3946531492 wait complete. 2023-10-06T11:16:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 -- start start 2023-10-06T11:16:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.802+0000 7fe7ff3ceb80 1 Processor -- start 2023-10-06T11:16:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 0x5643912c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643911e9060 con 0x564391299bd0 2023-10-06T11:16:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564391194890 con 0x56439129b9a0 2023-10-06T11:16:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643911afea0 con 0x5643912dfa90 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ff3ceb80 10 client.0 _ll_register_callbacks cb 0x564391085f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ef7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 0x5643912c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ef7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 0x5643912c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45000/0 (socket says 172.21.15.55:45000) 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/641430251 learned_addr learned my addr 172.21.15.55:0/641430251 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.803+0000 7fe7effff700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 msgr2=0x5643912bfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912bfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 msgr2=0x5643912c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ef7fe700 1 -- 172.21.15.55:0/641430251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0155760 con 0x564391299bd0 2023-10-06T11:16:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 0x5643912c4ed0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0006fd0 tx=0x7fe7e001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e759b5abc7e90584 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7cdffb700 1 -- 172.21.15.55:0/641430251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e002d070 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7cdffb700 1 -- 172.21.15.55:0/641430251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe7e0011e00 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56439128d690 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7cdffb700 1 -- 172.21.15.55:0/641430251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7e001d670 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 10 client.7260 fetch_fsmap learned FSMap version 68 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x564391025fe0 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7cdffb700 1 -- 172.21.15.55:0/641430251 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56439128d690 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7cdffb700 1 -- 172.21.15.55:0/641430251 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 3112+0+0 (secure 0 0 0) 0x7fe7e001d7d0 con 0x564391299bd0 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 10 client.7260 fetch_fsmap finished waiting for FSMap version 68 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 10 client.7260 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:16:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 20 client.7260 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912f28c0 0x5643912f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 4 client.7260 mds_command: new command op to 7128 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.804+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 --> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56439126a5c0 con 0x5643912f28c0 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912f28c0 0x5643912f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7cdffb700 10 client.7260 ms_handle_connect on v2:172.21.15.55:6832/2516972275 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912f28c0 0x5643912f2c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f88725857f47fa27 server_cookie=f2c58e47c4edc3f9 in_seq=0 out_seq=0 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7cdffb700 1 -- 172.21.15.55:0/641430251 <== mds.1 v2:172.21.15.55:6832/2516972275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56439126a5c0 con 0x5643912f28c0 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7cdffb700 10 client.7260 handle_command_reply: tid=0 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7ff3ceb80 1 client.7260 shutdown 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 msgr2=0x5643912c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.805+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 0x5643912c4ed0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0006fd0 tx=0x7fe7e001f040 comp rx=0 tx=0).stop 2023-10-06T11:16:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 shutdown_connections 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912f28c0 0x5643912f2c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564391299bd0 0x5643912c4ed0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7cdffb700 0 client.7260 ms_handle_reset on v2:172.21.15.55:6832/2516972275 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x5643912bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/641430251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 >> 172.21.15.55:0/641430251 conn(0x56439129a070 msgr2=0x5643912956c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 shutdown_connections 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/641430251 wait complete. 2023-10-06T11:16:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.806+0000 7fe7ff3ceb80 20 client.7260 trim_cache size 0 max 16384 2023-10-06T11:16:59.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 Processor -- start 2023-10-06T11:16:59.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 -- start start 2023-10-06T11:16:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564391299bd0 0x5643912f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 0x5643912c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56439106be30 con 0x5643912dfa90 2023-10-06T11:16:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564391278030 con 0x56439129b9a0 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643912967a0 con 0x564391299bd0 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7effff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 0x5643912c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7effff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 0x5643912c32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45006/0 (socket says 172.21.15.55:45006) 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.823+0000 7fe7effff700 1 -- 172.21.15.55:0/1395063041 learned_addr learned my addr 172.21.15.55:0/1395063041 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7effff700 1 -- 172.21.15.55:0/1395063041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564391299bd0 msgr2=0x5643912f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7effff700 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564391299bd0 0x5643912f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7effff700 1 -- 172.21.15.55:0/1395063041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 msgr2=0x5643912c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7effff700 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7effff700 1 -- 172.21.15.55:0/1395063041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643911b7780 con 0x5643912dfa90 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7effff700 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 0x5643912c32d0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8008660 tx=0x7fe7e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefc3214a289b81b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7d57fa700 1 -- 172.21.15.55:0/1395063041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80165e0 con 0x5643912dfa90 2023-10-06T11:16:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7d57fa700 1 -- 172.21.15.55:0/1395063041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e8016760 con 0x5643912dfa90 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7d57fa700 1 -- 172.21.15.55:0/1395063041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8016b20 con 0x5643912dfa90 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/1395063041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 msgr2=0x5643912c32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.824+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 0x5643912c32d0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8008660 tx=0x7fe7e800b040 comp rx=0 tx=0).stop 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/1395063041 shutdown_connections 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643912dfa90 0x5643912c32d0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564391299bd0 0x5643912f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/1395063041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56439129b9a0 0x5643912c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/1395063041 >> 172.21.15.55:0/1395063041 conn(0x56439129a070 msgr2=0x5643912e2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/1395063041 shutdown_connections 2023-10-06T11:16:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/1395063041 wait complete. 2023-10-06T11:16:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 -- start start 2023-10-06T11:16:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.825+0000 7fe7ff3ceb80 1 Processor -- start 2023-10-06T11:16:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391344540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x564391298ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643912e7870 con 0x56439129b9a0 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643912f12c0 con 0x564391299bd0 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564391293740 con 0x5643912dfa90 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ff3ceb80 10 client.0 _ll_register_callbacks cb 0x564391085f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45014/0 (socket says 172.21.15.55:45014) 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 -- 172.21.15.55:0/4292204221 learned_addr learned my addr 172.21.15.55:0/4292204221 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391344540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7effff700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x564391298ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 -- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 msgr2=0x564391298ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x564391298ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 -- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 msgr2=0x564391344540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391344540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.826+0000 7fe7eeffd700 1 -- 172.21.15.55:0/4292204221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8008330 con 0x56439129b9a0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7eeffd700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4052020 tx=0x7fe7e406d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3a91e8b79b87a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7cdffb700 1 -- 172.21.15.55:0/4292204221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400bc40 con 0x56439129b9a0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7cdffb700 1 -- 172.21.15.55:0/4292204221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe7e4053c60 con 0x56439129b9a0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7e406d070 con 0x56439129b9a0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7cdffb700 1 -- 172.21.15.55:0/4292204221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7e4055f90 con 0x56439129b9a0 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 10 client.7266 fetch_fsmap learned FSMap version 68 2023-10-06T11:16:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x56439119e470 con 0x56439129b9a0 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7cdffb700 1 -- 172.21.15.55:0/4292204221 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e406d070 con 0x56439129b9a0 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7cdffb700 1 -- 172.21.15.55:0/4292204221 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 3112+0+0 (secure 0 0 0) 0x7fe7e4055010 con 0x56439129b9a0 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 10 client.7266 fetch_fsmap finished waiting for FSMap version 68 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 10 client.7266 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 20 client.7266 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912beba0 0x5643912bef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 4 client.7266 mds_command: new command op to 7128 tid=0[{"prefix": "status"}] 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 --> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56439118be00 con 0x5643912beba0 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.827+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912beba0 0x5643912bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7cdffb700 10 client.7266 ms_handle_connect on v2:172.21.15.55:6832/2516972275 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ef7fe700 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912beba0 0x5643912bef70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d17431f301293094 server_cookie=d538691c001b214b in_seq=0 out_seq=0 2023-10-06T11:16:59.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7cdffb700 1 -- 172.21.15.55:0/4292204221 <== mds.1 v2:172.21.15.55:6832/2516972275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56439118be00 con 0x5643912beba0 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7cdffb700 10 client.7266 handle_command_reply: tid=0 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 client.7266 shutdown 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 msgr2=0x564391298580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4052020 tx=0x7fe7e406d000 comp rx=0 tx=0).stop 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 shutdown_connections 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:6832/2516972275,v1:172.21.15.55:6833/2516972275] conn(0x5643912beba0 0x5643912bef70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5643912dfa90 0x564391298ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7cdffb700 0 client.7266 ms_handle_reset on v2:172.21.15.55:6832/2516972275 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564391299bd0 0x564391344540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 --2- 172.21.15.55:0/4292204221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56439129b9a0 0x564391298580 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 >> 172.21.15.55:0/4292204221 conn(0x56439129a070 msgr2=0x5643912954b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 shutdown_connections 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 1 -- 172.21.15.55:0/4292204221 wait complete. 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7ff3ceb80 20 client.7266 trim_cache size 0 max 16384 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 1, 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7128, 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:16:59.837 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 2.7764508870000002, 2023-10-06T11:16:59.838 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 68, 2023-10-06T11:16:59.838 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 109, 2023-10-06T11:16:59.838 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 109, 2023-10-06T11:16:59.838 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 10.655764841 2023-10-06T11:16:59.838 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7dc066f30 msgr2=0x7fe7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7dc066f30 0x7fe7dc0693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00d16a0 tx=0x7fe7e0016000 comp rx=0 tx=0).stop 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 msgr2=0x7fe7f0154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.828+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 0x7fe7f0154b50 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400d890 tx=0x7fe7e4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 shutdown_connections 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fe7dc066f30 0x7fe7dc0693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f015d1f0 0x7fe7f0153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7f01593b0 0x7fe7f0154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 --2- 172.21.15.55:0/1768268954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0159780 0x7fe7f0154b50 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 >> 172.21.15.55:0/1768268954 conn(0x7fe7f00d05c0 msgr2=0x7fe7f00b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 shutdown_connections 2023-10-06T11:16:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.829+0000 7fe7f60d6700 1 -- 172.21.15.55:0/1768268954 wait complete. 2023-10-06T11:16:59.842 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:16:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.962+0000 7f957782e700 1 Processor -- start 2023-10-06T11:16:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.962+0000 7f957782e700 1 -- start start 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f957782e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f95700ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f957782e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9570143530 0x7f95700b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f957782e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95700cd500 0x7f95700b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f957782e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700d00f0 con 0x7f95700cd500 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f957782e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700b2e50 con 0x7f9570143530 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f957782e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700cfc60 con 0x7f9570143160 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95700cd500 0x7f95700b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95700cd500 0x7f95700b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45030/0 (socket says 172.21.15.55:45030) 2023-10-06T11:16:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 -- 172.21.15.55:0/377564180 learned_addr learned my addr 172.21.15.55:0/377564180 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f95755ca700 1 --2- 172.21.15.55:0/377564180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f95700ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9574dc9700 1 --2- 172.21.15.55:0/377564180 >> v2:172.21.15.142:3300/0 conn(0x7f9570143530 0x7f95700b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 -- 172.21.15.55:0/377564180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 msgr2=0x7f95700ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 --2- 172.21.15.55:0/377564180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f95700ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 -- 172.21.15.55:0/377564180 >> v2:172.21.15.142:3300/0 conn(0x7f9570143530 msgr2=0x7f95700b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 --2- 172.21.15.55:0/377564180 >> v2:172.21.15.142:3300/0 conn(0x7f9570143530 0x7f95700b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 -- 172.21.15.55:0/377564180 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700cf050 con 0x7f95700cd500 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f9575dcb700 1 --2- 172.21.15.55:0/377564180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700cd500 0x7f95700b1c10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f95700b3090 tx=0x7f9560009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d312bb3299385d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.963+0000 7f956ffff700 1 -- 172.21.15.55:0/377564180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000e070 con 0x7f95700cd500 2023-10-06T11:16:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f956ffff700 1 -- 172.21.15.55:0/377564180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956000b970 con 0x7f95700cd500 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f956ffff700 1 -- 172.21.15.55:0/377564180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600092e0 con 0x7f95700cd500 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 -- 172.21.15.55:0/377564180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700cd500 msgr2=0x7f95700b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 --2- 172.21.15.55:0/377564180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700cd500 0x7f95700b1c10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f95700b3090 tx=0x7f9560009840 comp rx=0 tx=0).stop 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 -- 172.21.15.55:0/377564180 shutdown_connections 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 --2- 172.21.15.55:0/377564180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700cd500 0x7f95700b1c10 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 --2- 172.21.15.55:0/377564180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f95700ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 --2- 172.21.15.55:0/377564180 >> v2:172.21.15.142:3300/0 conn(0x7f9570143530 0x7f95700b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 -- 172.21.15.55:0/377564180 >> 172.21.15.55:0/377564180 conn(0x7f95700d1010 msgr2=0x7f95700affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 -- 172.21.15.55:0/377564180 shutdown_connections 2023-10-06T11:16:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.964+0000 7f957782e700 1 -- 172.21.15.55:0/377564180 wait complete. 2023-10-06T11:16:59.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.965+0000 7f957782e700 1 Processor -- start 2023-10-06T11:16:59.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.965+0000 7f957782e700 1 -- start start 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f957782e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95700cd500 0x7f9570138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f957782e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f9570159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f957782e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 0x7f95700b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f957782e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570139700 con 0x7f9570143530 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f957782e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95701399e0 con 0x7f95700cd500 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f957782e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9570139cc0 con 0x7f9570143160 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9575dcb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 0x7f95700b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9575dcb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 0x7f95700b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45038/0 (socket says 172.21.15.55:45038) 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9575dcb700 1 -- 172.21.15.55:0/691812511 learned_addr learned my addr 172.21.15.55:0/691812511 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9574dc9700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f9570159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f95755ca700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95700cd500 0x7f9570138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9575dcb700 1 -- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 msgr2=0x7f9570159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9575dcb700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f9570159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.966+0000 7f9575dcb700 1 -- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95700cd500 msgr2=0x7f9570138e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f9575dcb700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95700cd500 0x7f9570138e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f9575dcb700 1 -- 172.21.15.55:0/691812511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560009ae0 con 0x7f9570143530 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f9575dcb700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 0x7f95700b0600 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f9570071040 tx=0x7f9560018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f956d7fa700 1 -- 172.21.15.55:0/691812511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560008ad0 con 0x7f9570143530 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f956d7fa700 1 -- 172.21.15.55:0/691812511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560008c50 con 0x7f9570143530 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f956d7fa700 1 -- 172.21.15.55:0/691812511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560026460 con 0x7f9570143530 2023-10-06T11:16:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9570139fa0 con 0x7f9570143530 2023-10-06T11:16:59.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.967+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957013a7a0 con 0x7f9570143530 2023-10-06T11:16:59.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.969+0000 7f956d7fa700 1 -- 172.21.15.55:0/691812511 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9560003040 con 0x7f9570143530 2023-10-06T11:16:59.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.969+0000 7f956d7fa700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f955c066f60 0x7f955c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.969+0000 7f956d7fa700 1 -- 172.21.15.55:0/691812511 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f95600865c0 con 0x7f9570143530 2023-10-06T11:16:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.969+0000 7f95755ca700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f955c066f60 0x7f955c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.970+0000 7f95755ca700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f955c066f60 0x7f955c069410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9568009db0 tx=0x7f95680091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.971+0000 7f9580b26b80 1 Processor -- start 2023-10-06T11:16:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.971+0000 7f9580b26b80 1 -- start start 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.971+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350beee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.971+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.971+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f9580b26b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350b27c80 con 0x55c350beea90 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350afea70 con 0x55c350baa9a0 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c350afc270 con 0x55c350ba8bd0 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350beee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350beee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45046/0 (socket says 172.21.15.55:45046) 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 -- 172.21.15.55:0/280771005 learned_addr learned my addr 172.21.15.55:0/280771005 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f9574dc9700 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f9575dcb700 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 -- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 msgr2=0x55c350ba7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 -- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 msgr2=0x55c350ba7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 -- 172.21.15.55:0/280771005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c350992270 con 0x55c350beea90 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95755ca700 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350beee60 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9568011f50 tx=0x7f9568019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee3ed185038e394 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95567fc700 1 -- 172.21.15.55:0/280771005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568014dc0 con 0x55c350beea90 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95567fc700 1 -- 172.21.15.55:0/280771005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568021450 con 0x55c350beea90 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.972+0000 7f95567fc700 1 -- 172.21.15.55:0/280771005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680217d0 con 0x55c350beea90 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 -- 172.21.15.55:0/280771005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 msgr2=0x55c350beee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350beee60 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9568011f50 tx=0x7f9568019000 comp rx=0 tx=0).stop 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 -- 172.21.15.55:0/280771005 shutdown_connections 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350beee60 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 --2- 172.21.15.55:0/280771005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 -- 172.21.15.55:0/280771005 >> 172.21.15.55:0/280771005 conn(0x55c350ba9070 msgr2=0x55c350ba9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 -- 172.21.15.55:0/280771005 shutdown_connections 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.973+0000 7f9580b26b80 1 -- 172.21.15.55:0/280771005 wait complete. 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.974+0000 7f9580b26b80 1 -- start start 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.974+0000 7f9580b26b80 1 Processor -- start 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350c01c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350be8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350beea90 0x55c350be9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350af8060 con 0x55c350baa9a0 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350aa3890 con 0x55c350beea90 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c350abeea0 con 0x55c350ba8bd0 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 10 client.0 _ll_register_callbacks cb 0x55c350994f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350be8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350be8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45056/0 (socket says 172.21.15.55:45056) 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 -- 172.21.15.55:0/2544419461 learned_addr learned my addr 172.21.15.55:0/2544419461 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f95755ca700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350c01c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9575dcb700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350beea90 0x55c350be9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 -- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 msgr2=0x55c350c01c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350c01c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 -- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350beea90 msgr2=0x55c350be9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350beea90 0x55c350be9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 -- 172.21.15.55:0/2544419461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9568011b90 con 0x55c350baa9a0 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9575dcb700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350beea90 0x55c350be9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f95755ca700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350c01c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9574dc9700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350be8ed0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9564014990 tx=0x7f95640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b09f55a89920d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f954f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:16:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f954f7fe700 1 -- 172.21.15.55:0/2544419461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564015760 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f954f7fe700 1 -- 172.21.15.55:0/2544419461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f95640158c0 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c350b9c690 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f954f7fe700 1 -- 172.21.15.55:0/2544419461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9564015c90 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 10 client.7278 fetch_fsmap learned FSMap version 68 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.975+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55c350934fe0 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f954f7fe700 1 -- 172.21.15.55:0/2544419461 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c350b9c690 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f954f7fe700 1 -- 172.21.15.55:0/2544419461 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 3112+0+0 (secure 0 0 0) 0x7f9564023250 con 0x55c350baa9a0 2023-10-06T11:16:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f9580b26b80 10 client.7278 fetch_fsmap finished waiting for FSMap version 68 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f9580b26b80 10 client.7278 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f9580b26b80 20 client.7278 populate_metadata read hostname 'smithi055' 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f9580b26b80 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bce380 0x55c350be7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f9580b26b80 4 client.7278 mds_command: new command op to 7149 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 --> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c350b795c0 con 0x55c350bce380 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f95755ca700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bce380 0x55c350be7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f954f7fe700 10 client.7278 ms_handle_connect on v2:172.21.15.55:6834/2083914208 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.976+0000 7f95755ca700 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bce380 0x55c350be7c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21f809a9bee06a7 server_cookie=e358a3329325bf6f in_seq=0 out_seq=0 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f954f7fe700 1 -- 172.21.15.55:0/2544419461 <== mds.0 v2:172.21.15.55:6834/2083914208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c350b795c0 con 0x55c350bce380 2023-10-06T11:16:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f954f7fe700 10 client.7278 handle_command_reply: tid=0 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 client.7278 shutdown 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 msgr2=0x55c350be8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350be8ed0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9564014990 tx=0x7f95640091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 shutdown_connections 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bce380 0x55c350be7c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350beea90 0x55c350be9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350c01c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f954f7fe700 0 client.7278 ms_handle_reset on v2:172.21.15.55:6834/2083914208 2023-10-06T11:16:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 --2- 172.21.15.55:0/2544419461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350be8ed0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 >> 172.21.15.55:0/2544419461 conn(0x55c350ba9070 msgr2=0x55c350bec2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 shutdown_connections 2023-10-06T11:16:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 1 -- 172.21.15.55:0/2544419461 wait complete. 2023-10-06T11:16:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.977+0000 7f9580b26b80 20 client.7278 trim_cache size 0 max 16384 2023-10-06T11:16:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.994+0000 7f9580b26b80 1 Processor -- start 2023-10-06T11:16:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.994+0000 7f9580b26b80 1 -- start start 2023-10-06T11:16:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350ba4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9580b26b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35097ae30 con 0x55c350beea90 2023-10-06T11:16:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350bd7be0 con 0x55c350baa9a0 2023-10-06T11:17:00.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c350ba20c0 con 0x55c350ba8bd0 2023-10-06T11:17:00.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350ba4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350ba4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45060/0 (socket says 172.21.15.55:45060) 2023-10-06T11:17:00.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 -- 172.21.15.55:0/776104489 learned_addr learned my addr 172.21.15.55:0/776104489 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:00.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9574dc9700 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f95755ca700 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 -- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 msgr2=0x55c350ba9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 -- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 msgr2=0x55c350ba4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.995+0000 7f9575dcb700 1 -- 172.21.15.55:0/776104489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c350ac6780 con 0x55c350beea90 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9575dcb700 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350ba4d80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9560053720 tx=0x7f9560084710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd67d9b5e470e6ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9556ffd700 1 -- 172.21.15.55:0/776104489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000e040 con 0x55c350beea90 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9556ffd700 1 -- 172.21.15.55:0/776104489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95600572f0 con 0x55c350beea90 2023-10-06T11:17:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9556ffd700 1 -- 172.21.15.55:0/776104489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956005a410 con 0x55c350beea90 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 -- 172.21.15.55:0/776104489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 msgr2=0x55c350ba4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350ba4d80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9560053720 tx=0x7f9560084710 comp rx=0 tx=0).stop 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 -- 172.21.15.55:0/776104489 shutdown_connections 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350beea90 0x55c350ba4d80 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350ba8bd0 0x55c350ba9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 --2- 172.21.15.55:0/776104489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350baa9a0 0x55c350ba4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 -- 172.21.15.55:0/776104489 >> 172.21.15.55:0/776104489 conn(0x55c350ba9070 msgr2=0x55c350bcb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 -- 172.21.15.55:0/776104489 shutdown_connections 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.996+0000 7f9580b26b80 1 -- 172.21.15.55:0/776104489 wait complete. 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.997+0000 7f9580b26b80 1 -- start start 2023-10-06T11:17:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.997+0000 7f9580b26b80 1 Processor -- start 2023-10-06T11:17:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350ba8bd0 0x55c350ba7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350c52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350beea90 0x55c350ba3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350bd78a0 con 0x55c350baa9a0 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c350becda0 con 0x55c350ba8bd0 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c350ba4310 con 0x55c350beea90 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9580b26b80 10 client.0 _ll_register_callbacks cb 0x55c350994f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350c52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350c52f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45062/0 (socket says 172.21.15.55:45062) 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 -- 172.21.15.55:0/431731532 learned_addr learned my addr 172.21.15.55:0/431731532 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9575dcb700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350beea90 0x55c350ba3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f95755ca700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350ba8bd0 0x55c350ba7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 -- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350beea90 msgr2=0x55c350ba3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350beea90 0x55c350ba3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 -- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350ba8bd0 msgr2=0x55c350ba7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350ba8bd0 0x55c350ba7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 -- 172.21.15.55:0/431731532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957013a7a0 con 0x55c350baa9a0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f9574dc9700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350c52f80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9564014990 tx=0x7f956401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1661ea0b9311e26f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.998+0000 7f954f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f954f7fe700 1 -- 172.21.15.55:0/431731532 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564023760 con 0x55c350baa9a0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f954f7fe700 1 -- 172.21.15.55:0/431731532 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f9564000e40 con 0x55c350baa9a0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9568021450 con 0x55c350baa9a0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f954f7fe700 1 -- 172.21.15.55:0/431731532 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9564023250 con 0x55c350baa9a0 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 10 client.7284 fetch_fsmap learned FSMap version 68 2023-10-06T11:17:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55c350aad470 con 0x55c350baa9a0 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f954f7fe700 1 -- 172.21.15.55:0/431731532 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568021450 con 0x55c350baa9a0 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f954f7fe700 1 -- 172.21.15.55:0/431731532 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 3112+0+0 (secure 0 0 0) 0x7f9564005a00 con 0x55c350baa9a0 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 10 client.7284 fetch_fsmap finished waiting for FSMap version 68 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 10 client.7284 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 20 client.7284 populate_metadata read hostname 'smithi055' 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bd1670 0x55c350bd1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 4 client.7284 mds_command: new command op to 7149 tid=0[{"prefix": "status"}] 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 --> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c350a9ae00 con 0x55c350bd1670 2023-10-06T11:17:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:16:59.999+0000 7f95755ca700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bd1670 0x55c350bd1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f954f7fe700 10 client.7284 ms_handle_connect on v2:172.21.15.55:6834/2083914208 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f95755ca700 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bd1670 0x55c350bd1a40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a45a86d1d53c94a server_cookie=dc9cb09673ab81c9 in_seq=0 out_seq=0 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f954f7fe700 1 -- 172.21.15.55:0/431731532 <== mds.0 v2:172.21.15.55:6834/2083914208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55c350a9ae00 con 0x55c350bd1670 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f954f7fe700 10 client.7284 handle_command_reply: tid=0 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 client.7284 shutdown 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 msgr2=0x55c350c52f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350c52f80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9564014990 tx=0x7f956401d000 comp rx=0 tx=0).stop 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 shutdown_connections 2023-10-06T11:17:00.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:6834/2083914208,v1:172.21.15.55:6835/2083914208] conn(0x55c350bd1670 0x55c350bd1a40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c350beea90 0x55c350ba3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c350ba8bd0 0x55c350ba7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f954f7fe700 0 client.7284 ms_handle_reset on v2:172.21.15.55:6834/2083914208 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 --2- 172.21.15.55:0/431731532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c350baa9a0 0x55c350c52f80 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 >> 172.21.15.55:0/431731532 conn(0x55c350ba9070 msgr2=0x55c350bcb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 shutdown_connections 2023-10-06T11:17:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 1 -- 172.21.15.55:0/431731532 wait complete. 2023-10-06T11:17:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.000+0000 7f9580b26b80 20 client.7284 trim_cache size 0 max 16384 2023-10-06T11:17:00.012 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2bd5b0c1-a996-4dae-ab19-fd6663182240", 2023-10-06T11:17:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-10-06T11:17:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7149, 2023-10-06T11:17:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 9.9012849769999995, 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 68, 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 109, 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 109, 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 10.752351748000001 2023-10-06T11:17:00.013 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f955c066f60 msgr2=0x7f955c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f955c066f60 0x7f955c069410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9568009db0 tx=0x7f95680091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 msgr2=0x7f95700b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 0x7f95700b0600 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f9570071040 tx=0x7f9560018000 comp rx=0 tx=0).stop 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 shutdown_connections 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f955c066f60 0x7f955c069410 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9570143530 0x7f95700b0600 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95700cd500 0x7f9570138e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 --2- 172.21.15.55:0/691812511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9570143160 0x7f9570159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 >> 172.21.15.55:0/691812511 conn(0x7f95700d1010 msgr2=0x7f9570136a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 shutdown_connections 2023-10-06T11:17:00.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:00.001+0000 7f957782e700 1 -- 172.21.15.55:0/691812511 wait complete. 2023-10-06T11:17:00.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T11:17:00.157 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2023-10-06T11:17:00.157 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:17:00.158 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T11:17:00.295 INFO:teuthology.orchestra.run.smithi055.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":39,"op_send_bytes":11276,"op_resend":33,"op_reply":39,"oplen_avg":{"avgcount":39,"sum":61},"op":39,"op_r":0,"op_w":39,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2023-10-06T11:17:00.295 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 39, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 39, "op_resend": 33, "op_rmw": 0, "op_send": 39, "op_send_bytes": 11276, "op_w": 39, "oplen_avg": { "avgcount": 39, "sum": 61 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T11:17:00.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json export dir /bravo 1 2023-10-06T11:17:00.432 INFO:teuthology.orchestra.run.smithi055.stdout:{"return_code":0} 2023-10-06T11:17:00.432 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2023-10-06T11:17:00.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T11:17:00.570 INFO:teuthology.orchestra.run.smithi055.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":39,"op_send_bytes":11276,"op_resend":33,"op_reply":39,"oplen_avg":{"avgcount":39,"sum":61},"op":39,"op_r":0,"op_w":39,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2023-10-06T11:17:00.570 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 39, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 39, "op_resend": 33, "op_rmw": 0, "op_send": 39, "op_send_bytes": 11276, "op_w": 39, "oplen_avg": { "avgcount": 39, "sum": 61 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T11:17:00.571 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-06T11:17:05.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T11:17:05.722 INFO:teuthology.orchestra.run.smithi055.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":41,"op_send_bytes":14556,"op_resend":33,"op_reply":41,"oplen_avg":{"avgcount":41,"sum":64},"op":41,"op_r":0,"op_w":41,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":3,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":17,"omap_rd":0,"omap_del":1}} 2023-10-06T11:17:05.723 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 17, "op": 41, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 41, "op_resend": 33, "op_rmw": 0, "op_send": 41, "op_send_bytes": 14556, "op_w": 41, "oplen_avg": { "avgcount": 41, "sum": 64 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T11:17:05.723 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-06T11:17:08.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:08.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:10.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump objecter 2023-10-06T11:17:10.875 INFO:teuthology.orchestra.run.smithi055.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":14890,"op_resend":33,"op_reply":43,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":4,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":19,"omap_rd":0,"omap_del":1}} 2023-10-06T11:17:10.876 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 19, "op": 43, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 33, "op_rmw": 0, "op_send": 43, "op_send_bytes": 14890, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2023-10-06T11:17:10.876 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-06T11:17:10.876 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T11:17:10.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:10.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:10.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:17:10.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:10.936 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:17:10.965 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T11:17:10.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:10.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T11:17:11.009 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:17:11.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:11.009 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:17:11.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-06T11:17:11.204 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2023-10-06T11:17:11.205 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-10-06T11:17:11.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T11:17:11.359 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2023-10-06T11:17:11.359 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:17:11.359 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2023-10-06T11:17:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.393+0000 7f66c40a4240 1 -- start start 2023-10-06T11:17:11.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.393+0000 7f66c40a4240 1 Processor -- start 2023-10-06T11:17:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221a400 0x557cd2208580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 0x557cd2208b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221ac00 0x557cd2209080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd149adc0 con 0x557cd221a800 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd149bcc0 con 0x557cd221a400 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd149bb80 con 0x557cd221ac00 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 0x557cd2208b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 0x557cd2208b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55996/0 (socket says 172.21.15.55:55996) 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 -- 172.21.15.55:0/1472322365 learned_addr learned my addr 172.21.15.55:0/1472322365 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bdd73700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221ac00 0x557cd2209080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bd572700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221a400 0x557cd2208580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 -- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221ac00 msgr2=0x557cd2209080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221ac00 0x557cd2209080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 -- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221a400 msgr2=0x557cd2208580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221a400 0x557cd2208580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 -- 172.21.15.55:0/1472322365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd147e340 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bdd73700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221ac00 0x557cd2209080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bd572700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221a400 0x557cd2208580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bcd71700 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 0x557cd2208b00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x557cd21e7dd0 tx=0x557cd21ed1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2e1a4c48caf82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bad6d700 1 -- 172.21.15.55:0/1472322365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557cd1493600 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bad6d700 1 -- 172.21.15.55:0/1472322365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557cd14b0600 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66bad6d700 1 -- 172.21.15.55:0/1472322365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557cd14931e0 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cd147e000 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557cd147eea0 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.394+0000 7f66c40a4240 4 waiting for MDS map... 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66bad6d700 1 -- 172.21.15.55:0/1472322365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x557cd149ec40 con 0x557cd221a800 2023-10-06T11:17:11.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66bad6d700 1 -- 172.21.15.55:0/1472322365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 69) v1 ==== 3116+0+0 (secure 0 0 0) 0x557cd2248600 con 0x557cd221a800 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66c40a4240 4 Got MDS map 69 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66c40a4240 10 main: main 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66c40a4240 4 main: connecting to RADOS... 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66c40a4240 1 Processor -- start 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.395+0000 7f66c40a4240 1 -- start start 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221b800 0x557cd2209600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221bc00 0x557cd2209b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66c40a4240 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd149a3c0 con 0x557cd22c2000 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66c40a4240 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd149bcc0 con 0x557cd221bc00 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66c40a4240 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd149a000 con 0x557cd221b800 2023-10-06T11:17:11.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56004/0 (socket says 172.21.15.55:56004) 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 -- 172.21.15.55:0/3680706116 learned_addr learned my addr 172.21.15.55:0/3680706116 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bd572700 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221bc00 0x557cd2209b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bdd73700 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221b800 0x557cd2209600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 -- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221b800 msgr2=0x557cd2209600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221b800 0x557cd2209600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 -- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221bc00 msgr2=0x557cd2209b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221bc00 0x557cd2209b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bcd71700 1 -- 172.21.15.55:0/3680706116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd147f860 con 0x557cd22c2000 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.396+0000 7f66bd572700 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221bc00 0x557cd2209b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:11.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66bcd71700 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 0x557cd220a100 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x557cd222f2f0 tx=0x557cd15162a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab8c73b075e8e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66b8d69700 1 -- 172.21.15.55:0/3680706116 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557cd1492f20 con 0x557cd22c2000 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66b8d69700 1 -- 172.21.15.55:0/3680706116 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557cd14b0000 con 0x557cd22c2000 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66b8d69700 1 -- 172.21.15.55:0/3680706116 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557cd1493600 con 0x557cd22c2000 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 -- 172.21.15.55:0/3680706116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 msgr2=0x557cd220a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 0x557cd220a100 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x557cd222f2f0 tx=0x557cd15162a0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 -- 172.21.15.55:0/3680706116 shutdown_connections 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221b800 0x557cd2209600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 --2- 172.21.15.55:0/3680706116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221bc00 0x557cd2209b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 -- 172.21.15.55:0/3680706116 >> 172.21.15.55:0/3680706116 conn(0x557cd221b000 msgr2=0x557cd154b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 -- 172.21.15.55:0/3680706116 shutdown_connections 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.397+0000 7f66c40a4240 1 -- 172.21.15.55:0/3680706116 wait complete. 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 Processor -- start 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 -- start start 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221bc00 0x557cd220ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221b800 0x557cd220a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd149b180 con 0x557cd221b800 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cd149b040 con 0x557cd22c2000 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66c40a4240 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cd149af00 con 0x557cd221bc00 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.398+0000 7f66bd572700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221b800 0x557cd220a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221b800 0x557cd220a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56012/0 (socket says 172.21.15.55:56012) 2023-10-06T11:17:11.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 -- 172.21.15.55:0/2998256735 learned_addr learned my addr 172.21.15.55:0/2998256735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bdd73700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221bc00 0x557cd220ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bcd71700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 -- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221bc00 msgr2=0x557cd220ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221bc00 0x557cd220ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 -- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd22c2000 msgr2=0x557cd220a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd22c2000 0x557cd220a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 -- 172.21.15.55:0/2998256735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cd147eea0 con 0x557cd221b800 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66bd572700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221b800 0x557cd220a680 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x557cd22c8090 tx=0x557cd2266e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66b7566700 1 -- 172.21.15.55:0/2998256735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557cd1492f20 con 0x557cd221b800 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66b7566700 1 -- 172.21.15.55:0/2998256735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557cd14b0300 con 0x557cd221b800 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557cd147fa00 con 0x557cd221b800 2023-10-06T11:17:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66b7566700 1 -- 172.21.15.55:0/2998256735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557cd1493600 con 0x557cd221b800 2023-10-06T11:17:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cd147eea0 con 0x557cd221b800 2023-10-06T11:17:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.399+0000 7f66c40a4240 4 main: resolving pool 16 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66b7566700 1 -- 172.21.15.55:0/2998256735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x557cd21d1080 con 0x557cd221b800 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66b7566700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x557cd22d4400 0x557cd220b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66b7566700 1 -- 172.21.15.55:0/2998256735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x557cd149ea80 con 0x557cd221b800 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66c40a4240 4 main: creating IoCtx.. 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66c40a4240 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x557cd22c2400 0x557cd2209b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- osd_op(unknown.0.0:1 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x557cd22c2800 con 0x557cd22c2400 2023-10-06T11:17:11.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66bdd73700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x557cd22d4400 0x557cd220b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66bcd71700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x557cd22c2400 0x557cd2209b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66bcd71700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x557cd22c2400 0x557cd2209b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.401+0000 7f66bdd73700 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x557cd22d4400 0x557cd220b700 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x557cd21e68d0 tx=0x557cd2214300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66bcd71700 1 -- 172.21.15.55:0/2998256735 <== osd.1 v2:172.21.15.55:6800/90686 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+14 (crc 0 0 0) 0x557cd222afc0 con 0x557cd22c2400 2023-10-06T11:17:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- osd_op(unknown.0.0:2 16.b 16:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x557cd22c2c00 con 0x557cd22c2400 2023-10-06T11:17:11.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66bcd71700 1 -- 172.21.15.55:0/2998256735 <== osd.1 v2:172.21.15.55:6800/90686 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) v8 ==== 159+0+5 (crc 0 0 0) 0x557cd222afc0 con 0x557cd22c2400 2023-10-06T11:17:11.413 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:11.413 INFO:teuthology.orchestra.run.smithi055.stdout: "0": { 2023-10-06T11:17:11.413 INFO:teuthology.orchestra.run.smithi055.stdout: "data": { 2023-10-06T11:17:11.413 INFO:teuthology.orchestra.run.smithi055.stdout: "sessions": [] 2023-10-06T11:17:11.413 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-10-06T11:17:11.414 INFO:teuthology.orchestra.run.smithi055.stdout: "result": 0 2023-10-06T11:17:11.414 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-10-06T11:17:11.414 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:11.414 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:11.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x557cd22c2400 msgr2=0x557cd2209b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x557cd22c2400 0x557cd2209b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x557cd22d4400 msgr2=0x557cd220b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x557cd22d4400 0x557cd220b700 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x557cd21e68d0 tx=0x557cd2214300 comp rx=0 tx=0).stop 2023-10-06T11:17:11.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221b800 msgr2=0x557cd220a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/2998256735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221b800 0x557cd220a680 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x557cd22c8090 tx=0x557cd2266e40 comp rx=0 tx=0).stop 2023-10-06T11:17:11.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66bd572700 1 -- 172.21.15.55:0/2998256735 reap_dead start 2023-10-06T11:17:11.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 shutdown_connections 2023-10-06T11:17:11.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 >> 172.21.15.55:0/2998256735 conn(0x557cd221b000 msgr2=0x557cd154b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 shutdown_connections 2023-10-06T11:17:11.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/2998256735 wait complete. 2023-10-06T11:17:11.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 msgr2=0x557cd2208b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 0x557cd2208b00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x557cd21e7dd0 tx=0x557cd21ed1a0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 shutdown_connections 2023-10-06T11:17:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557cd221ac00 0x557cd2209080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557cd221a400 0x557cd2208580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.402+0000 7f66c40a4240 1 --2- 172.21.15.55:0/1472322365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557cd221a800 0x557cd2208b00 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.403+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 >> 172.21.15.55:0/1472322365 conn(0x557cd221a000 msgr2=0x557cd154b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.403+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 shutdown_connections 2023-10-06T11:17:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.403+0000 7f66c40a4240 1 -- 172.21.15.55:0/1472322365 wait complete. 2023-10-06T11:17:11.424 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.064372, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2023-10-06T11:17:11.424 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2023-10-06T11:17:11.424 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:17:11.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:17:11.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:17:11.543 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:17:11.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:11.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.661+0000 7f0d8be4d700 1 Processor -- start 2023-10-06T11:17:11.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.661+0000 7f0d8be4d700 1 -- start start 2023-10-06T11:17:11.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d8be4d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d840c65f0 0x7f0d840ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d8be4d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840cff30 con 0x7f0d840c69c0 2023-10-06T11:17:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d8be4d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840cf0c0 con 0x7f0d840cb5d0 2023-10-06T11:17:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d8be4d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840cdf00 con 0x7f0d840c65f0 2023-10-06T11:17:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d89be9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d840c65f0 0x7f0d840ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d8a3ea700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d840c69c0 0x7f0d840b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46810/0 (socket says 172.21.15.55:46810) 2023-10-06T11:17:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d8a3ea700 1 -- 172.21.15.55:0/2332505706 learned_addr learned my addr 172.21.15.55:0/2332505706 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d89be9700 1 -- 172.21.15.55:0/2332505706 >> v1:172.21.15.142:6789/0 conn(0x7f0d840cb5d0 legacy=0x7f0d84159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d89be9700 1 -- 172.21.15.55:0/2332505706 >> v1:172.21.15.55:6789/0 conn(0x7f0d840c69c0 legacy=0x7f0d840b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d89be9700 1 -- 172.21.15.55:0/2332505706 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840d03c0 con 0x7f0d840c65f0 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d88be7700 1 -- 172.21.15.55:0/2332505706 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255804795 0 0) 0x7f0d840cff30 con 0x7f0d840c69c0 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.662+0000 7f0d89be9700 1 --2- 172.21.15.55:0/2332505706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d840ceb80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0d740098d0 tx=0x7f0d74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06aac95f52a1c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d88be7700 1 -- 172.21.15.55:0/2332505706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74009e70 con 0x7f0d840c65f0 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d88be7700 1 -- 172.21.15.55:0/2332505706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74005c10 con 0x7f0d840c65f0 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d88be7700 1 -- 172.21.15.55:0/2332505706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400b650 con 0x7f0d840c65f0 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 -- 172.21.15.55:0/2332505706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 msgr2=0x7f0d840ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/2332505706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d840ceb80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0d740098d0 tx=0x7f0d74009120 comp rx=0 tx=0).stop 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 -- 172.21.15.55:0/2332505706 shutdown_connections 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/2332505706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d840ceb80 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 -- 172.21.15.55:0/2332505706 >> 172.21.15.55:0/2332505706 conn(0x7f0d840d1080 msgr2=0x7f0d840cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 -- 172.21.15.55:0/2332505706 shutdown_connections 2023-10-06T11:17:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.663+0000 7f0d8be4d700 1 -- 172.21.15.55:0/2332505706 wait complete. 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.664+0000 7f0d8be4d700 1 Processor -- start 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.664+0000 7f0d8be4d700 1 -- start start 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8be4d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d84151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8be4d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d840c69c0 0x7f0d84157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8be4d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d840cb5d0 0x7f0d841440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8be4d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84157d90 con 0x7f0d840c65f0 2023-10-06T11:17:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8be4d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84151b20 con 0x7f0d840cb5d0 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8be4d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8416cf90 con 0x7f0d840c69c0 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d89be9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d84151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d89be9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d84151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56026/0 (socket says 172.21.15.55:56026) 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d89be9700 1 -- 172.21.15.55:0/801659460 learned_addr learned my addr 172.21.15.55:0/801659460 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d8a3ea700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d840cb5d0 0x7f0d841440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d89be9700 1 -- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d840c69c0 msgr2=0x7f0d84157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.665+0000 7f0d89be9700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d840c69c0 0x7f0d84157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d89be9700 1 -- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d840cb5d0 msgr2=0x7f0d841440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d89be9700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d840cb5d0 0x7f0d841440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d89be9700 1 -- 172.21.15.55:0/801659460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740093c0 con 0x7f0d840c65f0 2023-10-06T11:17:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d89be9700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d84151200 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0d840cf250 tx=0x7f0d74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74006460 con 0x7f0d840c65f0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740065c0 con 0x7f0d840c65f0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84144600 con 0x7f0d840c65f0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7401b480 con 0x7f0d840c65f0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.666+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84158300 con 0x7f0d840c65f0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.667+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8404c380 con 0x7f0d840c65f0 2023-10-06T11:17:11.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.668+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d7401b7f0 con 0x7f0d840c65f0 2023-10-06T11:17:11.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.668+0000 7f0d81ffb700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d70066f30 0x7f0d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.668+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0d74086b50 con 0x7f0d840c65f0 2023-10-06T11:17:11.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.668+0000 7f0d893e8700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d70066f30 0x7f0d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.669+0000 7f0d893e8700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d70066f30 0x7f0d700693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0d84157710 tx=0x7f0d78007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.672+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d74053a90 con 0x7f0d840c65f0 2023-10-06T11:17:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.909+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d840cf320 con 0x7f0d840c65f0 2023-10-06T11:17:11.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.910+0000 7f0d81ffb700 1 -- 172.21.15.55:0/801659460 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4619 (secure 0 0 0) 0x7f0d740570b0 con 0x7f0d840c65f0 2023-10-06T11:17:11.912 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:11.912 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:17:05.145701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7149,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:17:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d70066f30 msgr2=0x7f0d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d70066f30 0x7f0d700693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0d84157710 tx=0x7f0d78007ab0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 msgr2=0x7f0d84151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d84151200 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0d840cf250 tx=0x7f0d74016000 comp rx=0 tx=0).stop 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 shutdown_connections 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0d70066f30 0x7f0d700693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d840c65f0 0x7f0d84151200 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d840cb5d0 0x7f0d841440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 --2- 172.21.15.55:0/801659460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d840c69c0 0x7f0d84157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 >> 172.21.15.55:0/801659460 conn(0x7f0d840d1080 msgr2=0x7f0d840b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 shutdown_connections 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:11.912+0000 7f0d8be4d700 1 -- 172.21.15.55:0/801659460 wait complete. 2023-10-06T11:17:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 69 2023-10-06T11:17:11.926 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.043+0000 7fc14a086700 1 Processor -- start 2023-10-06T11:17:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.043+0000 7fc14a086700 1 -- start start 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc14a086700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1440cef10 0x7fc1441596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc14a086700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440cb630 con 0x7fc1440ceb40 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc14a086700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440cb910 con 0x7fc1440cb0c0 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc14a086700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1440cbbf0 con 0x7fc1440cef10 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc143fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1440cef10 0x7fc1441596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc1437fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1440ceb40 0x7fc1440c6670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46816/0 (socket says 172.21.15.55:46816) 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc1437fe700 1 -- 172.21.15.55:0/833244403 learned_addr learned my addr 172.21.15.55:0/833244403 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc143fff700 1 -- 172.21.15.55:0/833244403 >> v1:172.21.15.142:6789/0 conn(0x7fc1440cb0c0 legacy=0x7fc144158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc143fff700 1 -- 172.21.15.55:0/833244403 >> v1:172.21.15.55:6789/0 conn(0x7fc1440ceb40 legacy=0x7fc1440c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc143fff700 1 -- 172.21.15.55:0/833244403 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440cbed0 con 0x7fc1440cef10 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.044+0000 7fc143fff700 1 --2- 172.21.15.55:0/833244403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc1441596c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009e90 tx=0x7fc13c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0d318e102d32f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc1427fc700 1 -- 172.21.15.55:0/833244403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00e070 con 0x7fc1440cef10 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc1427fc700 1 -- 172.21.15.55:0/833244403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00bbb0 con 0x7fc1440cef10 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc1427fc700 1 -- 172.21.15.55:0/833244403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c012430 con 0x7fc1440cef10 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 -- 172.21.15.55:0/833244403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 msgr2=0x7fc1441596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 --2- 172.21.15.55:0/833244403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc1441596c0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009e90 tx=0x7fc13c009780 comp rx=0 tx=0).stop 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 -- 172.21.15.55:0/833244403 shutdown_connections 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 --2- 172.21.15.55:0/833244403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc1441596c0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 -- 172.21.15.55:0/833244403 >> 172.21.15.55:0/833244403 conn(0x7fc1440d0550 msgr2=0x7fc1440d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 -- 172.21.15.55:0/833244403 shutdown_connections 2023-10-06T11:17:12.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.045+0000 7fc14a086700 1 -- 172.21.15.55:0/833244403 wait complete. 2023-10-06T11:17:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.046+0000 7fc14a086700 1 Processor -- start 2023-10-06T11:17:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.046+0000 7fc14a086700 1 -- start start 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc14a086700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1440cb0c0 0x7fc1440b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc14a086700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1440ceb40 0x7fc144169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc14a086700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc14415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc14a086700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14416a910 con 0x7fc1440cef10 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc14a086700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14416ab30 con 0x7fc1440ceb40 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc14a086700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14416d360 con 0x7fc1440cb0c0 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc143fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc14415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc143fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc14415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56052/0 (socket says 172.21.15.55:56052) 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc143fff700 1 -- 172.21.15.55:0/465404554 learned_addr learned my addr 172.21.15.55:0/465404554 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc1437fe700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1440cb0c0 0x7fc1440b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc142ffd700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1440ceb40 0x7fc144169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc143fff700 1 -- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1440cb0c0 msgr2=0x7fc1440b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc143fff700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1440cb0c0 0x7fc1440b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.047+0000 7fc143fff700 1 -- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1440ceb40 msgr2=0x7fc144169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc143fff700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1440ceb40 0x7fc144169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc143fff700 1 -- 172.21.15.55:0/465404554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009a20 con 0x7fc1440cef10 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc1437fe700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1440cb0c0 0x7fc1440b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc142ffd700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1440ceb40 0x7fc144169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc143fff700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc14415aa80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0099f0 tx=0x7fc13c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c01e710 con 0x7fc1440cef10 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c01e870 con 0x7fc1440cef10 2023-10-06T11:17:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14416d640 con 0x7fc1440cef10 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c01ec30 con 0x7fc1440cef10 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.048+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1440b5240 con 0x7fc1440cef10 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.049+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14416d880 con 0x7fc1440cef10 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.049+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc13c01c3c0 con 0x7fc1440cef10 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.050+0000 7fc12b7fe700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.050+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc13c086b90 con 0x7fc1440cef10 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.050+0000 7fc1437fe700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.051+0000 7fc1437fe700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc130066f30 0x7fc1300693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc134001820 tx=0x7fc134009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.054+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc13c053ad0 con 0x7fc1440cef10 2023-10-06T11:17:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.247+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1440b53d0 con 0x7fc1440cef10 2023-10-06T11:17:12.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.248+0000 7fc12b7fe700 1 -- 172.21.15.55:0/465404554 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17314 (secure 0 0 0) 0x7fc13c0570f0 con 0x7fc1440cef10 2023-10-06T11:17:12.250 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:12.250 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:56.119211+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:31.352151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:32.593083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.25","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6836/2387992820":"2023-10-07T11:16:49.087130+0000","172.21.15.142:6834/2387992820":"2023-10-07T11:16:49.087130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc130066f30 msgr2=0x7fc1300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc130066f30 0x7fc1300693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc134001820 tx=0x7fc134009040 comp rx=0 tx=0).stop 2023-10-06T11:17:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 msgr2=0x7fc14415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc14415aa80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0099f0 tx=0x7fc13c018000 comp rx=0 tx=0).stop 2023-10-06T11:17:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 shutdown_connections 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc130066f30 0x7fc1300693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1440cef10 0x7fc14415aa80 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1440cb0c0 0x7fc1440b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 --2- 172.21.15.55:0/465404554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1440ceb40 0x7fc144169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 >> 172.21.15.55:0/465404554 conn(0x7fc1440d0550 msgr2=0x7fc144155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 shutdown_connections 2023-10-06T11:17:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.250+0000 7fc14a086700 1 -- 172.21.15.55:0/465404554 wait complete. 2023-10-06T11:17:12.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:13:00.897326+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:13:05.917155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:16:31.352151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:16:32.593083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:17:12.265 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:17:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.385+0000 7fcc522a5700 1 Processor -- start 2023-10-06T11:17:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.385+0000 7fcc522a5700 1 -- start start 2023-10-06T11:17:12.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc522a5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 0x7fcc4c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc522a5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c0c72e0 con 0x7fcc4c156120 2023-10-06T11:17:12.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc522a5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c0afe10 con 0x7fcc4c1564f0 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc522a5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c7000 con 0x7fcc4c06bae0 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc4c156120 0x7fcc4c06b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46826/0 (socket says 172.21.15.55:46826) 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4bfff700 1 -- 172.21.15.55:0/2667016777 learned_addr learned my addr 172.21.15.55:0/2667016777 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 0x7fcc4c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918215792 0 0) 0x7fcc4c0c72e0 con 0x7fcc4c156120 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc34003570 con 0x7fcc4c156120 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700944835 0 0) 0x7fcc34003570 con 0x7fcc4c156120 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 msgr2=0x7fcc4c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 0x7fcc4c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 >> v1:172.21.15.142:6789/0 conn(0x7fcc4c1564f0 legacy=0x7fcc4c0685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c06bf90 con 0x7fcc4c156120 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fcc3c001470 con 0x7fcc4c156120 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 >> v1:172.21.15.55:6789/0 conn(0x7fcc4c156120 legacy=0x7fcc4c06b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.386+0000 7fcc4affd700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc34003a90 0x7fcc34003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 0x7fcc340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c7000 con 0x7fcc34004810 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3400bb10 con 0x7fcc34003a90 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3400dee0 con 0x7fcc4c06bae0 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4bfff700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc34003a90 0x7fcc34003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc50842700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 0x7fcc340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 -- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 msgr2=0x7fcc340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c06bae0 0x7fcc340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 -- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc34003a90 msgr2=0x7fcc34003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc34003a90 0x7fcc34003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 -- 172.21.15.55:0/2667016777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34003570 con 0x7fcc34004810 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc34004c80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009c00 tx=0x7fcc400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1f2addc7f5c490 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000e710 con 0x7fcc34004810 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000e870 con 0x7fcc34004810 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.387+0000 7fcc4affd700 1 -- 172.21.15.55:0/2667016777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000ec30 con 0x7fcc34004810 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc522a5700 1 -- 172.21.15.55:0/2667016777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 msgr2=0x7fcc34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc522a5700 1 --2- 172.21.15.55:0/2667016777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc34004c80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009c00 tx=0x7fcc400091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc50842700 1 -- 172.21.15.55:0/2667016777 reap_dead start 2023-10-06T11:17:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc522a5700 1 -- 172.21.15.55:0/2667016777 shutdown_connections 2023-10-06T11:17:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc522a5700 1 -- 172.21.15.55:0/2667016777 >> 172.21.15.55:0/2667016777 conn(0x7fcc4c0c9f00 msgr2=0x7fcc4c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc522a5700 1 -- 172.21.15.55:0/2667016777 shutdown_connections 2023-10-06T11:17:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.388+0000 7fcc522a5700 1 -- 172.21.15.55:0/2667016777 wait complete. 2023-10-06T11:17:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.389+0000 7fcc522a5700 1 Processor -- start 2023-10-06T11:17:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.389+0000 7fcc522a5700 1 -- start start 2023-10-06T11:17:12.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc4c0c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c13af70 0x7fcc4c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c0c3fb0 0x7fcc4c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c4570 con 0x7fcc34004810 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c5f60 con 0x7fcc4c0c3fb0 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c6240 con 0x7fcc4c13af70 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc4c0c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc4c0c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56076/0 (socket says 172.21.15.55:56076) 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 -- 172.21.15.55:0/1611824459 learned_addr learned my addr 172.21.15.55:0/1611824459 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc50842700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c0c3fb0 0x7fcc4c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c13af70 0x7fcc4c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 -- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c13af70 msgr2=0x7fcc4c0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c13af70 0x7fcc4c0c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 -- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c0c3fb0 msgr2=0x7fcc4c0b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c0c3fb0 0x7fcc4c0b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 -- 172.21.15.55:0/1611824459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0c6520 con 0x7fcc34004810 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc50842700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c0c3fb0 0x7fcc4c0b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c13af70 0x7fcc4c0c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc4bfff700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc4c0c6a40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000e10 tx=0x7fcc4c0c7140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c018030 con 0x7fcc34004810 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0077d0 con 0x7fcc34004810 2023-10-06T11:17:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c166060 con 0x7fcc34004810 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.390+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00fb00 con 0x7fcc34004810 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.391+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c0c5b80 con 0x7fcc34004810 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.391+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c0c5d70 con 0x7fcc34004810 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.392+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc3c01b070 con 0x7fcc34004810 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.392+0000 7fcc33fff700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcc38066f30 0x7fcc380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.392+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fcc3c019070 con 0x7fcc34004810 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.392+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcc38066f30 0x7fcc380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.393+0000 7fcc4b7fe700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcc38066f30 0x7fcc380693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcc400091e0 tx=0x7fcc4001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.397+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc3c051670 con 0x7fcc34004810 2023-10-06T11:17:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.591+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc4c0c46b0 con 0x7fcc34004810 2023-10-06T11:17:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.591+0000 7fcc33fff700 1 -- 172.21.15.55:0/1611824459 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc3c054c90 con 0x7fcc34004810 2023-10-06T11:17:12.593 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-10-06T11:17:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcc38066f30 msgr2=0x7fcc380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcc38066f30 0x7fcc380693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcc400091e0 tx=0x7fcc4001a000 comp rx=0 tx=0).stop 2023-10-06T11:17:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 msgr2=0x7fcc4c0c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc4c0c6a40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000e10 tx=0x7fcc4c0c7140 comp rx=0 tx=0).stop 2023-10-06T11:17:12.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 shutdown_connections 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fcc38066f30 0x7fcc380693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc34004810 0x7fcc4c0c6a40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c0c3fb0 0x7fcc4c0b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 --2- 172.21.15.55:0/1611824459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c13af70 0x7fcc4c0c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 >> 172.21.15.55:0/1611824459 conn(0x7fcc4c0c9f00 msgr2=0x7fcc4c155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 shutdown_connections 2023-10-06T11:17:12.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.593+0000 7fcc522a5700 1 -- 172.21.15.55:0/1611824459 wait complete. 2023-10-06T11:17:12.607 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:17:12.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.727+0000 7fc69d39f700 1 Processor -- start 2023-10-06T11:17:12.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.727+0000 7fc69d39f700 1 -- start start 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.728+0000 7fc69d39f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6981593b0 0x7fc6980cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.728+0000 7fc69d39f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6980b1190 con 0x7fc69815d900 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.728+0000 7fc69d39f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6980cfb60 con 0x7fc698159780 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.728+0000 7fc69d39f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6980d0400 con 0x7fc6981593b0 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.728+0000 7fc6977fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc69815d900 0x7fc6980b1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46840/0 (socket says 172.21.15.55:46840) 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.728+0000 7fc6977fe700 1 -- 172.21.15.55:0/2168620141 learned_addr learned my addr 172.21.15.55:0/2168620141 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc696ffd700 1 --2- 172.21.15.55:0/2168620141 >> v2:172.21.15.142:3300/0 conn(0x7fc6981593b0 0x7fc6980cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595228196 0 0) 0x7fc6980b1190 con 0x7fc69815d900 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc684003570 con 0x7fc69815d900 2023-10-06T11:17:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997999415 0 0) 0x7fc684003570 con 0x7fc69815d900 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 >> v2:172.21.15.142:3300/0 conn(0x7fc6981593b0 msgr2=0x7fc6980cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 --2- 172.21.15.55:0/2168620141 >> v2:172.21.15.142:3300/0 conn(0x7fc6981593b0 0x7fc6980cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 >> v1:172.21.15.142:6789/0 conn(0x7fc698159780 legacy=0x7fc69815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980cfe40 con 0x7fc69815d900 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fc6880017f0 con 0x7fc69815d900 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 >> v1:172.21.15.55:6789/0 conn(0x7fc69815d900 legacy=0x7fc6980b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc684003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc684004810 0x7fc684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840052e0 0x7fc68400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980d0400 con 0x7fc684003a60 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68400c2a0 con 0x7fc684004810 2023-10-06T11:17:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68400c460 con 0x7fc6840052e0 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc696ffd700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc684003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc6967fc700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc684004810 0x7fc684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.729+0000 7fc6977fe700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840052e0 0x7fc68400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc696ffd700 1 -- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840052e0 msgr2=0x7fc68400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc696ffd700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840052e0 0x7fc68400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc696ffd700 1 -- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc684004810 msgr2=0x7fc684004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc696ffd700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc684004810 0x7fc684004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc696ffd700 1 -- 172.21.15.55:0/2168620141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684003570 con 0x7fc684003a60 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc6977fe700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6840052e0 0x7fc68400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc6977fe700 1 -- 172.21.15.55:0/2168620141 reap_dead start 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc696ffd700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc684003e70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc690009c00 tx=0x7fc6900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322762c2a6ecca77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69000e710 con 0x7fc684003a60 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69000e870 con 0x7fc684003a60 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc695ffb700 1 -- 172.21.15.55:0/2168620141 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69000ec30 con 0x7fc684003a60 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 -- 172.21.15.55:0/2168620141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 msgr2=0x7fc684003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc684003e70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc690009c00 tx=0x7fc6900091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 -- 172.21.15.55:0/2168620141 shutdown_connections 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 --2- 172.21.15.55:0/2168620141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc684003e70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 -- 172.21.15.55:0/2168620141 >> 172.21.15.55:0/2168620141 conn(0x7fc6980d05c0 msgr2=0x7fc6980d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 -- 172.21.15.55:0/2168620141 shutdown_connections 2023-10-06T11:17:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.730+0000 7fc69d39f700 1 -- 172.21.15.55:0/2168620141 wait complete. 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 Processor -- start 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 -- start start 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc6981516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69815ee50 0x7fc69815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69815c330 0x7fc69815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69815a710 con 0x7fc684003a60 2023-10-06T11:17:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981562a0 con 0x7fc69815c330 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.732+0000 7fc69d39f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc698156860 con 0x7fc69815ee50 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc6981516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc6981516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56094/0 (socket says 172.21.15.55:56094) 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 -- 172.21.15.55:0/125021286 learned_addr learned my addr 172.21.15.55:0/125021286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc6967fc700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69815ee50 0x7fc69815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 -- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69815ee50 msgr2=0x7fc69815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69815ee50 0x7fc69815f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 -- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69815c330 msgr2=0x7fc69815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69815c330 0x7fc69815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 -- 172.21.15.55:0/125021286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69815f800 con 0x7fc684003a60 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc696ffd700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc6981516c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c270 tx=0x7fc69001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690022070 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69000e9e0 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69815fa80 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69001c450 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.733+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6981564f0 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.734+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69804c380 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.735+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc69001c880 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.735+0000 7fc68effd700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc678066f30 0x7fc6780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.735+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc690085f10 con 0x7fc684003a60 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.735+0000 7fc6967fc700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc678066f30 0x7fc6780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.736+0000 7fc6967fc700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc678066f30 0x7fc6780693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc680000c00 tx=0x7fc680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.739+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc690052f00 con 0x7fc684003a60 2023-10-06T11:17:12.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.933+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6980d0120 con 0x7fc684003a60 2023-10-06T11:17:12.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.933+0000 7fc68effd700 1 -- 172.21.15.55:0/125021286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6900170a0 con 0x7fc684003a60 2023-10-06T11:17:12.935 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-10-06T11:17:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc678066f30 msgr2=0x7fc6780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc678066f30 0x7fc6780693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc680000c00 tx=0x7fc680009040 comp rx=0 tx=0).stop 2023-10-06T11:17:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 msgr2=0x7fc6981516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc6981516c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c270 tx=0x7fc69001a000 comp rx=0 tx=0).stop 2023-10-06T11:17:12.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 shutdown_connections 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fc678066f30 0x7fc6780693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc684003a60 0x7fc6981516c0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc69815c330 0x7fc69815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 --2- 172.21.15.55:0/125021286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc69815ee50 0x7fc69815f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 >> 172.21.15.55:0/125021286 conn(0x7fc6980d05c0 msgr2=0x7fc6980b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 shutdown_connections 2023-10-06T11:17:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:12.935+0000 7fc69d39f700 1 -- 172.21.15.55:0/125021286 wait complete. 2023-10-06T11:17:12.949 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:17:13.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.069+0000 7fb653f74700 1 Processor -- start 2023-10-06T11:17:13.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.069+0000 7fb653f74700 1 -- start start 2023-10-06T11:17:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb653f74700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb64c0675a0 0x7fb64c140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb653f74700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb64c06deb0 0x7fb64c141020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb653f74700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c0af340 con 0x7fb64c06dae0 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb653f74700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c141560 con 0x7fb64c06deb0 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb653f74700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c0c73b0 con 0x7fb64c0675a0 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb652511700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb64c06deb0 0x7fb64c141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb651d10700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb64c06dae0 0x7fb64c0684c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46850/0 (socket says 172.21.15.55:46850) 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb651d10700 1 -- 172.21.15.55:0/3776018065 learned_addr learned my addr 172.21.15.55:0/3776018065 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb65150f700 1 --2- 172.21.15.55:0/3776018065 >> v2:172.21.15.142:3300/0 conn(0x7fb64c0675a0 0x7fb64c140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb652511700 1 -- 172.21.15.55:0/3776018065 >> v2:172.21.15.142:3300/0 conn(0x7fb64c0675a0 msgr2=0x7fb64c140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb652511700 1 --2- 172.21.15.55:0/3776018065 >> v2:172.21.15.142:3300/0 conn(0x7fb64c0675a0 0x7fb64c140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb652511700 1 -- 172.21.15.55:0/3776018065 >> v1:172.21.15.55:6789/0 conn(0x7fb64c06dae0 legacy=0x7fb64c0684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb652511700 1 -- 172.21.15.55:0/3776018065 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c068d10 con 0x7fb64c06deb0 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb65150f700 1 --2- 172.21.15.55:0/3776018065 >> v2:172.21.15.142:3300/0 conn(0x7fb64c0675a0 0x7fb64c140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb652511700 1 --2- 172.21.15.55:0/3776018065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06deb0 0x7fb64c141020 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0695d0 tx=0x7fb644009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6640ff74d2ebae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.070+0000 7fb650d0e700 1 -- 172.21.15.55:0/3776018065 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64400e070 con 0x7fb64c06deb0 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb650d0e700 1 -- 172.21.15.55:0/3776018065 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64400bc30 con 0x7fb64c06deb0 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb650d0e700 1 -- 172.21.15.55:0/3776018065 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644012430 con 0x7fb64c06deb0 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 -- 172.21.15.55:0/3776018065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06deb0 msgr2=0x7fb64c141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 --2- 172.21.15.55:0/3776018065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06deb0 0x7fb64c141020 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0695d0 tx=0x7fb644009780 comp rx=0 tx=0).stop 2023-10-06T11:17:13.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 -- 172.21.15.55:0/3776018065 shutdown_connections 2023-10-06T11:17:13.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 --2- 172.21.15.55:0/3776018065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06deb0 0x7fb64c141020 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 --2- 172.21.15.55:0/3776018065 >> v2:172.21.15.142:3300/0 conn(0x7fb64c0675a0 0x7fb64c140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 -- 172.21.15.55:0/3776018065 >> 172.21.15.55:0/3776018065 conn(0x7fb64c0c8ff0 msgr2=0x7fb64c0c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 -- 172.21.15.55:0/3776018065 shutdown_connections 2023-10-06T11:17:13.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.071+0000 7fb653f74700 1 -- 172.21.15.55:0/3776018065 wait complete. 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.072+0000 7fb653f74700 1 Processor -- start 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.072+0000 7fb653f74700 1 -- start start 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb653f74700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb64c0675a0 0x7fb64c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb653f74700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 0x7fb64c16ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb653f74700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb64c06deb0 0x7fb64c16b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb653f74700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0c4350 con 0x7fb64c06dae0 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb653f74700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c158a20 con 0x7fb64c0675a0 2023-10-06T11:17:13.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb653f74700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0c3740 con 0x7fb64c06deb0 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 0x7fb64c16ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 0x7fb64c16ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56124/0 (socket says 172.21.15.55:56124) 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 -- 172.21.15.55:0/707281621 learned_addr learned my addr 172.21.15.55:0/707281621 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb651d10700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb64c0675a0 0x7fb64c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb652511700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb64c06deb0 0x7fb64c16b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 -- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb64c06deb0 msgr2=0x7fb64c16b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb64c06deb0 0x7fb64c16b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 -- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb64c0675a0 msgr2=0x7fb64c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb64c0675a0 0x7fb64c1584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb65150f700 1 -- 172.21.15.55:0/707281621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009a20 con 0x7fb64c06dae0 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.073+0000 7fb651d10700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb64c0675a0 0x7fb64c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.074+0000 7fb65150f700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 0x7fb64c16ad90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c850 tx=0x7fb63c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.074+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011600 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.074+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c011760 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.074+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c0c3a20 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.074+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011b00 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.074+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c0c3fe0 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.075+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c0c6ca0 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.075+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63c0073b0 con 0x7fb64c06dae0 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.076+0000 7fb641ffb700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.076+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fb63c084840 con 0x7fb64c06dae0 2023-10-06T11:17:13.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.076+0000 7fb651d10700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.076+0000 7fb651d10700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb630066f30 0x7fb6300693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb648001780 tx=0x7fb648009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.080+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb63c051780 con 0x7fb64c06dae0 2023-10-06T11:17:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.274+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb64c04c380 con 0x7fb64c06dae0 2023-10-06T11:17:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.275+0000 7fb641ffb700 1 -- 172.21.15.55:0/707281621 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb63c054da0 con 0x7fb64c06dae0 2023-10-06T11:17:13.277 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-10-06T11:17:13.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.276+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb630066f30 msgr2=0x7fb6300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.276+0000 7fb653f74700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb630066f30 0x7fb6300693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb648001780 tx=0x7fb648009040 comp rx=0 tx=0).stop 2023-10-06T11:17:13.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.276+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 msgr2=0x7fb64c16ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.276+0000 7fb653f74700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 0x7fb64c16ad90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c850 tx=0x7fb63c008040 comp rx=0 tx=0).stop 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 shutdown_connections 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb630066f30 0x7fb6300693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb64c06deb0 0x7fb64c16b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb64c0675a0 0x7fb64c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 --2- 172.21.15.55:0/707281621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb64c06dae0 0x7fb64c16ad90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 >> 172.21.15.55:0/707281621 conn(0x7fb64c0c8ff0 msgr2=0x7fb64c15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 shutdown_connections 2023-10-06T11:17:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.277+0000 7fb653f74700 1 -- 172.21.15.55:0/707281621 wait complete. 2023-10-06T11:17:13.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:17:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.410+0000 7eff97b70700 1 Processor -- start 2023-10-06T11:17:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.410+0000 7eff97b70700 1 -- start start 2023-10-06T11:17:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.411+0000 7eff97b70700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff900cc410 0x7eff900b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.411+0000 7eff97b70700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff9015aef0 0x7eff9015b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.411+0000 7eff97b70700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff900afcf0 con 0x7eff90158a00 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.411+0000 7eff97b70700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9015b880 con 0x7eff9015aef0 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.411+0000 7eff97b70700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff900aee00 con 0x7eff900cc410 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.411+0000 7eff9510b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff9015aef0 0x7eff9015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff9015aef0 0x7eff9015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56130/0 (socket says 172.21.15.55:56130) 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 -- 172.21.15.55:0/2890453232 learned_addr learned my addr 172.21.15.55:0/2890453232 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9590c700 1 --2- 172.21.15.55:0/2890453232 >> v2:172.21.15.142:3300/0 conn(0x7eff900cc410 0x7eff900b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 -- 172.21.15.55:0/2890453232 >> v2:172.21.15.142:3300/0 conn(0x7eff900cc410 msgr2=0x7eff900b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 --2- 172.21.15.55:0/2890453232 >> v2:172.21.15.142:3300/0 conn(0x7eff900cc410 0x7eff900b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 -- 172.21.15.55:0/2890453232 >> v1:172.21.15.142:6789/0 conn(0x7eff90158a00 legacy=0x7eff90158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 -- 172.21.15.55:0/2890453232 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900af0e0 con 0x7eff9015aef0 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9510b700 1 --2- 172.21.15.55:0/2890453232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff9015b340 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7eff900cad40 tx=0x7eff84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98ff09febc0cd7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9490a700 1 -- 172.21.15.55:0/2890453232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84009e70 con 0x7eff9015aef0 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9490a700 1 -- 172.21.15.55:0/2890453232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400b860 con 0x7eff9015aef0 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.412+0000 7eff9490a700 1 -- 172.21.15.55:0/2890453232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400bc00 con 0x7eff9015aef0 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 -- 172.21.15.55:0/2890453232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 msgr2=0x7eff9015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 --2- 172.21.15.55:0/2890453232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff9015b340 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7eff900cad40 tx=0x7eff84009250 comp rx=0 tx=0).stop 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 -- 172.21.15.55:0/2890453232 shutdown_connections 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 --2- 172.21.15.55:0/2890453232 >> v2:172.21.15.142:3300/0 conn(0x7eff900cc410 0x7eff900b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 --2- 172.21.15.55:0/2890453232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff9015b340 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 -- 172.21.15.55:0/2890453232 >> 172.21.15.55:0/2890453232 conn(0x7eff900ce370 msgr2=0x7eff900ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 -- 172.21.15.55:0/2890453232 shutdown_connections 2023-10-06T11:17:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.413+0000 7eff97b70700 1 -- 172.21.15.55:0/2890453232 wait complete. 2023-10-06T11:17:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.414+0000 7eff97b70700 1 Processor -- start 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.414+0000 7eff97b70700 1 -- start start 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff900cc410 0x7eff900c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff90158a00 0x7eff90164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff900b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9016b990 con 0x7eff9015aef0 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9016b380 con 0x7eff900cc410 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff900c8710 con 0x7eff90158a00 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff900b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff900b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56142/0 (socket says 172.21.15.55:56142) 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 -- 172.21.15.55:0/2933028599 learned_addr learned my addr 172.21.15.55:0/2933028599 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9590c700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff900cc410 0x7eff900c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9510b700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff90158a00 0x7eff90164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 -- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff90158a00 msgr2=0x7eff90164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff90158a00 0x7eff90164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 -- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff900cc410 msgr2=0x7eff900c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff900cc410 0x7eff900c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 -- 172.21.15.55:0/2933028599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840094f0 con 0x7eff9015aef0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff9610d700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff900b3780 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c560 tx=0x7eff88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011590 con 0x7eff9015aef0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff880116f0 con 0x7eff9015aef0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff900c8430 con 0x7eff9015aef0 2023-10-06T11:17:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.415+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011ab0 con 0x7eff9015aef0 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.416+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff900c80e0 con 0x7eff9015aef0 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.417+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9016b1e0 con 0x7eff9015aef0 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.417+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff8801b3b0 con 0x7eff9015aef0 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.417+0000 7eff8dffb700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.418+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7eff88083c20 con 0x7eff9015aef0 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.418+0000 7eff9590c700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.418+0000 7eff9590c700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7eff80009fd0 tx=0x7eff8000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.422+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff9016b1e0 con 0x7eff9015aef0 2023-10-06T11:17:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.614+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff9016b1e0 con 0x7eff9015aef0 2023-10-06T11:17:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.614+0000 7eff8dffb700 1 -- 172.21.15.55:0/2933028599 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff9016b1e0 con 0x7eff9015aef0 2023-10-06T11:17:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-10-06T11:17:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff7c066f30 msgr2=0x7eff7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7eff80009fd0 tx=0x7eff8000b040 comp rx=0 tx=0).stop 2023-10-06T11:17:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 msgr2=0x7eff900b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff900b3780 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c560 tx=0x7eff88007ef0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 shutdown_connections 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9015aef0 0x7eff900b3780 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff900cc410 0x7eff900c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 --2- 172.21.15.55:0/2933028599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff90158a00 0x7eff90164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 >> 172.21.15.55:0/2933028599 conn(0x7eff900ce370 msgr2=0x7eff9006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 shutdown_connections 2023-10-06T11:17:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.616+0000 7eff97b70700 1 -- 172.21.15.55:0/2933028599 wait complete. 2023-10-06T11:17:13.630 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:13.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.747+0000 7fd953095700 1 Processor -- start 2023-10-06T11:17:13.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.747+0000 7fd953095700 1 -- start start 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd953095700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c1594f0 0x7fd94c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd953095700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0cf620 con 0x7fd94c0ce490 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd953095700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0cea10 con 0x7fd94c1598c0 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd953095700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0cecf0 con 0x7fd94c1594f0 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd952894700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd94c0ce490 0x7fd94c0aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46866/0 (socket says 172.21.15.55:46866) 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd952894700 1 -- 172.21.15.55:0/1672575267 learned_addr learned my addr 172.21.15.55:0/1672575267 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd952093700 1 --2- 172.21.15.55:0/1672575267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c1594f0 0x7fd94c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778143123 0 0) 0x7fd94c0cf620 con 0x7fd94c0ce490 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.748+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd934003570 con 0x7fd94c0ce490 2023-10-06T11:17:13.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007202387 0 0) 0x7fd94c0cea10 con 0x7fd94c1598c0 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c0cf620 con 0x7fd94c1598c0 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd952093700 1 -- 172.21.15.55:0/1672575267 >> v1:172.21.15.142:6789/0 conn(0x7fd94c1598c0 legacy=0x7fd94c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3490173572 0 0) 0x7fd934003570 con 0x7fd94c0ce490 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd952093700 1 -- 172.21.15.55:0/1672575267 >> v1:172.21.15.55:6789/0 conn(0x7fd94c0ce490 legacy=0x7fd94c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd952093700 1 -- 172.21.15.55:0/1672575267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0cefd0 con 0x7fd94c1594f0 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd952093700 1 --2- 172.21.15.55:0/1672575267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c1594f0 0x7fd94c0cdf50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009910 tx=0x7fd93c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621d9ce403d9b2cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440017f0 con 0x7fd94c1594f0 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c011420 con 0x7fd94c1594f0 2023-10-06T11:17:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.749+0000 7fd951091700 1 -- 172.21.15.55:0/1672575267 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0117c0 con 0x7fd94c1594f0 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 -- 172.21.15.55:0/1672575267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c1594f0 msgr2=0x7fd94c0cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 --2- 172.21.15.55:0/1672575267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c1594f0 0x7fd94c0cdf50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009910 tx=0x7fd93c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 -- 172.21.15.55:0/1672575267 shutdown_connections 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 --2- 172.21.15.55:0/1672575267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c1594f0 0x7fd94c0cdf50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 -- 172.21.15.55:0/1672575267 >> 172.21.15.55:0/1672575267 conn(0x7fd94c0d0420 msgr2=0x7fd94c0d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 -- 172.21.15.55:0/1672575267 shutdown_connections 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.750+0000 7fd953095700 1 -- 172.21.15.55:0/1672575267 wait complete. 2023-10-06T11:17:13.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.751+0000 7fd953095700 1 Processor -- start 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.751+0000 7fd953095700 1 -- start start 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.751+0000 7fd953095700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c0ce490 0x7fd94c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 0x7fd94c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94c1598c0 0x7fd94c157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c4af0 con 0x7fd94c1594f0 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c5730 con 0x7fd94c1598c0 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c4810 con 0x7fd94c0ce490 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 0x7fd94c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 0x7fd94c15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56152/0 (socket says 172.21.15.55:56152) 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 -- 172.21.15.55:0/2015422470 learned_addr learned my addr 172.21.15.55:0/2015422470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd952894700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94c1598c0 0x7fd94c157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd952093700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c0ce490 0x7fd94c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 -- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c0ce490 msgr2=0x7fd94c156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c0ce490 0x7fd94c156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 -- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94c1598c0 msgr2=0x7fd94c157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94c1598c0 0x7fd94c157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 -- 172.21.15.55:0/2015422470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c009420 con 0x7fd94c1594f0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd951892700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 0x7fd94c15c020 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c590 tx=0x7fd940007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940010510 con 0x7fd94c1594f0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940010690 con 0x7fd94c1594f0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c0c50e0 con 0x7fd94c1594f0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940010a50 con 0x7fd94c1594f0 2023-10-06T11:17:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.752+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c15c560 con 0x7fd94c1594f0 2023-10-06T11:17:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.753+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c088df0 con 0x7fd94c1594f0 2023-10-06T11:17:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.754+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd94001b3b0 con 0x7fd94c1594f0 2023-10-06T11:17:13.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.754+0000 7fd94a7fc700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd938066f30 0x7fd9380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.754+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fd940084000 con 0x7fd94c1594f0 2023-10-06T11:17:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.754+0000 7fd952093700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd938066f30 0x7fd9380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.755+0000 7fd952093700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd938066f30 0x7fd9380693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0030c0 tx=0x7fd93c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.758+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd940050f40 con 0x7fd94c1594f0 2023-10-06T11:17:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.994+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd94c15e090 con 0x7fd94c1594f0 2023-10-06T11:17:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.995+0000 7fd94a7fc700 1 -- 172.21.15.55:0/2015422470 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4619 (secure 0 0 0) 0x7fd940017090 con 0x7fd94c1594f0 2023-10-06T11:17:13.996 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:13.997 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:17:05.145701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7149,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd938066f30 msgr2=0x7fd9380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd938066f30 0x7fd9380693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0030c0 tx=0x7fd93c016000 comp rx=0 tx=0).stop 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 msgr2=0x7fd94c15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 0x7fd94c15c020 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c590 tx=0x7fd940007de0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 shutdown_connections 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd938066f30 0x7fd9380693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd94c1598c0 0x7fd94c157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd94c0ce490 0x7fd94c156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 --2- 172.21.15.55:0/2015422470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd94c1594f0 0x7fd94c15c020 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 >> 172.21.15.55:0/2015422470 conn(0x7fd94c0d0420 msgr2=0x7fd94c0cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 shutdown_connections 2023-10-06T11:17:14.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:13.997+0000 7fd953095700 1 -- 172.21.15.55:0/2015422470 wait complete. 2023-10-06T11:17:14.000 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 69 2023-10-06T11:17:14.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.128+0000 7f7f9eb92700 1 Processor -- start 2023-10-06T11:17:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.128+0000 7f7f9eb92700 1 -- start start 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9eb92700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f980cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9eb92700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f980cef10 0x7f7f98158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9eb92700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f980ccc10 con 0x7f7f980ceb40 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9eb92700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980cb630 con 0x7f7f980cef10 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9eb92700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980cb910 con 0x7f7f980cb0c0 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9d12f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f980cef10 0x7f7f98158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9c92e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7f980ceb40 0x7f7f980c6670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46868/0 (socket says 172.21.15.55:46868) 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9c92e700 1 -- 172.21.15.55:0/2687330644 learned_addr learned my addr 172.21.15.55:0/2687330644 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f8ffff700 1 --2- 172.21.15.55:0/2687330644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f980cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9d12f700 1 -- 172.21.15.55:0/2687330644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 msgr2=0x7f7f980cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9d12f700 1 --2- 172.21.15.55:0/2687330644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f980cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9d12f700 1 -- 172.21.15.55:0/2687330644 >> v1:172.21.15.55:6789/0 conn(0x7f7f980ceb40 legacy=0x7f7f980c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9d12f700 1 -- 172.21.15.55:0/2687330644 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980cbbf0 con 0x7f7f980cef10 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f8f7fe700 1 -- 172.21.15.55:0/2687330644 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569872415 0 0) 0x7f7f980ccc10 con 0x7f7f980ceb40 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f9d12f700 1 --2- 172.21.15.55:0/2687330644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98158fb0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009e60 tx=0x7f7f90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1364190753be6836 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f8f7fe700 1 -- 172.21.15.55:0/2687330644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000e070 con 0x7f7f980cef10 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f8f7fe700 1 -- 172.21.15.55:0/2687330644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000bc30 con 0x7f7f980cef10 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.129+0000 7f7f8f7fe700 1 -- 172.21.15.55:0/2687330644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90012430 con 0x7f7f980cef10 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 -- 172.21.15.55:0/2687330644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 msgr2=0x7f7f98158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/2687330644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98158fb0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009e60 tx=0x7f7f90009780 comp rx=0 tx=0).stop 2023-10-06T11:17:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 -- 172.21.15.55:0/2687330644 shutdown_connections 2023-10-06T11:17:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/2687330644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98158fb0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/2687330644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f980cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 -- 172.21.15.55:0/2687330644 >> 172.21.15.55:0/2687330644 conn(0x7f7f980d0550 msgr2=0x7f7f980d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 -- 172.21.15.55:0/2687330644 shutdown_connections 2023-10-06T11:17:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.130+0000 7f7f9eb92700 1 -- 172.21.15.55:0/2687330644 wait complete. 2023-10-06T11:17:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.131+0000 7f7f9eb92700 1 Processor -- start 2023-10-06T11:17:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.131+0000 7f7f9eb92700 1 -- start start 2023-10-06T11:17:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9eb92700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f9816d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9eb92700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f980ceb40 0x7f7f981511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9eb92700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9eb92700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9816d730 con 0x7f7f980cef10 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9eb92700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981516f0 con 0x7f7f980ceb40 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9eb92700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9816d9d0 con 0x7f7f980cb0c0 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56170/0 (socket says 172.21.15.55:56170) 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 -- 172.21.15.55:0/1628231297 learned_addr learned my addr 172.21.15.55:0/1628231297 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9c92e700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f9816d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f8ffff700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f980ceb40 0x7f7f981511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 -- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 msgr2=0x7f7f9816d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f9816d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 -- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f980ceb40 msgr2=0x7f7f981511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f980ceb40 0x7f7f981511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.132+0000 7f7f9d12f700 1 -- 172.21.15.55:0/1628231297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009a20 con 0x7f7f980cef10 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.133+0000 7f7f9d12f700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98153420 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7f90013000 tx=0x7f7f90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.133+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90027470 con 0x7f7f980cef10 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.133+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90027610 con 0x7f7f980cef10 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.133+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9816dcb0 con 0x7f7f980cef10 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.133+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900279d0 con 0x7f7f980cef10 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.133+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f98152f00 con 0x7f7f980cef10 2023-10-06T11:17:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.134+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f981530f0 con 0x7f7f980cef10 2023-10-06T11:17:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.134+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f90024070 con 0x7f7f980cef10 2023-10-06T11:17:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.135+0000 7f7f8cff9700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.135+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7f90086fe0 con 0x7f7f980cef10 2023-10-06T11:17:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.135+0000 7f7f9c92e700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.135+0000 7f7f9c92e700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007fd0 tx=0x7f7f94007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.139+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f90053f20 con 0x7f7f980cef10 2023-10-06T11:17:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.338+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f9804c380 con 0x7f7f980cef10 2023-10-06T11:17:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.339+0000 7f7f8cff9700 1 -- 172.21.15.55:0/1628231297 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17314 (secure 0 0 0) 0x7f7f90057540 con 0x7f7f980cef10 2023-10-06T11:17:14.341 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:14.341 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:56.119211+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:31.352151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:32.593083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.25","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6836/2387992820":"2023-10-07T11:16:49.087130+0000","172.21.15.142:6834/2387992820":"2023-10-07T11:16:49.087130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7f84066f30 msgr2=0x7f7f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7f84066f30 0x7f7f840693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007fd0 tx=0x7f7f94007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 msgr2=0x7f7f98153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98153420 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7f90013000 tx=0x7f7f90019000 comp rx=0 tx=0).stop 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 shutdown_connections 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f7f84066f30 0x7f7f840693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f980cef10 0x7f7f98153420 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f980cb0c0 0x7f7f9816d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 --2- 172.21.15.55:0/1628231297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f980ceb40 0x7f7f981511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 >> 172.21.15.55:0/1628231297 conn(0x7f7f980d0550 msgr2=0x7f7f980d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 shutdown_connections 2023-10-06T11:17:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.341+0000 7f7f9eb92700 1 -- 172.21.15.55:0/1628231297 wait complete. 2023-10-06T11:17:14.355 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:17:14.355 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:14.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.472+0000 7f6dfa5f1700 1 Processor -- start 2023-10-06T11:17:14.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.472+0000 7f6dfa5f1700 1 -- start start 2023-10-06T11:17:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6dfa5f1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6df41598c0 0x7f6df40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6dfa5f1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df40aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6dfa5f1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40cf620 con 0x7f6df41594f0 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6dfa5f1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40cea10 con 0x7f6df41598c0 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6dfa5f1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40cecf0 con 0x7f6df40b2860 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6df8dee700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6df41598c0 0x7f6df40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6df95ef700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6df41594f0 0x7f6df40cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37582/0 (socket says 172.21.15.55:37582) 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6df95ef700 1 -- 172.21.15.55:0/2053463004 learned_addr learned my addr 172.21.15.55:0/2053463004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6df9df0700 1 --2- 172.21.15.55:0/2053463004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df40aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.473+0000 7f6df8dee700 1 -- 172.21.15.55:0/2053463004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 msgr2=0x7f6df40aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df8dee700 1 --2- 172.21.15.55:0/2053463004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df40aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df8dee700 1 -- 172.21.15.55:0/2053463004 >> v1:172.21.15.55:6789/0 conn(0x7f6df41594f0 legacy=0x7f6df40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df8dee700 1 -- 172.21.15.55:0/2053463004 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df40cefd0 con 0x7f6df41598c0 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df3fff700 1 -- 172.21.15.55:0/2053463004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662511859 0 0) 0x7f6df40cf620 con 0x7f6df41594f0 2023-10-06T11:17:14.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df8dee700 1 --2- 172.21.15.55:0/2053463004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41598c0 0x7f6df40b2320 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6de80098e0 tx=0x7f6de80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5713a1b437953b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df3fff700 1 -- 172.21.15.55:0/2053463004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8009e80 con 0x7f6df41598c0 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df3fff700 1 -- 172.21.15.55:0/2053463004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800b860 con 0x7f6df41598c0 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6df3fff700 1 -- 172.21.15.55:0/2053463004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800bbe0 con 0x7f6df41598c0 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2053463004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41598c0 msgr2=0x7f6df40b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2053463004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41598c0 0x7f6df40b2320 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6de80098e0 tx=0x7f6de80091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2053463004 shutdown_connections 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2053463004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2053463004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41598c0 0x7f6df40b2320 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.474+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2053463004 >> 172.21.15.55:0/2053463004 conn(0x7f6df40d0420 msgr2=0x7f6df40d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.475+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2053463004 shutdown_connections 2023-10-06T11:17:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.475+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2053463004 wait complete. 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.476+0000 7f6dfa5f1700 1 Processor -- start 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.476+0000 7f6dfa5f1700 1 -- start start 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df4169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 0x7f6df416b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6df41598c0 0x7f6df40c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df416b080 con 0x7f6df41594f0 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40c4540 con 0x7f6df41598c0 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40c3c10 con 0x7f6df40b2860 2023-10-06T11:17:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 0x7f6df416b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 0x7f6df416b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57750/0 (socket says 172.21.15.55:57750) 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 -- 172.21.15.55:0/2522276011 learned_addr learned my addr 172.21.15.55:0/2522276011 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df9df0700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6df41598c0 0x7f6df40c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df95ef700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df4169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 -- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 msgr2=0x7f6df4169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df4169860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 -- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6df41598c0 msgr2=0x7f6df40c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6df41598c0 0x7f6df40c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 -- 172.21.15.55:0/2522276011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8009420 con 0x7f6df41594f0 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df9df0700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6df41598c0 0x7f6df40c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:14.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df8dee700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 0x7f6df416b260 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6de8013000 tx=0x7f6de8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8020070 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8000cc0 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df40c3ef0 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800bbe0 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.477+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df4169da0 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.478+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df4088df0 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.479+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6de80118c0 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.479+0000 7f6df17fa700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6de0066f30 0x7f6de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.479+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f6de8085d90 con 0x7f6df41594f0 2023-10-06T11:17:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.480+0000 7f6df95ef700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6de0066f30 0x7f6de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.480+0000 7f6df95ef700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6de0066f30 0x7f6de00693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6de4001560 tx=0x7f6de4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.484+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6de8052c30 con 0x7f6df41594f0 2023-10-06T11:17:14.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.724+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6df404bb40 con 0x7f6df41594f0 2023-10-06T11:17:14.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.724+0000 7f6df17fa700 1 -- 172.21.15.55:0/2522276011 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4619 (secure 0 0 0) 0x7f6de8029090 con 0x7f6df41594f0 2023-10-06T11:17:14.726 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:14.727 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:17:05.145701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7149,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:17:14.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6de0066f30 msgr2=0x7f6de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6de0066f30 0x7f6de00693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6de4001560 tx=0x7f6de4009040 comp rx=0 tx=0).stop 2023-10-06T11:17:14.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 msgr2=0x7f6df416b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 0x7f6df416b260 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6de8013000 tx=0x7f6de8017000 comp rx=0 tx=0).stop 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 shutdown_connections 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6de0066f30 0x7f6de00693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6df41598c0 0x7f6df40c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6df40b2860 0x7f6df4169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 --2- 172.21.15.55:0/2522276011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6df41594f0 0x7f6df416b260 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 >> 172.21.15.55:0/2522276011 conn(0x7f6df40d0420 msgr2=0x7f6df40cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 shutdown_connections 2023-10-06T11:17:14.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.727+0000 7f6dfa5f1700 1 -- 172.21.15.55:0/2522276011 wait complete. 2023-10-06T11:17:14.730 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 69 2023-10-06T11:17:14.740 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:14.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.857+0000 7f5046e3d700 1 Processor -- start 2023-10-06T11:17:14.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.857+0000 7f5046e3d700 1 -- start start 2023-10-06T11:17:14.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.858+0000 7f5046e3d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50400ceb40 0x7f50400cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.858+0000 7f5046e3d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400ccc10 con 0x7f50400cef10 2023-10-06T11:17:14.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.858+0000 7f5046e3d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400cb630 con 0x7f50400cb0c0 2023-10-06T11:17:14.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.858+0000 7f5046e3d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50400cb910 con 0x7f50400ceb40 2023-10-06T11:17:14.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.858+0000 7f50453da700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50400cef10 0x7f5040158fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37598/0 (socket says 172.21.15.55:37598) 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.858+0000 7f50453da700 1 -- 172.21.15.55:0/2572145037 learned_addr learned my addr 172.21.15.55:0/2572145037 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f5044bd9700 1 --2- 172.21.15.55:0/2572145037 >> v2:172.21.15.142:3300/0 conn(0x7f50400ceb40 0x7f50400cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657907730 0 0) 0x7f50400ccc10 con 0x7f50400cef10 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f502c003570 con 0x7f50400cef10 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636181729 0 0) 0x7f502c003570 con 0x7f50400cef10 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 >> v2:172.21.15.142:3300/0 conn(0x7f50400ceb40 msgr2=0x7f50400cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 --2- 172.21.15.55:0/2572145037 >> v2:172.21.15.142:3300/0 conn(0x7f50400ceb40 0x7f50400cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 >> v1:172.21.15.142:6789/0 conn(0x7f50400cb0c0 legacy=0x7f50400c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400cbbf0 con 0x7f50400cef10 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f5028001470 con 0x7f50400cef10 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 >> v1:172.21.15.55:6789/0 conn(0x7f50400cef10 legacy=0x7f5040158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f502c003a60 0x7f502c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f502c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f502c0051c0 0x7f502c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400cb910 con 0x7f502c004810 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c00c0d0 con 0x7f502c0051c0 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c00c290 con 0x7f502c003a60 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503ffff700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f502c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f50453da700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f502c0051c0 0x7f502c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f5044bd9700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f502c003a60 0x7f502c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503ffff700 1 -- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f502c003a60 msgr2=0x7f502c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503ffff700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f502c003a60 0x7f502c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503ffff700 1 -- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f502c0051c0 msgr2=0x7f502c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503ffff700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f502c0051c0 0x7f502c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f503ffff700 1 -- 172.21.15.55:0/2572145037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c003570 con 0x7f502c004810 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.859+0000 7f50453da700 1 -- 172.21.15.55:0/2572145037 reap_dead start 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f503ffff700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f502c004c80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5030001880 tx=0x7f5030007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39add630a0dbbba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030012420 con 0x7f502c004810 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50300125a0 con 0x7f502c004810 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f503f7fe700 1 -- 172.21.15.55:0/2572145037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030012960 con 0x7f502c004810 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 -- 172.21.15.55:0/2572145037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 msgr2=0x7f502c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f502c004c80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5030001880 tx=0x7f5030007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:14.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 -- 172.21.15.55:0/2572145037 shutdown_connections 2023-10-06T11:17:14.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 --2- 172.21.15.55:0/2572145037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f502c004c80 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 -- 172.21.15.55:0/2572145037 >> 172.21.15.55:0/2572145037 conn(0x7f50400d0550 msgr2=0x7f50400d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 -- 172.21.15.55:0/2572145037 shutdown_connections 2023-10-06T11:17:14.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.860+0000 7f5046e3d700 1 -- 172.21.15.55:0/2572145037 wait complete. 2023-10-06T11:17:14.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.861+0000 7f5046e3d700 1 Processor -- start 2023-10-06T11:17:14.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 -- start start 2023-10-06T11:17:14.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f50400b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50400b41b0 0x7f5040152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5040153070 0x7f50401534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504014d170 con 0x7f502c004810 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400c7d10 con 0x7f5040153070 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.862+0000 7f5046e3d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50400b49d0 con 0x7f50400b41b0 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f50400b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f50400b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57762/0 (socket says 172.21.15.55:57762) 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 -- 172.21.15.55:0/317665865 learned_addr learned my addr 172.21.15.55:0/317665865 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f50453da700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5040153070 0x7f50401534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f503ffff700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50400b41b0 0x7f5040152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 -- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50400b41b0 msgr2=0x7f5040152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50400b41b0 0x7f5040152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 -- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5040153070 msgr2=0x7f50401534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5040153070 0x7f50401534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 -- 172.21.15.55:0/317665865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400b4cb0 con 0x7f502c004810 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5044bd9700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f50400b3c70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f50380115b0 tx=0x7f503800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503800e030 con 0x7f502c004810 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5038016470 con 0x7f502c004810 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038016830 con 0x7f502c004810 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50400b4f90 con 0x7f502c004810 2023-10-06T11:17:14.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.863+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5040153a00 con 0x7f502c004810 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.864+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50400c7ff0 con 0x7f502c004810 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.865+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5038016be0 con 0x7f502c004810 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.865+0000 7f503cff9700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5020066f30 0x7f50200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.865+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f503800f070 con 0x7f502c004810 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.865+0000 7f503ffff700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5020066f30 0x7f50200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.866+0000 7f503ffff700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5020066f30 0x7f50200693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f50400b5840 tx=0x7f5030015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:14.870+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5038052720 con 0x7f502c004810 2023-10-06T11:17:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.107+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f504004c380 con 0x7f502c004810 2023-10-06T11:17:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.107+0000 7f503cff9700 1 -- 172.21.15.55:0/317665865 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4619 (secure 0 0 0) 0x7f5038055d40 con 0x7f502c004810 2023-10-06T11:17:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:15.110 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:33.613713+0000","modified":"2023-10-06T11:17:05.145701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7149,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/2516972275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2516972275},{"type":"v1","addr":"172.21.15.55:6833","nonce":2516972275}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7149":{"gid":7149,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/2083914208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2083914208},{"type":"v1","addr":"172.21.15.55:6835","nonce":2083914208}]},"join_fscid":-1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:17:15.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5020066f30 msgr2=0x7f50200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5020066f30 0x7f50200693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f50400b5840 tx=0x7f5030015000 comp rx=0 tx=0).stop 2023-10-06T11:17:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 msgr2=0x7f50400b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f50400b3c70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f50380115b0 tx=0x7f503800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 shutdown_connections 2023-10-06T11:17:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5020066f30 0x7f50200693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502c004810 0x7f50400b3c70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5040153070 0x7f50401534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 --2- 172.21.15.55:0/317665865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50400b41b0 0x7f5040152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 >> 172.21.15.55:0/317665865 conn(0x7f50400d0550 msgr2=0x7f5040157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 shutdown_connections 2023-10-06T11:17:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.110+0000 7f5046e3d700 1 -- 172.21.15.55:0/317665865 wait complete. 2023-10-06T11:17:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 69 2023-10-06T11:17:15.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.241+0000 7fa5ed4c3700 1 Processor -- start 2023-10-06T11:17:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.241+0000 7fa5ed4c3700 1 -- start start 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5ed4c3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5e80af6d0 0x7fa5e80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5ed4c3700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e80cf7f0 con 0x7fa5e81593e0 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5ed4c3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e80cfad0 con 0x7fa5e81597b0 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5ed4c3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e80cfdb0 con 0x7fa5e80af6d0 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e6ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5e81593e0 0x7fa5e80cb590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37612/0 (socket says 172.21.15.55:37612) 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e6ffd700 1 -- 172.21.15.55:0/3672566906 learned_addr learned my addr 172.21.15.55:0/3672566906 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867761406 0 0) 0x7fa5e80cf7f0 con 0x7fa5e81593e0 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e77fe700 1 --2- 172.21.15.55:0/3672566906 >> v2:172.21.15.142:3300/0 conn(0x7fa5e80af6d0 0x7fa5e80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d4003570 con 0x7fa5e81593e0 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 244457905 0 0) 0x7fa5d4003570 con 0x7fa5e81593e0 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 >> v2:172.21.15.142:3300/0 conn(0x7fa5e80af6d0 msgr2=0x7fa5e80cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e5ffb700 1 --2- 172.21.15.55:0/3672566906 >> v2:172.21.15.142:3300/0 conn(0x7fa5e80af6d0 0x7fa5e80cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.242+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 >> v1:172.21.15.142:6789/0 conn(0x7fa5e81597b0 legacy=0x7fa5e80aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80d0090 con 0x7fa5e81593e0 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7fa5e00017f0 con 0x7fa5e81593e0 2023-10-06T11:17:15.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 >> v1:172.21.15.55:6789/0 conn(0x7fa5e81593e0 legacy=0x7fa5e80cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5d4003ab0 0x7fa5d4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4004810 0x7fa5d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d4005210 0x7fa5d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80cfdb0 con 0x7fa5d4003ab0 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d400c130 con 0x7fa5d4004810 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d400c2f0 con 0x7fa5d4005210 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5d4003ab0 0x7fa5d4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e67fc700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4004810 0x7fa5d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e77fe700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d4005210 0x7fa5d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 -- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d4005210 msgr2=0x7fa5d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d4005210 0x7fa5d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 -- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4004810 msgr2=0x7fa5d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4004810 0x7fa5d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 -- 172.21.15.55:0/3672566906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4003570 con 0x7fa5d4003ab0 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e77fe700 1 -- 172.21.15.55:0/3672566906 reap_dead start 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5d4003ab0 0x7fa5d4003ec0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000a860 tx=0x7fa5e0002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8c1e652a122b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00070f0 con 0x7fa5d4003ab0 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0007270 con 0x7fa5d4003ab0 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.243+0000 7fa5e5ffb700 1 -- 172.21.15.55:0/3672566906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0007630 con 0x7fa5d4003ab0 2023-10-06T11:17:15.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/3672566906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5d4003ab0 msgr2=0x7fa5d4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5d4003ab0 0x7fa5d4003ec0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000a860 tx=0x7fa5e0002100 comp rx=0 tx=0).stop 2023-10-06T11:17:15.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/3672566906 shutdown_connections 2023-10-06T11:17:15.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/3672566906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5d4003ab0 0x7fa5d4003ec0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/3672566906 >> 172.21.15.55:0/3672566906 conn(0x7fa5e80d0400 msgr2=0x7fa5e80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/3672566906 shutdown_connections 2023-10-06T11:17:15.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.244+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/3672566906 wait complete. 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.245+0000 7fa5ed4c3700 1 Processor -- start 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.245+0000 7fa5ed4c3700 1 -- start start 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5ed4c3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4003ab0 0x7fa5e80b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5ed4c3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 0x7fa5e8144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5ed4c3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e80ce800 0x7fa5e80ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5ed4c3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80cf1e0 con 0x7fa5e815c730 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5ed4c3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80b3760 con 0x7fa5d4003ab0 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5ed4c3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80b4ca0 con 0x7fa5e80ce800 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 0x7fa5e8144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 0x7fa5e8144cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57774/0 (socket says 172.21.15.55:57774) 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 -- 172.21.15.55:0/528503741 learned_addr learned my addr 172.21.15.55:0/528503741 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4003ab0 0x7fa5e80b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e77fe700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e80ce800 0x7fa5e80ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 -- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e80ce800 msgr2=0x7fa5e80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e80ce800 0x7fa5e80ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 -- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4003ab0 msgr2=0x7fa5e80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4003ab0 0x7fa5e80b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 -- 172.21.15.55:0/528503741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80b4f40 con 0x7fa5e815c730 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.246+0000 7fa5e67fc700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 0x7fa5e8144cd0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0002920 tx=0x7fa5d0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.247+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000f670 con 0x7fa5e815c730 2023-10-06T11:17:15.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.247+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d000f7d0 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.247+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e80b5220 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.247+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000fb90 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.247+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e80b57e0 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.248+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e8088aa0 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.248+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5d001c400 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.248+0000 7fa5deffd700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa5c8066f30 0x7fa5c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.249+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa5d0084c40 con 0x7fa5e815c730 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.249+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa5c8066f30 0x7fa5c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.249+0000 7fa5e6ffd700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa5c8066f30 0x7fa5c80693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000a320 tx=0x7fa5e0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.253+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5d0051ae0 con 0x7fa5e815c730 2023-10-06T11:17:15.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.446+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5e80c51a0 con 0x7fa5e815c730 2023-10-06T11:17:15.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.446+0000 7fa5deffd700 1 -- 172.21.15.55:0/528503741 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17314 (secure 0 0 0) 0x7fa5d0055100 con 0x7fa5e815c730 2023-10-06T11:17:15.448 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:15.448 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:16:56.119211+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:31.352151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:32.593083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.25","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6836/2387992820":"2023-10-07T11:16:49.087130+0000","172.21.15.142:6834/2387992820":"2023-10-07T11:16:49.087130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:15.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa5c8066f30 msgr2=0x7fa5c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa5c8066f30 0x7fa5c80693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000a320 tx=0x7fa5e0016000 comp rx=0 tx=0).stop 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 msgr2=0x7fa5e8144cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 0x7fa5e8144cd0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0002920 tx=0x7fa5d0007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 shutdown_connections 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa5c8066f30 0x7fa5c80693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e80ce800 0x7fa5e80ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d4003ab0 0x7fa5e80b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 --2- 172.21.15.55:0/528503741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5e815c730 0x7fa5e8144cd0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 >> 172.21.15.55:0/528503741 conn(0x7fa5e80d0400 msgr2=0x7fa5e80aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 shutdown_connections 2023-10-06T11:17:15.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.449+0000 7fa5ed4c3700 1 -- 172.21.15.55:0/528503741 wait complete. 2023-10-06T11:17:15.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:17:15.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.580+0000 7f58ef586700 1 Processor -- start 2023-10-06T11:17:15.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.580+0000 7f58ef586700 1 -- start start 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ef586700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58e81593b0 0x7f58e80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ef586700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58e815d900 0x7f58e80b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ef586700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e80b1190 con 0x7f58e8159780 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ef586700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e80d0400 con 0x7f58e81593b0 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ef586700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e80b6550 con 0x7f58e815d900 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ed322700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58e81593b0 0x7f58e80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ecb21700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58e8159780 0x7f58e815d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37624/0 (socket says 172.21.15.55:37624) 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.581+0000 7f58ecb21700 1 -- 172.21.15.55:0/2568956601 learned_addr learned my addr 172.21.15.55:0/2568956601 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:15.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58edb23700 1 --2- 172.21.15.55:0/2568956601 >> v2:172.21.15.142:3300/0 conn(0x7f58e815d900 0x7f58e80b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58ed322700 1 -- 172.21.15.55:0/2568956601 >> v2:172.21.15.142:3300/0 conn(0x7f58e815d900 msgr2=0x7f58e80b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58ed322700 1 --2- 172.21.15.55:0/2568956601 >> v2:172.21.15.142:3300/0 conn(0x7f58e815d900 0x7f58e80b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58ed322700 1 -- 172.21.15.55:0/2568956601 >> v1:172.21.15.55:6789/0 conn(0x7f58e8159780 legacy=0x7f58e815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58ed322700 1 -- 172.21.15.55:0/2568956601 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e80cfb60 con 0x7f58e81593b0 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58e7fff700 1 -- 172.21.15.55:0/2568956601 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743300171 0 0) 0x7f58e80b1190 con 0x7f58e8159780 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58ed322700 1 --2- 172.21.15.55:0/2568956601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e81593b0 0x7f58e80cf520 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58e80cfa90 tx=0x7f58e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d079a03281a77e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58e7fff700 1 -- 172.21.15.55:0/2568956601 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011630 con 0x7f58e81593b0 2023-10-06T11:17:15.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58e7fff700 1 -- 172.21.15.55:0/2568956601 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0011790 con 0x7f58e81593b0 2023-10-06T11:17:15.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.582+0000 7f58e7fff700 1 -- 172.21.15.55:0/2568956601 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011b30 con 0x7f58e81593b0 2023-10-06T11:17:15.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 -- 172.21.15.55:0/2568956601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e81593b0 msgr2=0x7f58e80cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 --2- 172.21.15.55:0/2568956601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e81593b0 0x7f58e80cf520 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58e80cfa90 tx=0x7f58e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 -- 172.21.15.55:0/2568956601 shutdown_connections 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 --2- 172.21.15.55:0/2568956601 >> v2:172.21.15.142:3300/0 conn(0x7f58e815d900 0x7f58e80b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 --2- 172.21.15.55:0/2568956601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e81593b0 0x7f58e80cf520 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 -- 172.21.15.55:0/2568956601 >> 172.21.15.55:0/2568956601 conn(0x7f58e80d05c0 msgr2=0x7f58e80d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 -- 172.21.15.55:0/2568956601 shutdown_connections 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.583+0000 7f58ef586700 1 -- 172.21.15.55:0/2568956601 wait complete. 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.584+0000 7f58ef586700 1 Processor -- start 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.584+0000 7f58ef586700 1 -- start start 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e81593b0 0x7f58e8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e8159780 0x7f58e8156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 0x7f58e8157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e81521e0 con 0x7f58e815d900 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e816a300 con 0x7f58e81593b0 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8154250 con 0x7f58e8159780 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 0x7f58e8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 0x7f58e8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57798/0 (socket says 172.21.15.55:57798) 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 -- 172.21.15.55:0/2440397321 learned_addr learned my addr 172.21.15.55:0/2440397321 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ed322700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e81593b0 0x7f58e8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ecb21700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e8159780 0x7f58e8156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 -- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e8159780 msgr2=0x7f58e8156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e8159780 0x7f58e8156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 -- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e81593b0 msgr2=0x7f58e8151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e81593b0 0x7f58e8151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 -- 172.21.15.55:0/2440397321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0009420 con 0x7f58e815d900 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ecb21700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e8159780 0x7f58e8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58edb23700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 0x7f58e8157000 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009d40 tx=0x7f58d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d800cb50 con 0x7f58e815d900 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d800f040 con 0x7f58e815d900 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e81696f0 con 0x7f58e815d900 2023-10-06T11:17:15.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8014480 con 0x7f58e815d900 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.585+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e8169cb0 con 0x7f58e815d900 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.587+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e816a490 con 0x7f58e815d900 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.587+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58d8014830 con 0x7f58e815d900 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.587+0000 7f58e57fa700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58d4066f30 0x7f58d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.587+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f58d8085530 con 0x7f58e815d900 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.588+0000 7f58ed322700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58d4066f30 0x7f58d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.588+0000 7f58ed322700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58d4066f30 0x7f58d40693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f58e00093f0 tx=0x7f58e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.591+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58d80523d0 con 0x7f58e815d900 2023-10-06T11:17:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.832+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f58e804c380 con 0x7f58e815d900 2023-10-06T11:17:15.834 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-10-06T11:17:15.832+0000 7fc5e1a2e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:17:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.836+0000 7f58e57fa700 1 -- 172.21.15.55:0/2440397321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7f58d80559f0 con 0x7f58e815d900 2023-10-06T11:17:15.841 INFO:tasks.ceph.mds.c.smithi055.stderr: -4045> 2023-10-06T11:16:56.098+0000 7ffa31220700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:17:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58d4066f30 msgr2=0x7f58d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58d4066f30 0x7f58d40693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f58e00093f0 tx=0x7f58e0017000 comp rx=0 tx=0).stop 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 msgr2=0x7f58e8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 0x7f58e8157000 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009d40 tx=0x7f58d800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 shutdown_connections 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f58d4066f30 0x7f58d40693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58e815d900 0x7f58e8157000 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e81593b0 0x7f58e8151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 --2- 172.21.15.55:0/2440397321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58e8159780 0x7f58e8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 >> 172.21.15.55:0/2440397321 conn(0x7f58e80d05c0 msgr2=0x7f58e815d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 shutdown_connections 2023-10-06T11:17:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.840+0000 7f58ef586700 1 -- 172.21.15.55:0/2440397321 wait complete. 2023-10-06T11:17:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:17:15.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:17:15.866 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-10-06T11:17:15.866 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-10-06T11:17:15.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.980+0000 7f80d863d700 1 Processor -- start 2023-10-06T11:17:15.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.980+0000 7f80d863d700 1 -- start start 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.981+0000 7f80d863d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80d01593b0 0x7f80d00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.981+0000 7f80d863d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d0159780 0x7f80d00b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.981+0000 7f80d863d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d00b1190 con 0x7f80d015d1f0 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.981+0000 7f80d863d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00d0400 con 0x7f80d01593b0 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.981+0000 7f80d863d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00b6550 con 0x7f80d0159780 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80d01593b0 0x7f80d00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80d01593b0 0x7f80d00cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57846/0 (socket says 172.21.15.55:57846) 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 -- 172.21.15.55:0/2453243236 learned_addr learned my addr 172.21.15.55:0/2453243236 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d5bd8700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d0159780 0x7f80d00b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 -- 172.21.15.55:0/2453243236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d0159780 msgr2=0x7f80d00b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d0159780 0x7f80d00b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 -- 172.21.15.55:0/2453243236 >> v1:172.21.15.142:6789/0 conn(0x7f80d015d1f0 legacy=0x7f80d015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 -- 172.21.15.55:0/2453243236 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00cfb60 con 0x7f80d01593b0 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d5bd8700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d0159780 0x7f80d00b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d63d9700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d01593b0 0x7f80d00cf520 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009f20 tx=0x7f80c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835e07f11740f0f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d53d7700 1 -- 172.21.15.55:0/2453243236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c000e070 con 0x7f80d01593b0 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d53d7700 1 -- 172.21.15.55:0/2453243236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c000ba80 con 0x7f80d01593b0 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.982+0000 7f80d53d7700 1 -- 172.21.15.55:0/2453243236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00092e0 con 0x7f80d01593b0 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 -- 172.21.15.55:0/2453243236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d01593b0 msgr2=0x7f80d00cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d01593b0 0x7f80d00cf520 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009f20 tx=0x7f80c0009840 comp rx=0 tx=0).stop 2023-10-06T11:17:15.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 -- 172.21.15.55:0/2453243236 shutdown_connections 2023-10-06T11:17:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d01593b0 0x7f80d00cf520 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 --2- 172.21.15.55:0/2453243236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d0159780 0x7f80d00b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 -- 172.21.15.55:0/2453243236 >> 172.21.15.55:0/2453243236 conn(0x7f80d00d05c0 msgr2=0x7f80d00d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 -- 172.21.15.55:0/2453243236 shutdown_connections 2023-10-06T11:17:15.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.983+0000 7f80d863d700 1 -- 172.21.15.55:0/2453243236 wait complete. 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.984+0000 7f80d863d700 1 Processor -- start 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.984+0000 7f80d863d700 1 -- start start 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d863d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d01593b0 0x7f80d00ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d863d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 0x7f80d0151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d863d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d015d1f0 0x7f80d015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d863d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d016ac10 con 0x7f80d0159780 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d863d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d016a000 con 0x7f80d015d1f0 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d863d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d016a2e0 con 0x7f80d01593b0 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 0x7f80d0151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 0x7f80d0151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57848/0 (socket says 172.21.15.55:57848) 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 -- 172.21.15.55:0/2634820725 learned_addr learned my addr 172.21.15.55:0/2634820725 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d63d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d01593b0 0x7f80d00ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d6bda700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d015d1f0 0x7f80d015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 -- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d01593b0 msgr2=0x7f80d00ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d01593b0 0x7f80d00ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 -- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d015d1f0 msgr2=0x7f80d015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d015d1f0 0x7f80d015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.985+0000 7f80d5bd8700 1 -- 172.21.15.55:0/2634820725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009ae0 con 0x7f80d0159780 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.986+0000 7f80d5bd8700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 0x7f80d0151980 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c830 tx=0x7f80c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.986+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4011600 con 0x7f80d0159780 2023-10-06T11:17:15.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.986+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4011760 con 0x7f80d0159780 2023-10-06T11:17:15.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.986+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d016a5c0 con 0x7f80d0159780 2023-10-06T11:17:15.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.986+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4011b20 con 0x7f80d0159780 2023-10-06T11:17:15.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.986+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d00aee40 con 0x7f80d0159780 2023-10-06T11:17:15.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.987+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d004c380 con 0x7f80d0159780 2023-10-06T11:17:15.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.987+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80c4018360 con 0x7f80d0159780 2023-10-06T11:17:15.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.988+0000 7f80ce7fc700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f80bc066f30 0x7f80bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.988+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f80c40847d0 con 0x7f80d0159780 2023-10-06T11:17:15.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.988+0000 7f80d63d9700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f80bc066f30 0x7f80bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.988+0000 7f80d63d9700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f80bc066f30 0x7f80bc0693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f80d00ae0a0 tx=0x7f80c0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:15.992+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80c4051660 con 0x7f80d0159780 2023-10-06T11:17:16.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.235+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f80d00cfe40 con 0x7f80d0159780 2023-10-06T11:17:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.838+0000 7f80ce7fc700 1 -- 172.21.15.55:0/2634820725 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f80c4054c80 con 0x7f80d0159780 2023-10-06T11:17:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f80bc066f30 msgr2=0x7f80bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f80bc066f30 0x7f80bc0693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f80d00ae0a0 tx=0x7f80c0018000 comp rx=0 tx=0).stop 2023-10-06T11:17:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 msgr2=0x7f80d0151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 0x7f80d0151980 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c830 tx=0x7f80c4008040 comp rx=0 tx=0).stop 2023-10-06T11:17:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 shutdown_connections 2023-10-06T11:17:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f80bc066f30 0x7f80bc0693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80d015d1f0 0x7f80d015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80d01593b0 0x7f80d00ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 --2- 172.21.15.55:0/2634820725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0159780 0x7f80d0151980 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 >> 172.21.15.55:0/2634820725 conn(0x7f80d00d05c0 msgr2=0x7f80d00b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 shutdown_connections 2023-10-06T11:17:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:16.841+0000 7f80d863d700 1 -- 172.21.15.55:0/2634820725 wait complete. 2023-10-06T11:17:16.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.028+0000 7f4f716fa700 1 Processor -- start 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.028+0000 7f4f716fa700 1 -- start start 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f716fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c1538b0 0x7f4f6c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f716fa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f6c153c80 0x7f4f6c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f716fa700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0b1c10 con 0x7f4f6c15d550 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f716fa700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0b0df0 con 0x7f4f6c153c80 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f716fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c15d9d0 con 0x7f4f6c1538b0 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f70ef9700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4f6c15d550 0x7f4f6c0cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37666/0 (socket says 172.21.15.55:37666) 2023-10-06T11:17:17.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f70ef9700 1 -- 172.21.15.55:0/3218626513 learned_addr learned my addr 172.21.15.55:0/3218626513 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/3218626513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c1538b0 0x7f4f6c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.029+0000 7f4f6b7fe700 1 --2- 172.21.15.55:0/3218626513 >> v2:172.21.15.142:3300/0 conn(0x7f4f6c153c80 0x7f4f6c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6affd700 1 -- 172.21.15.55:0/3218626513 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167877539 0 0) 0x7f4f6c0b1c10 con 0x7f4f6c15d550 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6affd700 1 -- 172.21.15.55:0/3218626513 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f54003570 con 0x7f4f6c15d550 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6bfff700 1 -- 172.21.15.55:0/3218626513 >> v2:172.21.15.142:3300/0 conn(0x7f4f6c153c80 msgr2=0x7f4f6c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/3218626513 >> v2:172.21.15.142:3300/0 conn(0x7f4f6c153c80 0x7f4f6c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6bfff700 1 -- 172.21.15.55:0/3218626513 >> v1:172.21.15.55:6789/0 conn(0x7f4f6c15d550 legacy=0x7f4f6c0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6bfff700 1 -- 172.21.15.55:0/3218626513 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0b1000 con 0x7f4f6c1538b0 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6b7fe700 1 --2- 172.21.15.55:0/3218626513 >> v2:172.21.15.142:3300/0 conn(0x7f4f6c153c80 0x7f4f6c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/3218626513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c1538b0 0x7f4f6c0b20a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0098e0 tx=0x7f4f5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530393ea53bb1d09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6affd700 1 -- 172.21.15.55:0/3218626513 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c011630 con 0x7f4f6c1538b0 2023-10-06T11:17:17.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6affd700 1 -- 172.21.15.55:0/3218626513 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c011790 con 0x7f4f6c1538b0 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.030+0000 7f4f6affd700 1 -- 172.21.15.55:0/3218626513 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c011b30 con 0x7f4f6c1538b0 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 -- 172.21.15.55:0/3218626513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c1538b0 msgr2=0x7f4f6c0b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 --2- 172.21.15.55:0/3218626513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c1538b0 0x7f4f6c0b20a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0098e0 tx=0x7f4f5c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 -- 172.21.15.55:0/3218626513 shutdown_connections 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 --2- 172.21.15.55:0/3218626513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c1538b0 0x7f4f6c0b20a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 --2- 172.21.15.55:0/3218626513 >> v2:172.21.15.142:3300/0 conn(0x7f4f6c153c80 0x7f4f6c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 -- 172.21.15.55:0/3218626513 >> 172.21.15.55:0/3218626513 conn(0x7f4f6c0d03e0 msgr2=0x7f4f6c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 -- 172.21.15.55:0/3218626513 shutdown_connections 2023-10-06T11:17:17.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.031+0000 7f4f716fa700 1 -- 172.21.15.55:0/3218626513 wait complete. 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.032+0000 7f4f716fa700 1 Processor -- start 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.032+0000 7f4f716fa700 1 -- start start 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f716fa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c1538b0 0x7f4f6c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f716fa700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 0x7f4f6c068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f716fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c15d550 0x7f4f6c068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f716fa700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c16b050 con 0x7f4f6c153c80 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f716fa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c16b2c0 con 0x7f4f6c1538b0 2023-10-06T11:17:17.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f716fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c16b5a0 con 0x7f4f6c15d550 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 0x7f4f6c068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 0x7f4f6c068950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57858/0 (socket says 172.21.15.55:57858) 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 -- 172.21.15.55:0/2344201842 learned_addr learned my addr 172.21.15.55:0/2344201842 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f70ef9700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c15d550 0x7f4f6c068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c1538b0 0x7f4f6c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 -- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c15d550 msgr2=0x7f4f6c068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c15d550 0x7f4f6c068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 -- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c1538b0 msgr2=0x7f4f6c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c1538b0 0x7f4f6c1400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 -- 172.21.15.55:0/2344201842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60009420 con 0x7f4f6c153c80 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c1538b0 0x7f4f6c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:17.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.033+0000 7f4f6b7fe700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 0x7f4f6c068950 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000ec80 tx=0x7f4f600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.034+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000c920 con 0x7f4f6c153c80 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.034+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6000ca80 con 0x7f4f6c153c80 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.034+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c009420 con 0x7f4f6c153c80 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.034+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000ce20 con 0x7f4f6c153c80 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.034+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c16bb60 con 0x7f4f6c153c80 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.035+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c16bed0 con 0x7f4f6c153c80 2023-10-06T11:17:17.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.035+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f60013680 con 0x7f4f6c153c80 2023-10-06T11:17:17.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.035+0000 7f4f53fff700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f58066f30 0x7f4f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.036+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f4f600849d0 con 0x7f4f6c153c80 2023-10-06T11:17:17.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.036+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f58066f30 0x7f4f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.036+0000 7f4f6bfff700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f58066f30 0x7f4f580693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0091e0 tx=0x7f4f5c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:17.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.040+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f600552f0 con 0x7f4f6c153c80 2023-10-06T11:17:17.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:17.234+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4f6c0cffa0 con 0x7f4f6c153c80 2023-10-06T11:17:18.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.203+0000 7f4f53fff700 1 -- 172.21.15.55:0/2344201842 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4f60054e80 con 0x7f4f6c153c80 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f58066f30 msgr2=0x7f4f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f58066f30 0x7f4f580693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0091e0 tx=0x7f4f5c017000 comp rx=0 tx=0).stop 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 msgr2=0x7f4f6c068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 0x7f4f6c068950 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000ec80 tx=0x7f4f600091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 shutdown_connections 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4f58066f30 0x7f4f580693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c15d550 0x7f4f6c068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c1538b0 0x7f4f6c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 --2- 172.21.15.55:0/2344201842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f6c153c80 0x7f4f6c068950 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 >> 172.21.15.55:0/2344201842 conn(0x7f4f6c0d03e0 msgr2=0x7f4f6c1521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:18.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 shutdown_connections 2023-10-06T11:17:18.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.207+0000 7f4f716fa700 1 -- 172.21.15.55:0/2344201842 wait complete. 2023-10-06T11:17:18.210 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:17:18.225 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:17:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.357+0000 7f5486cd5700 1 Processor -- start 2023-10-06T11:17:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.357+0000 7f5486cd5700 1 -- start start 2023-10-06T11:17:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5486cd5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54801593d0 0x7f54800b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5486cd5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f548015d930 0x7f54800c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5486cd5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54800cbac0 con 0x7f54801597a0 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5486cd5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800c6d50 con 0x7f548015d930 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5486cd5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800b0730 con 0x7f54801593d0 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5485272700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f548015d930 0x7f54800c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f547ffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f54801597a0 0x7f548015d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37676/0 (socket says 172.21.15.55:37676) 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f5485272700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f548015d930 0x7f54800c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57860/0 (socket says 172.21.15.55:57860) 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.358+0000 7f547ffff700 1 -- 172.21.15.55:0/2617865487 learned_addr learned my addr 172.21.15.55:0/2617865487 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5484a71700 1 --2- 172.21.15.55:0/2617865487 >> v2:172.21.15.142:3300/0 conn(0x7f54801593d0 0x7f54800b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5485272700 1 -- 172.21.15.55:0/2617865487 >> v2:172.21.15.142:3300/0 conn(0x7f54801593d0 msgr2=0x7f54800b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5485272700 1 --2- 172.21.15.55:0/2617865487 >> v2:172.21.15.142:3300/0 conn(0x7f54801593d0 0x7f54800b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5485272700 1 -- 172.21.15.55:0/2617865487 >> v1:172.21.15.55:6789/0 conn(0x7f54801597a0 legacy=0x7f548015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5485272700 1 -- 172.21.15.55:0/2617865487 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800cb190 con 0x7f548015d930 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f547f7fe700 1 -- 172.21.15.55:0/2617865487 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415715372 0 0) 0x7f54800cbac0 con 0x7f54801597a0 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5485272700 1 --2- 172.21.15.55:0/2617865487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548015d930 0x7f54800c6300 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5480064540 tx=0x7f5478009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7f87cb695b154b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f547f7fe700 1 -- 172.21.15.55:0/2617865487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800e070 con 0x7f548015d930 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f547f7fe700 1 -- 172.21.15.55:0/2617865487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547800bc30 con 0x7f548015d930 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f547f7fe700 1 -- 172.21.15.55:0/2617865487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478012430 con 0x7f548015d930 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5486cd5700 1 -- 172.21.15.55:0/2617865487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548015d930 msgr2=0x7f54800c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5486cd5700 1 --2- 172.21.15.55:0/2617865487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548015d930 0x7f54800c6300 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5480064540 tx=0x7f5478009780 comp rx=0 tx=0).stop 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5486cd5700 1 -- 172.21.15.55:0/2617865487 shutdown_connections 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5486cd5700 1 --2- 172.21.15.55:0/2617865487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548015d930 0x7f54800c6300 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5486cd5700 1 --2- 172.21.15.55:0/2617865487 >> v2:172.21.15.142:3300/0 conn(0x7f54801593d0 0x7f54800b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.359+0000 7f5486cd5700 1 -- 172.21.15.55:0/2617865487 >> 172.21.15.55:0/2617865487 conn(0x7f54800d0550 msgr2=0x7f54800d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:18.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.360+0000 7f5486cd5700 1 -- 172.21.15.55:0/2617865487 shutdown_connections 2023-10-06T11:17:18.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.360+0000 7f5486cd5700 1 -- 172.21.15.55:0/2617865487 wait complete. 2023-10-06T11:17:18.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.361+0000 7f5486cd5700 1 Processor -- start 2023-10-06T11:17:18.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.361+0000 7f5486cd5700 1 -- start start 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.361+0000 7f5486cd5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 0x7f54800b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54801597a0 0x7f548014a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f548015d930 0x7f54800cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54800c83b0 con 0x7f54801593d0 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548015bfb0 con 0x7f548015d930 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54800b3ef0 con 0x7f54801597a0 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 0x7f54800b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 0x7f54800b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57862/0 (socket says 172.21.15.55:57862) 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 -- 172.21.15.55:0/3361270163 learned_addr learned my addr 172.21.15.55:0/3361270163 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5485272700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f548015d930 0x7f54800cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f547ffff700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54801597a0 0x7f548014a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 -- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54801597a0 msgr2=0x7f548014a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54801597a0 0x7f548014a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 -- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f548015d930 msgr2=0x7f54800cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f548015d930 0x7f54800cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 -- 172.21.15.55:0/3361270163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009a20 con 0x7f54801593d0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5484a71700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 0x7f54800b39b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f547000d860 tx=0x7f5470008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700125f0 con 0x7f54801593d0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470012750 con 0x7f54801593d0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548014a620 con 0x7f54801593d0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470012b10 con 0x7f54801593d0 2023-10-06T11:17:18.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.362+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54800c7cf0 con 0x7f54801593d0 2023-10-06T11:17:18.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.363+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548004c380 con 0x7f54801593d0 2023-10-06T11:17:18.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.364+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f547001e460 con 0x7f54801593d0 2023-10-06T11:17:18.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.364+0000 7f547cff9700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f546c066f30 0x7f546c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.364+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6256+0+0 (secure 0 0 0) 0x7f5470084b10 con 0x7f54801593d0 2023-10-06T11:17:18.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.364+0000 7f547ffff700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f546c066f30 0x7f546c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.365+0000 7f547ffff700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f546c066f30 0x7f546c0693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f54800affe0 tx=0x7f5474009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.368+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5470051b60 con 0x7f54801593d0 2023-10-06T11:17:18.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:18.563+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f548014a5c0 con 0x7f54801593d0 2023-10-06T11:17:19.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.210+0000 7f547cff9700 1 -- 172.21.15.55:0/3361270163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5470055180 con 0x7f54801593d0 2023-10-06T11:17:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f546c066f30 msgr2=0x7f546c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f546c066f30 0x7f546c0693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f54800affe0 tx=0x7f5474009040 comp rx=0 tx=0).stop 2023-10-06T11:17:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 msgr2=0x7f54800b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 0x7f54800b39b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f547000d860 tx=0x7f5470008040 comp rx=0 tx=0).stop 2023-10-06T11:17:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 shutdown_connections 2023-10-06T11:17:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f546c066f30 0x7f546c0693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54801593d0 0x7f54800b39b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f548015d930 0x7f54800cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 --2- 172.21.15.55:0/3361270163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54801597a0 0x7f548014a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 >> 172.21.15.55:0/3361270163 conn(0x7f54800d0550 msgr2=0x7f54800c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 shutdown_connections 2023-10-06T11:17:19.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.213+0000 7f5486cd5700 1 -- 172.21.15.55:0/3361270163 wait complete. 2023-10-06T11:17:19.218 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-10-06T11:17:19.231 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:17:19.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-10-06T11:17:19.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.289 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:17:19.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:17:19.291 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.292 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-10-06T11:17:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-10-06T11:17:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-10-06T11:17:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-10-06T11:17:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:17:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-10-06T11:17:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-10-06T11:17:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-10-06T11:17:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-10-06T11:17:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-10-06T11:17:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-10-06T11:17:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-10-06T11:17:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:17:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-10-06T11:17:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-10-06T11:17:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:17:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-10-06T11:17:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-10-06T11:17:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-10-06T11:17:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-10-06T11:17:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-10-06T11:17:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-10-06T11:17:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-10-06T11:17:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:17:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-10-06T11:17:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-10-06T11:17:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:17:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-10-06T11:17:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:17:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:17:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2023-10-06T11:17:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-10-06T11:17:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.299 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-10-06T11:17:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:17:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-10-06T11:17:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-10-06T11:17:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-10-06T11:17:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-10-06T11:17:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.301 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-10-06T11:17:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:17:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-10-06T11:17:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-10-06T11:17:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-10-06T11:17:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-10-06T11:17:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-10-06T11:17:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-10-06T11:17:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-10-06T11:17:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:17:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:17:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:17:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:17:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:17:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:17:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-10-06T11:17:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:17:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-10-06T11:17:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-10-06T11:17:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-10-06T11:17:19.310 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2023-10-06T11:17:19.310 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2023-10-06T11:17:19.310 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:17:19.311 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2023-10-06T11:17:19.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.311 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2023-10-06T11:17:19.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.311 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2023-10-06T11:17:19.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.312 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2023-10-06T11:17:19.312 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2023-10-06T11:17:19.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.312 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2023-10-06T11:17:19.312 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2023-10-06T11:17:19.313 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.313 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:17:19.313 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2023-10-06T11:17:19.313 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.313 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:17:19.314 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:17:19.314 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.314 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2023-10-06T11:17:19.314 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.314 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2023-10-06T11:17:19.314 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2023-10-06T11:17:19.315 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:17:19.315 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:17:19.315 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2023-10-06T11:17:19.315 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:17:19.315 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2023-10-06T11:17:19.315 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:17:19.316 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:17:19.316 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2023-10-06T11:17:19.316 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.316 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:17:19.317 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.317 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2023-10-06T11:17:19.317 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.317 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2023-10-06T11:17:19.317 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.317 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 2bd5b0c1-a996-4dae-ab19-fd6663182240 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.318 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2023-10-06T11:17:19.319 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2023-10-06T11:17:19.319 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.319 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2023-10-06T11:17:19.319 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2023-10-06T11:17:19.319 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:17:19.319 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.320 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2023-10-06T11:17:19.321 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:17:19.322 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:19.323 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2023-10-06T11:17:19.324 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2023-10-06T11:17:19.325 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:19.325 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2023-10-06T11:17:19.325 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2023-10-06T11:17:19.325 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:19.325 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.325 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.326 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2023-10-06T11:17:19.327 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:17:19.328 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:17:19.328 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2023-10-06T11:17:19.328 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-10-06T11:17:19.328 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:17:19.328 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2023-10-06T11:17:19.328 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2023-10-06T11:17:19.329 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-10-06T11:17:19.330 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-10-06T11:17:19.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:17:19.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.450+0000 7f99796d8700 1 Processor -- start 2023-10-06T11:17:19.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.450+0000 7f99796d8700 1 -- start start 2023-10-06T11:17:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f99796d8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f99741640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f99796d8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99740ca5b0 con 0x7f99740cb060 2023-10-06T11:17:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f99796d8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997415a8e0 con 0x7f997413c430 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f99796d8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997406d500 con 0x7f997415a250 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f99737fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99740cb060 0x7f9974159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37690/0 (socket says 172.21.15.55:37690) 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f99737fe700 1 -- 172.21.15.55:0/548785075 learned_addr learned my addr 172.21.15.55:0/548785075 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f9978ed7700 1 --2- 172.21.15.55:0/548785075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f99741640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007297139 0 0) 0x7f99740ca5b0 con 0x7f99740cb060 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.451+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f995c003570 con 0x7f99740cb060 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599341158 0 0) 0x7f997415a8e0 con 0x7f997413c430 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99740ca5b0 con 0x7f997413c430 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922054384 0 0) 0x7f995c003570 con 0x7f99740cb060 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9978ed7700 1 -- 172.21.15.55:0/548785075 >> v1:172.21.15.142:6789/0 conn(0x7f997413c430 legacy=0x7f99740ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9978ed7700 1 -- 172.21.15.55:0/548785075 >> v1:172.21.15.55:6789/0 conn(0x7f99740cb060 legacy=0x7f9974159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9978ed7700 1 -- 172.21.15.55:0/548785075 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997415a670 con 0x7f997415a250 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9978ed7700 1 --2- 172.21.15.55:0/548785075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f99741640d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f996c009e90 tx=0x7f996c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243f51e7e137cbe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00e070 con 0x7f997415a250 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c00b870 con 0x7f997415a250 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.452+0000 7f9972ffd700 1 -- 172.21.15.55:0/548785075 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9968001470 con 0x7f997415a250 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 -- 172.21.15.55:0/548785075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 msgr2=0x7f99741640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 --2- 172.21.15.55:0/548785075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f99741640d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f996c009e90 tx=0x7f996c009780 comp rx=0 tx=0).stop 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 -- 172.21.15.55:0/548785075 shutdown_connections 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 --2- 172.21.15.55:0/548785075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f99741640d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 -- 172.21.15.55:0/548785075 >> 172.21.15.55:0/548785075 conn(0x7f997406b330 msgr2=0x7f997406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 -- 172.21.15.55:0/548785075 shutdown_connections 2023-10-06T11:17:19.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.453+0000 7f99796d8700 1 -- 172.21.15.55:0/548785075 wait complete. 2023-10-06T11:17:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.454+0000 7f99796d8700 1 Processor -- start 2023-10-06T11:17:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.454+0000 7f99796d8700 1 -- start start 2023-10-06T11:17:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99740cb060 0x7f997413b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 0x7f9974063410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f9974063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974154b60 con 0x7f997413c430 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974141210 con 0x7f99740cb060 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99741414f0 con 0x7f997415a250 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 0x7f9974063410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 0x7f9974063410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57874/0 (socket says 172.21.15.55:57874) 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 -- 172.21.15.55:0/2152615941 learned_addr learned my addr 172.21.15.55:0/2152615941 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f9973fff700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99740cb060 0x7f997413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f9978ed7700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f9974063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 -- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 msgr2=0x7f9974063950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f9974063950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 -- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99740cb060 msgr2=0x7f997413b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99740cb060 0x7f997413b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 -- 172.21.15.55:0/2152615941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009a20 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f9978ed7700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f9974063950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99737fe700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 0x7f9974063410 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f9968001ed0 tx=0x7f9968001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800ce40 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9968005b30 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99741417d0 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99680070f0 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.455+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974141d90 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.456+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997415bf60 con 0x7f997413c430 2023-10-06T11:17:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.457+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99680074a0 con 0x7f997413c430 2023-10-06T11:17:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.457+0000 7f995bfff700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9960066f30 0x7f99600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.457+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f9968084300 con 0x7f997413c430 2023-10-06T11:17:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.457+0000 7f9973fff700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9960066f30 0x7f99600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.458+0000 7f9973fff700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9960066f30 0x7f99600693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f997415bd50 tx=0x7f9964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.462+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99680515a0 con 0x7f997413c430 2023-10-06T11:17:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.655+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f997405f230 con 0x7f997413c430 2023-10-06T11:17:19.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.659+0000 7f995bfff700 1 -- 172.21.15.55:0/2152615941 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9968054bc0 con 0x7f997413c430 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9960066f30 msgr2=0x7f99600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9960066f30 0x7f99600693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f997415bd50 tx=0x7f9964009040 comp rx=0 tx=0).stop 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 msgr2=0x7f9974063410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 0x7f9974063410 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f9968001ed0 tx=0x7f9968001a20 comp rx=0 tx=0).stop 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 shutdown_connections 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9960066f30 0x7f99600693e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f997415a250 0x7f9974063950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99740cb060 0x7f997413b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 --2- 172.21.15.55:0/2152615941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997413c430 0x7f9974063410 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 >> 172.21.15.55:0/2152615941 conn(0x7f997406b330 msgr2=0x7f99740c4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 shutdown_connections 2023-10-06T11:17:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.661+0000 7f99796d8700 1 -- 172.21.15.55:0/2152615941 wait complete. 2023-10-06T11:17:19.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2023-10-06T11:17:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.792+0000 7f91d4e30700 1 Processor -- start 2023-10-06T11:17:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.792+0000 7f91d4e30700 1 -- start start 2023-10-06T11:17:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91d4e30700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91d0159440 0x7f91d00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91d4e30700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d00b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91d4e30700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d00cb7a0 con 0x7f91d00b35d0 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91d4e30700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00b0860 con 0x7f91d0159440 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91d4e30700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00cb150 con 0x7f91d00b2100 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91cf7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91d0159440 0x7f91d00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91cf7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91d0159440 0x7f91d00b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57884/0 (socket says 172.21.15.55:57884) 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91cf7fe700 1 -- 172.21.15.55:0/4197439951 learned_addr learned my addr 172.21.15.55:0/4197439951 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.793+0000 7f91cffff700 1 --2- 172.21.15.55:0/4197439951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d00b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91cf7fe700 1 -- 172.21.15.55:0/4197439951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 msgr2=0x7f91d00b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91cf7fe700 1 --2- 172.21.15.55:0/4197439951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d00b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91cf7fe700 1 -- 172.21.15.55:0/4197439951 >> v1:172.21.15.142:6789/0 conn(0x7f91d00b35d0 legacy=0x7f91d00cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91cf7fe700 1 -- 172.21.15.55:0/4197439951 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00cb430 con 0x7f91d0159440 2023-10-06T11:17:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91cf7fe700 1 --2- 172.21.15.55:0/4197439951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d0159440 0x7f91d00b3090 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f91c00099b0 tx=0x7f91c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b7a38c93c8f5c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91ce7fc700 1 -- 172.21.15.55:0/4197439951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0009ea0 con 0x7f91d0159440 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91ce7fc700 1 -- 172.21.15.55:0/4197439951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c000b860 con 0x7f91d0159440 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91ce7fc700 1 -- 172.21.15.55:0/4197439951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000bc00 con 0x7f91d0159440 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 -- 172.21.15.55:0/4197439951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d0159440 msgr2=0x7f91d00b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 --2- 172.21.15.55:0/4197439951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d0159440 0x7f91d00b3090 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f91c00099b0 tx=0x7f91c0009250 comp rx=0 tx=0).stop 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 -- 172.21.15.55:0/4197439951 shutdown_connections 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 --2- 172.21.15.55:0/4197439951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d00b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 --2- 172.21.15.55:0/4197439951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d0159440 0x7f91d00b3090 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 -- 172.21.15.55:0/4197439951 >> 172.21.15.55:0/4197439951 conn(0x7f91d006ece0 msgr2=0x7f91d006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 -- 172.21.15.55:0/4197439951 shutdown_connections 2023-10-06T11:17:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.794+0000 7f91d4e30700 1 -- 172.21.15.55:0/4197439951 wait complete. 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 Processor -- start 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 -- start start 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 0x7f91d015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d0159440 0x7f91d015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0159b40 con 0x7f91d00b35d0 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00c8610 con 0x7f91d0159440 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.796+0000 7f91d4e30700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d015bb20 con 0x7f91d00b2100 2023-10-06T11:17:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 0x7f91d015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 0x7f91d015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57890/0 (socket says 172.21.15.55:57890) 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 -- 172.21.15.55:0/3226370026 learned_addr learned my addr 172.21.15.55:0/3226370026 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91cf7fe700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91cffff700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d0159440 0x7f91d015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 -- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 msgr2=0x7f91d0154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d0154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 -- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d0159440 msgr2=0x7f91d015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d0159440 0x7f91d015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 -- 172.21.15.55:0/3226370026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00094f0 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91ceffd700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 0x7f91d015af40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f91c400c590 tx=0x7f91c400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4011590 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4011710 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d015be00 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4011ad0 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.797+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d015c190 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.798+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d005f230 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.799+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91c401b3b0 con 0x7f91d00b35d0 2023-10-06T11:17:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.799+0000 7f91b77fe700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f91bc066f30 0x7f91bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.799+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f91c4083a10 con 0x7f91d00b35d0 2023-10-06T11:17:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.799+0000 7f91cf7fe700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f91bc066f30 0x7f91bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.800+0000 7f91cf7fe700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f91bc066f30 0x7f91bc0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f91c00099b0 tx=0x7f91c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:19.803+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91c4050c30 con 0x7f91d00b35d0 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.075+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) v1 -- 0x7f91d00c8450 con 0x7f91d00b35d0 2023-10-06T11:17:20.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.218+0000 7f91b77fe700 1 -- 172.21.15.55:0/3226370026 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v252) v1 ==== 145+0+0 (secure 0 0 0) 0x7f91d00c8450 con 0x7f91d00b35d0 2023-10-06T11:17:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f91bc066f30 msgr2=0x7f91bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f91bc066f30 0x7f91bc0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f91c00099b0 tx=0x7f91c0017000 comp rx=0 tx=0).stop 2023-10-06T11:17:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 msgr2=0x7f91d015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 0x7f91d015af40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f91c400c590 tx=0x7f91c400c8a0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 shutdown_connections 2023-10-06T11:17:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f91bc066f30 0x7f91bc0693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91d0159440 0x7f91d015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91d00b2100 0x7f91d0154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 --2- 172.21.15.55:0/3226370026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d00b35d0 0x7f91d015af40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 >> 172.21.15.55:0/3226370026 conn(0x7f91d006ece0 msgr2=0x7f91d00cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 shutdown_connections 2023-10-06T11:17:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:20.220+0000 7f91d4e30700 1 -- 172.21.15.55:0/3226370026 wait complete. 2023-10-06T11:17:20.234 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2023-10-06T11:17:20.235 INFO:tasks.cephfs_test_runner: 2023-10-06T11:17:20.235 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T11:17:20.235 INFO:tasks.cephfs_test_runner:Ran 6 tests in 206.222s 2023-10-06T11:17:20.235 INFO:tasks.cephfs_test_runner: 2023-10-06T11:17:20.235 INFO:tasks.cephfs_test_runner:OK (skipped=2) 2023-10-06T11:17:20.235 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T11:17:20.249 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T11:17:20.298 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T11:17:20.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.298 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:17:20.314 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:17:20.315 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:17:20.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:17:20.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:17:20.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-10-06T11:17:20.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.562 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-10-06T11:17:20.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.578 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-10-06T11:17:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-10-06T11:17:20.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:17:20.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.649 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:17:20.666 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:17:20.666 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:17:20.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:17:20.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:17:20.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.818 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-10-06T11:17:20.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.928 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-10-06T11:17:20.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:20.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-10-06T11:17:21.013 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-10-06T11:17:21.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:17:21.014 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T11:17:21.024 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T11:17:21.024 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.144+0000 7f0dde4b8700 1 Processor -- start 2023-10-06T11:17:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.144+0000 7f0dde4b8700 1 -- start start 2023-10-06T11:17:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dde4b8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0dd80696e0 0x7f0dd8069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dde4b8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80ada60 0x7f0dd806d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dde4b8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dd80aeeb0 0x7f0dd806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dde4b8700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80cd000 con 0x7f0dd80aeeb0 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dde4b8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80aded0 con 0x7f0dd80696e0 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dde4b8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd806d890 con 0x7f0dd80ada60 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0ddca55700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dd80aeeb0 0x7f0dd806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0ddca55700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dd80aeeb0 0x7f0dd806eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57892/0 (socket says 172.21.15.55:57892) 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0ddca55700 1 -- 172.21.15.55:0/791459796 learned_addr learned my addr 172.21.15.55:0/791459796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.145+0000 7f0dd77fe700 1 --2- 172.21.15.55:0/791459796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80ada60 0x7f0dd806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0dd7fff700 1 --2- 172.21.15.55:0/791459796 >> v2:172.21.15.142:3300/0 conn(0x7f0dd80696e0 0x7f0dd8069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0ddca55700 1 -- 172.21.15.55:0/791459796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80ada60 msgr2=0x7f0dd806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0ddca55700 1 --2- 172.21.15.55:0/791459796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80ada60 0x7f0dd806d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0ddca55700 1 -- 172.21.15.55:0/791459796 >> v2:172.21.15.142:3300/0 conn(0x7f0dd80696e0 msgr2=0x7f0dd8069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0ddca55700 1 --2- 172.21.15.55:0/791459796 >> v2:172.21.15.142:3300/0 conn(0x7f0dd80696e0 0x7f0dd8069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0ddca55700 1 -- 172.21.15.55:0/791459796 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd806e6d0 con 0x7f0dd80aeeb0 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0ddca55700 1 --2- 172.21.15.55:0/791459796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80aeeb0 0x7f0dd806eb60 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8070150 tx=0x7f0dd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999e7c760182c53a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0dd6ffd700 1 -- 172.21.15.55:0/791459796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000e070 con 0x7f0dd80aeeb0 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0dd6ffd700 1 -- 172.21.15.55:0/791459796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000b930 con 0x7f0dd80aeeb0 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.146+0000 7f0dd6ffd700 1 -- 172.21.15.55:0/791459796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00092e0 con 0x7f0dd80aeeb0 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 -- 172.21.15.55:0/791459796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80aeeb0 msgr2=0x7f0dd806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/791459796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80aeeb0 0x7f0dd806eb60 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8070150 tx=0x7f0dd0009840 comp rx=0 tx=0).stop 2023-10-06T11:17:21.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 -- 172.21.15.55:0/791459796 shutdown_connections 2023-10-06T11:17:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/791459796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80aeeb0 0x7f0dd806eb60 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/791459796 >> v2:172.21.15.142:3300/0 conn(0x7f0dd80696e0 0x7f0dd8069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/791459796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80ada60 0x7f0dd806d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 -- 172.21.15.55:0/791459796 >> 172.21.15.55:0/791459796 conn(0x7f0dd8068080 msgr2=0x7f0dd80cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 -- 172.21.15.55:0/791459796 shutdown_connections 2023-10-06T11:17:21.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.147+0000 7f0dde4b8700 1 -- 172.21.15.55:0/791459796 wait complete. 2023-10-06T11:17:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.148+0000 7f0dde4b8700 1 Processor -- start 2023-10-06T11:17:21.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.148+0000 7f0dde4b8700 1 -- start start 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dde4b8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd80696e0 0x7f0dd80c1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dde4b8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 0x7f0dd8169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dde4b8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80aeeb0 0x7f0dd814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dde4b8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c2230 con 0x7f0dd80ada60 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dde4b8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80a9ad0 con 0x7f0dd80696e0 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dde4b8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c1620 con 0x7f0dd80aeeb0 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 0x7f0dd8169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 0x7f0dd8169610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57908/0 (socket says 172.21.15.55:57908) 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 -- 172.21.15.55:0/2969902583 learned_addr learned my addr 172.21.15.55:0/2969902583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:21.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0ddca55700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80aeeb0 0x7f0dd814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd7fff700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd80696e0 0x7f0dd80c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 -- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80aeeb0 msgr2=0x7f0dd814d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80aeeb0 0x7f0dd814d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 -- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd80696e0 msgr2=0x7f0dd80c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd80696e0 0x7f0dd80c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 -- 172.21.15.55:0/2969902583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009ae0 con 0x7f0dd80ada60 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.149+0000 7f0dd77fe700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 0x7f0dd8169610 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000ec80 tx=0x7f0dc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.150+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000c850 con 0x7f0dd80ada60 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.150+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000c9b0 con 0x7f0dd80ada60 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.150+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd80c1900 con 0x7f0dd80ada60 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.150+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000cd50 con 0x7f0dd80ada60 2023-10-06T11:17:21.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.150+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd80c1ec0 con 0x7f0dd80ada60 2023-10-06T11:17:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.150+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd80c23a0 con 0x7f0dd80ada60 2023-10-06T11:17:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.151+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dc0013680 con 0x7f0dd80ada60 2023-10-06T11:17:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.151+0000 7f0dcffff700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0db8066f30 0x7f0db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.151+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f0dc0084820 con 0x7f0dd80ada60 2023-10-06T11:17:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.152+0000 7f0dd7fff700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0db8066f30 0x7f0db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.152+0000 7f0dd7fff700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0db8066f30 0x7f0db80693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009db0 tx=0x7f0dc80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.156+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dc0051a40 con 0x7f0dd80ada60 2023-10-06T11:17:21.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.351+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dd8064a90 con 0x7f0dd80ada60 2023-10-06T11:17:21.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.352+0000 7f0dcffff700 1 -- 172.21.15.55:0/2969902583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+14256 (secure 0 0 0) 0x7f0dc0055060 con 0x7f0dd80ada60 2023-10-06T11:17:21.354 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:21.354 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":112,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:17:19.200892+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/2083914208":"2023-10-07T11:17:15.833376+0000","172.21.15.55:6834/2083914208":"2023-10-07T11:17:15.833376+0000","172.21.15.55:6833/2516972275":"2023-10-07T11:17:15.833361+0000","172.21.15.142:6834/2387992820":"2023-10-07T11:16:49.087130+0000","172.21.15.55:6832/2516972275":"2023-10-07T11:17:15.833361+0000","172.21.15.142:6836/2387992820":"2023-10-07T11:16:49.087130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0db8066f30 msgr2=0x7f0db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0db8066f30 0x7f0db80693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009db0 tx=0x7f0dc80091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 msgr2=0x7f0dd8169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 0x7f0dd8169610 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000ec80 tx=0x7f0dc00091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 shutdown_connections 2023-10-06T11:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f0db8066f30 0x7f0db80693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dd80aeeb0 0x7f0dd814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd80696e0 0x7f0dd80c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 --2- 172.21.15.55:0/2969902583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dd80ada60 0x7f0dd8169610 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 >> 172.21.15.55:0/2969902583 conn(0x7f0dd8068080 msgr2=0x7f0dd80ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 shutdown_connections 2023-10-06T11:17:21.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.354+0000 7f0dde4b8700 1 -- 172.21.15.55:0/2969902583 wait complete. 2023-10-06T11:17:21.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T11:17:21.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:21.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.486+0000 7fbf12bdc700 1 Processor -- start 2023-10-06T11:17:21.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.486+0000 7fbf12bdc700 1 -- start start 2023-10-06T11:17:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf12bdc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf0c156300 0x7fbf0c1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf12bdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0ad440 0x7fbf0c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf12bdc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c156d70 con 0x7fbf0c0c8f70 2023-10-06T11:17:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf12bdc700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c157050 con 0x7fbf0c156300 2023-10-06T11:17:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf12bdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c157330 con 0x7fbf0c0ad440 2023-10-06T11:17:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf0c156300 0x7fbf0c1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf0c156300 0x7fbf0c1566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57914/0 (socket says 172.21.15.55:57914) 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 -- 172.21.15.55:0/1674765909 learned_addr learned my addr 172.21.15.55:0/1674765909 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf0bfff700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0ad440 0x7fbf0c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 -- 172.21.15.55:0/1674765909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0ad440 msgr2=0x7fbf0c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0ad440 0x7fbf0c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 -- 172.21.15.55:0/1674765909 >> v1:172.21.15.142:6789/0 conn(0x7fbf0c0c8f70 legacy=0x7fbf0c0685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 -- 172.21.15.55:0/1674765909 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c157610 con 0x7fbf0c156300 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf0bfff700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0ad440 0x7fbf0c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.487+0000 7fbf10978700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1566d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbef40099b0 tx=0x7fbef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c66dead39e8630 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf0b7fe700 1 -- 172.21.15.55:0/1674765909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400b8f0 con 0x7fbf0c156300 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf0b7fe700 1 -- 172.21.15.55:0/1674765909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef400ba50 con 0x7fbf0c156300 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf0b7fe700 1 -- 172.21.15.55:0/1674765909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400bdf0 con 0x7fbf0c156300 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 -- 172.21.15.55:0/1674765909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 msgr2=0x7fbf0c1566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1566d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbef40099b0 tx=0x7fbef4009250 comp rx=0 tx=0).stop 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 -- 172.21.15.55:0/1674765909 shutdown_connections 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1566d0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/1674765909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0ad440 0x7fbf0c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 -- 172.21.15.55:0/1674765909 >> 172.21.15.55:0/1674765909 conn(0x7fbf0c06dcd0 msgr2=0x7fbf0c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 -- 172.21.15.55:0/1674765909 shutdown_connections 2023-10-06T11:17:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.488+0000 7fbf12bdc700 1 -- 172.21.15.55:0/1674765909 wait complete. 2023-10-06T11:17:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.489+0000 7fbf12bdc700 1 Processor -- start 2023-10-06T11:17:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.489+0000 7fbf12bdc700 1 -- start start 2023-10-06T11:17:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf12bdc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf0c0ad440 0x7fbf0c16aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf12bdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0c8f70 0x7fbf0c16b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf12bdc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf12bdc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16b610 con 0x7fbf0c156300 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf12bdc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16b820 con 0x7fbf0c0ad440 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf12bdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16bb00 con 0x7fbf0c0c8f70 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf11179700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf11179700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57928/0 (socket says 172.21.15.55:57928) 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf11179700 1 -- 172.21.15.55:0/3402636137 learned_addr learned my addr 172.21.15.55:0/3402636137 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf10978700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf0c0ad440 0x7fbf0c16aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.490+0000 7fbf0bfff700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0c8f70 0x7fbf0c16b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf11179700 1 -- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0c8f70 msgr2=0x7fbf0c16b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf11179700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0c8f70 0x7fbf0c16b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf11179700 1 -- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf0c0ad440 msgr2=0x7fbf0c16aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf11179700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf0c0ad440 0x7fbf0c16aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf11179700 1 -- 172.21.15.55:0/3402636137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40094f0 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf11179700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1697a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c910 tx=0x7fbf040016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04012630 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04012790 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c16bde0 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04012b30 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.491+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c16c3a0 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.492+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c070c90 con 0x7fbf0c156300 2023-10-06T11:17:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.492+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf0401a3a0 con 0x7fbf0c156300 2023-10-06T11:17:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.493+0000 7fbf08ff9700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.493+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fbf04084760 con 0x7fbf0c156300 2023-10-06T11:17:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.493+0000 7fbf10978700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.493+0000 7fbf10978700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbeec066f30 0x7fbeec0693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbef40099b0 tx=0x7fbef4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.497+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf04055410 con 0x7fbf0c156300 2023-10-06T11:17:21.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.684+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf0c16c5c0 con 0x7fbeec066f30 2023-10-06T11:17:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.687+0000 7fbf08ff9700 1 -- 172.21.15.55:0/3402636137 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72852 (secure 0 0 0) 0x7fbf0c16c5c0 con 0x7fbeec066f30 2023-10-06T11:17:21.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbeec066f30 msgr2=0x7fbeec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbeec066f30 0x7fbeec0693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbef40099b0 tx=0x7fbef4017000 comp rx=0 tx=0).stop 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 msgr2=0x7fbf0c1697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1697a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c910 tx=0x7fbf040016b0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 shutdown_connections 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf0c156300 0x7fbf0c1697a0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf0c0ad440 0x7fbf0c16aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 --2- 172.21.15.55:0/3402636137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf0c0c8f70 0x7fbf0c16b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 >> 172.21.15.55:0/3402636137 conn(0x7fbf0c06dcd0 msgr2=0x7fbf0c068660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 shutdown_connections 2023-10-06T11:17:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.689+0000 7fbf12bdc700 1 -- 172.21.15.55:0/3402636137 wait complete. 2023-10-06T11:17:21.693 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:17:21.703 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-06T11:17:20.899488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390240,"kb_used_data":11936,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584480,"statfs":{"total":773094113280,"available":770646507520,"internally_reserved":0,"allocated":12222464,"data_stored":6434605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24031,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-65,"num_read_kb":-58,"num_write":-160,"num_write_kb":-81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001288"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.670352+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:17:17.670352+0000","last_peered":"2023-10-06T11:17:17.670352+0000","last_clean":"2023-10-06T11:17:17.670352+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:17:17.670352+0000","last_undegraded":"2023-10-06T11:17:17.670352+0000","last_fullsized":"2023-10-06T11:17:17.670352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.741876+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:17:17.741876+0000","last_peered":"2023-10-06T11:17:17.741876+0000","last_clean":"2023-10-06T11:17:17.741876+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:17:17.741876+0000","last_undegraded":"2023-10-06T11:17:17.741876+0000","last_fullsized":"2023-10-06T11:17:17.741876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:15.837311+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:17:15.837311+0000","last_peered":"2023-10-06T11:17:15.837311+0000","last_clean":"2023-10-06T11:17:15.837311+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:17:15.837311+0000","last_undegraded":"2023-10-06T11:17:15.837311+0000","last_fullsized":"2023-10-06T11:17:15.837311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.741996+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:17:17.741996+0000","last_peered":"2023-10-06T11:17:17.741996+0000","last_clean":"2023-10-06T11:17:17.741996+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:17:17.741996+0000","last_undegraded":"2023-10-06T11:17:17.741996+0000","last_fullsized":"2023-10-06T11:17:17.741996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001437+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:17:18.001437+0000","last_peered":"2023-10-06T11:17:18.001437+0000","last_clean":"2023-10-06T11:17:18.001437+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:17:18.001437+0000","last_undegraded":"2023-10-06T11:17:18.001437+0000","last_fullsized":"2023-10-06T11:17:18.001437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001229+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:17:18.001229+0000","last_peered":"2023-10-06T11:17:18.001229+0000","last_clean":"2023-10-06T11:17:18.001229+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:17:18.001229+0000","last_undegraded":"2023-10-06T11:17:18.001229+0000","last_fullsized":"2023-10-06T11:17:18.001229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001811+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:17:18.001811+0000","last_peered":"2023-10-06T11:17:18.001811+0000","last_clean":"2023-10-06T11:17:18.001811+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:17:18.001811+0000","last_undegraded":"2023-10-06T11:17:18.001811+0000","last_fullsized":"2023-10-06T11:17:18.001811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.670229+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:17:17.670229+0000","last_peered":"2023-10-06T11:17:17.670229+0000","last_clean":"2023-10-06T11:17:17.670229+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:17:17.670229+0000","last_undegraded":"2023-10-06T11:17:17.670229+0000","last_fullsized":"2023-10-06T11:17:17.670229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:15.839869+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:17:15.839869+0000","last_peered":"2023-10-06T11:17:15.839869+0000","last_clean":"2023-10-06T11:17:15.839869+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:17:15.839869+0000","last_undegraded":"2023-10-06T11:17:15.839869+0000","last_fullsized":"2023-10-06T11:17:15.839869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299208,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072632,"statfs":{"total":96636764160,"available":96330375168,"internally_reserved":0,"allocated":1966080,"data_stored":1242964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":1.325,"15min":1.325},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":1.395,"15min":1.395},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66300000000000003,"5min":1.369,"15min":1.369},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.79900000000000004,"15min":1.038},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.872,"15min":0.872},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298628,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073212,"statfs":{"total":96636764160,"available":96330969088,"internally_reserved":0,"allocated":1372160,"data_stored":652084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.495},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60999999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":1.056,"15min":1.056},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72699999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83399999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":659597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.372,"15min":0.41899999999999998},"min":{"1min":0.20200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.50900000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38900000000000001,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57299999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.432,"15min":0.48299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.437}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.5,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.254,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.628},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.298,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92400000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.319,"5min":1.508,"15min":1.508},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299216,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072624,"statfs":{"total":96636764160,"available":96330366976,"internally_reserved":0,"allocated":1974272,"data_stored":1249254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.255,"5min":0.249,"15min":0.249},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.626,"15min":0.626},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.50800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.871,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.624},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92800000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.624,"15min":0.628},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298628,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073212,"statfs":{"total":96636764160,"available":96330969088,"internally_reserved":0,"allocated":1372160,"data_stored":652172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.373},"min":{"1min":0.20499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.374},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.61399999999999999,"5min":1.056,"15min":1.056},"last":0.434},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64400000000000002,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82299999999999995,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.68400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":2.335,"15min":2.335},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.64800000000000002,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85999999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":1.161,"15min":1.161},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":660762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47999999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.503,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.311},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.433}]},{"osd":2,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38500000000000001,"15min":0.40100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92600000000000005,"5min":0.997,"15min":0.997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.89200000000000002,"5min":1.115,"15min":1.115},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.52800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":658886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":1.163,"15min":1.163},"last":0.439},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71999999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.996,"15min":0.996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.748,"5min":1.234,"15min":1.234},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":1.113,"15min":1.113},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.81999999999999995,"5min":1.014,"15min":1.014},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.80500000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":658886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":1.369,"15min":1.369},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.60699999999999998,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2389999999999999,"5min":5.2389999999999999,"15min":5.2389999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":1.355,"15min":1.355},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75900000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":1.512,"15min":1.512},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52800000000000002,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.40699999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:21.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.822+0000 7fd58f59e700 1 Processor -- start 2023-10-06T11:17:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.822+0000 7fd58f59e700 1 -- start start 2023-10-06T11:17:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58f59e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5900b2100 0x7fd5900b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58f59e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5900cb7a0 con 0x7fd5900b35d0 2023-10-06T11:17:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58f59e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900b0860 con 0x7fd5900b2100 2023-10-06T11:17:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900cb150 con 0x7fd590159440 2023-10-06T11:17:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5900b2100 0x7fd5900b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5900b2100 0x7fd5900b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57942/0 (socket says 172.21.15.55:57942) 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58dd9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd5900b35d0 0x7fd5900cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37692/0 (socket says 172.21.15.55:37692) 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 -- 172.21.15.55:0/3461564645 learned_addr learned my addr 172.21.15.55:0/3461564645 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58e59c700 1 --2- 172.21.15.55:0/3461564645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 -- 172.21.15.55:0/3461564645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 msgr2=0x7fd5900b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 --2- 172.21.15.55:0/3461564645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 -- 172.21.15.55:0/3461564645 >> v1:172.21.15.55:6789/0 conn(0x7fd5900b35d0 legacy=0x7fd5900cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58ed9d700 1 -- 172.21.15.55:0/3461564645 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900cb430 con 0x7fd5900b2100 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.823+0000 7fd58d59a700 1 -- 172.21.15.55:0/3461564645 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104968497 0 0) 0x7fd5900cb7a0 con 0x7fd5900b35d0 2023-10-06T11:17:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58ed9d700 1 --2- 172.21.15.55:0/3461564645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b2100 0x7fd5900b2580 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd5880099b0 tx=0x7fd588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b2a08081c8389 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58d59a700 1 -- 172.21.15.55:0/3461564645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588009ea0 con 0x7fd5900b2100 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58d59a700 1 -- 172.21.15.55:0/3461564645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800b860 con 0x7fd5900b2100 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58d59a700 1 -- 172.21.15.55:0/3461564645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800bc00 con 0x7fd5900b2100 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 -- 172.21.15.55:0/3461564645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b2100 msgr2=0x7fd5900b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 --2- 172.21.15.55:0/3461564645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b2100 0x7fd5900b2580 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd5880099b0 tx=0x7fd588009250 comp rx=0 tx=0).stop 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 -- 172.21.15.55:0/3461564645 shutdown_connections 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 --2- 172.21.15.55:0/3461564645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b2100 0x7fd5900b2580 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 --2- 172.21.15.55:0/3461564645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 -- 172.21.15.55:0/3461564645 >> 172.21.15.55:0/3461564645 conn(0x7fd59006ece0 msgr2=0x7fd59006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.824+0000 7fd58f59e700 1 -- 172.21.15.55:0/3461564645 shutdown_connections 2023-10-06T11:17:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.825+0000 7fd58f59e700 1 -- 172.21.15.55:0/3461564645 wait complete. 2023-10-06T11:17:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 Processor -- start 2023-10-06T11:17:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 -- start start 2023-10-06T11:17:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5900b2100 0x7fd59016a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 0x7fd590151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900c61a0 con 0x7fd5900b35d0 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900ce5e0 con 0x7fd5900b2100 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900c5ec0 con 0x7fd590159440 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 0x7fd590151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58dd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 0x7fd590151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57956/0 (socket says 172.21.15.55:57956) 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.826+0000 7fd58dd9b700 1 -- 172.21.15.55:0/1229439276 learned_addr learned my addr 172.21.15.55:0/1229439276 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58e59c700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5900b2100 0x7fd59016a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58ed9d700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58dd9b700 1 -- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 msgr2=0x7fd5900d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58dd9b700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58dd9b700 1 -- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5900b2100 msgr2=0x7fd59016a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58dd9b700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5900b2100 0x7fd59016a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58dd9b700 1 -- 172.21.15.55:0/1229439276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880094f0 con 0x7fd5900b35d0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58ed9d700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58dd9b700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 0x7fd590151910 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd5780011e0 tx=0x7fd578007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578005a70 con 0x7fd5900b35d0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578005bd0 con 0x7fd5900b35d0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5900cdf90 con 0x7fd5900b35d0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780070d0 con 0x7fd5900b35d0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.827+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd590151e50 con 0x7fd5900b35d0 2023-10-06T11:17:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.828+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900cddd0 con 0x7fd5900b35d0 2023-10-06T11:17:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.829+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd578007480 con 0x7fd5900b35d0 2023-10-06T11:17:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.829+0000 7fd5867fc700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd570066f30 0x7fd5700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.829+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fd5780839e0 con 0x7fd5900b35d0 2023-10-06T11:17:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.829+0000 7fd58e59c700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd570066f30 0x7fd5700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.830+0000 7fd58e59c700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd570066f30 0x7fd5700693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd580009fd0 tx=0x7fd58000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:21.833+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd57804b5a0 con 0x7fd5900b35d0 2023-10-06T11:17:22.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.023+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd59005f230 con 0x7fd570066f30 2023-10-06T11:17:22.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.026+0000 7fd5867fc700 1 -- 172.21.15.55:0/1229439276 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72852 (secure 0 0 0) 0x7fd59005f230 con 0x7fd570066f30 2023-10-06T11:17:22.029 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd570066f30 msgr2=0x7fd5700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd570066f30 0x7fd5700693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd580009fd0 tx=0x7fd58000b040 comp rx=0 tx=0).stop 2023-10-06T11:17:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 msgr2=0x7fd590151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 0x7fd590151910 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd5780011e0 tx=0x7fd578007e10 comp rx=0 tx=0).stop 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 shutdown_connections 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fd570066f30 0x7fd5700693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd590159440 0x7fd5900d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5900b2100 0x7fd59016a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 --2- 172.21.15.55:0/1229439276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5900b35d0 0x7fd590151910 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 >> 172.21.15.55:0/1229439276 conn(0x7fd59006ece0 msgr2=0x7fd590156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 shutdown_connections 2023-10-06T11:17:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.028+0000 7fd58f59e700 1 -- 172.21.15.55:0/1229439276 wait complete. 2023-10-06T11:17:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:17:22.042 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-06T11:17:20.899488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390240,"kb_used_data":11936,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584480,"statfs":{"total":773094113280,"available":770646507520,"internally_reserved":0,"allocated":12222464,"data_stored":6434605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24031,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-65,"num_read_kb":-58,"num_write":-160,"num_write_kb":-81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001288"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.670352+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:17:17.670352+0000","last_peered":"2023-10-06T11:17:17.670352+0000","last_clean":"2023-10-06T11:17:17.670352+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:17:17.670352+0000","last_undegraded":"2023-10-06T11:17:17.670352+0000","last_fullsized":"2023-10-06T11:17:17.670352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.741876+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:17:17.741876+0000","last_peered":"2023-10-06T11:17:17.741876+0000","last_clean":"2023-10-06T11:17:17.741876+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:17:17.741876+0000","last_undegraded":"2023-10-06T11:17:17.741876+0000","last_fullsized":"2023-10-06T11:17:17.741876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:15.837311+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:17:15.837311+0000","last_peered":"2023-10-06T11:17:15.837311+0000","last_clean":"2023-10-06T11:17:15.837311+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:17:15.837311+0000","last_undegraded":"2023-10-06T11:17:15.837311+0000","last_fullsized":"2023-10-06T11:17:15.837311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.741996+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:17:17.741996+0000","last_peered":"2023-10-06T11:17:17.741996+0000","last_clean":"2023-10-06T11:17:17.741996+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:17:17.741996+0000","last_undegraded":"2023-10-06T11:17:17.741996+0000","last_fullsized":"2023-10-06T11:17:17.741996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001437+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:17:18.001437+0000","last_peered":"2023-10-06T11:17:18.001437+0000","last_clean":"2023-10-06T11:17:18.001437+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:17:18.001437+0000","last_undegraded":"2023-10-06T11:17:18.001437+0000","last_fullsized":"2023-10-06T11:17:18.001437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001229+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:17:18.001229+0000","last_peered":"2023-10-06T11:17:18.001229+0000","last_clean":"2023-10-06T11:17:18.001229+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:17:18.001229+0000","last_undegraded":"2023-10-06T11:17:18.001229+0000","last_fullsized":"2023-10-06T11:17:18.001229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001811+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:17:18.001811+0000","last_peered":"2023-10-06T11:17:18.001811+0000","last_clean":"2023-10-06T11:17:18.001811+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:17:18.001811+0000","last_undegraded":"2023-10-06T11:17:18.001811+0000","last_fullsized":"2023-10-06T11:17:18.001811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.670229+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:17:17.670229+0000","last_peered":"2023-10-06T11:17:17.670229+0000","last_clean":"2023-10-06T11:17:17.670229+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:17:17.670229+0000","last_undegraded":"2023-10-06T11:17:17.670229+0000","last_fullsized":"2023-10-06T11:17:17.670229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:15.839869+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:17:15.839869+0000","last_peered":"2023-10-06T11:17:15.839869+0000","last_clean":"2023-10-06T11:17:15.839869+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:17:15.839869+0000","last_undegraded":"2023-10-06T11:17:15.839869+0000","last_fullsized":"2023-10-06T11:17:15.839869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299208,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072632,"statfs":{"total":96636764160,"available":96330375168,"internally_reserved":0,"allocated":1966080,"data_stored":1242964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":1.325,"15min":1.325},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":1.395,"15min":1.395},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66300000000000003,"5min":1.369,"15min":1.369},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.79900000000000004,"15min":1.038},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.872,"15min":0.872},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298628,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073212,"statfs":{"total":96636764160,"available":96330969088,"internally_reserved":0,"allocated":1372160,"data_stored":652084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.495},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60999999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":1.056,"15min":1.056},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72699999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83399999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":659597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.372,"15min":0.41899999999999998},"min":{"1min":0.20200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.50900000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38900000000000001,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57299999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.432,"15min":0.48299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.437}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.5,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.254,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.628},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.298,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92400000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.319,"5min":1.508,"15min":1.508},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299216,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072624,"statfs":{"total":96636764160,"available":96330366976,"internally_reserved":0,"allocated":1974272,"data_stored":1249254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.255,"5min":0.249,"15min":0.249},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.626,"15min":0.626},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.50800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.871,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.624},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92800000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.624,"15min":0.628},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298628,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073212,"statfs":{"total":96636764160,"available":96330969088,"internally_reserved":0,"allocated":1372160,"data_stored":652172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.373},"min":{"1min":0.20499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.374},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.61399999999999999,"5min":1.056,"15min":1.056},"last":0.434},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64400000000000002,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82299999999999995,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.68400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":2.335,"15min":2.335},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.64800000000000002,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85999999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":1.161,"15min":1.161},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":660762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47999999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.503,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.311},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.433}]},{"osd":2,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38500000000000001,"15min":0.40100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92600000000000005,"5min":0.997,"15min":0.997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.89200000000000002,"5min":1.115,"15min":1.115},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.52800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":658886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":1.163,"15min":1.163},"last":0.439},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71999999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.996,"15min":0.996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.748,"5min":1.234,"15min":1.234},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":1.113,"15min":1.113},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.81999999999999995,"5min":1.014,"15min":1.014},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.80500000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":658886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":1.369,"15min":1.369},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.60699999999999998,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2389999999999999,"5min":5.2389999999999999,"15min":5.2389999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":1.355,"15min":1.355},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75900000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":1.512,"15min":1.512},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52800000000000002,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.40699999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:22.045 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T11:17:22.045 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:22.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.162+0000 7f67e6c2f700 1 Processor -- start 2023-10-06T11:17:22.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e6c2f700 1 -- start start 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e6c2f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67e00ca370 0x7f67e0158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e6c2f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67e00adb60 0x7f67e00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e6c2f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e0157de0 con 0x7f67e00ce6d0 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e6c2f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e00cbb90 con 0x7f67e00adb60 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e6c2f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e00ceb10 con 0x7f67e00ca370 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67dffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67e00adb60 0x7f67e00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e51cc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67e00ce6d0 0x7f67e015aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37698/0 (socket says 172.21.15.55:37698) 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.163+0000 7f67e51cc700 1 -- 172.21.15.55:0/1382280469 learned_addr learned my addr 172.21.15.55:0/1382280469 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67e49cb700 1 --2- 172.21.15.55:0/1382280469 >> v2:172.21.15.142:3300/0 conn(0x7f67e00ca370 0x7f67e0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67dffff700 1 -- 172.21.15.55:0/1382280469 >> v2:172.21.15.142:3300/0 conn(0x7f67e00ca370 msgr2=0x7f67e0158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67dffff700 1 --2- 172.21.15.55:0/1382280469 >> v2:172.21.15.142:3300/0 conn(0x7f67e00ca370 0x7f67e0158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67dffff700 1 -- 172.21.15.55:0/1382280469 >> v1:172.21.15.55:6789/0 conn(0x7f67e00ce6d0 legacy=0x7f67e015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67dffff700 1 -- 172.21.15.55:0/1382280469 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00cb5d0 con 0x7f67e00adb60 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67e49cb700 1 --2- 172.21.15.55:0/1382280469 >> v2:172.21.15.142:3300/0 conn(0x7f67e00ca370 0x7f67e0158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67dffff700 1 --2- 172.21.15.55:0/1382280469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00adb60 0x7f67e00ce190 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f67e006f2c0 tx=0x7f67cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803a2600d2438cb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67df7fe700 1 -- 172.21.15.55:0/1382280469 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00b6b0 con 0x7f67e00adb60 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67df7fe700 1 -- 172.21.15.55:0/1382280469 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00b810 con 0x7f67e00adb60 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.164+0000 7f67df7fe700 1 -- 172.21.15.55:0/1382280469 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00bbb0 con 0x7f67e00adb60 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 -- 172.21.15.55:0/1382280469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00adb60 msgr2=0x7f67e00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/1382280469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00adb60 0x7f67e00ce190 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f67e006f2c0 tx=0x7f67cc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 -- 172.21.15.55:0/1382280469 shutdown_connections 2023-10-06T11:17:22.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/1382280469 >> v2:172.21.15.142:3300/0 conn(0x7f67e00ca370 0x7f67e0158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/1382280469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00adb60 0x7f67e00ce190 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 -- 172.21.15.55:0/1382280469 >> 172.21.15.55:0/1382280469 conn(0x7f67e00707d0 msgr2=0x7f67e0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 -- 172.21.15.55:0/1382280469 shutdown_connections 2023-10-06T11:17:22.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.165+0000 7f67e6c2f700 1 -- 172.21.15.55:0/1382280469 wait complete. 2023-10-06T11:17:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.166+0000 7f67e6c2f700 1 Processor -- start 2023-10-06T11:17:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.166+0000 7f67e6c2f700 1 -- start start 2023-10-06T11:17:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e6c2f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e00adb60 0x7f67e00b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e6c2f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 0x7f67e00c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e6c2f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e00ce6d0 0x7f67e0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e6c2f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e01521b0 con 0x7f67e00ca370 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e6c2f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00ca1a0 con 0x7f67e00ce6d0 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e6c2f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00c3020 con 0x7f67e00adb60 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 0x7f67e00c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 0x7f67e00c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57970/0 (socket says 172.21.15.55:57970) 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 -- 172.21.15.55:0/3503482130 learned_addr learned my addr 172.21.15.55:0/3503482130 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e51cc700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e00ce6d0 0x7f67e0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67e49cb700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e00adb60 0x7f67e00b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 -- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e00adb60 msgr2=0x7f67e00b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e00adb60 0x7f67e00b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 -- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e00ce6d0 msgr2=0x7f67e0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e00ce6d0 0x7f67e0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 -- 172.21.15.55:0/3503482130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc009420 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dffff700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 0x7f67e00c1d10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f67e00cdfa0 tx=0x7f67cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.167+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc011420 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.168+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc011580 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.168+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc011920 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.168+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e00c2410 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.168+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e00c29d0 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.169+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e0064a90 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.169+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67cc011d10 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.169+0000 7f67dcff9700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f67c4066f30 0x7f67c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.169+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f67cc086110 con 0x7f67e00ca370 2023-10-06T11:17:22.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.170+0000 7f67e49cb700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f67c4066f30 0x7f67c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.170+0000 7f67e49cb700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f67c4066f30 0x7f67c40693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f67d4006fd0 tx=0x7f67d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.174+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67cc0533b0 con 0x7f67e00ca370 2023-10-06T11:17:22.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.363+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67e00c3160 con 0x7f67c4066f30 2023-10-06T11:17:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.366+0000 7f67dcff9700 1 -- 172.21.15.55:0/3503482130 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72852 (secure 0 0 0) 0x7f67e00c3160 con 0x7f67c4066f30 2023-10-06T11:17:22.368 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:22.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f67c4066f30 msgr2=0x7f67c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f67c4066f30 0x7f67c40693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f67d4006fd0 tx=0x7f67d4008040 comp rx=0 tx=0).stop 2023-10-06T11:17:22.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 msgr2=0x7f67e00c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 0x7f67e00c1d10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f67e00cdfa0 tx=0x7f67cc017000 comp rx=0 tx=0).stop 2023-10-06T11:17:22.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 shutdown_connections 2023-10-06T11:17:22.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f67c4066f30 0x7f67c40693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67e00ce6d0 0x7f67e0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67e00adb60 0x7f67e00b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 --2- 172.21.15.55:0/3503482130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67e00ca370 0x7f67e00c1d10 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 >> 172.21.15.55:0/3503482130 conn(0x7f67e00707d0 msgr2=0x7f67e01554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 shutdown_connections 2023-10-06T11:17:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.368+0000 7f67e6c2f700 1 -- 172.21.15.55:0/3503482130 wait complete. 2023-10-06T11:17:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:17:22.381 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-06T11:17:20.899488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390240,"kb_used_data":11936,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584480,"statfs":{"total":773094113280,"available":770646507520,"internally_reserved":0,"allocated":12222464,"data_stored":6434605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24031,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-65,"num_read_kb":-58,"num_write":-160,"num_write_kb":-81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001288"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.670352+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:17:17.670352+0000","last_peered":"2023-10-06T11:17:17.670352+0000","last_clean":"2023-10-06T11:17:17.670352+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:17:17.670352+0000","last_undegraded":"2023-10-06T11:17:17.670352+0000","last_fullsized":"2023-10-06T11:17:17.670352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.741876+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:17:17.741876+0000","last_peered":"2023-10-06T11:17:17.741876+0000","last_clean":"2023-10-06T11:17:17.741876+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:17:17.741876+0000","last_undegraded":"2023-10-06T11:17:17.741876+0000","last_fullsized":"2023-10-06T11:17:17.741876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:15.837311+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:17:15.837311+0000","last_peered":"2023-10-06T11:17:15.837311+0000","last_clean":"2023-10-06T11:17:15.837311+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:17:15.837311+0000","last_undegraded":"2023-10-06T11:17:15.837311+0000","last_fullsized":"2023-10-06T11:17:15.837311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.741996+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:17:17.741996+0000","last_peered":"2023-10-06T11:17:17.741996+0000","last_clean":"2023-10-06T11:17:17.741996+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:17:17.741996+0000","last_undegraded":"2023-10-06T11:17:17.741996+0000","last_fullsized":"2023-10-06T11:17:17.741996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001437+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:17:18.001437+0000","last_peered":"2023-10-06T11:17:18.001437+0000","last_clean":"2023-10-06T11:17:18.001437+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:17:18.001437+0000","last_undegraded":"2023-10-06T11:17:18.001437+0000","last_fullsized":"2023-10-06T11:17:18.001437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001229+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:17:18.001229+0000","last_peered":"2023-10-06T11:17:18.001229+0000","last_clean":"2023-10-06T11:17:18.001229+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:17:18.001229+0000","last_undegraded":"2023-10-06T11:17:18.001229+0000","last_fullsized":"2023-10-06T11:17:18.001229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.001811+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:17:18.001811+0000","last_peered":"2023-10-06T11:17:18.001811+0000","last_clean":"2023-10-06T11:17:18.001811+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:17:18.001811+0000","last_undegraded":"2023-10-06T11:17:18.001811+0000","last_fullsized":"2023-10-06T11:17:18.001811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:17.670229+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:17:17.670229+0000","last_peered":"2023-10-06T11:17:17.670229+0000","last_clean":"2023-10-06T11:17:17.670229+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:17:17.670229+0000","last_undegraded":"2023-10-06T11:17:17.670229+0000","last_fullsized":"2023-10-06T11:17:17.670229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T11:17:15.839869+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:17:15.839869+0000","last_peered":"2023-10-06T11:17:15.839869+0000","last_clean":"2023-10-06T11:17:15.839869+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:17:15.839869+0000","last_undegraded":"2023-10-06T11:17:15.839869+0000","last_fullsized":"2023-10-06T11:17:15.839869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299208,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072632,"statfs":{"total":96636764160,"available":96330375168,"internally_reserved":0,"allocated":1966080,"data_stored":1242964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":1.325,"15min":1.325},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":1.395,"15min":1.395},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66300000000000003,"5min":1.369,"15min":1.369},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.79900000000000004,"15min":1.038},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.872,"15min":0.872},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298628,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073212,"statfs":{"total":96636764160,"available":96330969088,"internally_reserved":0,"allocated":1372160,"data_stored":652084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.495},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60999999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":1.056,"15min":1.056},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72699999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83399999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":659597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.372,"15min":0.41899999999999998},"min":{"1min":0.20200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.50900000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38900000000000001,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57299999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.432,"15min":0.48299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.437}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.5,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.254,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.628},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.298,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92400000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.319,"5min":1.508,"15min":1.508},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299216,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072624,"statfs":{"total":96636764160,"available":96330366976,"internally_reserved":0,"allocated":1974272,"data_stored":1249254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.255,"5min":0.249,"15min":0.249},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.626,"15min":0.626},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.50800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.871,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.624},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92800000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.624,"15min":0.628},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298628,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073212,"statfs":{"total":96636764160,"available":96330969088,"internally_reserved":0,"allocated":1372160,"data_stored":652172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.373},"min":{"1min":0.20499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.374},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.61399999999999999,"5min":1.056,"15min":1.056},"last":0.434},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64400000000000002,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82299999999999995,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.68400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":2.335,"15min":2.335},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.64800000000000002,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85999999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":1.161,"15min":1.161},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":660762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47999999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36799999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.503,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.311},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.433}]},{"osd":2,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38500000000000001,"15min":0.40100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92600000000000005,"5min":0.997,"15min":0.997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.89200000000000002,"5min":1.115,"15min":1.115},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.52800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":658886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":1.163,"15min":1.163},"last":0.439},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71999999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.996,"15min":0.996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.748,"5min":1.234,"15min":1.234},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":1.113,"15min":1.113},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.81999999999999995,"5min":1.014,"15min":1.014},"last":0.629}]},{"osd":7,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.80500000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":658886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":1.369,"15min":1.369},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.60699999999999998,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2389999999999999,"5min":5.2389999999999999,"15min":5.2389999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":1.355,"15min":1.355},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75900000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":1.512,"15min":1.512},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52800000000000002,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.40699999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:22.384 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:22.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c6552a700 1 Processor -- start 2023-10-06T11:17:22.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c6552a700 1 -- start start 2023-10-06T11:17:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c6552a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c6015db10 0x7f8c600cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c6552a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600cecf0 con 0x7f8c600ad210 2023-10-06T11:17:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c6552a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600cefd0 con 0x7f8c600ad5e0 2023-10-06T11:17:22.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c6552a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c600cca90 con 0x7f8c6015db10 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.501+0000 7f8c5e7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c6015db10 0x7f8c600cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5e7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c6015db10 0x7f8c600cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57972/0 (socket says 172.21.15.55:57972) 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5e7fc700 1 -- 172.21.15.55:0/2515328253 learned_addr learned my addr 172.21.15.55:0/2515328253 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5effd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c600ad210 0x7f8c6015d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37714/0 (socket says 172.21.15.55:37714) 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5e7fc700 1 -- 172.21.15.55:0/2515328253 >> v1:172.21.15.142:6789/0 conn(0x7f8c600ad5e0 legacy=0x7f8c600ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5e7fc700 1 -- 172.21.15.55:0/2515328253 >> v1:172.21.15.55:6789/0 conn(0x7f8c600ad210 legacy=0x7f8c6015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5dffb700 1 -- 172.21.15.55:0/2515328253 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538362461 0 0) 0x7f8c600cecf0 con 0x7f8c600ad210 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5e7fc700 1 -- 172.21.15.55:0/2515328253 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600ccd70 con 0x7f8c6015db10 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5e7fc700 1 --2- 172.21.15.55:0/2515328253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db10 0x7f8c600cd290 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f8c480099b0 tx=0x7f8c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8de84088de5f2e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5dffb700 1 -- 172.21.15.55:0/2515328253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800b860 con 0x7f8c6015db10 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5dffb700 1 -- 172.21.15.55:0/2515328253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4800b9c0 con 0x7f8c6015db10 2023-10-06T11:17:22.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.502+0000 7f8c5dffb700 1 -- 172.21.15.55:0/2515328253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800bd60 con 0x7f8c6015db10 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 -- 172.21.15.55:0/2515328253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db10 msgr2=0x7f8c600cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 --2- 172.21.15.55:0/2515328253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db10 0x7f8c600cd290 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f8c480099b0 tx=0x7f8c48009250 comp rx=0 tx=0).stop 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 -- 172.21.15.55:0/2515328253 shutdown_connections 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 --2- 172.21.15.55:0/2515328253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db10 0x7f8c600cd290 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 -- 172.21.15.55:0/2515328253 >> 172.21.15.55:0/2515328253 conn(0x7f8c60067d90 msgr2=0x7f8c600ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 -- 172.21.15.55:0/2515328253 shutdown_connections 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.503+0000 7f8c6552a700 1 -- 172.21.15.55:0/2515328253 wait complete. 2023-10-06T11:17:22.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.504+0000 7f8c6552a700 1 Processor -- start 2023-10-06T11:17:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.504+0000 7f8c6552a700 1 -- start start 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 0x7f8c6015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c600ad5e0 0x7f8c60154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c6015db10 0x7f8c6015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60160790 con 0x7f8c600ad210 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600c1e90 con 0x7f8c6015db10 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6015fef0 con 0x7f8c600ad5e0 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 0x7f8c6015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 0x7f8c6015f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57984/0 (socket says 172.21.15.55:57984) 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 -- 172.21.15.55:0/3270884765 learned_addr learned my addr 172.21.15.55:0/3270884765 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 -- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c600ad5e0 msgr2=0x7f8c60154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c600ad5e0 0x7f8c60154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 -- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c6015db10 msgr2=0x7f8c6015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c6015db10 0x7f8c6015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 -- 172.21.15.55:0/3270884765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480094f0 con 0x7f8c600ad210 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c5effd700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 0x7f8c6015f5c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c810 tx=0x7f8c58007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007300 con 0x7f8c600ad210 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58007480 con 0x7f8c600ad210 2023-10-06T11:17:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580057f0 con 0x7f8c600ad210 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601601d0 con 0x7f8c600ad210 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.505+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6015fb00 con 0x7f8c600ad210 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.506+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6006ee10 con 0x7f8c600ad210 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.507+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c58005b60 con 0x7f8c600ad210 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.507+0000 7f8c56ffd700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c40066f30 0x7f8c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.507+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f8c58083f40 con 0x7f8c600ad210 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.507+0000 7f8c5e7fc700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c40066f30 0x7f8c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.508+0000 7f8c5e7fc700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c40066f30 0x7f8c400693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c600cd7d0 tx=0x7f8c48017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.511+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c580511e0 con 0x7f8c600ad210 2023-10-06T11:17:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.705+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c60064a90 con 0x7f8c600ad210 2023-10-06T11:17:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.706+0000 7f8c56ffd700 1 -- 172.21.15.55:0/3270884765 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+14256 (secure 0 0 0) 0x7f8c58054800 con 0x7f8c600ad210 2023-10-06T11:17:22.708 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:22.708 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":112,"fsid":"2bd5b0c1-a996-4dae-ab19-fd6663182240","created":"2023-10-06T11:12:47.218786+0000","modified":"2023-10-06T11:17:19.200892+0000","last_up_change":"2023-10-06T11:12:58.945799+0000","last_in_change":"2023-10-06T11:12:49.876402+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T11:13:00.897326+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T11:13:05.917155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e5cbdc97-a9f4-4743-8b21-390106fa48d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":90685},{"type":"v1","addr":"172.21.15.55:6809","nonce":90685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":90685},{"type":"v1","addr":"172.21.15.55:6811","nonce":90685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":90685},{"type":"v1","addr":"172.21.15.55:6815","nonce":90685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":90685},{"type":"v1","addr":"172.21.15.55:6813","nonce":90685}]},"public_addr":"172.21.15.55:6809/90685","cluster_addr":"172.21.15.55:6811/90685","heartbeat_back_addr":"172.21.15.55:6815/90685","heartbeat_front_addr":"172.21.15.55:6813/90685","state":["exists","up"]},{"osd":1,"uuid":"2d5e909b-302b-4782-bcb2-a4ce4e9a9e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":90686},{"type":"v1","addr":"172.21.15.55:6801","nonce":90686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":90686},{"type":"v1","addr":"172.21.15.55:6803","nonce":90686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":90686},{"type":"v1","addr":"172.21.15.55:6807","nonce":90686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":90686},{"type":"v1","addr":"172.21.15.55:6805","nonce":90686}]},"public_addr":"172.21.15.55:6801/90686","cluster_addr":"172.21.15.55:6803/90686","heartbeat_back_addr":"172.21.15.55:6807/90686","heartbeat_front_addr":"172.21.15.55:6805/90686","state":["exists","up"]},{"osd":2,"uuid":"7c514074-b72a-4b8e-83c3-8e7259e95180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":90687},{"type":"v1","addr":"172.21.15.55:6819","nonce":90687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":90687},{"type":"v1","addr":"172.21.15.55:6823","nonce":90687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6829","nonce":90687},{"type":"v1","addr":"172.21.15.55:6831","nonce":90687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6825","nonce":90687},{"type":"v1","addr":"172.21.15.55:6827","nonce":90687}]},"public_addr":"172.21.15.55:6819/90687","cluster_addr":"172.21.15.55:6823/90687","heartbeat_back_addr":"172.21.15.55:6831/90687","heartbeat_front_addr":"172.21.15.55:6827/90687","state":["exists","up"]},{"osd":3,"uuid":"97f9cb9a-2dec-48d3-8d46-2ec0e86661f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":90688},{"type":"v1","addr":"172.21.15.55:6818","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":90688},{"type":"v1","addr":"172.21.15.55:6822","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":90688},{"type":"v1","addr":"172.21.15.55:6830","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":90688},{"type":"v1","addr":"172.21.15.55:6826","nonce":90688}]},"public_addr":"172.21.15.55:6818/90688","cluster_addr":"172.21.15.55:6822/90688","heartbeat_back_addr":"172.21.15.55:6830/90688","heartbeat_front_addr":"172.21.15.55:6826/90688","state":["exists","up"]},{"osd":4,"uuid":"7a3da0b5-7c0e-4a44-bee4-6164f3010296","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":90857},{"type":"v1","addr":"172.21.15.142:6809","nonce":90857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":90857},{"type":"v1","addr":"172.21.15.142:6811","nonce":90857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":90857},{"type":"v1","addr":"172.21.15.142:6815","nonce":90857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":90857},{"type":"v1","addr":"172.21.15.142:6813","nonce":90857}]},"public_addr":"172.21.15.142:6809/90857","cluster_addr":"172.21.15.142:6811/90857","heartbeat_back_addr":"172.21.15.142:6815/90857","heartbeat_front_addr":"172.21.15.142:6813/90857","state":["exists","up"]},{"osd":5,"uuid":"829cdebd-73f9-4b35-970f-9db061d86f9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":90883},{"type":"v1","addr":"172.21.15.142:6819","nonce":90883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":90883},{"type":"v1","addr":"172.21.15.142:6824","nonce":90883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":90883},{"type":"v1","addr":"172.21.15.142:6831","nonce":90883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":90883},{"type":"v1","addr":"172.21.15.142:6828","nonce":90883}]},"public_addr":"172.21.15.142:6819/90883","cluster_addr":"172.21.15.142:6824/90883","heartbeat_back_addr":"172.21.15.142:6831/90883","heartbeat_front_addr":"172.21.15.142:6828/90883","state":["exists","up"]},{"osd":6,"uuid":"d1735cdc-48e1-46a8-b607-092577a501bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":90888},{"type":"v1","addr":"172.21.15.142:6818","nonce":90888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":90888},{"type":"v1","addr":"172.21.15.142:6821","nonce":90888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":90888},{"type":"v1","addr":"172.21.15.142:6829","nonce":90888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":90888},{"type":"v1","addr":"172.21.15.142:6825","nonce":90888}]},"public_addr":"172.21.15.142:6818/90888","cluster_addr":"172.21.15.142:6821/90888","heartbeat_back_addr":"172.21.15.142:6829/90888","heartbeat_front_addr":"172.21.15.142:6825/90888","state":["exists","up"]},{"osd":7,"uuid":"451e1b0a-1b48-4ab9-8d0c-7bf5b5b33cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":90858},{"type":"v1","addr":"172.21.15.142:6801","nonce":90858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":90858},{"type":"v1","addr":"172.21.15.142:6803","nonce":90858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":90858},{"type":"v1","addr":"172.21.15.142:6807","nonce":90858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":90858},{"type":"v1","addr":"172.21.15.142:6805","nonce":90858}]},"public_addr":"172.21.15.142:6801/90858","cluster_addr":"172.21.15.142:6803/90858","heartbeat_back_addr":"172.21.15.142:6807/90858","heartbeat_front_addr":"172.21.15.142:6805/90858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.049554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.046084+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.006581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.076562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.136407+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.143546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.113809+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:12:55.081082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/2083914208":"2023-10-07T11:17:15.833376+0000","172.21.15.55:6834/2083914208":"2023-10-07T11:17:15.833376+0000","172.21.15.55:6833/2516972275":"2023-10-07T11:17:15.833361+0000","172.21.15.142:6834/2387992820":"2023-10-07T11:16:49.087130+0000","172.21.15.55:6832/2516972275":"2023-10-07T11:17:15.833361+0000","172.21.15.142:6836/2387992820":"2023-10-07T11:16:49.087130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c40066f30 msgr2=0x7f8c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c40066f30 0x7f8c400693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c600cd7d0 tx=0x7f8c48017000 comp rx=0 tx=0).stop 2023-10-06T11:17:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 msgr2=0x7f8c6015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 0x7f8c6015f5c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c810 tx=0x7f8c58007cc0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 shutdown_connections 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c40066f30 0x7f8c400693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c600ad210 0x7f8c6015f5c0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c6015db10 0x7f8c6015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 --2- 172.21.15.55:0/3270884765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c600ad5e0 0x7f8c60154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 >> 172.21.15.55:0/3270884765 conn(0x7f8c60067d90 msgr2=0x7f8c600ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 shutdown_connections 2023-10-06T11:17:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:22.708+0000 7f8c6552a700 1 -- 172.21.15.55:0/3270884765 wait complete. 2023-10-06T11:17:23.723 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T11:17:23.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:23.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.859+0000 7f484eee8700 1 Processor -- start 2023-10-06T11:17:23.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.859+0000 7f484eee8700 1 -- start start 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484eee8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848153d20 0x7f48481577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484eee8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4848157ce0 0x7f484815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484eee8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484815c400 con 0x7f4848153950 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484eee8700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484815cfa0 con 0x7f4848157ce0 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484eee8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4848158200 con 0x7f4848153d20 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484cc84700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4848153950 0x7f484815c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37726/0 (socket says 172.21.15.55:37726) 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484d485700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4848157ce0 0x7f484815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.860+0000 7f484cc84700 1 -- 172.21.15.55:0/4137506518 learned_addr learned my addr 172.21.15.55:0/4137506518 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:23.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f4847fff700 1 --2- 172.21.15.55:0/4137506518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848153d20 0x7f48481577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f484d485700 1 -- 172.21.15.55:0/4137506518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848153d20 msgr2=0x7f48481577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f484d485700 1 --2- 172.21.15.55:0/4137506518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848153d20 0x7f48481577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f484d485700 1 -- 172.21.15.55:0/4137506518 >> v1:172.21.15.55:6789/0 conn(0x7f4848153950 legacy=0x7f484815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f48477fe700 1 -- 172.21.15.55:0/4137506518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483555161 0 0) 0x7f484815c400 con 0x7f4848153950 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f484d485700 1 -- 172.21.15.55:0/4137506518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484815b7f0 con 0x7f4848157ce0 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f484d485700 1 --2- 172.21.15.55:0/4137506518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848157ce0 0x7f484815ad30 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4840009e60 tx=0x7f4840009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a373290f2d4f402f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f48477fe700 1 -- 172.21.15.55:0/4137506518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000e070 con 0x7f4848157ce0 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f48477fe700 1 -- 172.21.15.55:0/4137506518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000bc30 con 0x7f4848157ce0 2023-10-06T11:17:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.861+0000 7f48477fe700 1 -- 172.21.15.55:0/4137506518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840012430 con 0x7f4848157ce0 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 -- 172.21.15.55:0/4137506518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848157ce0 msgr2=0x7f484815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 --2- 172.21.15.55:0/4137506518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848157ce0 0x7f484815ad30 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4840009e60 tx=0x7f4840009780 comp rx=0 tx=0).stop 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 -- 172.21.15.55:0/4137506518 shutdown_connections 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 --2- 172.21.15.55:0/4137506518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848157ce0 0x7f484815ad30 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 --2- 172.21.15.55:0/4137506518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848153d20 0x7f48481577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 -- 172.21.15.55:0/4137506518 >> 172.21.15.55:0/4137506518 conn(0x7f484806ece0 msgr2=0x7f484806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 -- 172.21.15.55:0/4137506518 shutdown_connections 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.862+0000 7f484eee8700 1 -- 172.21.15.55:0/4137506518 wait complete. 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.863+0000 7f484eee8700 1 Processor -- start 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.863+0000 7f484eee8700 1 -- start start 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484eee8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4848153950 0x7f4848151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484eee8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848153d20 0x7f4848169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484eee8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848157ce0 0x7f484816a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484eee8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848151e90 con 0x7f4848153d20 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484eee8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484816b280 con 0x7f4848153950 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484eee8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484816b560 con 0x7f4848157ce0 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848153d20 0x7f4848169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848153d20 0x7f4848169d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58010/0 (socket says 172.21.15.55:58010) 2023-10-06T11:17:23.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 -- 172.21.15.55:0/3377127351 learned_addr learned my addr 172.21.15.55:0/3377127351 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484cc84700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4848153950 0x7f4848151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484d485700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848157ce0 0x7f484816a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 -- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848157ce0 msgr2=0x7f484816a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848157ce0 0x7f484816a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 -- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4848153950 msgr2=0x7f4848151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4848153950 0x7f4848151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 -- 172.21.15.55:0/3377127351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840009a20 con 0x7f4848153d20 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484cc84700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4848153950 0x7f4848151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f484d485700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4848157ce0 0x7f484816a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.864+0000 7f4847fff700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848153d20 0x7f4848169d20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f483c00d8c0 tx=0x7f483c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.865+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00de60 con 0x7f4848153d20 2023-10-06T11:17:23.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.865+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00b780 con 0x7f4848153d20 2023-10-06T11:17:23.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.865+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484816a840 con 0x7f4848153d20 2023-10-06T11:17:23.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.865+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00bb20 con 0x7f4848153d20 2023-10-06T11:17:23.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.865+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484816ae00 con 0x7f4848153d20 2023-10-06T11:17:23.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.865+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4848064a90 con 0x7f4848153d20 2023-10-06T11:17:23.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.866+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f483c01e460 con 0x7f4848153d20 2023-10-06T11:17:23.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f4844ff9700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4834066f30 0x7f48340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f483c084c20 con 0x7f4848153d20 2023-10-06T11:17:23.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f4844ff9700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f483406d990 0x7f483406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f484cc84700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4834066f30 0x7f48340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 --> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4834070490 con 0x7f483406d990 2023-10-06T11:17:23.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f483c087260 con 0x7f4848153d20 2023-10-06T11:17:23.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f484d485700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f483406d990 0x7f483406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f484d485700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f483406d990 0x7f483406fdc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.867+0000 7f484cc84700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4834066f30 0x7f48340693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4838001890 tx=0x7f4838009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.868+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== osd.0 v2:172.21.15.55:6808/90685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4834070490 con 0x7f483406d990 2023-10-06T11:17:23.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.882+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 --> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f484815bad0 con 0x7f483406d990 2023-10-06T11:17:23.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.882+0000 7f4844ff9700 1 -- 172.21.15.55:0/3377127351 <== osd.0 v2:172.21.15.55:6808/90685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f484815bad0 con 0x7f483406d990 2023-10-06T11:17:23.884 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:23.884 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:23.884 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:23.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.882+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f483406d990 msgr2=0x7f483406fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.882+0000 7f484eee8700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:6808/90685,v1:172.21.15.55:6809/90685] conn(0x7f483406d990 0x7f483406fdc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4834066f30 msgr2=0x7f48340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4834066f30 0x7f48340693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4838001890 tx=0x7f4838009040 comp rx=0 tx=0).stop 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848153d20 msgr2=0x7f4848169d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 --2- 172.21.15.55:0/3377127351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4848153d20 0x7f4848169d20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f483c00d8c0 tx=0x7f483c008040 comp rx=0 tx=0).stop 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484d485700 1 -- 172.21.15.55:0/3377127351 reap_dead start 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 shutdown_connections 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 >> 172.21.15.55:0/3377127351 conn(0x7f484806ece0 msgr2=0x7f48480b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 shutdown_connections 2023-10-06T11:17:23.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:23.883+0000 7f484eee8700 1 -- 172.21.15.55:0/3377127351 wait complete. 2023-10-06T11:17:23.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T11:17:24.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 Processor -- start 2023-10-06T11:17:24.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 -- start start 2023-10-06T11:17:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f080b49a0 0x7f1f080aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b0760 0x7f1f080b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080b0c60 con 0x7f1f08159560 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080b0f40 con 0x7f1f080b49a0 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.015+0000 7f1f0eec8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080b1220 con 0x7f1f080b0760 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f080b49a0 0x7f1f080aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f080b49a0 0x7f1f080aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58024/0 (socket says 172.21.15.55:58024) 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f0cc64700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1f08159560 0x7f1f080aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37728/0 (socket says 172.21.15.55:37728) 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 -- 172.21.15.55:0/2591192285 learned_addr learned my addr 172.21.15.55:0/2591192285 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f0d465700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b0760 0x7f1f080b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 -- 172.21.15.55:0/2591192285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b0760 msgr2=0x7f1f080b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b0760 0x7f1f080b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 -- 172.21.15.55:0/2591192285 >> v1:172.21.15.55:6789/0 conn(0x7f1f08159560 legacy=0x7f1f080aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 -- 172.21.15.55:0/2591192285 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080b1500 con 0x7f1f080b49a0 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f077fe700 1 -- 172.21.15.55:0/2591192285 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845204572 0 0) 0x7f1f080b0c60 con 0x7f1f08159560 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f0d465700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b0760 0x7f1f080b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f07fff700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b49a0 0x7f1f080aac40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80099e0 tx=0x7f1ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cac01218e669cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f077fe700 1 -- 172.21.15.55:0/2591192285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800b820 con 0x7f1f080b49a0 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f077fe700 1 -- 172.21.15.55:0/2591192285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800b980 con 0x7f1f080b49a0 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.016+0000 7f1f077fe700 1 -- 172.21.15.55:0/2591192285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800bd20 con 0x7f1f080b49a0 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2591192285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b49a0 msgr2=0x7f1f080aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b49a0 0x7f1f080aac40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80099e0 tx=0x7f1ef8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2591192285 shutdown_connections 2023-10-06T11:17:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b0760 0x7f1f080b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2591192285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f080b49a0 0x7f1f080aac40 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2591192285 >> 172.21.15.55:0/2591192285 conn(0x7f1f080997f0 msgr2=0x7f1f0806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2591192285 shutdown_connections 2023-10-06T11:17:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.017+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2591192285 wait complete. 2023-10-06T11:17:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.018+0000 7f1f0eec8700 1 Processor -- start 2023-10-06T11:17:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.018+0000 7f1f0eec8700 1 -- start start 2023-10-06T11:17:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0eec8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f080b0760 0x7f1f0809ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0eec8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b49a0 0x7f1f0814b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0eec8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 0x7f1f0809bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0eec8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815ccc0 con 0x7f1f08159560 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0eec8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815cfa0 con 0x7f1f080b0760 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0eec8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08159930 con 0x7f1f080b49a0 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 0x7f1f0809bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 0x7f1f0809bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58040/0 (socket says 172.21.15.55:58040) 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 -- 172.21.15.55:0/2763863455 learned_addr learned my addr 172.21.15.55:0/2763863455 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0cc64700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f080b0760 0x7f1f0809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f07fff700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b49a0 0x7f1f0814b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 -- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b49a0 msgr2=0x7f1f0814b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b49a0 0x7f1f0814b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 -- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f080b0760 msgr2=0x7f1f0809ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f080b0760 0x7f1f0809ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 -- 172.21.15.55:0/2763863455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80094f0 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.019+0000 7f1f0d465700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 0x7f1f0809bc50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000c880 tx=0x7f1ef0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.020+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0011600 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.020+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0011760 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.020+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f08159c10 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.020+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0011b00 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.020+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0809b180 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.021+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f080cf760 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.021+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ef0021350 con 0x7f1f08159560 2023-10-06T11:17:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.021+0000 7f1f04ff9700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1ee8066f30 0x7f1ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.021+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f1ef0084420 con 0x7f1f08159560 2023-10-06T11:17:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.022+0000 7f1f0cc64700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1ee8066f30 0x7f1ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.022+0000 7f1f0cc64700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1ee8066f30 0x7f1ee80693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1f00007fd0 tx=0x7f1f00001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.026+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ef00550d0 con 0x7f1f08159560 2023-10-06T11:17:24.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.219+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f0815d110 con 0x7f1ee8066f30 2023-10-06T11:17:24.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.220+0000 7f1f04ff9700 1 -- 172.21.15.55:0/2763863455 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1f00005b70 con 0x7f1ee8066f30 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1ee8066f30 msgr2=0x7f1ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1ee8066f30 0x7f1ee80693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1f00007fd0 tx=0x7f1f00001630 comp rx=0 tx=0).stop 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 msgr2=0x7f1f0809bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 0x7f1f0809bc50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000c880 tx=0x7f1ef0008040 comp rx=0 tx=0).stop 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 shutdown_connections 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1ee8066f30 0x7f1ee80693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08159560 0x7f1f0809bc50 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f080b0760 0x7f1f0809ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 --2- 172.21.15.55:0/2763863455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b49a0 0x7f1f0814b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 >> 172.21.15.55:0/2763863455 conn(0x7f1f080997f0 msgr2=0x7f1f080b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 shutdown_connections 2023-10-06T11:17:24.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.222+0000 7f1f0eec8700 1 -- 172.21.15.55:0/2763863455 wait complete. 2023-10-06T11:17:24.225 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T11:17:24.235 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T11:17:24.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:24.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.357+0000 7f59c75bb700 1 Processor -- start 2023-10-06T11:17:24.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.357+0000 7f59c75bb700 1 -- start start 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c75bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59c00b02c0 0x7f59c00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c75bb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 0x7f59c015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c75bb700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c00cb940 con 0x7f59c01590e0 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c75bb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c00c7320 con 0x7f59c00b02c0 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c75bb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c015e180 con 0x7f59c00b0690 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c5b58700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59c01590e0 0x7f59c0159560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34658/0 (socket says 172.21.15.55:34658) 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c5b58700 1 -- 172.21.15.55:0/2662109200 learned_addr learned my addr 172.21.15.55:0/2662109200 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:24.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c5357700 1 --2- 172.21.15.55:0/2662109200 >> v2:172.21.15.142:3300/0 conn(0x7f59c00b02c0 0x7f59c00b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59c4b56700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 0x7f59c015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942514305 0 0) 0x7f59c00cb940 con 0x7f59c01590e0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac003570 con 0x7f59c01590e0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106463326 0 0) 0x7f59ac003570 con 0x7f59c01590e0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 msgr2=0x7f59c015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 0x7f59c015dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 >> v2:172.21.15.142:3300/0 conn(0x7f59c00b02c0 msgr2=0x7f59c00b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 --2- 172.21.15.55:0/2662109200 >> v2:172.21.15.142:3300/0 conn(0x7f59c00b02c0 0x7f59c00b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00b2990 con 0x7f59c01590e0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 677741671 0 0) 0x7f59b80017f0 con 0x7f59c01590e0 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 >> v1:172.21.15.55:6789/0 conn(0x7f59c01590e0 legacy=0x7f59c0159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ac004810 0x7f59ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 0x7f59ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00c7320 con 0x7f59ac003a60 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c015e180 con 0x7f59ac004810 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.358+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00ba60 con 0x7f59c00b0690 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c4b56700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ac004810 0x7f59ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5b58700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 0x7f59ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 -- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 msgr2=0x7f59ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c00b0690 0x7f59ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 -- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ac004810 msgr2=0x7f59ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59ac004810 0x7f59ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 -- 172.21.15.55:0/2662109200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac003570 con 0x7f59ac003a60 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59c5357700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59ac003e70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009c30 tx=0x7f59bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fafdd714727cb86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00e710 con 0x7f59ac003a60 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00e870 con 0x7f59ac003a60 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.359+0000 7f59b7fff700 1 -- 172.21.15.55:0/2662109200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00ec30 con 0x7f59ac003a60 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c75bb700 1 -- 172.21.15.55:0/2662109200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 msgr2=0x7f59ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c75bb700 1 --2- 172.21.15.55:0/2662109200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59ac003e70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009c30 tx=0x7f59bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c5b58700 1 -- 172.21.15.55:0/2662109200 reap_dead start 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c75bb700 1 -- 172.21.15.55:0/2662109200 shutdown_connections 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c75bb700 1 -- 172.21.15.55:0/2662109200 >> 172.21.15.55:0/2662109200 conn(0x7f59c00682f0 msgr2=0x7f59c00686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c75bb700 1 -- 172.21.15.55:0/2662109200 shutdown_connections 2023-10-06T11:17:24.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.360+0000 7f59c75bb700 1 -- 172.21.15.55:0/2662109200 wait complete. 2023-10-06T11:17:24.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.361+0000 7f59c75bb700 1 Processor -- start 2023-10-06T11:17:24.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.361+0000 7f59c75bb700 1 -- start start 2023-10-06T11:17:24.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c75bb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59c00c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c75bb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59c0169a90 0x7f59c01498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c75bb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c015b170 0x7f59c00ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c75bb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0159d00 con 0x7f59ac003a60 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c75bb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0149e00 con 0x7f59c0169a90 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c75bb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c016a000 con 0x7f59c015b170 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59c00c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59c00c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38824/0 (socket says 172.21.15.55:38824) 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 -- 172.21.15.55:0/2589623984 learned_addr learned my addr 172.21.15.55:0/2589623984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c4b56700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59c0169a90 0x7f59c01498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5b58700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c015b170 0x7f59c00ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 -- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c015b170 msgr2=0x7f59c00ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59c015b170 0x7f59c00ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 -- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59c0169a90 msgr2=0x7f59c01498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59c0169a90 0x7f59c01498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 -- 172.21.15.55:0/2589623984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c016a2e0 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.362+0000 7f59c5357700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59c00c6a10 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0046d0 tx=0x7f59bc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.363+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc022070 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.363+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00e9e0 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.363+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c016a5c0 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.363+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc006e50 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.363+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c015b610 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.363+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59c0064a90 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.364+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59bc01c660 con 0x7f59ac003a60 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.364+0000 7f59b57fa700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f59a4066f30 0x7f59a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f59bc085b80 con 0x7f59ac003a60 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59b57fa700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f59a406d990 0x7f59a406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59a4070490 con 0x7f59a406d990 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59bc08a240 con 0x7f59ac003a60 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59c4b56700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f59a4066f30 0x7f59a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59c5b58700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f59a406d990 0x7f59a406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59c5b58700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f59a406d990 0x7f59a406fdc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.365+0000 7f59c4b56700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f59a4066f30 0x7f59a40693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f59c016cff0 tx=0x7f59b00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.366+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== osd.1 v2:172.21.15.55:6800/90686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f59a4070490 con 0x7f59a406d990 2023-10-06T11:17:24.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 --> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59c00b2c70 con 0x7f59a406d990 2023-10-06T11:17:24.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59b57fa700 1 -- 172.21.15.55:0/2589623984 <== osd.1 v2:172.21.15.55:6800/90686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f59c00b2c70 con 0x7f59a406d990 2023-10-06T11:17:24.382 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:24.382 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:24.382 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f59a406d990 msgr2=0x7f59a406fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:6800/90686,v1:172.21.15.55:6801/90686] conn(0x7f59a406d990 0x7f59a406fdc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f59a4066f30 msgr2=0x7f59a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f59a4066f30 0x7f59a40693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f59c016cff0 tx=0x7f59b00091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 msgr2=0x7f59c00c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 --2- 172.21.15.55:0/2589623984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ac003a60 0x7f59c00c6a10 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0046d0 tx=0x7f59bc01a000 comp rx=0 tx=0).stop 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c5b58700 1 -- 172.21.15.55:0/2589623984 reap_dead start 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 shutdown_connections 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 >> 172.21.15.55:0/2589623984 conn(0x7f59c00682f0 msgr2=0x7f59c0156150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 shutdown_connections 2023-10-06T11:17:24.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.380+0000 7f59c75bb700 1 -- 172.21.15.55:0/2589623984 wait complete. 2023-10-06T11:17:24.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T11:17:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.512+0000 7f99372f5700 1 Processor -- start 2023-10-06T11:17:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.512+0000 7f99372f5700 1 -- start start 2023-10-06T11:17:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f99372f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993006c330 0x7f9930161050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f99372f5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993006c9a0 con 0x7f9930156350 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f99372f5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9930156b20 con 0x7f99300cc8e0 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f99372f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993006c790 con 0x7f993006c330 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f9935091700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9930156350 0x7f99300cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34664/0 (socket says 172.21.15.55:34664) 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f9935091700 1 -- 172.21.15.55:0/2455471026 learned_addr learned my addr 172.21.15.55:0/2455471026 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f9935892700 1 --2- 172.21.15.55:0/2455471026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993006c330 0x7f9930161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099573935 0 0) 0x7f993006c9a0 con 0x7f9930156350 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.513+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9918003570 con 0x7f9930156350 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701356718 0 0) 0x7f9930156b20 con 0x7f99300cc8e0 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f993006c9a0 con 0x7f99300cc8e0 2023-10-06T11:17:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338809488 0 0) 0x7f9918003570 con 0x7f9930156350 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f9935892700 1 -- 172.21.15.55:0/2455471026 >> v1:172.21.15.142:6789/0 conn(0x7f99300cc8e0 legacy=0x7f993006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f9935892700 1 -- 172.21.15.55:0/2455471026 >> v1:172.21.15.55:6789/0 conn(0x7f9930156350 legacy=0x7f99300cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f9935892700 1 -- 172.21.15.55:0/2455471026 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930156e00 con 0x7f993006c330 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f9935892700 1 --2- 172.21.15.55:0/2455471026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993006c330 0x7f9930161050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9928009910 tx=0x7f99280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ff730807b6af5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99200017f0 con 0x7f993006c330 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9928011420 con 0x7f993006c330 2023-10-06T11:17:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.514+0000 7f992ffff700 1 -- 172.21.15.55:0/2455471026 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280117a0 con 0x7f993006c330 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 -- 172.21.15.55:0/2455471026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993006c330 msgr2=0x7f9930161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 --2- 172.21.15.55:0/2455471026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993006c330 0x7f9930161050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9928009910 tx=0x7f99280091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 -- 172.21.15.55:0/2455471026 shutdown_connections 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 --2- 172.21.15.55:0/2455471026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f993006c330 0x7f9930161050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 -- 172.21.15.55:0/2455471026 >> 172.21.15.55:0/2455471026 conn(0x7f99300cdeb0 msgr2=0x7f99300c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 -- 172.21.15.55:0/2455471026 shutdown_connections 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.515+0000 7f99372f5700 1 -- 172.21.15.55:0/2455471026 wait complete. 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.516+0000 7f99372f5700 1 Processor -- start 2023-10-06T11:17:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.516+0000 7f99372f5700 1 -- start start 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 0x7f99301691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99300cc8e0 0x7f99300c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9930156350 0x7f993014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300c4930 con 0x7f993006c330 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99301696e0 con 0x7f9930156350 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993014bf70 con 0x7f99300cc8e0 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 0x7f99301691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 0x7f99301691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38836/0 (socket says 172.21.15.55:38836) 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 -- 172.21.15.55:0/2593444874 learned_addr learned my addr 172.21.15.55:0/2593444874 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935892700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9930156350 0x7f993014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9934890700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99300cc8e0 0x7f99300c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 -- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99300cc8e0 msgr2=0x7f99300c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99300cc8e0 0x7f99300c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 -- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9930156350 msgr2=0x7f993014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9930156350 0x7f993014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 -- 172.21.15.55:0/2593444874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928009420 con 0x7f993006c330 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9934890700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99300cc8e0 0x7f99300c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f9935091700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 0x7f99301691a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f992000cc10 tx=0x7f9920007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920004dc0 con 0x7f993006c330 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992000a720 con 0x7f993006c330 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993014c250 con 0x7f993006c330 2023-10-06T11:17:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.517+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000aae0 con 0x7f993006c330 2023-10-06T11:17:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.518+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993014c530 con 0x7f993006c330 2023-10-06T11:17:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.519+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9930064a90 con 0x7f993006c330 2023-10-06T11:17:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.519+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9920007150 con 0x7f993006c330 2023-10-06T11:17:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.519+0000 7f992d7fa700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.519+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f9920084030 con 0x7f993006c330 2023-10-06T11:17:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.520+0000 7f9934890700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.520+0000 7f9934890700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f99240011e0 tx=0x7f9924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.524+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99200512d0 con 0x7f993006c330 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.718+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f99300c4a70 con 0x7f991c066f30 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.719+0000 7f992d7fa700 1 -- 172.21.15.55:0/2593444874 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f992400d660 con 0x7f991c066f30 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f991c066f30 msgr2=0x7f991c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f991c066f30 0x7f991c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f99240011e0 tx=0x7f9924009040 comp rx=0 tx=0).stop 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 msgr2=0x7f99301691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 0x7f99301691a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f992000cc10 tx=0x7f9920007d20 comp rx=0 tx=0).stop 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 shutdown_connections 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f991c066f30 0x7f991c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f993006c330 0x7f99301691a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9930156350 0x7f993014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 --2- 172.21.15.55:0/2593444874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99300cc8e0 0x7f99300c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 >> 172.21.15.55:0/2593444874 conn(0x7f99300cdeb0 msgr2=0x7f99300cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 shutdown_connections 2023-10-06T11:17:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.721+0000 7f99372f5700 1 -- 172.21.15.55:0/2593444874 wait complete. 2023-10-06T11:17:24.724 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T11:17:24.735 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T11:17:24.735 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.855+0000 7f2880d25700 1 Processor -- start 2023-10-06T11:17:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.856+0000 7f2880d25700 1 -- start start 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.856+0000 7f2880d25700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.856+0000 7f2880d25700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f287c0ae570 0x7f287c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.856+0000 7f2880d25700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0c9a50 con 0x7f287c067af0 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.856+0000 7f2880d25700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c067f70 con 0x7f287c0ae570 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.856+0000 7f2880d25700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0c9440 con 0x7f287c0a7be0 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f287c0ae570 0x7f287c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f287c0ae570 0x7f287c0675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38840/0 (socket says 172.21.15.55:38840) 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 -- 172.21.15.55:0/945260325 learned_addr learned my addr 172.21.15.55:0/945260325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f287a59c700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 -- 172.21.15.55:0/945260325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 msgr2=0x7f287c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 -- 172.21.15.55:0/945260325 >> v1:172.21.15.142:6789/0 conn(0x7f287c067af0 legacy=0x7f287c06e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 -- 172.21.15.55:0/945260325 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0ad0d0 con 0x7f287c0ae570 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f287a59c700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f2879d9b700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c0675b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f28640099b0 tx=0x7f2864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3664f984e4dfea8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f287959a700 1 -- 172.21.15.55:0/945260325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400b820 con 0x7f287c0ae570 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f287959a700 1 -- 172.21.15.55:0/945260325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400b980 con 0x7f287c0ae570 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.857+0000 7f287959a700 1 -- 172.21.15.55:0/945260325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400bd20 con 0x7f287c0ae570 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 -- 172.21.15.55:0/945260325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 msgr2=0x7f287c0675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c0675b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f28640099b0 tx=0x7f2864009250 comp rx=0 tx=0).stop 2023-10-06T11:17:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 -- 172.21.15.55:0/945260325 shutdown_connections 2023-10-06T11:17:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 --2- 172.21.15.55:0/945260325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c0675b0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 -- 172.21.15.55:0/945260325 >> 172.21.15.55:0/945260325 conn(0x7f287c0cd1e0 msgr2=0x7f287c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 -- 172.21.15.55:0/945260325 shutdown_connections 2023-10-06T11:17:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.858+0000 7f2880d25700 1 -- 172.21.15.55:0/945260325 wait complete. 2023-10-06T11:17:24.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.859+0000 7f2880d25700 1 Processor -- start 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.859+0000 7f2880d25700 1 -- start start 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2880d25700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f287c067af0 0x7f287c0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2880d25700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2880d25700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2880d25700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0cbfd0 con 0x7f287c0ae570 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2880d25700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0cb0e0 con 0x7f287c067af0 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2880d25700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0cb3c0 con 0x7f287c0a7be0 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c1566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38850/0 (socket says 172.21.15.55:38850) 2023-10-06T11:17:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 -- 172.21.15.55:0/1924520933 learned_addr learned my addr 172.21.15.55:0/1924520933 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287a59c700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f287c067af0 0x7f287c0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f2879d9b700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 -- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 msgr2=0x7f287c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f287c0a7be0 0x7f287c0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 -- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f287c067af0 msgr2=0x7f287c0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f287c067af0 0x7f287c0cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 -- 172.21.15.55:0/1924520933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640094f0 con 0x7f287c0ae570 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.860+0000 7f287ad9d700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c1566f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f286c00bc30 tx=0x7f286c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.861+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00c840 con 0x7f287c0ae570 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.861+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00c9e0 con 0x7f287c0ae570 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.861+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c0cb6a0 con 0x7f287c0ae570 2023-10-06T11:17:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.861+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00cda0 con 0x7f287c0ae570 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.861+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c0cbc60 con 0x7f287c0ae570 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.861+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f287c064a90 con 0x7f287c0ae570 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.862+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f286c014620 con 0x7f287c0ae570 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.862+0000 7f28727fc700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f285c066f30 0x7f285c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.862+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f286c0850b0 con 0x7f287c0ae570 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f28727fc700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f285c06d990 0x7f285c06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 --> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f285c070490 con 0x7f285c06d990 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f286c085480 con 0x7f287c0ae570 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f287a59c700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f285c066f30 0x7f285c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f2879d9b700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f285c06d990 0x7f285c06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f2879d9b700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f285c06d990 0x7f285c06fdc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.863+0000 7f287a59c700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f285c066f30 0x7f285c0693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2874006fd0 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.864+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== osd.2 v2:172.21.15.55:6817/90687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f285c070490 con 0x7f285c06d990 2023-10-06T11:17:24.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 --> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f287c0afb30 con 0x7f285c06d990 2023-10-06T11:17:24.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f28727fc700 1 -- 172.21.15.55:0/1924520933 <== osd.2 v2:172.21.15.55:6817/90687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f287c0afb30 con 0x7f285c06d990 2023-10-06T11:17:24.880 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:24.880 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:24.880 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:24.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f285c06d990 msgr2=0x7f285c06fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:6817/90687,v1:172.21.15.55:6819/90687] conn(0x7f285c06d990 0x7f285c06fdc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f285c066f30 msgr2=0x7f285c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f285c066f30 0x7f285c0693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2874006fd0 tx=0x7f2874008040 comp rx=0 tx=0).stop 2023-10-06T11:17:24.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 msgr2=0x7f287c1566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 --2- 172.21.15.55:0/1924520933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c0ae570 0x7f287c1566f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f286c00bc30 tx=0x7f286c009820 comp rx=0 tx=0).stop 2023-10-06T11:17:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f287ad9d700 1 -- 172.21.15.55:0/1924520933 reap_dead start 2023-10-06T11:17:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 shutdown_connections 2023-10-06T11:17:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 >> 172.21.15.55:0/1924520933 conn(0x7f287c0cd1e0 msgr2=0x7f287c0ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 shutdown_connections 2023-10-06T11:17:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:24.878+0000 7f2880d25700 1 -- 172.21.15.55:0/1924520933 wait complete. 2023-10-06T11:17:24.891 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T11:17:25.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.009+0000 7f6a48d29700 1 Processor -- start 2023-10-06T11:17:25.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.009+0000 7f6a48d29700 1 -- start start 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a48d29700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b49a0 0x7f6a440aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a48d29700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a440b0760 0x7f6a440b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a48d29700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440b0c60 con 0x7f6a44159560 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a48d29700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440b0f40 con 0x7f6a440b0760 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a48d29700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b1220 con 0x7f6a440b49a0 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a42d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a440b0760 0x7f6a440b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a4259c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6a44159560 0x7f6a440aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34670/0 (socket says 172.21.15.55:34670) 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a4259c700 1 -- 172.21.15.55:0/3540187840 learned_addr learned my addr 172.21.15.55:0/3540187840 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a41d9b700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b49a0 0x7f6a440aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3540187840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b49a0 msgr2=0x7f6a440aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a42d9d700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b49a0 0x7f6a440aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3540187840 >> v1:172.21.15.55:6789/0 conn(0x7f6a44159560 legacy=0x7f6a440aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3540187840 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440b1500 con 0x7f6a440b0760 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a4159a700 1 -- 172.21.15.55:0/3540187840 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256123141 0 0) 0x7f6a440b0c60 con 0x7f6a44159560 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.010+0000 7f6a41d9b700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b49a0 0x7f6a440aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a42d9d700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a440b0760 0x7f6a440b1bc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009e60 tx=0x7f6a3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c6f8312688e214 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a4159a700 1 -- 172.21.15.55:0/3540187840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00e070 con 0x7f6a440b0760 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a4159a700 1 -- 172.21.15.55:0/3540187840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00bc30 con 0x7f6a440b0760 2023-10-06T11:17:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a4159a700 1 -- 172.21.15.55:0/3540187840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c012430 con 0x7f6a440b0760 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 -- 172.21.15.55:0/3540187840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a440b0760 msgr2=0x7f6a440b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a440b0760 0x7f6a440b1bc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009e60 tx=0x7f6a3c009780 comp rx=0 tx=0).stop 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 -- 172.21.15.55:0/3540187840 shutdown_connections 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a440b0760 0x7f6a440b1bc0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3540187840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b49a0 0x7f6a440aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 -- 172.21.15.55:0/3540187840 >> 172.21.15.55:0/3540187840 conn(0x7f6a440997f0 msgr2=0x7f6a4406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 -- 172.21.15.55:0/3540187840 shutdown_connections 2023-10-06T11:17:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.011+0000 7f6a48d29700 1 -- 172.21.15.55:0/3540187840 wait complete. 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.012+0000 7f6a48d29700 1 Processor -- start 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 -- start start 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b0760 0x7f6a4409d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b49a0 0x7f6a4415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 0x7f6a4415c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44099f20 con 0x7f6a44159560 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4415c6d0 con 0x7f6a440b49a0 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a48d29700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4415c9a0 con 0x7f6a440b0760 2023-10-06T11:17:25.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a42d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 0x7f6a4415c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a42d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 0x7f6a4415c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38866/0 (socket says 172.21.15.55:38866) 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.013+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3069390141 learned_addr learned my addr 172.21.15.55:0/3069390141 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a41d9b700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b49a0 0x7f6a4415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a4259c700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b0760 0x7f6a4409d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b0760 msgr2=0x7f6a4409d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a42d9d700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b0760 0x7f6a4409d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b49a0 msgr2=0x7f6a4415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a42d9d700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b49a0 0x7f6a4415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a42d9d700 1 -- 172.21.15.55:0/3069390141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009a20 con 0x7f6a44159560 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a4259c700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b0760 0x7f6a4409d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a41d9b700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b49a0 0x7f6a4415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a42d9d700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 0x7f6a4415c190 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6a44067c20 tx=0x7f6a3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c01d630 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c01d7b0 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4415cc80 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c01db70 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.014+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44159c10 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.015+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4415b2b0 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.015+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3c024070 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.016+0000 7f6a3a7fc700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a24066f30 0x7f6a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.016+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f6a3c086f60 con 0x7f6a44159560 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.016+0000 7f6a4259c700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a24066f30 0x7f6a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.017+0000 7f6a4259c700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a24066f30 0x7f6a240693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a34001810 tx=0x7f6a34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.020+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a4415b2b0 con 0x7f6a44159560 2023-10-06T11:17:25.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.212+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a4415ce70 con 0x7f6a24066f30 2023-10-06T11:17:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.212+0000 7f6a3a7fc700 1 -- 172.21.15.55:0/3069390141 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a4415ce70 con 0x7f6a24066f30 2023-10-06T11:17:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a24066f30 msgr2=0x7f6a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a24066f30 0x7f6a240693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a34001810 tx=0x7f6a34009040 comp rx=0 tx=0).stop 2023-10-06T11:17:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 msgr2=0x7f6a4415c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 0x7f6a4415c190 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6a44067c20 tx=0x7f6a3c019000 comp rx=0 tx=0).stop 2023-10-06T11:17:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 shutdown_connections 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f6a24066f30 0x7f6a240693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a44159560 0x7f6a4415c190 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440b0760 0x7f6a4409d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 --2- 172.21.15.55:0/3069390141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b49a0 0x7f6a4415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 >> 172.21.15.55:0/3069390141 conn(0x7f6a440997f0 msgr2=0x7f6a440b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 shutdown_connections 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.214+0000 7f6a48d29700 1 -- 172.21.15.55:0/3069390141 wait complete. 2023-10-06T11:17:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T11:17:25.228 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T11:17:25.228 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:25.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.350+0000 7fa9e0921700 1 Processor -- start 2023-10-06T11:17:25.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.350+0000 7fa9e0921700 1 -- start start 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9e0921700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9e0921700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9dc157ce0 0x7fa9dc15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9e0921700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc15c400 con 0x7fa9dc153950 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9e0921700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc15cfa0 con 0x7fa9dc157ce0 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9e0921700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc158200 con 0x7fa9dc153d20 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9dad9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9dc157ce0 0x7fa9dc15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9da59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9dc153950 0x7fa9dc15c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34676/0 (socket says 172.21.15.55:34676) 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9da59c700 1 -- 172.21.15.55:0/2685177071 learned_addr learned my addr 172.21.15.55:0/2685177071 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9d9d9b700 1 --2- 172.21.15.55:0/2685177071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9dad9d700 1 -- 172.21.15.55:0/2685177071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 msgr2=0x7fa9dc1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9dad9d700 1 --2- 172.21.15.55:0/2685177071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9dad9d700 1 -- 172.21.15.55:0/2685177071 >> v1:172.21.15.55:6789/0 conn(0x7fa9dc153950 legacy=0x7fa9dc15c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9d959a700 1 -- 172.21.15.55:0/2685177071 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669068907 0 0) 0x7fa9dc15c400 con 0x7fa9dc153950 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9dad9d700 1 -- 172.21.15.55:0/2685177071 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc15b7f0 con 0x7fa9dc157ce0 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9dad9d700 1 --2- 172.21.15.55:0/2685177071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc15ad30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e60 tx=0x7fa9cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626f18b34dc3b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9d959a700 1 -- 172.21.15.55:0/2685177071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00e070 con 0x7fa9dc157ce0 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9d959a700 1 -- 172.21.15.55:0/2685177071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00bb60 con 0x7fa9dc157ce0 2023-10-06T11:17:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.351+0000 7fa9d959a700 1 -- 172.21.15.55:0/2685177071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc012430 con 0x7fa9dc157ce0 2023-10-06T11:17:25.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 -- 172.21.15.55:0/2685177071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 msgr2=0x7fa9dc15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 --2- 172.21.15.55:0/2685177071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc15ad30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009e60 tx=0x7fa9cc009780 comp rx=0 tx=0).stop 2023-10-06T11:17:25.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 -- 172.21.15.55:0/2685177071 shutdown_connections 2023-10-06T11:17:25.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 --2- 172.21.15.55:0/2685177071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc15ad30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 --2- 172.21.15.55:0/2685177071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 -- 172.21.15.55:0/2685177071 >> 172.21.15.55:0/2685177071 conn(0x7fa9dc06ece0 msgr2=0x7fa9dc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 -- 172.21.15.55:0/2685177071 shutdown_connections 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.352+0000 7fa9e0921700 1 -- 172.21.15.55:0/2685177071 wait complete. 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.353+0000 7fa9e0921700 1 Processor -- start 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.353+0000 7fa9e0921700 1 -- start start 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9e0921700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9dc153950 0x7fa9dc0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9e0921700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9e0921700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9e0921700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16d040 con 0x7fa9dc157ce0 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9e0921700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16d250 con 0x7fa9dc153950 2023-10-06T11:17:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9e0921700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16d530 con 0x7fa9dc153d20 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc0b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38878/0 (socket says 172.21.15.55:38878) 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 -- 172.21.15.55:0/3180140799 learned_addr learned my addr 172.21.15.55:0/3180140799 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9da59c700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9dc153950 0x7fa9dc0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9d9d9b700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 -- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 msgr2=0x7fa9dc1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9dc153d20 0x7fa9dc1541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 -- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9dc153950 msgr2=0x7fa9dc0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9dc153950 0x7fa9dc0cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 -- 172.21.15.55:0/3180140799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc009a20 con 0x7fa9dc157ce0 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.354+0000 7fa9dad9d700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc0b59f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc088e40 tx=0x7fa9cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.355+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc012ea0 con 0x7fa9dc157ce0 2023-10-06T11:17:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.355+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc027470 con 0x7fa9dc157ce0 2023-10-06T11:17:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.355+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc16d810 con 0x7fa9dc157ce0 2023-10-06T11:17:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.355+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc027830 con 0x7fa9dc157ce0 2023-10-06T11:17:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.355+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc16ddd0 con 0x7fa9dc157ce0 2023-10-06T11:17:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.355+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9dc064a90 con 0x7fa9dc157ce0 2023-10-06T11:17:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.356+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9cc024070 con 0x7fa9dc157ce0 2023-10-06T11:17:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.356+0000 7fa9d27fc700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa9bc066f60 0x7fa9bc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fa9cc087080 con 0x7fa9dc157ce0 2023-10-06T11:17:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9d27fc700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7fa9bc06d9c0 0x7fa9bc06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 --> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9bc0704c0 con 0x7fa9bc06d9c0 2023-10-06T11:17:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9cc087450 con 0x7fa9dc157ce0 2023-10-06T11:17:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9da59c700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa9bc066f60 0x7fa9bc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9d9d9b700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7fa9bc06d9c0 0x7fa9bc06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9d9d9b700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7fa9bc06d9c0 0x7fa9bc06fdf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.357+0000 7fa9da59c700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa9bc066f60 0x7fa9bc069410 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40029c0 tx=0x7fa9d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.358+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== osd.3 v2:172.21.15.55:6816/90688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa9bc0704c0 con 0x7fa9bc06d9c0 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 --> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa9dc15bad0 con 0x7fa9bc06d9c0 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9d27fc700 1 -- 172.21.15.55:0/3180140799 <== osd.3 v2:172.21.15.55:6816/90688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa9dc15bad0 con 0x7fa9bc06d9c0 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7fa9bc06d9c0 msgr2=0x7fa9bc06fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:6816/90688,v1:172.21.15.55:6818/90688] conn(0x7fa9bc06d9c0 0x7fa9bc06fdf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa9bc066f60 msgr2=0x7fa9bc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fa9bc066f60 0x7fa9bc069410 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40029c0 tx=0x7fa9d4009040 comp rx=0 tx=0).stop 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 msgr2=0x7fa9dc0b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 --2- 172.21.15.55:0/3180140799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9dc157ce0 0x7fa9dc0b59f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc088e40 tx=0x7fa9cc019000 comp rx=0 tx=0).stop 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9dad9d700 1 -- 172.21.15.55:0/3180140799 reap_dead start 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 shutdown_connections 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 >> 172.21.15.55:0/3180140799 conn(0x7fa9dc06ece0 msgr2=0x7fa9dc159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 shutdown_connections 2023-10-06T11:17:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.372+0000 7fa9e0921700 1 -- 172.21.15.55:0/3180140799 wait complete. 2023-10-06T11:17:25.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T11:17:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.503+0000 7f55fcbd1700 1 Processor -- start 2023-10-06T11:17:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.503+0000 7f55fcbd1700 1 -- start start 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.504+0000 7f55fcbd1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f55f8159560 0x7f55f80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.504+0000 7f55fcbd1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55f80b0760 0x7f55f80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.504+0000 7f55fcbd1700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f80b0c60 con 0x7f55f80b49a0 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.504+0000 7f55fcbd1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80b0f40 con 0x7f55f80b0760 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.504+0000 7f55fcbd1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80b1220 con 0x7f55f8159560 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.504+0000 7f55f6d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55f80b0760 0x7f55f80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55f80b0760 0x7f55f80b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38890/0 (socket says 172.21.15.55:38890) 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 -- 172.21.15.55:0/754365391 learned_addr learned my addr 172.21.15.55:0/754365391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:25.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f659c700 1 --2- 172.21.15.55:0/754365391 >> v2:172.21.15.142:3300/0 conn(0x7f55f8159560 0x7f55f80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 -- 172.21.15.55:0/754365391 >> v2:172.21.15.142:3300/0 conn(0x7f55f8159560 msgr2=0x7f55f80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 --2- 172.21.15.55:0/754365391 >> v2:172.21.15.142:3300/0 conn(0x7f55f8159560 0x7f55f80aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 -- 172.21.15.55:0/754365391 >> v1:172.21.15.142:6789/0 conn(0x7f55f80b49a0 legacy=0x7f55f80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 -- 172.21.15.55:0/754365391 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80b1500 con 0x7f55f80b0760 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f6d9d700 1 --2- 172.21.15.55:0/754365391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f80b1bc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f55e80099b0 tx=0x7f55e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b5c723f373586e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f559a700 1 -- 172.21.15.55:0/754365391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8009ea0 con 0x7f55f80b0760 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f559a700 1 -- 172.21.15.55:0/754365391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800b820 con 0x7f55f80b0760 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.505+0000 7f55f559a700 1 -- 172.21.15.55:0/754365391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800bbc0 con 0x7f55f80b0760 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 -- 172.21.15.55:0/754365391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 msgr2=0x7f55f80b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/754365391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f80b1bc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f55e80099b0 tx=0x7f55e8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:25.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 -- 172.21.15.55:0/754365391 shutdown_connections 2023-10-06T11:17:25.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/754365391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f80b1bc0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/754365391 >> v2:172.21.15.142:3300/0 conn(0x7f55f8159560 0x7f55f80aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 -- 172.21.15.55:0/754365391 >> 172.21.15.55:0/754365391 conn(0x7f55f80997f0 msgr2=0x7f55f806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 -- 172.21.15.55:0/754365391 shutdown_connections 2023-10-06T11:17:25.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.506+0000 7f55fcbd1700 1 -- 172.21.15.55:0/754365391 wait complete. 2023-10-06T11:17:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.507+0000 7f55fcbd1700 1 Processor -- start 2023-10-06T11:17:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.507+0000 7f55fcbd1700 1 -- start start 2023-10-06T11:17:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f809a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f80b49a0 0x7f55f816a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55f8159560 0x7f55f816a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f809be10 con 0x7f55f80b0760 2023-10-06T11:17:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f809b200 con 0x7f55f80b49a0 2023-10-06T11:17:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f809b4e0 con 0x7f55f8159560 2023-10-06T11:17:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f809a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f809a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38900/0 (socket says 172.21.15.55:38900) 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 -- 172.21.15.55:0/1114306340 learned_addr learned my addr 172.21.15.55:0/1114306340 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f6d9d700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55f8159560 0x7f55f816a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f5d9b700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f80b49a0 0x7f55f816a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 -- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55f8159560 msgr2=0x7f55f816a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55f8159560 0x7f55f816a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 -- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f80b49a0 msgr2=0x7f55f816a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f80b49a0 0x7f55f816a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 -- 172.21.15.55:0/1114306340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80094f0 con 0x7f55f80b0760 2023-10-06T11:17:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55f659c700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f809a7b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009ea0 tx=0x7f55f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000caa0 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000f040 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f809b7c0 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000ce30 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.508+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f8158e80 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.509+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f8064a90 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.510+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55f0014690 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.510+0000 7f55ee7fc700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f55d8066f30 0x7f55d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.510+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f55f0084c10 con 0x7f55f80b0760 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.510+0000 7f55f5d9b700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f55d8066f30 0x7f55d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.511+0000 7f55f5d9b700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f55d8066f30 0x7f55d80693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55f80af710 tx=0x7f55e0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.514+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55f0051e30 con 0x7f55f80b0760 2023-10-06T11:17:25.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.705+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f55f809bf50 con 0x7f55d8066f30 2023-10-06T11:17:25.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.705+0000 7f55ee7fc700 1 -- 172.21.15.55:0/1114306340 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55e0014450 con 0x7f55d8066f30 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f55d8066f30 msgr2=0x7f55d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f55d8066f30 0x7f55d80693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55f80af710 tx=0x7f55e0007ec0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 msgr2=0x7f55f809a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f809a7b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009ea0 tx=0x7f55f000b040 comp rx=0 tx=0).stop 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 shutdown_connections 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f55d8066f30 0x7f55d80693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f80b0760 0x7f55f809a7b0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55f8159560 0x7f55f816a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 --2- 172.21.15.55:0/1114306340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f80b49a0 0x7f55f816a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.707+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 >> 172.21.15.55:0/1114306340 conn(0x7f55f80997f0 msgr2=0x7f55f80ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.708+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 shutdown_connections 2023-10-06T11:17:25.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.708+0000 7f55fcbd1700 1 -- 172.21.15.55:0/1114306340 wait complete. 2023-10-06T11:17:25.711 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T11:17:25.721 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T11:17:25.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:25.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 Processor -- start 2023-10-06T11:17:25.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 -- start start 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86300ae570 0x7f86300675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8630067af0 0x7f863006a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300c9a50 con 0x7f86300a7be0 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8630067f10 con 0x7f86300ae570 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.843+0000 7f863598b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86300c9440 con 0x7f8630067af0 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862effd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86300a7be0 0x7f863015a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34686/0 (socket says 172.21.15.55:34686) 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862effd700 1 -- 172.21.15.55:0/3401443796 learned_addr learned my addr 172.21.15.55:0/3401443796 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862e7fc700 1 --2- 172.21.15.55:0/3401443796 >> v2:172.21.15.55:3300/0 conn(0x7f86300ae570 0x7f86300675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862f7fe700 1 --2- 172.21.15.55:0/3401443796 >> v2:172.21.15.142:3300/0 conn(0x7f8630067af0 0x7f863006a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862dffb700 1 -- 172.21.15.55:0/3401443796 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992502400 0 0) 0x7f86300c9a50 con 0x7f86300a7be0 2023-10-06T11:17:25.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862dffb700 1 -- 172.21.15.55:0/3401443796 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c003570 con 0x7f86300a7be0 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862e7fc700 1 -- 172.21.15.55:0/3401443796 >> v2:172.21.15.142:3300/0 conn(0x7f8630067af0 msgr2=0x7f863006a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862e7fc700 1 --2- 172.21.15.55:0/3401443796 >> v2:172.21.15.142:3300/0 conn(0x7f8630067af0 0x7f863006a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862e7fc700 1 -- 172.21.15.55:0/3401443796 >> v1:172.21.15.55:6789/0 conn(0x7f86300a7be0 legacy=0x7f863015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862e7fc700 1 -- 172.21.15.55:0/3401443796 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300ad0d0 con 0x7f86300ae570 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862e7fc700 1 --2- 172.21.15.55:0/3401443796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f86300675b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f863015ad70 tx=0x7f86180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3397716d68d28a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862dffb700 1 -- 172.21.15.55:0/3401443796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618011630 con 0x7f86300ae570 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862dffb700 1 -- 172.21.15.55:0/3401443796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86180117b0 con 0x7f86300ae570 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.844+0000 7f862dffb700 1 -- 172.21.15.55:0/3401443796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618011b70 con 0x7f86300ae570 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 -- 172.21.15.55:0/3401443796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 msgr2=0x7f86300675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 --2- 172.21.15.55:0/3401443796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f86300675b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f863015ad70 tx=0x7f86180091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 -- 172.21.15.55:0/3401443796 shutdown_connections 2023-10-06T11:17:25.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 --2- 172.21.15.55:0/3401443796 >> v2:172.21.15.142:3300/0 conn(0x7f8630067af0 0x7f863006a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 --2- 172.21.15.55:0/3401443796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f86300675b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 -- 172.21.15.55:0/3401443796 >> 172.21.15.55:0/3401443796 conn(0x7f86300cd1e0 msgr2=0x7f86300cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 -- 172.21.15.55:0/3401443796 shutdown_connections 2023-10-06T11:17:25.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.845+0000 7f863598b700 1 -- 172.21.15.55:0/3401443796 wait complete. 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.846+0000 7f863598b700 1 Processor -- start 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.846+0000 7f863598b700 1 -- start start 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f863598b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8630067af0 0x7f86300b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f863598b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86300a7be0 0x7f863014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f863598b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f8630150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f863598b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8630150850 con 0x7f86300ae570 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f863598b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863015c960 con 0x7f8630067af0 2023-10-06T11:17:25.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f863598b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300cc420 con 0x7f86300a7be0 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f8630150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f8630150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38922/0 (socket says 172.21.15.55:38922) 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 -- 172.21.15.55:0/725018416 learned_addr learned my addr 172.21.15.55:0/725018416 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862effd700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8630067af0 0x7f86300b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862e7fc700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86300a7be0 0x7f863014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 -- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86300a7be0 msgr2=0x7f863014fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86300a7be0 0x7f863014fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 -- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8630067af0 msgr2=0x7f86300b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8630067af0 0x7f86300b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 -- 172.21.15.55:0/725018416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618009420 con 0x7f86300ae570 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862effd700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8630067af0 0x7f86300b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:25.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f862f7fe700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f8630150310 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8620009df0 tx=0x7f862000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.847+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862000cb50 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.848+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862000f040 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.848+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620014480 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.848+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300b2dc0 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.848+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300cc0b0 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.848+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8630064a90 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.849+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86200147f0 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.849+0000 7f8626ffd700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8610066f30 0x7f86100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.849+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f8620085c00 con 0x7f86300ae570 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f862effd700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8610066f30 0x7f86100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f8626ffd700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7f861006d990 0x7f861006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 --> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8610070490 con 0x7f861006d990 2023-10-06T11:17:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8620085ef0 con 0x7f86300ae570 2023-10-06T11:17:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f862e7fc700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7f861006d990 0x7f861006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f862effd700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8610066f30 0x7f86100693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f86280058d0 tx=0x7f8628009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.850+0000 7f862e7fc700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7f861006d990 0x7f861006fdc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.851+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== osd.4 v2:172.21.15.142:6808/90857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8610070490 con 0x7f861006d990 2023-10-06T11:17:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.865+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 --> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86300afb30 con 0x7f861006d990 2023-10-06T11:17:25.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.865+0000 7f8626ffd700 1 -- 172.21.15.55:0/725018416 <== osd.4 v2:172.21.15.142:6808/90857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86300afb30 con 0x7f861006d990 2023-10-06T11:17:25.867 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:25.867 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7f861006d990 msgr2=0x7f861006fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6808/90857,v1:172.21.15.142:6809/90857] conn(0x7f861006d990 0x7f861006fdc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8610066f30 msgr2=0x7f86100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8610066f30 0x7f86100693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f86280058d0 tx=0x7f8628009040 comp rx=0 tx=0).stop 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 msgr2=0x7f8630150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 --2- 172.21.15.55:0/725018416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86300ae570 0x7f8630150310 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8620009df0 tx=0x7f862000b040 comp rx=0 tx=0).stop 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f862f7fe700 1 -- 172.21.15.55:0/725018416 reap_dead start 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 shutdown_connections 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 >> 172.21.15.55:0/725018416 conn(0x7f86300cd1e0 msgr2=0x7f86300ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 shutdown_connections 2023-10-06T11:17:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.866+0000 7f863598b700 1 -- 172.21.15.55:0/725018416 wait complete. 2023-10-06T11:17:25.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T11:17:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.998+0000 7fb1e0059700 1 Processor -- start 2023-10-06T11:17:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.998+0000 7fb1e0059700 1 -- start start 2023-10-06T11:17:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1e0059700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1d8159560 0x7fb1d80aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1e0059700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d80b49a0 0x7fb1d80aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1e0059700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1d80b0760 0x7fb1d80b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1e0059700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80b0c60 con 0x7fb1d80b0760 2023-10-06T11:17:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1e0059700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80b0f40 con 0x7fb1d8159560 2023-10-06T11:17:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1e0059700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80b1220 con 0x7fb1d80b49a0 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1d80b0760 0x7fb1d80b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1d80b0760 0x7fb1d80b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38932/0 (socket says 172.21.15.55:38932) 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 -- 172.21.15.55:0/1208236945 learned_addr learned my addr 172.21.15.55:0/1208236945 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1dddf5700 1 --2- 172.21.15.55:0/1208236945 >> v2:172.21.15.142:3300/0 conn(0x7fb1d8159560 0x7fb1d80aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1dd5f4700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d80b49a0 0x7fb1d80aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 -- 172.21.15.55:0/1208236945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d80b49a0 msgr2=0x7fb1d80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d80b49a0 0x7fb1d80aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 -- 172.21.15.55:0/1208236945 >> v2:172.21.15.142:3300/0 conn(0x7fb1d8159560 msgr2=0x7fb1d80aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 --2- 172.21.15.55:0/1208236945 >> v2:172.21.15.142:3300/0 conn(0x7fb1d8159560 0x7fb1d80aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 -- 172.21.15.55:0/1208236945 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80b1500 con 0x7fb1d80b0760 2023-10-06T11:17:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1dd5f4700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d80b49a0 0x7fb1d80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1de5f6700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d80b3890 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8088c80 tx=0x7fb1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c849a47795e0ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:25.999+0000 7fb1dcdf3700 1 -- 172.21.15.55:0/1208236945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000b860 con 0x7fb1d80b0760 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1dcdf3700 1 -- 172.21.15.55:0/1208236945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d000b9c0 con 0x7fb1d80b0760 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1dcdf3700 1 -- 172.21.15.55:0/1208236945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000bd60 con 0x7fb1d80b0760 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 -- 172.21.15.55:0/1208236945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 msgr2=0x7fb1d80b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d80b3890 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8088c80 tx=0x7fb1d0009250 comp rx=0 tx=0).stop 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 -- 172.21.15.55:0/1208236945 shutdown_connections 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d80b3890 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 --2- 172.21.15.55:0/1208236945 >> v2:172.21.15.142:3300/0 conn(0x7fb1d8159560 0x7fb1d80aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 --2- 172.21.15.55:0/1208236945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d80b49a0 0x7fb1d80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 -- 172.21.15.55:0/1208236945 >> 172.21.15.55:0/1208236945 conn(0x7fb1d80997f0 msgr2=0x7fb1d806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 -- 172.21.15.55:0/1208236945 shutdown_connections 2023-10-06T11:17:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.000+0000 7fb1e0059700 1 -- 172.21.15.55:0/1208236945 wait complete. 2023-10-06T11:17:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.001+0000 7fb1e0059700 1 Processor -- start 2023-10-06T11:17:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.001+0000 7fb1e0059700 1 -- start start 2023-10-06T11:17:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1e0059700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d8167680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1e0059700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d80b49a0 0x7fb1d8170f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1e0059700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d8159560 0x7fb1d8171470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1e0059700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8171e30 con 0x7fb1d80b0760 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1e0059700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815e950 con 0x7fb1d80b49a0 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1e0059700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815ec30 con 0x7fb1d8159560 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d8167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d8167680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38936/0 (socket says 172.21.15.55:38936) 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 -- 172.21.15.55:0/2822265417 learned_addr learned my addr 172.21.15.55:0/2822265417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dd5f4700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d80b49a0 0x7fb1d8170f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 -- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d8159560 msgr2=0x7fb1d8171470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d8159560 0x7fb1d8171470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 -- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d80b49a0 msgr2=0x7fb1d8170f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d80b49a0 0x7fb1d8170f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dddf5700 1 -- 172.21.15.55:0/2822265417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00094f0 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.002+0000 7fb1dd5f4700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d80b49a0 0x7fb1d8170f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.003+0000 7fb1dddf5700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d8167680 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800e0e0 tx=0x7fb1c80098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.003+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800ed80 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.003+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8014420 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.003+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80147e0 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.003+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d816eb00 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.003+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d816f0c0 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.004+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d816f430 con 0x7fb1d80b0760 2023-10-06T11:17:26.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.004+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1c8014b50 con 0x7fb1d80b0760 2023-10-06T11:17:26.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.005+0000 7fb1d5ffb700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb1c4066f30 0x7fb1c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.005+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fb1c8084d70 con 0x7fb1d80b0760 2023-10-06T11:17:26.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.005+0000 7fb1dd5f4700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb1c4066f30 0x7fb1c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.005+0000 7fb1dd5f4700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb1c4066f30 0x7fb1c40693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8159150 tx=0x7fb1cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.009+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1c8051f90 con 0x7fb1d80b0760 2023-10-06T11:17:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.202+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d8064a90 con 0x7fb1c4066f30 2023-10-06T11:17:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.203+0000 7fb1d5ffb700 1 -- 172.21.15.55:0/2822265417 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1d8064a90 con 0x7fb1c4066f30 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb1c4066f30 msgr2=0x7fb1c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb1c4066f30 0x7fb1c40693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8159150 tx=0x7fb1cc008040 comp rx=0 tx=0).stop 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 msgr2=0x7fb1d8167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d8167680 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800e0e0 tx=0x7fb1c80098d0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 shutdown_connections 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fb1c4066f30 0x7fb1c40693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1d80b0760 0x7fb1d8167680 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1d8159560 0x7fb1d8171470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 --2- 172.21.15.55:0/2822265417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d80b49a0 0x7fb1d8170f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 >> 172.21.15.55:0/2822265417 conn(0x7fb1d80997f0 msgr2=0x7fb1d80b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 shutdown_connections 2023-10-06T11:17:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.205+0000 7fb1e0059700 1 -- 172.21.15.55:0/2822265417 wait complete. 2023-10-06T11:17:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T11:17:26.219 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T11:17:26.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:26.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.342+0000 7fbe96453700 1 Processor -- start 2023-10-06T11:17:26.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.342+0000 7fbe96453700 1 -- start start 2023-10-06T11:17:26.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe96453700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe90067770 0x7fbe90067b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe96453700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe9015a860 0x7fbe900cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe96453700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900cce90 con 0x7fbe900cc630 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe96453700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9015a3d0 con 0x7fbe90067770 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe96453700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900ccbb0 con 0x7fbe9015a860 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe9015a860 0x7fbe900cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe8ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe90067770 0x7fbe90067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe949f0700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbe900cc630 0x7fbe90158fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:57102/0 (socket says 172.21.15.55:57102) 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.343+0000 7fbe949f0700 1 -- 172.21.15.55:0/2882509821 learned_addr learned my addr 172.21.15.55:0/2882509821 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8ffff700 1 -- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe9015a860 msgr2=0x7fbe900cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8ffff700 1 --2- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe9015a860 0x7fbe900cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8ffff700 1 -- 172.21.15.55:0/2882509821 >> v1:172.21.15.142:6789/0 conn(0x7fbe900cc630 legacy=0x7fbe90158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8ffff700 1 -- 172.21.15.55:0/2882509821 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90159d80 con 0x7fbe90067770 2023-10-06T11:17:26.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8effd700 1 -- 172.21.15.55:0/2882509821 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044662401 0 0) 0x7fbe900cce90 con 0x7fbe900cc630 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8f7fe700 1 --2- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe9015a860 0x7fbe900cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8ffff700 1 --2- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe90067770 0x7fbe90067b40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe800098e0 tx=0x7fbe800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80cab4c0f542189 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8effd700 1 -- 172.21.15.55:0/2882509821 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000b640 con 0x7fbe90067770 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8effd700 1 -- 172.21.15.55:0/2882509821 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8000b7a0 con 0x7fbe90067770 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.344+0000 7fbe8effd700 1 -- 172.21.15.55:0/2882509821 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000bb40 con 0x7fbe90067770 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 -- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe90067770 msgr2=0x7fbe90067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 --2- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe90067770 0x7fbe90067b40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe800098e0 tx=0x7fbe800091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 -- 172.21.15.55:0/2882509821 shutdown_connections 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 --2- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe90067770 0x7fbe90067b40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 --2- 172.21.15.55:0/2882509821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe9015a860 0x7fbe900cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 -- 172.21.15.55:0/2882509821 >> 172.21.15.55:0/2882509821 conn(0x7fbe900cdbc0 msgr2=0x7fbe900c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 -- 172.21.15.55:0/2882509821 shutdown_connections 2023-10-06T11:17:26.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.345+0000 7fbe96453700 1 -- 172.21.15.55:0/2882509821 wait complete. 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.346+0000 7fbe96453700 1 Processor -- start 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.346+0000 7fbe96453700 1 -- start start 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe90067770 0x7fbe90154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe900cc630 0x7fbe900b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9015a860 0x7fbe901477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90156490 con 0x7fbe9015a860 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90155880 con 0x7fbe900cc630 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90155b60 con 0x7fbe90067770 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9015a860 0x7fbe901477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9015a860 0x7fbe901477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38938/0 (socket says 172.21.15.55:38938) 2023-10-06T11:17:26.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 -- 172.21.15.55:0/1536296953 learned_addr learned my addr 172.21.15.55:0/1536296953 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe8f7fe700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe900cc630 0x7fbe900b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe8ffff700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe90067770 0x7fbe90154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 -- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe90067770 msgr2=0x7fbe90154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe90067770 0x7fbe90154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 -- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe900cc630 msgr2=0x7fbe900b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe900cc630 0x7fbe900b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 -- 172.21.15.55:0/1536296953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe84009420 con 0x7fbe9015a860 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe8f7fe700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe900cc630 0x7fbe900b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:26.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe949f0700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9015a860 0x7fbe901477b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800cc90 tx=0x7fbe88001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cea0 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800ab70 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe80009420 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880070f0 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.347+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe90156120 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.348+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe90064a90 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe880074a0 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe77fff700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fbe88084a80 con 0x7fbe9015a860 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe77fff700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7fbe7c06d990 0x7fbe7c06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 --> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe7c070490 con 0x7fbe7c06d990 2023-10-06T11:17:26.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe88086ea0 con 0x7fbe9015a860 2023-10-06T11:17:26.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.349+0000 7fbe8ffff700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.350+0000 7fbe8f7fe700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7fbe7c06d990 0x7fbe7c06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.350+0000 7fbe8ffff700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbe7c066f30 0x7fbe7c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe80003080 tx=0x7fbe80017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.350+0000 7fbe8f7fe700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7fbe7c06d990 0x7fbe7c06fdc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.351+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== osd.5 v2:172.21.15.142:6817/90883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbe7c070490 con 0x7fbe7c06d990 2023-10-06T11:17:26.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 --> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe9015a060 con 0x7fbe7c06d990 2023-10-06T11:17:26.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe77fff700 1 -- 172.21.15.55:0/1536296953 <== osd.5 v2:172.21.15.142:6817/90883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbe9015a060 con 0x7fbe7c06d990 2023-10-06T11:17:26.367 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:26.367 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:26.367 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7fbe7c06d990 msgr2=0x7fbe7c06fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6817/90883,v1:172.21.15.142:6819/90883] conn(0x7fbe7c06d990 0x7fbe7c06fdc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbe7c066f30 msgr2=0x7fbe7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7fbe7c066f30 0x7fbe7c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe80003080 tx=0x7fbe80017000 comp rx=0 tx=0).stop 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9015a860 msgr2=0x7fbe901477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe96453700 1 --2- 172.21.15.55:0/1536296953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9015a860 0x7fbe901477b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800cc90 tx=0x7fbe88001a80 comp rx=0 tx=0).stop 2023-10-06T11:17:26.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.365+0000 7fbe949f0700 1 -- 172.21.15.55:0/1536296953 reap_dead start 2023-10-06T11:17:26.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.366+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 shutdown_connections 2023-10-06T11:17:26.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.366+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 >> 172.21.15.55:0/1536296953 conn(0x7fbe900cdbc0 msgr2=0x7fbe900cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.366+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 shutdown_connections 2023-10-06T11:17:26.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.366+0000 7fbe96453700 1 -- 172.21.15.55:0/1536296953 wait complete. 2023-10-06T11:17:26.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T11:17:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.498+0000 7f8ca3d98700 1 Processor -- start 2023-10-06T11:17:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.498+0000 7f8ca3d98700 1 -- start start 2023-10-06T11:17:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca3d98700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c9c156500 0x7f8c9c0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca3d98700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 0x7f8c9c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca3d98700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0acd20 con 0x7f8c9c0c7570 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca3d98700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c06f430 con 0x7f8c9c156500 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca3d98700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c1568d0 con 0x7f8c9c06ed60 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca2335700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 0x7f8c9c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1b34700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c9c156500 0x7f8c9c0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1333700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8c9c0c7570 0x7f8c9c06e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.55:57112/0 (socket says 172.21.15.55:57112) 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca2335700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 0x7f8c9c0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.55:51734/0 (socket says 172.21.15.55:51734) 2023-10-06T11:17:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1333700 1 -- 172.21.15.55:0/3302876918 learned_addr learned my addr 172.21.15.55:0/3302876918 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 msgr2=0x7f8c9c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1b34700 1 --2- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 0x7f8c9c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3302876918 >> v1:172.21.15.142:6789/0 conn(0x7f8c9c0c7570 legacy=0x7f8c9c06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca0b32700 1 -- 172.21.15.55:0/3302876918 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088612306 0 0) 0x7f8c9c0acd20 con 0x7f8c9c0c7570 2023-10-06T11:17:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3302876918 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0c7b30 con 0x7f8c9c156500 2023-10-06T11:17:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.499+0000 7f8ca2335700 1 --2- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 0x7f8c9c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca1b34700 1 --2- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c156500 0x7f8c9c0c7030 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8c980098e0 tx=0x7f8c980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ce83dd792e2a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca0b32700 1 -- 172.21.15.55:0/3302876918 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800b640 con 0x7f8c9c156500 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca0b32700 1 -- 172.21.15.55:0/3302876918 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800b7a0 con 0x7f8c9c156500 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca0b32700 1 -- 172.21.15.55:0/3302876918 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800bb40 con 0x7f8c9c156500 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c156500 msgr2=0x7f8c9c0c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c156500 0x7f8c9c0c7030 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8c980098e0 tx=0x7f8c980091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3302876918 shutdown_connections 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c06ed60 0x7f8c9c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3302876918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c156500 0x7f8c9c0c7030 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.500+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3302876918 >> 172.21.15.55:0/3302876918 conn(0x7f8c9c068080 msgr2=0x7f8c9c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.501+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3302876918 shutdown_connections 2023-10-06T11:17:26.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.501+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3302876918 wait complete. 2023-10-06T11:17:26.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 Processor -- start 2023-10-06T11:17:26.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 -- start start 2023-10-06T11:17:26.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 0x7f8c9c0c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c0c7570 0x7f8c9c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c156500 0x7f8c9c0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0b17d0 con 0x7f8c9c06ed60 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0bff00 con 0x7f8c9c0c7570 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.502+0000 7f8ca3d98700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0c01e0 con 0x7f8c9c156500 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 0x7f8c9c0c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 0x7f8c9c0c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38948/0 (socket says 172.21.15.55:38948) 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3712278703 learned_addr learned my addr 172.21.15.55:0/3712278703 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1333700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c0c7570 0x7f8c9c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca2335700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c156500 0x7f8c9c0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c156500 msgr2=0x7f8c9c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c156500 0x7f8c9c0c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c0c7570 msgr2=0x7f8c9c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c0c7570 0x7f8c9c0b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 -- 172.21.15.55:0/3712278703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009a20 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1333700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c0c7570 0x7f8c9c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca1b34700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 0x7f8c9c0c0f80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8c980093f0 tx=0x7f8c98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800bb20 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98011420 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c98009420 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011820 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.503+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c0c07a0 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.504+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c0c0df0 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.505+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c98011c50 con 0x7f8c9c06ed60 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.505+0000 7f8c91ffb700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c80066f30 0x7f8c800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.505+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f8c98085f70 con 0x7f8c9c06ed60 2023-10-06T11:17:26.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.505+0000 7f8ca1333700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c80066f30 0x7f8c800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.506+0000 7f8ca1333700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c80066f30 0x7f8c800693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c007fd0 tx=0x7f8c8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.509+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c980530f0 con 0x7f8c9c06ed60 2023-10-06T11:17:26.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.705+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c9c064a90 con 0x7f8c80066f30 2023-10-06T11:17:26.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.705+0000 7f8c91ffb700 1 -- 172.21.15.55:0/3712278703 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8c9c064a90 con 0x7f8c80066f30 2023-10-06T11:17:26.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c80066f30 msgr2=0x7f8c800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c80066f30 0x7f8c800693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c007fd0 tx=0x7f8c8c009040 comp rx=0 tx=0).stop 2023-10-06T11:17:26.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 msgr2=0x7f8c9c0c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 0x7f8c9c0c0f80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8c980093f0 tx=0x7f8c98017000 comp rx=0 tx=0).stop 2023-10-06T11:17:26.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 shutdown_connections 2023-10-06T11:17:26.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f8c80066f30 0x7f8c800693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c9c06ed60 0x7f8c9c0c0f80 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c9c156500 0x7f8c9c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 --2- 172.21.15.55:0/3712278703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9c0c7570 0x7f8c9c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 >> 172.21.15.55:0/3712278703 conn(0x7f8c9c068080 msgr2=0x7f8c9c0ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 shutdown_connections 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.708+0000 7f8ca3d98700 1 -- 172.21.15.55:0/3712278703 wait complete. 2023-10-06T11:17:26.711 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T11:17:26.721 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T11:17:26.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:26.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.843+0000 7f554c4a2700 1 Processor -- start 2023-10-06T11:17:26.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.843+0000 7f554c4a2700 1 -- start start 2023-10-06T11:17:26.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554c4a2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5544159c50 0x7f554415d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554c4a2700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55440cc830 con 0x7f55440c41a0 2023-10-06T11:17:26.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554c4a2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554415e1d0 con 0x7f5544157230 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554c4a2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c4620 con 0x7f5544159c50 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554aa3f700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55440c41a0 0x7f55440ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34688/0 (socket says 172.21.15.55:34688) 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554aa3f700 1 -- 172.21.15.55:0/4041736585 learned_addr learned my addr 172.21.15.55:0/4041736585 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f5549a3d700 1 --2- 172.21.15.55:0/4041736585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5544159c50 0x7f554415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720251019 0 0) 0x7f55440cc830 con 0x7f55440c41a0 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f552c003570 con 0x7f55440c41a0 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484488201 0 0) 0x7f554415e1d0 con 0x7f5544157230 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55440cc830 con 0x7f5544157230 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f5549a3d700 1 -- 172.21.15.55:0/4041736585 >> v1:172.21.15.142:6789/0 conn(0x7f5544157230 legacy=0x7f55440c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f5549a3d700 1 -- 172.21.15.55:0/4041736585 >> v1:172.21.15.55:6789/0 conn(0x7f55440c41a0 legacy=0x7f55440ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f5549a3d700 1 -- 172.21.15.55:0/4041736585 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554415d930 con 0x7f5544159c50 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.844+0000 7f5549a3d700 1 --2- 172.21.15.55:0/4041736585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5544159c50 0x7f554415d250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5538009910 tx=0x7f55380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35be51dfeced9c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538011630 con 0x7f5544159c50 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538011790 con 0x7f5544159c50 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554923c700 1 -- 172.21.15.55:0/4041736585 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538011b30 con 0x7f5544159c50 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 -- 172.21.15.55:0/4041736585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5544159c50 msgr2=0x7f554415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 --2- 172.21.15.55:0/4041736585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5544159c50 0x7f554415d250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5538009910 tx=0x7f55380091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 -- 172.21.15.55:0/4041736585 shutdown_connections 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 --2- 172.21.15.55:0/4041736585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5544159c50 0x7f554415d250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 -- 172.21.15.55:0/4041736585 >> 172.21.15.55:0/4041736585 conn(0x7f5544087fc0 msgr2=0x7f5544067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 -- 172.21.15.55:0/4041736585 shutdown_connections 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.845+0000 7f554c4a2700 1 -- 172.21.15.55:0/4041736585 wait complete. 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.846+0000 7f554c4a2700 1 Processor -- start 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.846+0000 7f554c4a2700 1 -- start start 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554c4a2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55440c41a0 0x7f554414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554c4a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5544157230 0x7f554416daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554c4a2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5544159c50 0x7f554416dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554c4a2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c59c0 con 0x7f5544159c50 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554c4a2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554415b3f0 con 0x7f5544157230 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554c4a2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554415bc30 con 0x7f55440c41a0 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5544159c50 0x7f554416dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5544159c50 0x7f554416dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38956/0 (socket says 172.21.15.55:38956) 2023-10-06T11:17:26.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 -- 172.21.15.55:0/1103714283 learned_addr learned my addr 172.21.15.55:0/1103714283 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f5549a3d700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5544157230 0x7f554416daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554a23e700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55440c41a0 0x7f554414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 -- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55440c41a0 msgr2=0x7f554414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55440c41a0 0x7f554414b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 -- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5544157230 msgr2=0x7f554416daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5544157230 0x7f554416daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554aa3f700 1 -- 172.21.15.55:0/1103714283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538009420 con 0x7f5544159c50 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.847+0000 7f554a23e700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55440c41a0 0x7f554414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f554aa3f700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5544159c50 0x7f554416dfe0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c560 tx=0x7f553c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c005c00 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c005d80 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55440c5400 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c007320 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554415b5e0 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.848+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55440cbbd0 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.849+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f553c007690 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f55427fc700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5530066f30 0x7f55300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f553c084140 con 0x7f5544159c50 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f554a23e700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5530066f30 0x7f55300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f55427fc700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7f553006d990 0x7f553006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 --> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5530070490 con 0x7f553006d990 2023-10-06T11:17:26.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f553c084510 con 0x7f5544159c50 2023-10-06T11:17:26.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f5549a3d700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7f553006d990 0x7f553006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.850+0000 7f554a23e700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5530066f30 0x7f55300693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f553400e310 tx=0x7f5534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.851+0000 7f5549a3d700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7f553006d990 0x7f553006fdc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.851+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== osd.6 v2:172.21.15.142:6816/90888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5530070490 con 0x7f553006d990 2023-10-06T11:17:26.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.865+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 --> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5544064a90 con 0x7f553006d990 2023-10-06T11:17:26.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.865+0000 7f55427fc700 1 -- 172.21.15.55:0/1103714283 <== osd.6 v2:172.21.15.142:6816/90888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5544064a90 con 0x7f553006d990 2023-10-06T11:17:26.867 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:26.867 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:26.867 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:26.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7f553006d990 msgr2=0x7f553006fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6816/90888,v1:172.21.15.142:6818/90888] conn(0x7f553006d990 0x7f553006fdc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5530066f30 msgr2=0x7f55300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f5530066f30 0x7f55300693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f553400e310 tx=0x7f5534009040 comp rx=0 tx=0).stop 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5544159c50 msgr2=0x7f554416dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 --2- 172.21.15.55:0/1103714283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5544159c50 0x7f554416dfe0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c560 tx=0x7f553c007dd0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554aa3f700 1 -- 172.21.15.55:0/1103714283 reap_dead start 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 shutdown_connections 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 >> 172.21.15.55:0/1103714283 conn(0x7f5544087fc0 msgr2=0x7f55440c3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 shutdown_connections 2023-10-06T11:17:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.866+0000 7f554c4a2700 1 -- 172.21.15.55:0/1103714283 wait complete. 2023-10-06T11:17:26.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T11:17:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.997+0000 7f1194340700 1 Processor -- start 2023-10-06T11:17:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.997+0000 7f1194340700 1 -- start start 2023-10-06T11:17:27.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f1194340700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f118c15cab0 0x7f118c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f1194340700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0caa90 0x7f118c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f1194340700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c06ecd0 con 0x7f118c0675b0 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f1194340700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0cb870 con 0x7f118c15cab0 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f1194340700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0cbb50 con 0x7f118c0caa90 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f11920dc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f118c15cab0 0x7f118c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f11920dc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f118c15cab0 0x7f118c06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38968/0 (socket says 172.21.15.55:38968) 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.998+0000 7f11920dc700 1 -- 172.21.15.55:0/2442641849 learned_addr learned my addr 172.21.15.55:0/2442641849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11918db700 1 --2- 172.21.15.55:0/2442641849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0caa90 0x7f118c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11920dc700 1 -- 172.21.15.55:0/2442641849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0caa90 msgr2=0x7f118c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11920dc700 1 --2- 172.21.15.55:0/2442641849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0caa90 0x7f118c0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11920dc700 1 -- 172.21.15.55:0/2442641849 >> v1:172.21.15.142:6789/0 conn(0x7f118c0675b0 legacy=0x7f118c0679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11920dc700 1 -- 172.21.15.55:0/2442641849 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c06e680 con 0x7f118c15cab0 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11920dc700 1 --2- 172.21.15.55:0/2442641849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c06f160 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396c8432a1050df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11910da700 1 -- 172.21.15.55:0/2442641849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400e070 con 0x7f118c15cab0 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11910da700 1 -- 172.21.15.55:0/2442641849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400ba80 con 0x7f118c15cab0 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:26.999+0000 7f11910da700 1 -- 172.21.15.55:0/2442641849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840092e0 con 0x7f118c15cab0 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 -- 172.21.15.55:0/2442641849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 msgr2=0x7f118c06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 --2- 172.21.15.55:0/2442641849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c06f160 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184009840 comp rx=0 tx=0).stop 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 -- 172.21.15.55:0/2442641849 shutdown_connections 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 --2- 172.21.15.55:0/2442641849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c06f160 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 --2- 172.21.15.55:0/2442641849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0caa90 0x7f118c0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 -- 172.21.15.55:0/2442641849 >> 172.21.15.55:0/2442641849 conn(0x7f118c0cdeb0 msgr2=0x7f118c0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 -- 172.21.15.55:0/2442641849 shutdown_connections 2023-10-06T11:17:27.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.000+0000 7f1194340700 1 -- 172.21.15.55:0/2442641849 wait complete. 2023-10-06T11:17:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.001+0000 7f1194340700 1 Processor -- start 2023-10-06T11:17:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.001+0000 7f1194340700 1 -- start start 2023-10-06T11:17:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0675b0 0x7f118c0ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f118c0caa90 0x7f118c155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0ae9d0 con 0x7f118c15cab0 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0addc0 con 0x7f118c0caa90 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0ae0a0 con 0x7f118c0675b0 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c0aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38978/0 (socket says 172.21.15.55:38978) 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 -- 172.21.15.55:0/2263234608 learned_addr learned my addr 172.21.15.55:0/2263234608 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11918db700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f118c0caa90 0x7f118c155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11920dc700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0675b0 0x7f118c0ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 -- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0675b0 msgr2=0x7f118c0ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0675b0 0x7f118c0ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 -- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f118c0caa90 msgr2=0x7f118c155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f118c0caa90 0x7f118c155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 -- 172.21.15.55:0/2263234608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009ae0 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11918db700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f118c0caa90 0x7f118c155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f11928dd700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c0aee60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c560 tx=0x7f117c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011590 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c0116f0 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.002+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0ae380 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.003+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011ab0 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.003+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0af3a0 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.004+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c0aeb80 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.004+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f117c01b3b0 con 0x7f118c15cab0 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.004+0000 7f118a7fc700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.005+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f117c083aa0 con 0x7f118c15cab0 2023-10-06T11:17:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.005+0000 7f11920dc700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.005+0000 7f11920dc700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1178066f30 0x7f11780693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.009+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f118c0aeb80 con 0x7f118c15cab0 2023-10-06T11:17:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.203+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f118c064a90 con 0x7f1178066f30 2023-10-06T11:17:27.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.203+0000 7f118a7fc700 1 -- 172.21.15.55:0/2263234608 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f118c064a90 con 0x7f1178066f30 2023-10-06T11:17:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1178066f30 msgr2=0x7f11780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1178066f30 0x7f11780693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184018000 comp rx=0 tx=0).stop 2023-10-06T11:17:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 msgr2=0x7f118c0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c0aee60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c560 tx=0x7f117c007ef0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 shutdown_connections 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f118c15cab0 0x7f118c0aee60 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f118c0675b0 0x7f118c0ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 --2- 172.21.15.55:0/2263234608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f118c0caa90 0x7f118c155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 >> 172.21.15.55:0/2263234608 conn(0x7f118c0cdeb0 msgr2=0x7f118c0c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 shutdown_connections 2023-10-06T11:17:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.205+0000 7f1194340700 1 -- 172.21.15.55:0/2263234608 wait complete. 2023-10-06T11:17:27.209 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T11:17:27.221 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T11:17:27.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:17:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.343+0000 7f9f21f35700 1 Processor -- start 2023-10-06T11:17:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.343+0000 7f9f21f35700 1 -- start start 2023-10-06T11:17:27.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21f35700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21f35700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f1c0cc5e0 0x7f9f1c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21f35700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c1599f0 con 0x7f9f1c0c3580 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21f35700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c93b0 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21f35700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c87e0 con 0x7f9f1c0b05c0 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21734700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f1c0c3580 0x7f9f1c0c9840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34696/0 (socket says 172.21.15.55:34696) 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f21734700 1 -- 172.21.15.55:0/956617311 learned_addr learned my addr 172.21.15.55:0/956617311 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f1bfff700 1 --2- 172.21.15.55:0/956617311 >> v2:172.21.15.142:3300/0 conn(0x7f9f1c0cc5e0 0x7f9f1c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f20f33700 1 --2- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f1b7fe700 1 -- 172.21.15.55:0/956617311 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898596618 0 0) 0x7f9f1c1599f0 con 0x7f9f1c0c3580 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.344+0000 7f9f1b7fe700 1 -- 172.21.15.55:0/956617311 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f04003570 con 0x7f9f1c0c3580 2023-10-06T11:17:27.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1bfff700 1 -- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 msgr2=0x7f9f1c0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1bfff700 1 --2- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1bfff700 1 -- 172.21.15.55:0/956617311 >> v1:172.21.15.55:6789/0 conn(0x7f9f1c0c3580 legacy=0x7f9f1c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1bfff700 1 -- 172.21.15.55:0/956617311 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0c8a80 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1bfff700 1 --2- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c0cd430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098e0 tx=0x7f9f100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7832ce44be3eb27c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1b7fe700 1 -- 172.21.15.55:0/956617311 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10011630 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1b7fe700 1 -- 172.21.15.55:0/956617311 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10011790 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.345+0000 7f9f1b7fe700 1 -- 172.21.15.55:0/956617311 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10011b30 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 -- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0cc5e0 msgr2=0x7f9f1c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 --2- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c0cd430 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f100098e0 tx=0x7f9f100091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 -- 172.21.15.55:0/956617311 shutdown_connections 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 --2- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 --2- 172.21.15.55:0/956617311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c0cd430 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 -- 172.21.15.55:0/956617311 >> 172.21.15.55:0/956617311 conn(0x7f9f1c097340 msgr2=0x7f9f1c067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 -- 172.21.15.55:0/956617311 shutdown_connections 2023-10-06T11:17:27.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.346+0000 7f9f21f35700 1 -- 172.21.15.55:0/956617311 wait complete. 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.347+0000 7f9f21f35700 1 Processor -- start 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.347+0000 7f9f21f35700 1 -- start start 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0c3580 0x7f9f1c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c16a240 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c16a800 con 0x7f9f1c0c3580 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0b2b30 con 0x7f9f1c0b05c0 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c169030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38982/0 (socket says 172.21.15.55:38982) 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 -- 172.21.15.55:0/2678390540 learned_addr learned my addr 172.21.15.55:0/2678390540 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f1bfff700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0c3580 0x7f9f1c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f20f33700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 -- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 msgr2=0x7f9f1c0b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f1c0b05c0 0x7f9f1c0b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 -- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0c3580 msgr2=0x7f9f1c0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f1c0c3580 0x7f9f1c0b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 -- 172.21.15.55:0/2678390540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10009420 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21734700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c169030 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0010e0 tx=0x7f9f0c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c005c00 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c005d60 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0072e0 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c0b2e10 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.348+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c0b27d0 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.349+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f1c05f230 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.350+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f0c007690 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.350+0000 7f9f18ff9700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f08066f30 0x7f9f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.350+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f9f0c0839d0 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.350+0000 7f9f18ff9700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f9f0806d990 0x7f9f0806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.350+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 --> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f08070490 con 0x7f9f0806d990 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.350+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f0c088240 con 0x7f9f1c0cc5e0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.351+0000 7f9f20f33700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f08066f30 0x7f9f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.351+0000 7f9f1bfff700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f9f0806d990 0x7f9f0806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.351+0000 7f9f20f33700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f08066f30 0x7f9f080693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009fd0 tx=0x7f9f1400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.351+0000 7f9f1bfff700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f9f0806d990 0x7f9f0806fdc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.352+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== osd.7 v2:172.21.15.142:6800/90858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9f08070490 con 0x7f9f0806d990 2023-10-06T11:17:27.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.366+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 --> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f1c0c8d60 con 0x7f9f0806d990 2023-10-06T11:17:27.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.366+0000 7f9f18ff9700 1 -- 172.21.15.55:0/2678390540 <== osd.7 v2:172.21.15.142:6800/90858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9f1c0c8d60 con 0x7f9f0806d990 2023-10-06T11:17:27.368 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-10-06T11:17:27.369 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:17:27.369 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f9f0806d990 msgr2=0x7f9f0806fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6800/90858,v1:172.21.15.142:6801/90858] conn(0x7f9f0806d990 0x7f9f0806fdc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f08066f30 msgr2=0x7f9f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f9f08066f30 0x7f9f080693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009fd0 tx=0x7f9f1400b040 comp rx=0 tx=0).stop 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f1c0cc5e0 msgr2=0x7f9f1c169030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 --2- 172.21.15.55:0/2678390540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f1c0cc5e0 0x7f9f1c169030 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0010e0 tx=0x7f9f0c007dd0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21734700 1 -- 172.21.15.55:0/2678390540 reap_dead start 2023-10-06T11:17:27.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 shutdown_connections 2023-10-06T11:17:27.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 >> 172.21.15.55:0/2678390540 conn(0x7f9f1c097340 msgr2=0x7f9f1c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 shutdown_connections 2023-10-06T11:17:27.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.367+0000 7f9f21f35700 1 -- 172.21.15.55:0/2678390540 wait complete. 2023-10-06T11:17:27.380 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T11:17:27.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.499+0000 7f2e67b65700 1 Processor -- start 2023-10-06T11:17:27.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.499+0000 7f2e67b65700 1 -- start start 2023-10-06T11:17:27.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.499+0000 7f2e67b65700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e60159560 0x7f2e600aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e67b65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e600aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e67b65700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e600b0760 0x7f2e600b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e67b65700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600b0c60 con 0x7f2e600b0760 2023-10-06T11:17:27.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e67b65700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600b0f40 con 0x7f2e60159560 2023-10-06T11:17:27.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e67b65700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600b1220 con 0x7f2e600b49a0 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e600b0760 0x7f2e600b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e600b0760 0x7f2e600b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38996/0 (socket says 172.21.15.55:38996) 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 -- 172.21.15.55:0/3853792571 learned_addr learned my addr 172.21.15.55:0/3853792571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e65901700 1 --2- 172.21.15.55:0/3853792571 >> v2:172.21.15.142:3300/0 conn(0x7f2e60159560 0x7f2e600aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e65100700 1 --2- 172.21.15.55:0/3853792571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e600aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 -- 172.21.15.55:0/3853792571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 msgr2=0x7f2e600aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 --2- 172.21.15.55:0/3853792571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e600aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 -- 172.21.15.55:0/3853792571 >> v2:172.21.15.142:3300/0 conn(0x7f2e60159560 msgr2=0x7f2e600aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:27.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 --2- 172.21.15.55:0/3853792571 >> v2:172.21.15.142:3300/0 conn(0x7f2e60159560 0x7f2e600aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 -- 172.21.15.55:0/3853792571 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600b1500 con 0x7f2e600b0760 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e65901700 1 --2- 172.21.15.55:0/3853792571 >> v2:172.21.15.142:3300/0 conn(0x7f2e60159560 0x7f2e600aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e66102700 1 --2- 172.21.15.55:0/3853792571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e600b3890 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2e60088c80 tx=0x7f2e50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9524f94d0844dbc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e648ff700 1 -- 172.21.15.55:0/3853792571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5000e070 con 0x7f2e600b0760 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e648ff700 1 -- 172.21.15.55:0/3853792571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5000ba50 con 0x7f2e600b0760 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.500+0000 7f2e648ff700 1 -- 172.21.15.55:0/3853792571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500092e0 con 0x7f2e600b0760 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 -- 172.21.15.55:0/3853792571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 msgr2=0x7f2e600b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 --2- 172.21.15.55:0/3853792571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e600b3890 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2e60088c80 tx=0x7f2e50009840 comp rx=0 tx=0).stop 2023-10-06T11:17:27.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 -- 172.21.15.55:0/3853792571 shutdown_connections 2023-10-06T11:17:27.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 --2- 172.21.15.55:0/3853792571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e600b3890 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 --2- 172.21.15.55:0/3853792571 >> v2:172.21.15.142:3300/0 conn(0x7f2e60159560 0x7f2e600aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 --2- 172.21.15.55:0/3853792571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e600aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 -- 172.21.15.55:0/3853792571 >> 172.21.15.55:0/3853792571 conn(0x7f2e600997f0 msgr2=0x7f2e6006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 -- 172.21.15.55:0/3853792571 shutdown_connections 2023-10-06T11:17:27.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.501+0000 7f2e67b65700 1 -- 172.21.15.55:0/3853792571 wait complete. 2023-10-06T11:17:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.502+0000 7f2e67b65700 1 Processor -- start 2023-10-06T11:17:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.502+0000 7f2e67b65700 1 -- start start 2023-10-06T11:17:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e67b65700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e6015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e67b65700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e601566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e67b65700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e60159560 0x7f2e6009a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e67b65700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6009d1b0 con 0x7f2e600b0760 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e67b65700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6015e1b0 con 0x7f2e60159560 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e67b65700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6016a040 con 0x7f2e600b49a0 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e6015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e6015dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39004/0 (socket says 172.21.15.55:39004) 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 -- 172.21.15.55:0/2659525123 learned_addr learned my addr 172.21.15.55:0/2659525123 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e66102700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e60159560 0x7f2e6009a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65100700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e601566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 -- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 msgr2=0x7f2e601566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e601566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 -- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e60159560 msgr2=0x7f2e6009a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e60159560 0x7f2e6009a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 -- 172.21.15.55:0/2659525123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50009ae0 con 0x7f2e600b0760 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e66102700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e60159560 0x7f2e6009a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e65901700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e6015dc70 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800d890 tx=0x7f2e58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.503+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58005a00 con 0x7f2e600b0760 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.504+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58005b60 con 0x7f2e600b0760 2023-10-06T11:17:27.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.504+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6016a320 con 0x7f2e600b0760 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.504+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580125f0 con 0x7f2e600b0760 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.504+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60156c10 con 0x7f2e600b0760 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.505+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e60064a90 con 0x7f2e600b0760 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.505+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e580129a0 con 0x7f2e600b0760 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.505+0000 7f2e5dffb700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2e4c066f30 0x7f2e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.506+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f2e580847e0 con 0x7f2e600b0760 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.506+0000 7f2e65100700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2e4c066f30 0x7f2e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.506+0000 7f2e65100700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2e4c066f30 0x7f2e4c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2e600cc1b0 tx=0x7f2e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.510+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e58051a00 con 0x7f2e600b0760 2023-10-06T11:17:27.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.705+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e6009cfa0 con 0x7f2e4c066f30 2023-10-06T11:17:27.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.705+0000 7f2e5dffb700 1 -- 172.21.15.55:0/2659525123 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e5400f6e0 con 0x7f2e4c066f30 2023-10-06T11:17:27.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2e4c066f30 msgr2=0x7f2e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2e4c066f30 0x7f2e4c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2e600cc1b0 tx=0x7f2e54008040 comp rx=0 tx=0).stop 2023-10-06T11:17:27.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 msgr2=0x7f2e6015dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e6015dc70 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800d890 tx=0x7f2e58008040 comp rx=0 tx=0).stop 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 shutdown_connections 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f2e4c066f30 0x7f2e4c0693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e600b0760 0x7f2e6015dc70 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e60159560 0x7f2e6009a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 --2- 172.21.15.55:0/2659525123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e600b49a0 0x7f2e601566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 >> 172.21.15.55:0/2659525123 conn(0x7f2e600997f0 msgr2=0x7f2e600b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 shutdown_connections 2023-10-06T11:17:27.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.707+0000 7f2e67b65700 1 -- 172.21.15.55:0/2659525123 wait complete. 2023-10-06T11:17:27.713 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T11:17:27.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:27.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.839+0000 7f4b23060700 1 Processor -- start 2023-10-06T11:17:27.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.839+0000 7f4b23060700 1 -- start start 2023-10-06T11:17:27.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.839+0000 7f4b23060700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b1c0b0760 0x7f4b1c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.839+0000 7f4b23060700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0b0c60 con 0x7f4b1c0b49a0 2023-10-06T11:17:27.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.839+0000 7f4b23060700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0b0f40 con 0x7f4b1c159560 2023-10-06T11:17:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b23060700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0ab350 con 0x7f4b1c0b0760 2023-10-06T11:17:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b1bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4b1c0b49a0 0x7f4b1c0aac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34700/0 (socket says 172.21.15.55:34700) 2023-10-06T11:17:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b1bfff700 1 -- 172.21.15.55:0/3236029829 learned_addr learned my addr 172.21.15.55:0/3236029829 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b215fd700 1 --2- 172.21.15.55:0/3236029829 >> v2:172.21.15.142:3300/0 conn(0x7f4b1c0b0760 0x7f4b1c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/3236029829 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315414035 0 0) 0x7f4b1c0b0c60 con 0x7f4b1c0b49a0 2023-10-06T11:17:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/3236029829 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b08003570 con 0x7f4b1c0b49a0 2023-10-06T11:17:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b215fd700 1 -- 172.21.15.55:0/3236029829 >> v1:172.21.15.142:6789/0 conn(0x7f4b1c159560 legacy=0x7f4b1c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b215fd700 1 -- 172.21.15.55:0/3236029829 >> v1:172.21.15.55:6789/0 conn(0x7f4b1c0b49a0 legacy=0x7f4b1c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/3236029829 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 752844663 0 0) 0x7f4b08003570 con 0x7f4b1c0b49a0 2023-10-06T11:17:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b215fd700 1 -- 172.21.15.55:0/3236029829 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0b1220 con 0x7f4b1c0b0760 2023-10-06T11:17:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.840+0000 7f4b215fd700 1 --2- 172.21.15.55:0/3236029829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c0ccf90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009e90 tx=0x7f4b14009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3eb5266ad33aefe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/3236029829 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400e070 con 0x7f4b1c0b0760 2023-10-06T11:17:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/3236029829 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400b920 con 0x7f4b1c0b0760 2023-10-06T11:17:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b1b7fe700 1 -- 172.21.15.55:0/3236029829 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c001470 con 0x7f4b1c0b0760 2023-10-06T11:17:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 -- 172.21.15.55:0/3236029829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0b0760 msgr2=0x7f4b1c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 --2- 172.21.15.55:0/3236029829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c0ccf90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009e90 tx=0x7f4b14009780 comp rx=0 tx=0).stop 2023-10-06T11:17:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 -- 172.21.15.55:0/3236029829 shutdown_connections 2023-10-06T11:17:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 --2- 172.21.15.55:0/3236029829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c0ccf90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 -- 172.21.15.55:0/3236029829 >> 172.21.15.55:0/3236029829 conn(0x7f4b1c0997f0 msgr2=0x7f4b1c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 -- 172.21.15.55:0/3236029829 shutdown_connections 2023-10-06T11:17:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.841+0000 7f4b23060700 1 -- 172.21.15.55:0/3236029829 wait complete. 2023-10-06T11:17:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.842+0000 7f4b23060700 1 Processor -- start 2023-10-06T11:17:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.842+0000 7f4b23060700 1 -- start start 2023-10-06T11:17:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b23060700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c14d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b23060700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0b49a0 0x7f4b1c0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b23060700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c159560 0x7f4b1c09d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b23060700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c09cef0 con 0x7f4b1c0b0760 2023-10-06T11:17:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b23060700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c09c2e0 con 0x7f4b1c159560 2023-10-06T11:17:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b23060700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c09c5c0 con 0x7f4b1c0b49a0 2023-10-06T11:17:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b20dfc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c14d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b20dfc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c14d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39014/0 (socket says 172.21.15.55:39014) 2023-10-06T11:17:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b20dfc700 1 -- 172.21.15.55:0/2807764678 learned_addr learned my addr 172.21.15.55:0/2807764678 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0b49a0 0x7f4b1c0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.843+0000 7f4b215fd700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c159560 0x7f4b1c09d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b20dfc700 1 -- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0b49a0 msgr2=0x7f4b1c0ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b20dfc700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0b49a0 0x7f4b1c0ab490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b20dfc700 1 -- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c159560 msgr2=0x7f4b1c09d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b20dfc700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c159560 0x7f4b1c09d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b20dfc700 1 -- 172.21.15.55:0/2807764678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009a20 con 0x7f4b1c0b0760 2023-10-06T11:17:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0b49a0 0x7f4b1c0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b20dfc700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c14d810 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400c540 tx=0x7f4b04001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04011590 con 0x7f4b1c0b0760 2023-10-06T11:17:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040116f0 con 0x7f4b1c0b0760 2023-10-06T11:17:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c09c8a0 con 0x7f4b1c0b0760 2023-10-06T11:17:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04011ab0 con 0x7f4b1c0b0760 2023-10-06T11:17:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.844+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c14dd50 con 0x7f4b1c0b0760 2023-10-06T11:17:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.845+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c064a90 con 0x7f4b1c0b0760 2023-10-06T11:17:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.845+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b0401b3b0 con 0x7f4b1c0b0760 2023-10-06T11:17:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.846+0000 7f4b18ff9700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f30 0x7f4afc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.846+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f4b04083990 con 0x7f4b1c0b0760 2023-10-06T11:17:27.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.846+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f30 0x7f4afc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.846+0000 7f4b1bfff700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f30 0x7f4afc0693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c16cb70 tx=0x7f4b0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:27.850+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b04050c60 con 0x7f4b1c0b0760 2023-10-06T11:17:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.040+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b1c09d030 con 0x7f4afc066f30 2023-10-06T11:17:28.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.044+0000 7f4b18ff9700 1 -- 172.21.15.55:0/2807764678 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72821 (secure 0 0 0) 0x7f4b0c007df0 con 0x7f4afc066f30 2023-10-06T11:17:28.046 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f30 msgr2=0x7f4afc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f30 0x7f4afc0693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c16cb70 tx=0x7f4b0c009040 comp rx=0 tx=0).stop 2023-10-06T11:17:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 msgr2=0x7f4b1c14d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c14d810 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400c540 tx=0x7f4b04001070 comp rx=0 tx=0).stop 2023-10-06T11:17:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 shutdown_connections 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f4afc066f30 0x7f4afc0693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b1c0b0760 0x7f4b1c14d810 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b1c159560 0x7f4b1c09d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 --2- 172.21.15.55:0/2807764678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b1c0b49a0 0x7f4b1c0ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 >> 172.21.15.55:0/2807764678 conn(0x7f4b1c0997f0 msgr2=0x7f4b1c0683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 shutdown_connections 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:28.046+0000 7f4b23060700 1 -- 172.21.15.55:0/2807764678 wait complete. 2023-10-06T11:17:28.051 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:17:28.059 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-10-06T11:17:26.900698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2390376,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584344,"statfs":{"total":773094113280,"available":770646368256,"internally_reserved":0,"allocated":12361728,"data_stored":6503280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.695240"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.968668+0000","last_change":"2023-10-06T11:13:07.053520+0000","last_active":"2023-10-06T11:17:18.968668+0000","last_peered":"2023-10-06T11:17:18.968668+0000","last_clean":"2023-10-06T11:17:18.968668+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:17:18.968668+0000","last_undegraded":"2023-10-06T11:17:18.968668+0000","last_fullsized":"2023-10-06T11:17:18.968668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:48.253755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.209349+0000","last_change":"2023-10-06T11:13:07.052818+0000","last_active":"2023-10-06T11:17:18.209349+0000","last_peered":"2023-10-06T11:17:18.209349+0000","last_clean":"2023-10-06T11:17:18.209349+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:17:18.209349+0000","last_undegraded":"2023-10-06T11:17:18.209349+0000","last_fullsized":"2023-10-06T11:17:18.209349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.966388+0000","last_change":"2023-10-06T11:13:07.436644+0000","last_active":"2023-10-06T11:17:18.966388+0000","last_peered":"2023-10-06T11:17:18.966388+0000","last_clean":"2023-10-06T11:17:18.966388+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:17:18.966388+0000","last_undegraded":"2023-10-06T11:17:18.966388+0000","last_fullsized":"2023-10-06T11:17:18.966388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:18.862236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.210104+0000","last_change":"2023-10-06T11:13:07.052261+0000","last_active":"2023-10-06T11:17:18.210104+0000","last_peered":"2023-10-06T11:17:18.210104+0000","last_clean":"2023-10-06T11:17:18.210104+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:17:18.210104+0000","last_undegraded":"2023-10-06T11:17:18.210104+0000","last_fullsized":"2023-10-06T11:17:18.210104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.966732+0000","last_change":"2023-10-06T11:13:02.091292+0000","last_active":"2023-10-06T11:17:18.966732+0000","last_peered":"2023-10-06T11:17:18.966732+0000","last_clean":"2023-10-06T11:17:18.966732+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:17:18.966732+0000","last_undegraded":"2023-10-06T11:17:18.966732+0000","last_fullsized":"2023-10-06T11:17:18.966732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:00.949456+0000","last_clean_scrub_stamp":"2023-10-06T11:13:00.949456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:48.958424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.966555+0000","last_change":"2023-10-06T11:13:07.060440+0000","last_active":"2023-10-06T11:17:18.966555+0000","last_peered":"2023-10-06T11:17:18.966555+0000","last_clean":"2023-10-06T11:17:18.966555+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:17:18.966555+0000","last_undegraded":"2023-10-06T11:17:18.966555+0000","last_fullsized":"2023-10-06T11:17:18.966555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:19:51.194245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.967287+0000","last_change":"2023-10-06T11:13:07.057466+0000","last_active":"2023-10-06T11:17:18.967287+0000","last_peered":"2023-10-06T11:17:18.967287+0000","last_clean":"2023-10-06T11:17:18.967287+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:17:18.967287+0000","last_undegraded":"2023-10-06T11:17:18.967287+0000","last_fullsized":"2023-10-06T11:17:18.967287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:19.989815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.967190+0000","last_change":"2023-10-06T11:13:07.060555+0000","last_active":"2023-10-06T11:17:18.967190+0000","last_peered":"2023-10-06T11:17:18.967190+0000","last_clean":"2023-10-06T11:17:18.967190+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:17:18.967190+0000","last_undegraded":"2023-10-06T11:17:18.967190+0000","last_fullsized":"2023-10-06T11:17:18.967190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:47.499337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.968398+0000","last_change":"2023-10-06T11:13:07.060975+0000","last_active":"2023-10-06T11:17:18.968398+0000","last_peered":"2023-10-06T11:17:18.968398+0000","last_clean":"2023-10-06T11:17:18.968398+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:17:18.968398+0000","last_undegraded":"2023-10-06T11:17:18.968398+0000","last_fullsized":"2023-10-06T11:17:18.968398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:06.036606+0000","last_clean_scrub_stamp":"2023-10-06T11:13:06.036606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:39.006343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299232,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072608,"statfs":{"total":96636764160,"available":96330350592,"internally_reserved":0,"allocated":1990656,"data_stored":1255686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":1.325,"15min":1.325},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":1.395,"15min":1.395},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66300000000000003,"5min":1.369,"15min":1.369},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.79900000000000004,"15min":1.038},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.443},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.872,"15min":0.872},"last":0.39400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.495},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60999999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.499}]},{"osd":3,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":1.056,"15min":1.056},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72699999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.436}]},{"osd":7,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83399999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.372,"15min":0.41899999999999998},"min":{"1min":0.20200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.50900000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38900000000000001,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57299999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.375},{"interface":"front","average":{"1min":0.379,"5min":0.432,"15min":0.48299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.5,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.254,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.298,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.746}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92400000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.319,"5min":1.508,"15min":1.508},"last":0.68500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299232,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072608,"statfs":{"total":96636764160,"available":96330350592,"internally_reserved":0,"allocated":1990656,"data_stored":1255686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.255,"5min":0.249,"15min":0.249},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.626,"15min":0.626},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.50800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.871,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92800000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.624,"15min":0.628},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.373},"min":{"1min":0.20499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.29099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.61399999999999999,"5min":1.056,"15min":1.056},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64400000000000002,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82299999999999995,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.68400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":2.335,"15min":2.335},"last":0.496},{"interface":"front","average":{"1min":0.62,"5min":0.64800000000000002,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85999999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.47399999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":1.161,"15min":1.161},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47999999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.503,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.307},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38500000000000001,"15min":0.40100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92600000000000005,"5min":0.997,"15min":0.997},"last":0.502},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.439}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.89200000000000002,"5min":1.115,"15min":1.115},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.52800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":1.163,"15min":1.163},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71999999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.996,"15min":0.996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.748,"5min":1.234,"15min":1.234},"last":0.622}]},{"osd":3,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":1.113,"15min":1.113},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.81999999999999995,"5min":1.014,"15min":1.014},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.80500000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":1.369,"15min":1.369},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.60699999999999998,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2389999999999999,"5min":5.2389999999999999,"15min":5.2389999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":1.355,"15min":1.355},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75900000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":1.512,"15min":1.512},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52800000000000002,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.503}]},{"osd":7,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.40699999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.48599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:28.064 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.064 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.064 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T11:13:00.949456+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T11:13:06.036606+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=13, tm_sec=6, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:17:28.065 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T11:17:39.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:39.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:48.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:48.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.198+0000 7ff2a359e700 1 Processor -- start 2023-10-06T11:17:48.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.198+0000 7ff2a359e700 1 -- start start 2023-10-06T11:17:48.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a4159440 0x7ff2a40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2a40b35d0 0x7ff2a40cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a359e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40cb7a0 con 0x7ff2a40cc170 2023-10-06T11:17:48.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a359e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40b0860 con 0x7ff2a40b35d0 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40cb150 con 0x7ff2a4159440 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a1d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2a40b35d0 0x7ff2a40cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a2d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff2a40cc170 0x7ff2a40b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58936/0 (socket says 172.21.15.55:58936) 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a2d9d700 1 -- 172.21.15.55:0/2533345453 learned_addr learned my addr 172.21.15.55:0/2533345453 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.199+0000 7ff2a259c700 1 --2- 172.21.15.55:0/2533345453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a4159440 0x7ff2a40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a1d9b700 1 -- 172.21.15.55:0/2533345453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a4159440 msgr2=0x7ff2a40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a1d9b700 1 --2- 172.21.15.55:0/2533345453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a4159440 0x7ff2a40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a1d9b700 1 -- 172.21.15.55:0/2533345453 >> v1:172.21.15.55:6789/0 conn(0x7ff2a40cc170 legacy=0x7ff2a40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a1d9b700 1 -- 172.21.15.55:0/2533345453 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40cb430 con 0x7ff2a40b35d0 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a159a700 1 -- 172.21.15.55:0/2533345453 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587872412 0 0) 0x7ff2a40cb7a0 con 0x7ff2a40cc170 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a1d9b700 1 --2- 172.21.15.55:0/2533345453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a40b35d0 0x7ff2a40cbc30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0098e0 tx=0x7ff28c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d88620653b1bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a159a700 1 -- 172.21.15.55:0/2533345453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00b640 con 0x7ff2a40b35d0 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a159a700 1 -- 172.21.15.55:0/2533345453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c00b7a0 con 0x7ff2a40b35d0 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a159a700 1 -- 172.21.15.55:0/2533345453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00bb40 con 0x7ff2a40b35d0 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a359e700 1 -- 172.21.15.55:0/2533345453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a40b35d0 msgr2=0x7ff2a40cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.200+0000 7ff2a359e700 1 --2- 172.21.15.55:0/2533345453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a40b35d0 0x7ff2a40cbc30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0098e0 tx=0x7ff28c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.201+0000 7ff2a359e700 1 -- 172.21.15.55:0/2533345453 shutdown_connections 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.201+0000 7ff2a359e700 1 --2- 172.21.15.55:0/2533345453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a4159440 0x7ff2a40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.201+0000 7ff2a359e700 1 --2- 172.21.15.55:0/2533345453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a40b35d0 0x7ff2a40cbc30 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.201+0000 7ff2a359e700 1 -- 172.21.15.55:0/2533345453 >> 172.21.15.55:0/2533345453 conn(0x7ff2a406ece0 msgr2=0x7ff2a406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.201+0000 7ff2a359e700 1 -- 172.21.15.55:0/2533345453 shutdown_connections 2023-10-06T11:17:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.201+0000 7ff2a359e700 1 -- 172.21.15.55:0/2533345453 wait complete. 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.202+0000 7ff2a359e700 1 Processor -- start 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.202+0000 7ff2a359e700 1 -- start start 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.202+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b35d0 0x7ff2a40cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a40cc170 0x7ff2a415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 0x7ff2a41549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415de20 con 0x7ff2a4159440 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4154ef0 con 0x7ff2a40cc170 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415ec20 con 0x7ff2a40b35d0 2023-10-06T11:17:48.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 0x7ff2a41549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 0x7ff2a41549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37152/0 (socket says 172.21.15.55:37152) 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 -- 172.21.15.55:0/4152651115 learned_addr learned my addr 172.21.15.55:0/4152651115 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a1d9b700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a40cc170 0x7ff2a415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a259c700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b35d0 0x7ff2a40cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 -- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b35d0 msgr2=0x7ff2a40cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b35d0 0x7ff2a40cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 -- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a40cc170 msgr2=0x7ff2a415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a40cc170 0x7ff2a415d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 -- 172.21.15.55:0/4152651115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c009420 con 0x7ff2a4159440 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a2d9d700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 0x7ff2a41549b0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c7e0 tx=0x7ff29c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c005c00 con 0x7ff2a4159440 2023-10-06T11:17:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c005d80 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a415e010 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c007320 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.203+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a415e5d0 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.204+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a405f230 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.205+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff29c01b3b0 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.205+0000 7ff29a7fc700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff284066f30 0x7ff2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.205+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7ff29c0839c0 con 0x7ff2a4159440 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.206+0000 7ff2a259c700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff284066f30 0x7ff2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.206+0000 7ff2a259c700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff284066f30 0x7ff2840693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff294009fd0 tx=0x7ff29400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.210+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff29c050be0 con 0x7ff2a4159440 2023-10-06T11:17:48.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.398+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 --> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2a415ed60 con 0x7ff284066f30 2023-10-06T11:17:48.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.401+0000 7ff29a7fc700 1 -- 172.21.15.55:0/4152651115 <== mgr.4100 v2:172.21.15.142:6832/90269 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72853 (secure 0 0 0) 0x7ff2a415ed60 con 0x7ff284066f30 2023-10-06T11:17:48.404 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff284066f30 msgr2=0x7ff2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff284066f30 0x7ff2840693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff294009fd0 tx=0x7ff29400b040 comp rx=0 tx=0).stop 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 msgr2=0x7ff2a41549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 0x7ff2a41549b0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c7e0 tx=0x7ff29c007d90 comp rx=0 tx=0).stop 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 shutdown_connections 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7ff284066f30 0x7ff2840693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2a4159440 0x7ff2a41549b0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b35d0 0x7ff2a40cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 --2- 172.21.15.55:0/4152651115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a40cc170 0x7ff2a415d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 >> 172.21.15.55:0/4152651115 conn(0x7ff2a406ece0 msgr2=0x7ff2a4155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 shutdown_connections 2023-10-06T11:17:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.404+0000 7ff2a359e700 1 -- 172.21.15.55:0/4152651115 wait complete. 2023-10-06T11:17:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-10-06T11:17:48.417 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2023-10-06T11:17:46.905326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2390376,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752584344,"statfs":{"total":773094113280,"available":770646368256,"internally_reserved":0,"allocated":12361728,"data_stored":6503280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002847"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:29.085008+0000","last_change":"2023-10-06T11:17:29.084965+0000","last_active":"2023-10-06T11:17:29.085008+0000","last_peered":"2023-10-06T11:17:29.085008+0000","last_clean":"2023-10-06T11:17:29.085008+0000","last_became_active":"2023-10-06T11:13:07.053240+0000","last_became_peered":"2023-10-06T11:13:07.053240+0000","last_unstale":"2023-10-06T11:17:29.085008+0000","last_undegraded":"2023-10-06T11:17:29.085008+0000","last_fullsized":"2023-10-06T11:17:29.085008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:29.084817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:29.084817+0000","last_clean_scrub_stamp":"2023-10-06T11:17:29.084817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:25.250693+0000","scrub_duration":0.0015811690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":100,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:33.758546+0000","last_change":"2023-10-06T11:17:33.758511+0000","last_active":"2023-10-06T11:17:33.758546+0000","last_peered":"2023-10-06T11:17:33.758546+0000","last_clean":"2023-10-06T11:17:33.758546+0000","last_became_active":"2023-10-06T11:13:07.052542+0000","last_became_peered":"2023-10-06T11:13:07.052542+0000","last_unstale":"2023-10-06T11:17:33.758546+0000","last_undegraded":"2023-10-06T11:17:33.758546+0000","last_fullsized":"2023-10-06T11:17:33.758546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:33.758415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:33.758415+0000","last_clean_scrub_stamp":"2023-10-06T11:17:33.758415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:55.500951+0000","scrub_duration":0.0020330140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:28.765473+0000","last_change":"2023-10-06T11:17:28.765445+0000","last_active":"2023-10-06T11:17:28.765473+0000","last_peered":"2023-10-06T11:17:28.765473+0000","last_clean":"2023-10-06T11:17:28.765473+0000","last_became_active":"2023-10-06T11:13:07.436352+0000","last_became_peered":"2023-10-06T11:13:07.436352+0000","last_unstale":"2023-10-06T11:17:28.765473+0000","last_undegraded":"2023-10-06T11:17:28.765473+0000","last_fullsized":"2023-10-06T11:17:28.765473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:28.765325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:28.765325+0000","last_clean_scrub_stamp":"2023-10-06T11:17:28.765325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:20.035304+0000","scrub_duration":0.0015472979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":100,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:27.649873+0000","last_change":"2023-10-06T11:17:27.649836+0000","last_active":"2023-10-06T11:17:27.649873+0000","last_peered":"2023-10-06T11:17:27.649873+0000","last_clean":"2023-10-06T11:17:27.649873+0000","last_became_active":"2023-10-06T11:13:07.051955+0000","last_became_peered":"2023-10-06T11:13:07.051955+0000","last_unstale":"2023-10-06T11:17:27.649873+0000","last_undegraded":"2023-10-06T11:17:27.649873+0000","last_fullsized":"2023-10-06T11:17:27.649873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:27.649692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:27.649692+0000","last_clean_scrub_stamp":"2023-10-06T11:17:27.649692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:54.059311+0000","scrub_duration":0.0018246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"112'119","reported_seq":247,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:31.210965+0000","last_change":"2023-10-06T11:17:31.210926+0000","last_active":"2023-10-06T11:17:31.210965+0000","last_peered":"2023-10-06T11:17:31.210965+0000","last_clean":"2023-10-06T11:17:31.210965+0000","last_became_active":"2023-10-06T11:13:02.090353+0000","last_became_peered":"2023-10-06T11:13:02.090353+0000","last_unstale":"2023-10-06T11:17:31.210965+0000","last_undegraded":"2023-10-06T11:17:31.210965+0000","last_fullsized":"2023-10-06T11:17:31.210965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'119","last_scrub_stamp":"2023-10-06T11:17:31.210787+0000","last_deep_scrub":"112'119","last_deep_scrub_stamp":"2023-10-06T11:17:31.210787+0000","last_clean_scrub_stamp":"2023-10-06T11:17:31.210787+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:16.645365+0000","scrub_duration":0.0059488379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:35.210848+0000","last_change":"2023-10-06T11:17:35.210821+0000","last_active":"2023-10-06T11:17:35.210848+0000","last_peered":"2023-10-06T11:17:35.210848+0000","last_clean":"2023-10-06T11:17:35.210848+0000","last_became_active":"2023-10-06T11:13:07.060120+0000","last_became_peered":"2023-10-06T11:13:07.060120+0000","last_unstale":"2023-10-06T11:17:35.210848+0000","last_undegraded":"2023-10-06T11:17:35.210848+0000","last_fullsized":"2023-10-06T11:17:35.210848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:35.210723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:35.210723+0000","last_clean_scrub_stamp":"2023-10-06T11:17:35.210723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:38:50.648359+0000","scrub_duration":0.0026318880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:36.173824+0000","last_change":"2023-10-06T11:17:36.173799+0000","last_active":"2023-10-06T11:17:36.173824+0000","last_peered":"2023-10-06T11:17:36.173824+0000","last_clean":"2023-10-06T11:17:36.173824+0000","last_became_active":"2023-10-06T11:13:07.057210+0000","last_became_peered":"2023-10-06T11:13:07.057210+0000","last_unstale":"2023-10-06T11:17:36.173824+0000","last_undegraded":"2023-10-06T11:17:36.173824+0000","last_fullsized":"2023-10-06T11:17:36.173824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:36.173707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:36.173707+0000","last_clean_scrub_stamp":"2023-10-06T11:17:36.173707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:41.233030+0000","scrub_duration":0.0022210939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:31.065423+0000","last_change":"2023-10-06T11:17:31.065379+0000","last_active":"2023-10-06T11:17:31.065423+0000","last_peered":"2023-10-06T11:17:31.065423+0000","last_clean":"2023-10-06T11:17:31.065423+0000","last_became_active":"2023-10-06T11:13:07.060232+0000","last_became_peered":"2023-10-06T11:13:07.060232+0000","last_unstale":"2023-10-06T11:17:31.065423+0000","last_undegraded":"2023-10-06T11:17:31.065423+0000","last_fullsized":"2023-10-06T11:17:31.065423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:31.065266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:31.065266+0000","last_clean_scrub_stamp":"2023-10-06T11:17:31.065266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:59.069995+0000","scrub_duration":0.0020084399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:17:31.624546+0000","last_change":"2023-10-06T11:17:31.624520+0000","last_active":"2023-10-06T11:17:31.624546+0000","last_peered":"2023-10-06T11:17:31.624546+0000","last_clean":"2023-10-06T11:17:31.624546+0000","last_became_active":"2023-10-06T11:13:07.060683+0000","last_became_peered":"2023-10-06T11:13:07.060683+0000","last_unstale":"2023-10-06T11:17:31.624546+0000","last_undegraded":"2023-10-06T11:17:31.624546+0000","last_fullsized":"2023-10-06T11:17:31.624546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:31.624419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:31.624419+0000","last_clean_scrub_stamp":"2023-10-06T11:17:31.624419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:49.204852+0000","scrub_duration":0.0015999720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299232,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072608,"statfs":{"total":96636764160,"available":96330350592,"internally_reserved":0,"allocated":1990656,"data_stored":1255686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71399999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.68799999999999994,"5min":1.325,"15min":1.325},"last":0.749}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58599999999999997,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73899999999999999,"5min":1.395,"15min":1.395},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66300000000000003,"5min":1.369,"15min":1.369},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.79900000000000004,"15min":1.038},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79400000000000004,"5min":8.6850000000000005,"15min":8.6850000000000005},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72099999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66500000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71899999999999997,"5min":0.872,"15min":0.872},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.58199999999999996,"15min":0.60599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70499999999999996,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.495},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60999999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.495},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.504},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65100000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75900000000000001,"5min":1.056,"15min":1.056},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72699999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83399999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.372,"15min":0.41899999999999998},"min":{"1min":0.20200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.50900000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.309},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38900000000000001,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57299999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.432,"15min":0.48299999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.48599999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.5,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.254,"5min":3.5150000000000001,"15min":3.5150000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":7.2400000000000002,"15min":7.2400000000000002},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79500000000000004,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.298,"5min":3.3809999999999998,"15min":3.3809999999999998},"last":0.747}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.76400000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92400000000000004,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.319,"5min":1.508,"15min":1.508},"last":0.70899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299232,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072608,"statfs":{"total":96636764160,"available":96330350592,"internally_reserved":0,"allocated":1990656,"data_stored":1255686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.255,"5min":0.249,"15min":0.249},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.626,"15min":0.626},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.50800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.871,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.48099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1}]},{"osd":7,"last update":"Fri Oct 6 11:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92800000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.624,"15min":0.628},"min":{"1min":0.45200000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.84599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.40100000000000002,"15min":0.373},"min":{"1min":0.20499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51600000000000001,"5min":7.1600000000000001,"15min":7.1600000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.222,"15min":0.222},"max":{"1min":0.61399999999999999,"5min":1.056,"15min":1.056},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.312,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65100000000000002,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64400000000000002,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82299999999999995,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.68400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94599999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92900000000000005,"5min":2.335,"15min":2.335},"last":0.747},{"interface":"front","average":{"1min":0.62,"5min":0.64800000000000002,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85999999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83999999999999997,"5min":1.161,"15min":1.161},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47999999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.629}]},{"osd":1,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.503,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38500000000000001,"15min":0.40100000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61699999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57799999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.49099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92600000000000005,"5min":0.997,"15min":0.997},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.626,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.875}]},{"osd":6,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.89200000000000002,"5min":1.115,"15min":1.115},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.52800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67700000000000005,"5min":1.163,"15min":1.163},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71999999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.64200000000000002,"5min":0.996,"15min":0.996},"last":0.5},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.47599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.748,"5min":1.234,"15min":1.234},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51000000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":1.113,"15min":1.113},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.81999999999999995,"5min":1.014,"15min":1.014},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60999999999999999,"15min":0.622},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.80500000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.435}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298652,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073188,"statfs":{"total":96636764160,"available":96330944512,"internally_reserved":0,"allocated":1396736,"data_stored":665318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.747}]},{"osd":1,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":1.369,"15min":1.369},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.60699999999999998,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2389999999999999,"5min":5.2389999999999999,"15min":5.2389999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68899999999999995,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.439,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68200000000000005,"5min":1.355,"15min":1.355},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.42899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75900000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":1.512,"15min":1.512},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52800000000000002,"15min":0.56999999999999995},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52300000000000002,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.40699999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60099999999999998,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:48.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T11:17:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.536+0000 7f146dc31700 1 Processor -- start 2023-10-06T11:17:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.536+0000 7f146dc31700 1 -- start start 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f146dc31700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680d09e0 0x7f1468164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f146dc31700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680b5ef0 con 0x7f1468159bd0 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f146dc31700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680b3600 con 0x7f14680cd940 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f146dc31700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14680b6380 con 0x7f14680d09e0 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f1466ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1468159bd0 0x7f14680d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58944/0 (socket says 172.21.15.55:58944) 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f1466ffd700 1 -- 172.21.15.55:0/3572715721 learned_addr learned my addr 172.21.15.55:0/3572715721 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.537+0000 7f1467fff700 1 --2- 172.21.15.55:0/3572715721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680d09e0 0x7f1468164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f14667fc700 1 -- 172.21.15.55:0/3572715721 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407802682 0 0) 0x7f14680b5ef0 con 0x7f1468159bd0 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f14667fc700 1 -- 172.21.15.55:0/3572715721 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1450003570 con 0x7f1468159bd0 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f1467fff700 1 -- 172.21.15.55:0/3572715721 >> v1:172.21.15.142:6789/0 conn(0x7f14680cd940 legacy=0x7f14680b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f14667fc700 1 -- 172.21.15.55:0/3572715721 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226547916 0 0) 0x7f14680b3600 con 0x7f14680cd940 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f1467fff700 1 -- 172.21.15.55:0/3572715721 >> v1:172.21.15.55:6789/0 conn(0x7f1468159bd0 legacy=0x7f14680d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f1467fff700 1 -- 172.21.15.55:0/3572715721 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680b52e0 con 0x7f14680d09e0 2023-10-06T11:17:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f1467fff700 1 --2- 172.21.15.55:0/3572715721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680d09e0 0x7f1468164210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1460009e90 tx=0x7f1460009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d22d404feb2b5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f14667fc700 1 -- 172.21.15.55:0/3572715721 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000e070 con 0x7f14680d09e0 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f14667fc700 1 -- 172.21.15.55:0/3572715721 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146000bc30 con 0x7f14680d09e0 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.538+0000 7f14667fc700 1 -- 172.21.15.55:0/3572715721 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460012430 con 0x7f14680d09e0 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 -- 172.21.15.55:0/3572715721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680d09e0 msgr2=0x7f1468164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 --2- 172.21.15.55:0/3572715721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680d09e0 0x7f1468164210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1460009e90 tx=0x7f1460009780 comp rx=0 tx=0).stop 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 -- 172.21.15.55:0/3572715721 shutdown_connections 2023-10-06T11:17:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 --2- 172.21.15.55:0/3572715721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680d09e0 0x7f1468164210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 -- 172.21.15.55:0/3572715721 >> 172.21.15.55:0/3572715721 conn(0x7f146806ece0 msgr2=0x7f146806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:48.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 -- 172.21.15.55:0/3572715721 shutdown_connections 2023-10-06T11:17:48.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.539+0000 7f146dc31700 1 -- 172.21.15.55:0/3572715721 wait complete. 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.540+0000 7f146dc31700 1 Processor -- start 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.540+0000 7f146dc31700 1 -- start start 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f146dc31700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680cd940 0x7f14681491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f146dc31700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680d09e0 0x7f146815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f146dc31700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 0x7f146815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f146dc31700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1468155200 con 0x7f1468159bd0 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f146dc31700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146815e570 con 0x7f14680d09e0 2023-10-06T11:17:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f146dc31700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14681554c0 con 0x7f14680cd940 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 0x7f146815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 0x7f146815d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37166/0 (socket says 172.21.15.55:37166) 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 -- 172.21.15.55:0/3076534183 learned_addr learned my addr 172.21.15.55:0/3076534183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f14677fe700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680cd940 0x7f14681491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1466ffd700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680d09e0 0x7f146815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 -- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680cd940 msgr2=0x7f14681491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680cd940 0x7f14681491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 -- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680d09e0 msgr2=0x7f146815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680d09e0 0x7f146815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 -- 172.21.15.55:0/3076534183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1460009a20 con 0x7f1468159bd0 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1466ffd700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680d09e0 0x7f146815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.541+0000 7f1467fff700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 0x7f146815d6a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f146000b6c0 tx=0x7f1460019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.542+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146001c610 con 0x7f1468159bd0 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.542+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146001c790 con 0x7f1468159bd0 2023-10-06T11:17:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.542+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14680d0060 con 0x7f1468159bd0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.542+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146001cb50 con 0x7f1468159bd0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.542+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146815dfb0 con 0x7f1468159bd0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.543+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1468064a90 con 0x7f1468159bd0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.543+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f146001b400 con 0x7f1468159bd0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.543+0000 7f144f7fe700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.544+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f14600866f0 con 0x7f1468159bd0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.544+0000 7f14677fe700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.544+0000 7f14677fe700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f14580011e0 tx=0x7f1458009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.548+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1460053910 con 0x7f1468159bd0 2023-10-06T11:17:48.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.739+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1468155600 con 0x7f1468159bd0 2023-10-06T11:17:48.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.743+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1460053910 con 0x7f1468159bd0 2023-10-06T11:17:48.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.743+0000 7f144f7fe700 1 -- 172.21.15.55:0/3076534183 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1460056f30 con 0x7f1468159bd0 2023-10-06T11:17:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1454066f30 msgr2=0x7f14540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f14580011e0 tx=0x7f1458009040 comp rx=0 tx=0).stop 2023-10-06T11:17:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 msgr2=0x7f146815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 0x7f146815d6a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f146000b6c0 tx=0x7f1460019000 comp rx=0 tx=0).stop 2023-10-06T11:17:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 shutdown_connections 2023-10-06T11:17:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1468159bd0 0x7f146815d6a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14680cd940 0x7f14681491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 --2- 172.21.15.55:0/3076534183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14680d09e0 0x7f146815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 >> 172.21.15.55:0/3076534183 conn(0x7f146806ece0 msgr2=0x7f1468063410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 shutdown_connections 2023-10-06T11:17:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.746+0000 7f146dc31700 1 -- 172.21.15.55:0/3076534183 wait complete. 2023-10-06T11:17:48.760 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:17:48.760 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:48.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.878+0000 7f72b63d0700 1 Processor -- start 2023-10-06T11:17:48.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.878+0000 7f72b63d0700 1 -- start start 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b63d0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72b00adb60 0x7f72b00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b63d0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72b00ce6d0 0x7f72b015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b63d0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b0157de0 con 0x7f72b00ca370 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b63d0700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00cbb90 con 0x7f72b00ce6d0 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b63d0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00ceb10 con 0x7f72b00adb60 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72affff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f72b00ca370 0x7f72b0158270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58950/0 (socket says 172.21.15.55:58950) 2023-10-06T11:17:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72affff700 1 -- 172.21.15.55:0/685799314 learned_addr learned my addr 172.21.15.55:0/685799314 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b496d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72b00ce6d0 0x7f72b015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72af7fe700 1 --2- 172.21.15.55:0/685799314 >> v2:172.21.15.142:3300/0 conn(0x7f72b00adb60 0x7f72b00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72aeffd700 1 -- 172.21.15.55:0/685799314 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287461790 0 0) 0x7f72b0157de0 con 0x7f72b00ca370 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72aeffd700 1 -- 172.21.15.55:0/685799314 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7298003570 con 0x7f72b00ca370 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b496d700 1 -- 172.21.15.55:0/685799314 >> v2:172.21.15.142:3300/0 conn(0x7f72b00adb60 msgr2=0x7f72b00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b496d700 1 --2- 172.21.15.55:0/685799314 >> v2:172.21.15.142:3300/0 conn(0x7f72b00adb60 0x7f72b00ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b496d700 1 -- 172.21.15.55:0/685799314 >> v1:172.21.15.55:6789/0 conn(0x7f72b00ca370 legacy=0x7f72b0158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b496d700 1 -- 172.21.15.55:0/685799314 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00cb5d0 con 0x7f72b00ce6d0 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72b496d700 1 --2- 172.21.15.55:0/685799314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ce6d0 0x7f72b015aed0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f72b006c350 tx=0x7f72a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6401a6ff40f07189 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72aeffd700 1 -- 172.21.15.55:0/685799314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800e070 con 0x7f72b00ce6d0 2023-10-06T11:17:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72aeffd700 1 -- 172.21.15.55:0/685799314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f72a800bb60 con 0x7f72b00ce6d0 2023-10-06T11:17:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.879+0000 7f72aeffd700 1 -- 172.21.15.55:0/685799314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8012430 con 0x7f72b00ce6d0 2023-10-06T11:17:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 -- 172.21.15.55:0/685799314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ce6d0 msgr2=0x7f72b015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 --2- 172.21.15.55:0/685799314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ce6d0 0x7f72b015aed0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f72b006c350 tx=0x7f72a8009780 comp rx=0 tx=0).stop 2023-10-06T11:17:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 -- 172.21.15.55:0/685799314 shutdown_connections 2023-10-06T11:17:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 --2- 172.21.15.55:0/685799314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ce6d0 0x7f72b015aed0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 --2- 172.21.15.55:0/685799314 >> v2:172.21.15.142:3300/0 conn(0x7f72b00adb60 0x7f72b00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 -- 172.21.15.55:0/685799314 >> 172.21.15.55:0/685799314 conn(0x7f72b00707d0 msgr2=0x7f72b0070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 -- 172.21.15.55:0/685799314 shutdown_connections 2023-10-06T11:17:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.880+0000 7f72b63d0700 1 -- 172.21.15.55:0/685799314 wait complete. 2023-10-06T11:17:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.881+0000 7f72b63d0700 1 Processor -- start 2023-10-06T11:17:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.881+0000 7f72b63d0700 1 -- start start 2023-10-06T11:17:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b63d0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72b00adb60 0x7f72b00afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b63d0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 0x7f72b00b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b63d0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72b00ce6d0 0x7f72b0152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b63d0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b1220 con 0x7f72b00ca370 2023-10-06T11:17:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b63d0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b1500 con 0x7f72b00ce6d0 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b63d0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b17e0 con 0x7f72b00adb60 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72af7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 0x7f72b00b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72af7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 0x7f72b00b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37194/0 (socket says 172.21.15.55:37194) 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72af7fe700 1 -- 172.21.15.55:0/3019734705 learned_addr learned my addr 172.21.15.55:0/3019734705 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72b496d700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72b00ce6d0 0x7f72b0152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72affff700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72b00adb60 0x7f72b00afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.882+0000 7f72af7fe700 1 -- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72b00adb60 msgr2=0x7f72b00afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72af7fe700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72b00adb60 0x7f72b00afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72af7fe700 1 -- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72b00ce6d0 msgr2=0x7f72b0152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72af7fe700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72b00ce6d0 0x7f72b0152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72af7fe700 1 -- 172.21.15.55:0/3019734705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8009a20 con 0x7f72b00ca370 2023-10-06T11:17:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72af7fe700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 0x7f72b00b0410 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f72a4006b00 tx=0x7f72a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4009670 con 0x7f72b00ca370 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f72a40097f0 con 0x7f72b00ca370 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00b1ac0 con 0x7f72b00ca370 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4009bd0 con 0x7f72b00ca370 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.883+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b0152c90 con 0x7f72b00ca370 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.884+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b00b1fe0 con 0x7f72b00ca370 2023-10-06T11:17:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.884+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72a401e460 con 0x7f72b00ca370 2023-10-06T11:17:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.885+0000 7f7297fff700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f729c066f30 0x7f729c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.885+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f72a4084c60 con 0x7f72b00ca370 2023-10-06T11:17:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.885+0000 7f72affff700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f729c066f30 0x7f729c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.885+0000 7f72affff700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f729c066f30 0x7f729c0693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f72a00058d0 tx=0x7f72a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:48.889+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72b00b1fe0 con 0x7f72b00ca370 2023-10-06T11:17:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.126+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72b00b1fe0 con 0x7f72b00ca370 2023-10-06T11:17:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.126+0000 7f7297fff700 1 -- 172.21.15.55:0/3019734705 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f72b00b1fe0 con 0x7f72b00ca370 2023-10-06T11:17:49.128 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-10-06T11:17:49.129 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5906,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/470097968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":470097968},{"type":"v1","addr":"172.21.15.142:6835","nonce":470097968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/1769399288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":1769399288},{"type":"v1","addr":"172.21.15.142:6837","nonce":1769399288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2499980268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2499980268},{"type":"v1","addr":"172.21.15.55:6833","nonce":2499980268}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3639412051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3639412051},{"type":"v1","addr":"172.21.15.55:6835","nonce":3639412051}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-10-06T11:17:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f729c066f30 msgr2=0x7f729c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f729c066f30 0x7f729c0693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f72a00058d0 tx=0x7f72a0009040 comp rx=0 tx=0).stop 2023-10-06T11:17:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 msgr2=0x7f72b00b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 0x7f72b00b0410 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f72a4006b00 tx=0x7f72a4008040 comp rx=0 tx=0).stop 2023-10-06T11:17:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 shutdown_connections 2023-10-06T11:17:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:6832/90269,v1:172.21.15.142:6833/90269] conn(0x7f729c066f30 0x7f729c0693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72b00ce6d0 0x7f72b0152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72b00adb60 0x7f72b00afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 --2- 172.21.15.55:0/3019734705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72b00ca370 0x7f72b00b0410 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 >> 172.21.15.55:0/3019734705 conn(0x7f72b00707d0 msgr2=0x7f72b0154550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 shutdown_connections 2023-10-06T11:17:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-10-06T11:17:49.128+0000 7f72b63d0700 1 -- 172.21.15.55:0/3019734705 wait complete. 2023-10-06T11:17:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 71 2023-10-06T11:17:49.143 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T11:17:49.143 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T11:17:49.143 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:17:49.143 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.152 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:17:49.152 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:17:49.152 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.201 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:17:49.202 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:17:49.202 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.213 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:17:49.213 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:17:49.213 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.264 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:17:49.264 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T11:17:49.264 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T11:17:49.265 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.298 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T11:17:49.299 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T11:17:49.299 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.370 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T11:17:49.370 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T11:17:49.370 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.441 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T11:17:49.442 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T11:17:49.442 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.507 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T11:17:49.507 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T11:17:49.507 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.546 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T11:17:49.546 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T11:17:49.546 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.625 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T11:17:49.625 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T11:17:49.626 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.691 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T11:17:49.692 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T11:17:49.692 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.761 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T11:17:49.761 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T11:17:49.761 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T11:17:49.761 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.784 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T11:17:49.784 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T11:17:49.784 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.827 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T11:17:49.827 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T11:17:49.827 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T11:17:49.827 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.838 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T11:17:49.839 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T11:17:49.839 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.878 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T11:17:49.878 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T11:17:49.878 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:49.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T11:17:49.929 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T11:17:49.929 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T11:17:49.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T11:17:49.962 INFO:teuthology.orchestra.run.smithi055.stdout:1696590787.0459132 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T11:17:49.962 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T11:17:49.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T11:17:50.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T11:17:50.101 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-06T11:17:50.169 INFO:teuthology.orchestra.run.smithi055.stdout:1696590787.0459132 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T11:17:50.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:17:50.171 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T11:17:50.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:17:50.437 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T11:17:50.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:17:50.581 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T11:17:50.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:17:50.652 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T11:17:50.726 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:17:50.726 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T11:17:50.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:17:50.920 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T11:17:50.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:17:50.979 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T11:17:51.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:17:51.044 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T11:17:51.137 INFO:tasks.ceph:Archiving mon data... 2023-10-06T11:17:51.138 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/data/mon.a.tgz 2023-10-06T11:17:51.139 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-10-06T11:17:51.154 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.QDeUEGKzWE 2023-10-06T11:17:51.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QDeUEGKzWE 2023-10-06T11:17:51.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.QDeUEGKzWE 2023-10-06T11:17:51.419 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.QDeUEGKzWE is 507KB 2023-10-06T11:17:51.518 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.QDeUEGKzWE 2023-10-06T11:17:51.532 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/data/mon.b.tgz 2023-10-06T11:17:51.533 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-10-06T11:17:51.548 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.m8eagyqf52 2023-10-06T11:17:51.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.m8eagyqf52 2023-10-06T11:17:51.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.m8eagyqf52 2023-10-06T11:17:51.836 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.m8eagyqf52 is 647KB 2023-10-06T11:17:51.908 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.m8eagyqf52 2023-10-06T11:17:51.922 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/data/mon.c.tgz 2023-10-06T11:17:51.922 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-10-06T11:17:51.976 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Bq9pqYu4sG 2023-10-06T11:17:51.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Bq9pqYu4sG 2023-10-06T11:17:52.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.Bq9pqYu4sG 2023-10-06T11:17:52.251 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.Bq9pqYu4sG is 647KB 2023-10-06T11:17:52.353 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.Bq9pqYu4sG 2023-10-06T11:17:52.367 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T11:17:52.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T11:17:52.370 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T11:17:52.432 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T11:17:52.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T11:17:52.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T11:17:52.461 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T11:17:52.497 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T11:17:52.503 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T11:17:52.504 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/remote/smithi055/crash 2023-10-06T11:17:52.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T11:17:52.534 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/remote/smithi142/crash 2023-10-06T11:17:52.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T11:17:52.567 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T11:17:52.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:52.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:52.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:52.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:52.772 INFO:tasks.ceph:Compressing logs... 2023-10-06T11:17:52.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:17:52.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:17:54.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-06T11:17:54.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-06T11:17:54.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T11:17:54.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-06T11:17:54.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T11:17:54.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T11:17:54.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T11:17:54.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T11:17:57.943 INFO:tasks.ceph:Archiving logs... 2023-10-06T11:17:57.943 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/remote/smithi055/log 2023-10-06T11:17:57.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T11:17:58.959 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/remote/smithi142/log 2023-10-06T11:17:58.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T11:17:59.592 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T11:17:59.603 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T11:17:59.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T11:17:59.606 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T11:17:59.680 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T11:17:59.690 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T11:17:59.690 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:17:59.693 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:17:59.707 INFO:teuthology.orchestra.run.smithi055.stderr:bash: ntpq: command not found 2023-10-06T11:17:59.708 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:210 Number of sources = 4 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 19 -536us[ -536us] +/- 85ms 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -437us[ -437us] +/- 77ms 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv03.front.sepia.ceph.com 3 6 377 20 +916us[ +943us] +/- 69ms 2023-10-06T11:17:59.710 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:17:59.711 INFO:teuthology.orchestra.run.smithi055.stdout:210 Number of sources = 4 2023-10-06T11:17:59.711 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:17:59.711 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2023-10-06T11:17:59.711 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 21 -581us[ -575us] +/- 85ms 2023-10-06T11:17:59.711 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -475us[ -469us] +/- 77ms 2023-10-06T11:17:59.712 INFO:teuthology.orchestra.run.smithi055.stdout:^* hv03.front.sepia.ceph.com 3 6 377 18 +891us[ +897us] +/- 69ms 2023-10-06T11:17:59.712 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:17:59.712 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T11:17:59.728 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T11:17:59.728 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T11:17:59.774 DEBUG:teuthology.orchestra.run.smithi055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T11:17:59.887 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T11:17:59.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:18:00.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:00.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:18:00.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:00.043 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T11:18:00.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T11:18:00.082 INFO:teuthology.task.internal:Duration was 971.049004 seconds 2023-10-06T11:18:00.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T11:18:00.132 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T11:18:00.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T11:18:00.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T11:18:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:18:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:18:00.538 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T11:18:00.539 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2023-10-06T11:18:00.539 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T11:18:00.559 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-10-06T11:18:00.560 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T11:18:00.579 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T11:18:00.579 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:18:00.601 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:18:00.659 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T11:18:00.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T11:18:00.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T11:18:00.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T11:18:00.783 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T11:18:00.783 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T11:18:00.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T11:18:00.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T11:18:00.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:18:00.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:18:00.873 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2023-10-06T11:18:00.897 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-10-06T11:18:00.911 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:18:00.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:00.942 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:18:00.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:00.965 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T11:18:00.975 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T11:18:00.976 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/remote/smithi055 2023-10-06T11:18:00.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T11:18:01.021 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387/remote/smithi142 2023-10-06T11:18:01.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T11:18:01.058 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T11:18:01.058 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T11:18:01.061 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T11:18:01.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T11:18:01.118 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T11:18:01.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T11:18:01.150 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T11:18:01.150 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T11:18:01.152 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T11:18:01.165 INFO:teuthology.orchestra.run.smithi055.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 11:18 /home/ubuntu/cephtest 2023-10-06T11:18:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: 262172 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 11:18 /home/ubuntu/cephtest 2023-10-06T11:18:01.167 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T11:18:01.200 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T11:18:01.303 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T11:18:01.326 DEBUG:teuthology.nuke:shortname: smithi055 2023-10-06T11:18:01.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:18:01.349 DEBUG:teuthology.nuke:shortname: smithi142 2023-10-06T11:18:01.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:18:01.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:54:44.100216', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfA70rXdcP7VtZS4hWwOWKeSR3CWfg6XNN7t2mMWNTM6Al0tFQNb8UEn6A1a/Hgg3aoUoXiT6wdgqdUIOJzh+I='} 2023-10-06T11:18:01.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:54:44.102079', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd/W4zYwgaIpJR2tJL8Rjp1wbqFJOksMBCcJJPNtAaqHKAf7+VnrnlSq9Jc/Ap2UAqWfFpLspkzcb+LpQzfxd0='} 2023-10-06T11:18:01.403 INFO:teuthology.orchestra.console.smithi055:Power off 2023-10-06T11:18:01.404 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:18:01.429 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-10-06T11:18:01.430 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:01.445 INFO:teuthology.orchestra.console.smithi142:Power off 2023-10-06T11:18:01.445 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:18:01.454 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-10-06T11:18:01.468 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-10-06T11:18:01.468 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:01.491 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-10-06T11:18:05.456 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:05.492 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:05.566 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-10-06T11:18:05.602 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-10-06T11:18:09.570 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:09.603 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:09.681 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-10-06T11:18:09.714 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-10-06T11:18:13.685 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:13.715 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:18:13.795 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-10-06T11:18:13.829 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-10-06T11:18:13.897 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-10-06T11:18:13.930 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-10-06T11:18:14.035 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} duration: 971.0490038394928 failure_reason: '"1696590787.0459132 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T11:18:14.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:18:14.115 INFO:teuthology.run:FAIL